Remote control method and device and vehicle

Abstract

The embodiment of the invention provides a remote control method and device and a vehicle. The method comprises the steps that first motion data of a remote control device are collected through a first sensor, and position information of the remote control device is determined according to the first motion data and second motion data of a mobile device and comprises displacement information of the remote control device relative to a display device; or the remote control device displays the coordinate information of the cursor in the display device, the mobile device and the display device are relatively static, and then the position information is sent to the display device. The cursor corresponding to the remote control device is displayed by the display device, directional remote control of the mobile device is achieved, it is ensured that a user conveniently and accurately interacts with the mobile device, the motion data of the remote control device is calibrated based on the motion data of the mobile device, the influence of movement of the mobile device on the operation accuracy of the remote control device is avoided, and the user experience is improved. And the accuracy of interaction between the user and the mobile device is further improved.

Description

Remote control method and device and vehicle TECHNICAL FIELD

[0001] The present application relates to the technical field of vehicles, in particular to a remote control method, device and vehicle. BACKGROUND

[0002] At present, through the intelligent design of a vehicle, a user can interact with some devices deployed in the vehicle to control the vehicle. The interaction mode of the user and the vehicle can be realized through the touch operation of the user on a display device, but in some scenarios, it is difficult to realize the touch operation, for example, the rear passengers are difficult to perform the touch operation on the center control screen, in this case, if the user interacts with the devices in the vehicle through non-contact gesture control or voice control, the interaction often fails due to misrecognition, and similar problems also exist in other movable devices (such as ships, aircrafts, etc.). Therefore, for the movable devices, how to realize convenient and accurate interaction between man and machine is a problem to be solved at present.

[0003] SUMMARY

[0004] The present application provides a remote control method, device and vehicle, which realizes convenient and accurate interaction between man and machine for the movable devices.

[0005] In a first aspect, the present application provides a remote control method, the execution subject of the method can be a remote control device, which can be realized as an electronic device or a component in the electronic device, such as a chip, a chip system or other functional modules capable of calling and executing programs.

[0006] The method comprises: collecting, by the remote control device, first motion data of the remote control device through a first sensor, and determining position information of the remote control device based on the first motion data and second motion data of a mobile device, the position information comprising displacement information of the remote control device relative to a display device or coordinate information of a cursor presented by the remote control device in the display device, and then sending the position information of the remote control device to the display device to make the display device present a cursor corresponding to the remote control device, realizing the pointing type remote control of the mobile device, ensuring convenient and accurate interaction of the user with the mobile device, and determining the position information of the remote control device in combination with the second motion data and the first motion data, realizing the calibration of the motion data of the remote control device based on the motion data of the mobile device, avoiding the influence of the movement of the mobile device on the operation accuracy of the remote control device, and further improving the accuracy of the interaction between the user and the mobile device.

[0007] Optionally, the first motion data can be raw data collected by the first sensor or determined based on the raw data collected by the first sensor.

[0008] Optionally, the second motion data can be raw data collected by the second sensor, or determined based on the raw data collected by the second sensor.

[0009] Optionally, the remote control device can perform a pointing control on the mobile device in a three-dimensional space or a two-dimensional space.

[0010] In some embodiments, the remote control device can determine the position information of the remote control device on a target plane parallel to the display interface of the display device according to the first motion data and the second motion data, so that the user can operate the remote control device to move on the target plane. In this case, the processing complexity of the remote control device in determining the position information is relatively low.

[0011] In some embodiments, the remote control device receives the second motion data sent by the mobile device. Optionally, when the second motion data is determined based on raw data collected by the second sensor, the processing complexity of the remote control device can be reduced. Optionally, when the second motion data is the motion data of the mobile device on the target plane, the amount of data of the second motion data transmitted between the remote control device and the mobile device is relatively small, thereby saving the communication bandwidth.

[0012] Optionally, the first sensor includes an inertial motion unit (IMU) sensor.

[0013] In order to accurately present the position of the cursor after the user operates the remote control device, and to further improve the accuracy of the interaction, in some embodiments, the positional relationship between the collection position of the first motion data and the collection position of the second motion data should also be considered, and the influence on accurately identifying the position information of the remote control device should also be considered. For example, the second motion data is corrected according to the relative position information, and the relative position information indicates the relative position between the remote control device and the second sensor of the mobile device when the first sensor collects the first motion data.

[0014] In some embodiments, the remote control device determines whether the remote control device is in a stationary state according to the displacement information of the remote control device relative to the display device, and sends the position information to the display device when the remote control device is in a non-stationary state, so as to reduce the signaling overhead.

[0015] In the above embodiments, the remote control device determines that the remote control device is in a non-stationary state when the displacement information is greater than or equal to a preset value, or determines that the remote control device is in a stationary state when the displacement information is less than the preset value. Based on the preset value, whether the remote control device is in a stationary state or a non-stationary state can be determined, which can be applied to the division of the stationary state and the non-stationary state in various scenarios, thereby avoiding the error displacement caused by the misrecognition of the operation of the remote control device 210 due to the data collection error and the processing error.

[0016] In a second aspect, the present application provides a remote control method, and an execution subject of the method can be a mobile device, which can be implemented as a movable apparatus or a component in the movable apparatus, such as a chip, a chip system or other functional module capable of invoking and executing programs.

[0017] The method comprises: collecting, by a second sensor, second motion data of the mobile device, the second motion data being used to determine position information of the remote control device, the position information comprising: displacement information of the remote control device relative to the display device, or coordinate information of a cursor presented by the remote control device in the display device, the mobile device being relatively static with the display device and sending the second motion data to the remote control device.

[0018] In some embodiments, the second sensor comprises an IMU sensor.

[0019] In some embodiments, before sending the second motion data to the remote control device, the mobile device corrects the second motion data according to relative position information, the relative position information indicating a relative position between the remote control device and the second sensor of the mobile device when the first sensor collects the first motion data.

[0020] In a third aspect, the present application provides a remote control device, comprising: an acquisition module configured to collect, by a first sensor, first motion data of the remote control device; a processing module configured to determine, according to the first motion data and second motion data of a mobile device, position information of the remote control device, the position information comprising: displacement information of the remote control device relative to a display device, or coordinate information of a cursor presented by the remote control device in the display device, the mobile device being relatively static with the display device; and a sending module configured to send the position information to the display device.

[0021] In some embodiments, the processing module is specifically configured to determine, according to the first motion data and the second motion data, the position information of the remote control device on a target plane, the target plane being parallel to a display interface of the display device.

[0022] In some embodiments, the acquisition module is specifically configured to receive the second motion data sent by the mobile device.

[0023] In some embodiments, the first sensor comprises an IMU sensor.

[0024] In some embodiments, before determining, according to the first motion data and the second motion data of the mobile device, the position information of the remote control device, the processing module is further configured to correct the second motion data according to relative position information, the relative position information indicating a relative position between the remote control device and the second sensor of the mobile device when the first sensor collects the first motion data.

[0025] In some embodiments, the sending module is specifically configured to: determine whether the remote control device is in a static state according to the displacement information of the remote control device relative to the display device; and send the position information to the display device when the remote control device is not in the static state.

[0026] In some embodiments, the processing module is specifically configured to: determine that the remote control device is not in the static state when the displacement information is greater than or equal to a preset value; or determine that the remote control device is in the static state when the displacement information is less than the preset value.

[0027] In a fourth aspect, the present application provides a mobile device, comprising: an acquisition module configured to collect second motion data of the mobile device by a second sensor, the second motion data being used to determine position information of the remote control device, the position information comprising: displacement information of the remote control device relative to the display device, or coordinate information of a cursor presented by the remote control device in the display device, the mobile device being relatively static with the display device; and a sending module configured to send the second motion data to the remote control device.

[0028] In some embodiments, the second sensor comprises an IMU sensor.

[0029] In some embodiments, before sending the second motion data to the remote control device, the processing device is further configured to correct the second motion data according to relative position information, the relative position information indicating a relative position between the remote control device and the second sensor of the mobile device when the first sensor collects the first motion data.

[0030] In a fifth aspect, the embodiments of the present application provide an interaction system, comprising: a remote control device and a mobile device, the remote control device being provided with a first sensor, the mobile device being provided with a second sensor and a display device, the mobile device being relatively static with the display device; the first sensor being configured to collect first motion data of the remote control device, the second sensor being configured to collect second motion data of the mobile device; the mobile device being configured to send the second motion data of the mobile device to the remote control device; the remote control device being configured to determine position information of the remote control device according to the first motion data and the second motion data, the position information comprising: displacement information of the remote control device relative to the display device, or coordinate information of a cursor presented by the remote control device in the display device; and the remote control device being configured to send the position information to the display device.

[0031] In some embodiments, the remote control device is specifically configured to: determine position information of the remote control device on a target plane according to the first motion data and the second motion data, the target plane being parallel to a display interface of the display device.

[0032] In some embodiments, the first sensor comprises an IMU sensor; and / or, the second sensor comprises an IMU sensor.

[0033] In some embodiments, the distance between the remote control device and the second sensor is less than or equal to a preset value when the first sensor collects the first motion data.

[0034] In some embodiments, the mobile device determines the second sensor according to the position of the mobile device when the first sensor collects the first motion data.

[0035] In some embodiments, the remote control device corrects the second motion data according to relative position information, or the mobile device corrects the second motion data according to the relative position information, wherein the relative position information indicates the relative position between the remote control device and the second sensor when the first sensor collects the first motion data.

[0036] In some embodiments, the remote control device determines whether the remote control device is in a stationary state according to displacement information of the remote control device relative to the display device, and the remote control device sends the position information to the display device when the remote control device is not in the stationary state.

[0037] In some embodiments, the remote control device determines that the remote control device is not in the stationary state when the displacement information is greater than or equal to a preset value, or the remote control device determines that the remote control device is in the stationary state when the displacement information is less than the preset value.

[0038] In a sixth aspect, an embodiment of the present application provides an electronic device, comprising a processor and a memory, the memory being configured to store a computer program, and the processor being configured to invoke and run the computer program stored in the memory to execute the method in the first aspect, the second aspect, or the possible implementation manners.

[0039] In a seventh aspect, an embodiment of the present application provides a vehicle, comprising the device in the second aspect or the possible implementation manners.

[0040] In an eighth aspect, an embodiment of the present application provides a chip, comprising a processor configured to invoke and run computer instructions from a memory, so that a device installed with the chip executes the method in the first aspect, the second aspect, or the possible implementation manners.

[0041] In a ninth aspect, an embodiment of the present application provides a computer readable storage medium configured to store computer program instructions, and the computer program instructions cause a computer to execute the method in the first aspect, the second aspect, or the possible implementation manners.

[0042] In a tenth aspect, an embodiment of the present application provides a computer program product comprising computer program instructions, and the computer program instructions cause a computer to execute the method in the first aspect, the second aspect, or the possible implementation manners. BRIEF DESCRIPTION OF DRAWINGS

[0043] FIG. 1 is a schematic diagram of an interactive system according to an embodiment of the present application.

[0044] Fig. 2 is a flow diagram of device interaction in an interactive system according to an embodiment of the present application.

[0045] Fig. 3a is a flow diagram of device interaction in an interactive system according to another embodiment of the present application.

[0046] Fig. 3b is a flow diagram of device interaction in an interactive system according to another embodiment of the present application.

[0047] Fig. 4 is a flow diagram of device interaction in an interactive system according to another embodiment of the present application.

[0048] Fig. 5 is a structural diagram of an electronic device according to an embodiment of the present application.

[0049] Fig. 6 is a flow diagram of a remote control method according to an embodiment of the present application.

[0050] Fig. 7 is a flow diagram of another remote control method according to an embodiment of the present application.

[0051] Fig. 8 is a schematic block diagram of a processing device according to an embodiment of the present application. DETAILED DESCRIPTION

[0052] The technical solutions in the embodiments of the present application will be described below with reference to the accompanying drawings.

[0053] For the purpose of understanding the embodiments of the present application, it should be noted that "at least one" means one or more, and "multiple" means two or more. The "and / or" describes the association relationship of the associated objects, which means that there can be three kinds of relationships, for example, A and / or B, which can represent the following cases: A exists alone, A and B exist together, B exists alone, where A and B can be singular or plural. The character " / " generally represents an "or" relationship between the associated objects. "At least one of the following" or similar expressions means any combination of these items, including any combination of single or multiple items. For example, at least one of a, b and c can represent: a, or b, or c, or a and b, or a and c, or b and c, or a, b and c. Where a, b and c can be single or multiple.

[0054] The vehicle in the embodiments of the present application can be an intelligent vehicle, such as an automatic driving vehicle in which all functions are realized as automatic control, or an assisted driving vehicle in which part of the functions are realized as automatic control to provide driving assistance, or can be an ordinary vehicle. For ease of description, the vehicle is referred to as a vehicle hereinafter. When the vehicle in the embodiments of the present application is an ordinary vehicle, the vehicle can be automatically controlled by an electronic device outside the vehicle. The present application can realize vehicle control for any type of vehicle, such as a fuel vehicle, a new energy vehicle, and the like.

[0055] In the embodiments of the present application, a user interacts with a vehicle through a remote control device to realize control of the vehicle or a device in the vehicle, to ensure the accuracy of the interaction, and the remote control device presents the movement of a cursor in a display interface when controlling the vehicle or the device in the vehicle, realizes pointing and selection of a target control, and does not need to switch icons for selection step by step. Through the pointing capability of the remote control device, the user can realize jump selection, sliding, dragging, and the like, and the convenience of the interaction is improved. The application scenario of the embodiments of the present application is exemplarily described below in combination with FIG. 1.

[0056] FIG. 1 is a schematic diagram of an interaction system 100 provided by the embodiments of the present application. As shown in FIG. 1, the interaction system 100 includes a remote control device 110 and a vehicle 120. A user can interact with the vehicle 120 or a device in the vehicle 120 through the remote control device 110 to realize driving control or non-driving control of the vehicle. The driving control can include control of vehicle forward movement, braking, steering, control of vehicle lights, control of a rain wiper, and the like, and the non-driving control can include control of a sound box of the vehicle, control of an air conditioner of the vehicle, control of a window of the vehicle, and the like.

[0057] The display device 121 in the vehicle 120 can present an interaction interface for realizing interaction between the remote control device 110 and the vehicle 120 or a device in the vehicle 120. The display device 121 can be integrated in the vehicle, such as a central control screen, or the display device 121 can be independent of the vehicle 120, such as a display screen of an arbitrary terminal device placed in the vehicle. The terminal device can be, for example, a mobile phone, a tablet computer, a desktop computer, or the like, or can be a wearable device, which can also be referred to as a wearable smart device. The wearable device is a portable device that is directly worn on the body or integrated into clothes or accessories of a user. It should be noted that the display device 121 and the vehicle 120 remain relatively stationary.

[0058] The remote control device 110 can be a pointing type remote control device, or the remote control device 110 can be an air mouse, etc. The remote control device 110 is provided with a sensor for collecting motion data of the remote control device 110, such as a spatial posture of the remote control device, which can be a spatial posture sensor such as an IMU sensor, and the collected motion data can include, but is not limited to, three-axis posture angle and / or three-axis acceleration. With the change of the movement or pointing of the remote control device 110 in space relative to the display device 110, the displacement of the cursor of the remote control device 110 can be included in the display interface presented by the display device 121. The embodiments of the present application do not limit the hardware form of the remote control device 110, for example, the remote control device 110 can be carried in any form of shell or fabric. The remote control device 110 can be a handheld device, or the remote control device 110 can be a wearable device, such as a glove, a finger sleeve, etc.

[0059] It should be noted that, in order to facilitate understanding, the control of the vehicle by the remote control device is taken as an example for description, wherein the vehicle can be replaced by any mobile device, such as a robot, an intelligent skateboard, a ship, an aircraft, etc.

[0060] In some scenarios of vehicle driving, for example, the vehicle drives on a bumpy road, the vehicle turns, or the vehicle accelerates or decelerates, etc., so that the remote control device 110 has displacement due to inertial conduction, in other words, the relative displacement between the remote control device 110 and the vehicle 120 collected by the sensor in the remote control device 110 includes the displacement of the vehicle in addition to the displacement caused by the user operating the remote control device 110. In this case, the motion data collected by the remote control device 110 cannot identify valid control data, resulting in the displacement of the cursor presented in the display interface.

[0061] Therefore, the embodiments of the present application correct the motion data of the remote control device based on the motion data of the vehicle to correct the displacement of the cursor of the remote control device, and realize accurate interaction. The interactive system provided by the present application will be described below in combination with FIG. 2.

[0062] FIG. 2 is a flow diagram of device interaction in an interactive system 200 provided by an embodiment of the present application. Referring to FIG. 2, the interactive system 200 can include a remote control device 210 and a mobile device 220. The remote control device 210 can be a remote control device or a component in the remote control device, such as a chip, a chip system or other functional modules capable of calling and executing programs; the mobile device 220 can be a movable device, such as a vehicle, an airplane, a ship, a robot, an intelligent skateboard, an aircraft, etc., or can be a component in the movable device, such as a chip, a chip system or other functional modules capable of calling and executing programs, for example, the mobile device 220 can be a cockpit control system and / or a vehicle control system in a vehicle.

[0063] When the remote control device 210 is implemented as a remote control apparatus, the remote control device 210 is deployed with a first processing device 211, and when the remote control device 210 is implemented as a component in the remote control apparatus, the remote control device 210 is the first processing device 211; similarly, when the mobile device 220 is implemented as a mobile apparatus, the mobile device 220 is deployed with a second processing device 221, and when the mobile device 220 is implemented as a component in the mobile apparatus, the mobile device 220 is the second processing device 221. The first processing device 211 and the second processing device 221 are named only for distinguishing different processing devices, and both can be collectively described as processing devices. Hereinafter, for the convenience of description, the remote control device 210 is deployed with the first processing device 211, and the mobile device 220 is deployed with the second processing device 221. In some embodiments, the steps performed by the remote control device 210 can also be understood as being performed by the first processing device 211, and the steps performed by the mobile device 220 can also be understood as being performed by the second processing device 221.

[0064] The remote control device 210 can also be deployed with a first sensor 212, and the mobile device 220 can also be deployed with a second sensor 222 and a display device 223. The remote control device 210 and the mobile device 220 (including the display device 223 and / or the sensor 222 in the mobile device 220) can communicate through wired or wireless means. For example, the remote control device 210 and the mobile device 220 can realize wired communication based on universal serial bus (USB); for another example, the remote control device 210 and the mobile device 220 can realize wireless communication based on bluetooth low energy (BLE), ultra wide band (UWB), sparklink-low energy (SLE), etc. The present application does not limit the deployment relationship between the remote control device 210 and the mobile device 220 when the remote control device 210 is not in operation. For example, when the remote control device 210 is not in operation, it can be fixed in the mobile device 220, such as being fixed in the mobile device 220 by buckling or slot, etc.; for another example, when the remote control device 210 is not in operation, it can not be fixed in the mobile device 220, such as being placed on the back seat of a vehicle or in the mesh pocket of the front seat, etc.

[0065] The first sensor and the second sensor are merely used for distinguishing the sensors in the remote control device 210 and the sensors in the mobile device 220, and do not limit the naming of the sensors. Similarly, in order to distinguish the motion data of the remote control device 210 and the motion data of the mobile device 220, the motion data of the remote control device is referred to as first motion data, and the motion data of the mobile device is referred to as second motion data. The first motion data can be motion data collected by the first sensor 212 or determined based on the motion data collected by the first sensor 212, and the second motion data can be motion data collected by the second sensor 222 or determined based on the motion data collected by the second sensor 222.

[0066] Referring to FIG. 2, the first processing device 211 can collect first motion data of the remote control device 210 through the first sensor 212. It should be understood that the first motion data can be raw data collected by the first sensor 212 or determined based on the raw data collected by the first sensor 212. As mentioned above, the first sensor 212 can be a spatial posture sensor, and the motion data collected by the first sensor 212 can include, but is not limited to, three-axis posture angles of the remote control device 210 and / or three-axis accelerations of the remote control device 210. In the case where the first motion data is determined based on the raw data collected by the first sensor 212, the first motion data can be displacement information of the remote control device 210 in a predefined three-dimensional spatial coordinate system. The dimension of the coordinate system, i.e., the dimension of the displacement information, is not limited in the present application, for example, it can be a three-dimensional spatial coordinate system or a two-dimensional planar coordinate system. The coordinate system can be, for example, a geodetic coordinate system.

[0067] The second processing device 221 can collect second motion data of the mobile device 220 through the second sensor 222. It should be understood that the second motion data can be raw data collected by the second sensor 222 or determined based on the raw data collected by the second sensor 222. The second sensor 222 can be a spatial posture sensor, and the motion data of the mobile device 220 collected by the second sensor 222 can include, but is not limited to, three-axis posture angles of the mobile device 220 and / or three-axis accelerations of the mobile device 220. In the case where the second motion data is determined based on the raw data collected by the second sensor 222, the second motion data can be displacement information of the mobile device 220. The displacement information of the mobile device 220 can be expressed in a predefined coordinate system. The dimension of the coordinate system, i.e., the dimension of the displacement information, is not limited in the present application, for example, it can be a three-dimensional spatial coordinate system or a two-dimensional planar coordinate system. The coordinate system can be, for example, a geodetic coordinate system.

[0068] For example, the mobile device 220 can send the second motion data to the remote control device 210, and the first processing device 211 can determine the position information of the remote control device 210 based on the first motion data and the second motion data. In the process of determining the position information of the remote control device 211 based on the first motion data and the second motion data, when the first motion data is the raw data collected by the first sensor 212, such as the three-axis attitude angle of the remote control device 210 and / or the three-axis acceleration of the remote control device 210, the first processing device 211 can process the first motion data to obtain the displacement information of the remote control device 210, for example, the first processing device 211 calculates the displacement information of the remote control device 210 based on the three-axis attitude angle and / or the three-axis acceleration collected by the first sensor 212; similarly, if the second motion data is the raw data collected by the second sensor 222, such as the three-axis attitude angle of the mobile device 220 and / or the three-axis acceleration of the mobile device 220, the first processing device 211 can process the second motion data to obtain the displacement information of the mobile device 220, for example, the first processing device 211 calculates the displacement information of the mobile device 220 based on the three-axis attitude angle and / or the three-axis acceleration of the mobile device 220; further, the first processing device 211 determines the position information of the remote control device 210 based on the displacement information of the remote control device 210 (x1, y1) and the displacement information of the mobile device 220. It should be understood that if the second motion data is determined based on the raw data collected by the second sensor 222, the second processing device 221 can process the second motion data to obtain the displacement information of the mobile device 220, and then send the displacement information of the mobile device 220 as the second motion data to the remote control device 210.

[0069] It should be noted that the present application does not limit the algorithm used by the first processing device 211 to determine the position information of the remote control device 210, for example, the first processing device 211 can also directly determine the position information of the remote control device 210 based on the raw data collected by the first sensor 212 (such as the three-axis attitude angle and / or the three-axis acceleration of the remote control device 210) and the raw data collected by the second sensor 222 (such as the three-axis attitude angle and / or the three-axis acceleration of the mobile device 220), without converting the raw data collected by the first sensor 212 into the displacement information of the remote control device 210 and converting the raw data collected by the second sensor 222 into the displacement information of the mobile device 220. In this case, the first motion data is the raw data collected by the first sensor 212, and the second motion data is the raw data collected by the second sensor 222.

[0070] In the first implementation of the above example, the position information of the remote control device 210 can include displacement information of the remote control device 210 relative to the display device 223. For example, assuming that the remote control device 210 controls the mobile device 220 based on user operation in a three-dimensional space, such as the user can operate the remote control device 210 in the front-back direction, the up-down direction, and / or the left-right direction, in this case, the remote control device 210 can obtain displacement information of the remote control device 210, such as (x1, y1, z1), and obtain displacement information of the mobile device 220, such as (x2, y2, z2), and then determine displacement information of the remote control device 210 relative to the display device 223 based on the displacement information of the remote control device 210, such as (x1, y1, z1), and the displacement information of the mobile device 220, such as (x2, y2, z2), such as (x2-x1, y2-y1, z2-z1); for another example, assuming that the remote control device 210 controls the mobile device 220 based on user operation in a two-dimensional space (such as a target plane), which is parallel to the display interface of the real device 221, that is, the user can operate the remote control device 210 in the up-down direction and / or the left-right direction of the target plane, in this case, the remote control device 210 can obtain displacement information of the remote control device 210, such as (x1, y1), and obtain displacement information of the mobile device 220, such as (x2, y2), and then determine displacement information of the remote control device 210 relative to the display device 223 based on the displacement information of the remote control device 210, such as (x1, y1), and the displacement information of the mobile device 220, such as (x2, y2), such as (x2-x1, y2-y1). It can be understood that when the remote control device 210 controls the mobile device 220 based on user operation in a three-dimensional space, the user can combine the front-back movement of the remote control device to realize more operation control modes; when the remote control device 210 controls the mobile device 220 based on user operation in a two-dimensional space, the amount of data of the second motion data transmitted between the mobile device 220 and the remote control device 210 is smaller, saving communication bandwidth.

[0071] In the second implementation of the above example, the position information of the remote control device 210 can include coordinate information of a cursor presented in the display device 223 by the remote control device 210. Based on this, the present implementation can further determine the coordinate information of the cursor presented in the display device 223 by the remote control device 210 based on the displacement information of the remote control device 210 relative to the display device 223 on the basis of the first implementation. Alternatively, the first processing device 211 can determine the coordinate information of the cursor presented in the display device 223 based on the displacement information of the remote control device 210 relative to the display device 223 and the current position of the cursor. For example, assuming that the remote control device 210 controls the mobile device 220 in a three-dimensional space based on user operation, the first processing device 211 determines the displacement information of the remote control device 210 relative to the display device 223 as (x2-x1, y2-y1, z2-z1), and then the coordinate information (x', y', z') of the cursor can be (x+(x2-x1), y+(y2-y1), z+(z2-z1)), where (x, y, z) is the current coordinate information of the cursor. It should be noted that there can be a proportional conversion relationship between the displacement information (x2-x1, y2-y1, z2-z1) of the remote control device 210 relative to the display device 223 and the coordinate displacement of the cursor, such as the displacement information of the cursor can be (k(x2-x1), k(y2-y1), k(z2-z1)), where k is a proportional coefficient, and the coordinate information (x', y', z') of the cursor can be (x+k(x2-x1), y+k(y2-y1), z+k(z2-z1)). For another example, assuming that the remote control device 210 controls the mobile device 220 in a two-dimensional space (such as a target plane) based on user operation, the first processing device 211 determines the displacement information of the remote control device 210 relative to the display device 223 as (x2-x1, y2-y1), and then the coordinate information (x', y') of the cursor can be (x+(x2-x1), y+(y2-y1)), where (x, y) is the current coordinate information of the cursor. It should be noted that there can be a proportional conversion relationship between the displacement information (x2-x1, y2-y1) of the remote control device 210 relative to the display device 223 and the coordinate displacement of the cursor, such as the displacement information of the cursor can be (k(x2-x1), k(y2-y1)), where k is a proportional coefficient, and the coordinate information (x', y') of the cursor can be (x+k(x2-x1), y+k(y2-y1)).

[0072] In the above example, the remote control device 210 can send the position information of the remote control device 210 to the display device 223, so that the display device 223 renders and presents a display interface, which includes a cursor displayed according to the determined position, so that the display position of the cursor is updated in real time with the movement or pointing of the remote control device 210, and the interaction between the remote control device 210 and the mobile device 220 is realized. Based on the first implementation manner, the display device 223 can determine the position information of the cursor presented by the remote control device 210 in the display device 223 based on the displacement information of the remote control device 210 relative to the display device 223, and then the display device 223 determines the position information of the cursor based on the determined position information of the cursor. The process can refer to the description of the determination of the position information of the cursor by the remote control device 210 in the second implementation manner, and is not described herein for brevity.

[0073] In order to accurately obtain the displacement information of the remote control device 210, in some embodiments, the remote control device 210 can be positioned by a positioning device. The application does not make any limitation on the positioning device. For example, the positioning device can be a positioning device using UWB technology. The positioning device can be deployed on the remote control device 210. The positioning device can assist the first sensor in the remote control device 210 to accurately obtain the displacement information of the remote control device 210. The positioning device can accurately position the remote control device 210 in a direction perpendicular to the display interface, and is especially suitable for controlling the mobile device 220 in a three-dimensional space based on user operation by the remote control device 210.

[0074] Similarly, in order to accurately obtain the displacement information of the mobile device 220, in some embodiments, the mobile device 220 can be positioned by a positioning device. The application does not make any limitation on the positioning device. For example, the positioning device can be a positioning device using UWB technology. The positioning device can be deployed on the mobile device 220. The positioning device can assist the sensor in the mobile device 220 to accurately obtain the displacement information of the mobile device 220. The positioning device can accurately position the mobile device 220 in a direction perpendicular to the display interface, so as to accurately determine the displacement information of the remote control device 210 relative to the display device 223 in a three-dimensional space, and is especially suitable for controlling the mobile device 220 in a three-dimensional space based on user operation by the remote control device 210.

[0075] To make the user operation of the remote control device 210 accurately present the cursor position, to further improve the accuracy of the interaction. In some embodiments, the position relationship between the collection position of the first motion data and the collection position of the second motion data should also be considered, and the influence on accurately identifying the position information of the remote control device 210. Among them, the collection position of the first motion data can be the position of the first sensor 212 or the position of the remote control device 210 when the first sensor 212 collects the first motion data, and the collection position of the second motion data can be the position of the second sensor 222. For the convenience of description, the relative position between the first sensor 212 and the second sensor 222 is uniformly referred to as the relative position information.

[0076] For example, the second sensor 222 can be deployed at the front part of the vehicle, and the user interacts through the remote control device 210 in the back seat of the vehicle, and the position of the first sensor 212 is near the back seat of the vehicle. In this case, there can be a time delay between the motion data collected by the sensors, such as the second motion data collected at the first time acting on the first motion data collected at the second time; or, due to the structure of the vehicle, the vibration amplitude generated by different parts of the vehicle is different, such as the vibration amplitude of the front part of the vehicle collected by the second sensor 222 (i.e. the second motion data) will increase in the back seat part of the vehicle body.

[0077] Based on this, in some implementation manners of the embodiments of the present application, the second motion data can be corrected, and then the position information of the remote control device is determined based on the first motion data and the corrected second motion data. As an example, referring to FIG. 3a, the first processing device 211 can correct the second motion data according to the relative position information; as another example, referring to FIG. 3b, the second processing device 221 can correct the second motion data according to the relative position information, and send the corrected second motion data to the remote control device 210. In the case that the second processing device 221 corrects the second motion data, the second processing device 221 can receive the information of the position of the remote control device 210 when the first sensor 212 collects the first motion data, and then determine the relative position information based on the information and the position of the second sensor 222 deployed by itself.

[0078] Optionally, the first processing device 211 can also correct the first motion data based on the relative position information to eliminate the influence of the position relationship between the first sensor 212 and the second sensor 222 on accurately identifying the position information of the remote control device 210.

[0079] It should be understood that the correction of the first motion data or the second motion data based on the relative position information is a pre-correction manner, and the present application is not limited thereto, for example, the position information of the remote control device 210 can also be corrected based on the relative position information, for example, the remote control device 210 or the display device 223 can correct the displacement information of the remote control device 210 relative to the display device 223 based on the relative position information, and for example, the remote control device 210 or the display device 223 can correct the coordinate information of the cursor presented by the remote control device 210 in the display device 223 based on the relative position information.

[0080] It can be understood that when the user does not operate the remote control device 210 to interact with the mobile device 220, the remote control device 210 should be relatively stationary with the mobile device 220, and it can be considered that the remote control device 210 is in a stationary state, and when the user operates the remote control device 210 to interact with the mobile device 220, there is a relative displacement between the remote control device 210 and the mobile device 220, and it can be considered that the remote control device 210 is in a non-stationary state. For example, referring to FIG. 4, the first processing device 211 can determine whether the remote control device 210 is in a stationary state or a non-stationary state according to the displacement information of the remote control device 210 relative to the display device 223. Further, the first processing device 211 can send position information to the display device 223 when the remote control device 210 is in a non-stationary state, and not send position information when the remote control device 210 is in a stationary state, so as to reduce signaling overhead.

[0081] Of course, the present application does not limit the execution subject when determining whether the remote control device 210 is in a stationary state, for example, the display device 223 can determine whether the remote control device 210 is in a stationary state based on the received position information of the remote control device 210, and the position of the cursor presented in the display interface does not change when determining whether the remote control device 210 is in a stationary state, and the position of the cursor is updated based on the position information of the remote control device 210 when determining that the remote control device 210 is in a non-stationary state. Alternatively, when the display device 223 determines whether the remote control device 210 is in a stationary state, the coordinate information of the cursor can be updated, so that when the position information of the remote control device 210 is received again, the updated coordinate information of the cursor is taken as the coordinate information of the cursor at the current time.

[0082] When the remote control device 210 is in a static state, the displacement information of the remote control device relative to the display device 223 should be zero in theory. Considering the data acquisition error and processing error of the sensor, when the displacement information of the remote control device 210 relative to the display device 223 is less than a preset value, it can be considered that the remote control device is in a static state, and when the displacement information of the remote control device 210 relative to the display device 223 is greater than the preset value, it can be considered that the remote control device is in a non-static state. When the displacement information of the remote control device 210 relative to the display device 223 is less than the preset value, the remote control device 210 can be in a static state or a non-static state based on the application scenario, which is not limited in the application, so as to avoid misrecognition of the error displacement of the remote control device 210 due to the data acquisition error and the processing error.

[0083] Therefore, in the embodiment of the application, when the remote control device 210 interacts with the mobile device 220, the position information of the remote control device is determined based on the second motion data of the mobile device 220 and the first motion data collected by the first sensor 212 deployed by the remote control device, the position information including displacement information of the remote control device relative to the display device 223 or coordinate information of a cursor presented by the remote control device in the display device 223, and then the position information of the remote control device is sent to the display device 223 to make the display device 223 present the cursor corresponding to the remote control device 210, so as to realize the directional control of the mobile device, ensure the convenient and accurate interaction of the user with the mobile device, and determine the position information of the remote control device in combination with the second motion data and the first motion data, so as to realize the calibration of the motion data of the remote control device based on the motion data of the mobile device, avoid the influence of the movement of the mobile device on the operation accuracy of the remote control device, and further improve the accuracy of the interaction between the user and the mobile device.

[0084] FIG. 5 is a structural schematic diagram of an electronic device provided in an embodiment of the present application. The electronic device 300 shown in FIG. 5 can be an implementation of the remote control device (such as the remote control device 110 or the remote control device 210), the mobile device (such as the vehicle 120 or the mobile device 220), or an implementation of a component (such as the display device 121 or the display device 223) in the mobile device. In combination with FIG. 5, the electronic device 300 can include a processor 310 and a memory 320. The processor 310 and the memory 320 communicate with each other through an internal connection path. Optionally, the memory 320 can include a read-only memory and a random access memory, and provide instructions and data to the processor 310. Part of the memory 320 can also include a non-volatile random access memory. The memory 320 can be a separate device or integrated in the processor 310. The processor 310 can be used to execute instructions stored in the memory 320, and when the processor 310 executes the instructions stored in the memory 320, the processor 310 is used to perform various steps and / or processes of the method embodiments of the present application.

[0085] In the implementation process, the steps of the method in the embodiments of the present application can be executed by a hardware processor in the processor 310, or executed by a combination of hardware and software modules in the processor 310. The software modules can be in a mature storage medium in the art. The storage medium is in the memory 320, and the processor 310 reads the information in the memory 320, and combines the hardware to complete the steps in the following method.

[0086] In some embodiments, the electronic device 300 can also include a power supply 330, which is used to supply power to the components or circuits in the electronic device, so that the processor 310 executes various steps and / or processes in the method embodiments of the present application.

[0087] In some embodiments, the electronic device 300 can also include a communication port 340, which is used to realize the communication connection between the electronic device and other devices or chips.

[0088] In addition, in order to make the function of the terminal device more perfect, the electronic device 300 can also include one or more of a display screen 350, an audio circuit 360, and a sensor 370, and the audio circuit 360 can include a speaker, a microphone, etc.

[0089] When the mobile device is implemented as the electronic device 300, the electronic device 300 can present a human-computer interaction interface through the display screen 350, and respond to the user's operation to present the corresponding interface. Optionally, the electronic device 300 can collect the motion data of the mobile device through the sensor 370.

[0090] When the remote control device is implemented as the electronic device 300, the electronic device 300 can collect motion data of the remote control device through the sensor 370.

[0091] In some embodiments, the electronic device 300 can implement corresponding processes of various methods in the embodiments of the present application. For brevity, details are not described herein.

[0092] It should be noted that the processor 310 in the embodiments of the present application can be an integrated circuit chip with a signal processing capability. The processor 310 described above can be a microprocessor, a central processing unit (CPU), a digital signal processor (DSP), an application-specific integrated circuit (ASIC), a field programmable gate array (FPGA) or other programmable logic devices, discrete gate or transistor logic devices, discrete hardware components. The disclosed methods, steps and logic block diagrams in the embodiments of the present application can be implemented or executed.

[0093] It is to be understood that the memory in the embodiments of the present application can be a volatile memory or a nonvolatile memory, or can include both volatile and nonvolatile memory. Among them, the nonvolatile memory can be a read-only memory (ROM), a programmable read-only memory (PROM), an erasable programmable read-only memory (EPROM), an electrically EPROM (EEPROM), or a flash memory. The volatile memory can be a random access memory (RAM) used as an external cache. By way of example, and not limitation, many forms of RAM can be used, such as static RAM (SRAM), dynamic RAM (DRAM), synchronous dynamic RAM (SDRAM), double data rate SDRAM (DDR SDRAM), enhanced SDRAM (ESDRAM), synchlink DRAM (SLDRAM), and direct rambus RAM (DR RAM). It should be noted that the memory of the system and method described herein is intended to include, but not be limited to, these and any other suitable types of memory.

[0094] It should be understood that the specific process of each module performing the above corresponding steps has been described in detail in the above method embodiments, and for the sake of brevity, will not be repeated here.

[0095] It should be understood that the specific process of each module performing the above corresponding steps has been described in detail in the above method embodiments, and for the sake of brevity, will not be repeated here.

[0096] The embodiments of the present application also provide a computer readable storage medium for storing a computer program.

[0097] In some embodiments, the computer program causes the computer to execute the technical solutions on the side of the remote control device, the mobile device, or the display device in the embodiments of the present application. For the sake of brevity, they will not be repeated here.

[0098] The embodiments of the present application also provide a computer program product including computer program instructions.

[0099] In some embodiments, the computer program instructions cause the computer to execute the technical solutions of the remote control device, the mobile device or the display device side in the embodiments of the present application. For brevity, details are not repeated here.

[0100] The embodiments of the present application further provide a computer program.

[0101] In some embodiments, when the computer program runs on the computer, the computer is caused to execute the technical solutions of the remote control device, the mobile device or the display device side in the embodiments of the present application. For brevity, details are not repeated here.

[0102] The embodiments of the present application further provide a vehicle.

[0103] In some embodiments, the vehicle includes the control device or the chip of the vehicle in the embodiments of the present application.

[0104] In some embodiments, the vehicle further includes the sensor in the embodiments of the present application.

[0105] In some embodiments, the vehicle includes the display device in the embodiments of the present application.

[0106] Those skilled in the art can appreciate that the units and algorithm steps of the examples described in combination with the embodiments disclosed herein can be realized by electronic hardware or a combination of computer software and electronic hardware. Whether the functions are realized in hardware or software depends on the specific application and design constraints of the technical solutions. Those skilled in the art can use different methods to realize the described functions for each specific application, but such implementation should not be considered beyond the scope of the present application.

[0107] The above is merely specific implementations of the present application, but the protection scope of the present application is not limited thereto, any person skilled in the art can easily think of changes or replacements within the technical range disclosed by the present application, which should be covered within the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

[0108] The embodiments of the present application take the interaction between the remote control device and the mobile device as an example for description. The remote control device can be realized as an electronic device, a chip, a chip system or other functional modules capable of calling and executing programs, and the remote control device can be the remote control device 110 in FIG. 1. The mobile device can be realized as a vehicle or an electronic device, a chip, a chip system or other functional modules capable of calling and executing programs in the vehicle, and the mobile device can be, for example, the vehicle 120 in FIG. 1.

[0109] The remote control method provided by the embodiments of the present application will be described below in combination with the accompanying drawings.

[0110] FIG. 6 is a flow diagram of a remote control method according to an embodiment of the present application. The method can be performed by the remote control device described above, which can be implemented as an electronic device, a chip, a chip system, or any other functional module capable of invoking and executing a program. In conjunction with FIG. 6, the method 400 can include some or all of the following processes.

[0111] S410, collecting first motion data of the remote control device by using a first sensor;

[0112] S420, determining position information of the remote control device according to the first motion data and second motion data of the mobile device, the position information including displacement information of the remote control device relative to the display device, or coordinate information of a cursor presented by the remote control device in the display device, the mobile device being relatively static with respect to the display device;

[0113] S430, sending the position information to the display device.

[0114] FIG. 7 is a flow diagram of another remote control method according to an embodiment of the present application. The method can be performed by the mobile device described above, which can be implemented as a vehicle or an electronic device, a chip, a chip system, or any other functional module capable of invoking and executing a program in the vehicle. In conjunction with FIG. 7, the method 500 can include some or all of the following processes.

[0115] S510, collecting second motion data of the mobile device by using a second sensor, the second motion data being used to determine position information of the remote control device, the position information including displacement information of the remote control device relative to the display device, or coordinate information of a cursor presented by the remote control device in the display device, the mobile device being relatively static with respect to the display device;

[0116] S520, sending the second motion data to the remote control device.

[0117] The steps in the method embodiments shown in FIGS. 6 and 7 have been described in the foregoing embodiments of the interactive system, and will not be repeated here for brevity.

[0118] FIG. 8 is a schematic block diagram of a processing device according to an embodiment of the present application. As shown in FIG. 8, the processing device 600 can be applied to implement the method on the side of the remote control device described above, or the processing device 600 can be applied to implement the method on the side of the mobile device described above. The processing device 600 can include an obtaining module 610, a processing module 620, and a sending module 630.

[0119] In an example, when the processing apparatus 600 is configured to implement the method on the remote control device side, the obtaining module 610 is configured to acquire first motion data of the remote control device by using a first sensor; the processing module 620 is configured to determine position information of the remote control device according to the first motion data and second motion data of a mobile device, the position information comprising displacement information of the remote control device relative to a display device, or coordinate information of a cursor presented by the remote control device in the display device, the mobile device being relatively static with respect to the display device; and the sending module 630 is configured to send the position information to the display device.

[0120] In some embodiments, the processing module 620 is specifically configured to determine the position information of the remote control device on a target plane according to the first motion data and the second motion data, the target plane being parallel to a display interface of the display device.

[0121] In some embodiments, the obtaining module 610 is specifically configured to receive the second motion data sent by the mobile device.

[0122] In some embodiments, the first sensor comprises an IMU sensor.

[0123] In some embodiments, before determining the position information of the remote control device according to the first motion data and the second motion data of the mobile device, the processing module 620 is further configured to correct the second motion data according to relative position information, the relative position information indicating a relative position between the remote control device and a second sensor of the mobile device when the first sensor acquires the first motion data.

[0124] In some embodiments, the sending module 630 is specifically configured to determine whether the remote control device is in a static state according to the displacement information of the remote control device relative to the display device; and send the position information to the display device when the remote control device is not in the static state.

[0125] In some embodiments, the processing module 620 is specifically configured to determine that the remote control device is not in the static state when the displacement information is greater than or equal to a preset value; or determine that the remote control device is in the static state when the displacement information is less than the preset value.

[0126] In an example, when the processing apparatus 600 is configured to implement the method on the mobile device side, the obtaining module 610 is configured to acquire second motion data of the mobile device by using a second sensor, the second motion data being used to determine position information of a remote control device, the position information comprising displacement information of the remote control device relative to a display device, or coordinate information of a cursor presented by the remote control device in the display device, the mobile device being relatively static with respect to the display device; and the sending module 630 is configured to send the second motion data to the remote control device.

[0127] In some embodiments, the second sensor comprises an IMU sensor.

[0128] In some embodiments, before sending the second motion data to the remote control device, the processing device 620 is further configured to correct the second motion data according to relative position information, the relative position information indicating a relative position between the remote control device and the second sensor of the mobile device when the first sensor collects the first motion data.

[0129] The division of units / modules in the above apparatus is only a logical function division. In actual implementation, all or part of them can be integrated into one physical entity, or can be physically separated.

Claims

1. A remote control method characterized by, The application is applied to a remote control device, comprising: acquiring first motion data of the remote control device through a first sensor; determining position information of the remote control device according to the first motion data and second motion data of a mobile device, the position information comprising displacement information of the remote control device relative to a display device or coordinate information of a cursor presented by the remote control device in the display device, the mobile device being relatively stationary with the display device; sending the position information to the display device.

2. The method of claim 1, wherein, The determining of the position information of the remote control device according to the first motion data and the second motion data of the mobile device comprises: determining position information of the remote control device on a target plane according to the first motion data and the second motion data, the target plane being parallel to a display interface of the display device.

3. The method according to claim 1 or 2, characterized in that, Further comprising: receiving the second motion data sent by the mobile device.

4. The method according to any one of claims 1 to 3, characterized in that, The first sensor comprises an inertial motion unit (IMU) sensor.

5. The method according to any one of claims 1 to 4, characterized in that, Before the determining of the position information of the remote control device according to the first motion data and the second motion data of the mobile device, further comprising: correcting the second motion data according to relative position information, the relative position information indicating a relative position between the remote control device and a second sensor of the mobile device when the first sensor acquires the first motion data.

6. The method according to any one of claims 1 to 5, characterized in that, The sending of the position information to the display device comprises: determining whether the remote control device is in a stationary state according to the displacement information of the remote control device relative to the display device; sending the position information to the display device when the remote control device is not in the stationary state.

7. The method of claim 6, wherein, The determining of whether the remote control device is in the stationary state according to the displacement information of the remote control device relative to the display device comprises: determining that the remote control device is not in the stationary state when the displacement information is greater than or equal to a preset value; or determining that the remote control device is in the stationary state when the displacement information is less than the preset value.

8. A remote control device, characterized in that comprising: an acquiring module configured to acquire first motion data of the remote control device through a first sensor; a processing module configured to determine position information of the remote control device according to the first motion data and second motion data of a mobile device, the position information comprising displacement information of the remote control device relative to a display device or coordinate information of a cursor presented by the remote control device in the display device, the mobile device being relatively stationary with the display device; a sending module configured to send the position information to the display device.

9. The apparatus of claim 8, wherein, The processing module is specifically configured to: determine position information of the remote control device on a target plane according to the first motion data and the second motion data, the target plane being parallel to a display interface of the display device.

10. The apparatus of claim 8 or 9, wherein, The acquiring module is further configured to: receive the second motion data sent by the mobile device.

11. The apparatus of any one of claims 8 to 10, wherein, The first sensor comprises an inertial motion unit (IMU) sensor.

12. The apparatus of any one of claims 8 to 11, wherein, Before the determining of the position information of the remote control device according to the first motion data and the second motion data of the mobile device, the processing module is further configured to: correct the second motion data according to relative position information, the relative position information indicating a relative position between the remote control device and a second sensor of the mobile device when the first sensor acquires the first motion data. The second motion data is corrected according to relative position information, the relative position information indicating a relative position between the remote control device and the second sensor of the mobile device when the first sensor collects the first motion data.

13. The apparatus of any one of claims 8 to 12, wherein, The sending module is specifically configured to: determine whether the remote control device is in a static state according to displacement information of the remote control device relative to the display device; send the position information to the display device when the remote control device is in a non-static state.

14. The apparatus of claim 13, wherein, The processing module is specifically configured to: determine that the remote control device is in a non-static state when the displacement information is greater than or equal to a preset value; or determine that the remote control device is in a static state when the displacement information is less than the preset value.

15. An interactive system, characterized by The system comprises: a remote control device and a mobile device, the remote control device being provided with a first sensor, and the mobile device being provided with a second sensor and a display device, the mobile device being relatively static with the display device; the first sensor is configured to collect first motion data of the remote control device, and the second sensor is configured to collect second motion data of the mobile device; the mobile device sends the second motion data of the mobile device to the remote control device; the remote control device determines position information of the remote control device according to the first motion data and the second motion data, the position information comprising displacement information of the remote control device relative to the display device or coordinate information of a cursor of the remote control device presented in the display device; the remote control device sends the position information to the display device.

16. The system of claim 15, wherein, The remote control device is specifically configured to: determine position information of the remote control device on a target plane according to the first motion data and the second motion data, the target plane being parallel to a display interface of the display device.

17. The system of claim 15 or 16, wherein, The first sensor comprises an IMU sensor; and / or, the second sensor comprises an IMU sensor.

18. The system of any one of claims 15 to 17, wherein, When the first sensor collects the first motion data, a distance between the remote control device and the second sensor is less than or equal to a preset value.

19. The system of claim 18, wherein, The mobile device determines the second sensor according to a position of the first sensor when the first sensor collects the first motion data.

20. The system of any one of claims 15 to 19, wherein: the remote control device corrects the second motion data according to relative position information; or the mobile device corrects the second motion data according to relative position information; wherein the relative position information indicates a relative position between the remote control device and the second sensor when the first sensor collects the first motion data.

21. The system of any one of claims 15 to 20, wherein: the remote control device determines whether the remote control device is in a static state according to displacement information of the remote control device relative to the display device; the remote control device sends the position information to the display device when the remote control device is in a non-static state.

22. The system of claim 21, wherein: The remote control device determines that the remote control device is in a non-stationary state when the displacement information is greater than or equal to a preset value; or The remote control device determines that the remote control device is in a stationary state when the displacement information is less than the preset value.

23. An electronic device, comprising: Comprise: A processor and a memory for storing a computer program, the processor is used to call and run the computer program stored in the memory, and execute the method as claimed in any one of claims 1 to 7.

24. A vehicle characterized by comprising: Comprise: A processing device; The processing device collects second motion data of the mobile device through a second sensor, the second motion data is used to determine position information of the remote control device, the position information comprises: displacement information of the remote control device relative to a display device, or coordinate information of a cursor presented by the remote control device in the display device, the display device is relatively stationary with the vehicle; The processing device sends the second motion data to the remote control device.

25. The vehicle of claim 24, wherein Further comprise: The second sensor.

26. The vehicle of claim 24 or 25, characterized in that Further comprise: The display device.

27. A chip, characterized by Comprise: A processor for calling and running computer instructions from a memory, so that the device installed with the chip executes the method as claimed in any one of claims 1 to 7.

28. A computer-readable storage medium, characterized in that, For storing computer program instructions, the computer program makes the computer execute the method as claimed in any one of claims 1 to 7.

29. A computer program product, characterised in that, Comprise computer program instructions, which make the computer execute the method as claimed in any one of claims 1 to 7.

Images