Display control method, electronic device, and system
By acquiring the attitude information of the display screen and remote control, and using the angular velocity and acceleration information in the three axes, the position of the cursor on the display screen is calculated, which solves the problem of inaccurate cursor position caused by changes in the attitude of the remote control and improves the user experience.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- HUAWEI TECH CO LTD
- Filing Date
- 2026-01-20
- Publication Date
- 2026-07-30
AI Technical Summary
While the vehicle is in motion, changes in the remote control's orientation cause the cursor pointing at the remote control to become uncontrollable by the user, affecting the user experience.
By acquiring the attitude information of the display screen and remote control, and using the angular velocity and acceleration information in the three-axis direction, the position of the cursor on the display screen is calculated, the attitude difference is calibrated, and the precise display of the cursor is controlled.
It enables precise control of the cursor while the vehicle is in motion, thus improving the user experience.
Smart Images

Figure CN2026073805_30072026_PF_FP_ABST
Abstract
Description
Display control methods, electronic devices and systems
[0001] This application claims priority to Chinese Patent Application No. 202510127746.7, filed on January 27, 2025, entitled “Display Control Method, Electronic Device and System”, the entire contents of which are incorporated herein by reference. Technical Field
[0002] This application relates to the field of terminal technology, and in particular to a display control method, electronic device and system. Background Technology
[0003] Users can operate the vehicle's display screen by pointing at the remote control. However, when the vehicle is in motion, the remote control will change its orientation as the vehicle turns, goes uphill or downhill, etc., causing the position of the cursor on the display screen to change beyond the user's control, which affects the user experience. Summary of the Invention
[0004] This application provides a display control method, electronic device, and system that improves the accuracy of remote control control of the first identifier on the display screen and enhances the user experience.
[0005] To achieve the above objectives, this application provides the following technical solution:
[0006] In a first aspect, embodiments of this application provide a display control method applied to a first device. The method includes: establishing a communication connection with a second device; acquiring first information and second information, wherein the first information is used to indicate the posture of the first device and the second information is used to indicate the posture of the second device; and controlling the position of a first identifier on a display screen based on the first information and the second information, wherein the first identifier is used to indicate the focus position on the display screen.
[0007] In this way, when the vehicle is in motion, the position of the first identifier can be changed due to changes in the posture of the first device or the second device, which would lead to inaccurate display of the first identifier on the screen. This enables precise control of the first identifier on the screen and improves the user experience.
[0008] In one possible implementation, controlling the position of the first identifier on the display screen based on the first information and the second information includes: determining third information based on the first information and the second information, the third information being used to indicate the difference between the first information and the second information; and controlling the position of the first identifier on the display screen to change when the third information satisfies a first condition.
[0009] Based on a third piece of information derived from the difference between the first and second pieces of information, the position of the first identifier on the display screen is controlled. This third piece of information can be used to indicate the angle information of the first identifier. When the posture of the first identifier meets a first condition, the position of the first identifier on the display screen is changed. In this way, the first device can determine the position of the first identifier by determining its angle information, thereby controlling the first identifier.
[0010] In one possible implementation, the first information is used to indicate one or more of the following: angular velocity information of the first device in the three-axis direction, angular velocity information of the first device in the three-axis direction, acceleration information of the first device in the three-axis direction, azimuth angle of the first device in the horizontal direction and pitch angle in the vertical direction, or the change value of the azimuth angle of the first device in the horizontal direction and the change value of the pitch angle of the first device in the vertical direction.
[0011] Specifically, the acceleration information of the first device in the three-axis directions can be used to calibrate the angular velocity information of the first device in the three-axis directions, improving the accuracy of the angular velocity information of the first device in the three-axis directions. The azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first device can be used to calculate the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first marker. Furthermore, the changes in the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first device are instantaneous data, preventing the accumulation of errors in the azimuth and pitch angles over time, thus improving the accuracy of the obtained azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first marker.
[0012] In one possible implementation, the azimuth angle of the first device in the horizontal direction is determined by the angular velocity information of the first device in the three-axis directions; or, the azimuth angle of the first device in the horizontal direction is determined by the angular velocity information and acceleration information of the first device in the three-axis directions; the pitch angle of the first device in the vertical direction is determined by the angular velocity information of the first device in the three-axis directions; or, the pitch angle of the first device in the vertical direction is determined by the angular velocity information and acceleration information of the first device in the three-axis directions; the change value of the azimuth angle of the first device in the horizontal direction is determined by the azimuth angle of the first device in the horizontal direction; the change value of the pitch angle of the first device in the vertical direction is determined by the pitch angle of the first device in the vertical direction.
[0013] In one possible implementation, the second information is used to indicate one or more of the following: angular velocity information of the second device in the three-axis direction, angular velocity information of the second device in the three-axis direction, acceleration information of the second device in the three-axis direction, azimuth angle of the second device in the horizontal direction and pitch angle in the vertical direction, or the change value of the azimuth angle of the second device in the horizontal direction and the change value of the pitch angle of the second device in the vertical direction.
[0014] Specifically, the acceleration information of the second device in the three-axis directions can be used to calibrate the angular velocity information of the second device in the three-axis directions, improving the accuracy of the angular velocity information of the second device in the three-axis directions. The azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the second device can be used to calculate the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first marker. Furthermore, the changes in the azimuth angle in the horizontal direction and the changes in the pitch angle in the vertical direction of the second device are instantaneous data, preventing the accumulation of errors in the azimuth and pitch angles of the second device over time, thus improving the accuracy of the obtained azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first marker.
[0015] In one possible implementation, the azimuth angle of the second device in the horizontal direction is determined by the angular velocity information of the second device in the three-axis directions; or, the azimuth angle of the second device in the horizontal direction is determined by the angular velocity information and acceleration information of the second device in the three-axis directions; the pitch angle of the second device in the vertical direction is determined by the angular velocity information of the first device in the three-axis directions; or, the pitch angle of the second device in the vertical direction is determined by the angular velocity information and acceleration information of the second device in the three-axis directions; the change value of the azimuth angle of the second device in the horizontal direction is determined by the azimuth angle of the second device in the horizontal direction; the change value of the pitch angle of the second device in the vertical direction is determined by the pitch angle of the second device in the vertical direction.
[0016] In one possible implementation, the third information is used to indicate the difference between the azimuth angle of the first device in the horizontal direction and the azimuth angle of the second device in the horizontal direction, and the difference between the pitch angle of the first device in the vertical direction and the pitch angle of the second device in the vertical direction; or, the third information is used to indicate the cumulative amount of the difference between the change value of the azimuth angle of the first device in the horizontal direction and the change value of the azimuth angle of the second device in the horizontal direction, and the cumulative amount of the difference between the change value of the pitch angle of the first device in the vertical direction and the change value of the pitch angle of the second device in the vertical direction.
[0017] Thus, the location information of the first identifier can be determined subsequently using the third information. Specifically, the changes in the horizontal azimuth and vertical pitch angles of the first device are instantaneous data. The location information of the first identifier is determined based on the cumulative difference between the changes in the horizontal azimuth and horizontal azimuth of the first device and the second device, as well as the cumulative difference between the changes in the vertical pitch angles of the first device and the second device. This prevents errors in the azimuth and pitch angles of the first device from accumulating over time, improving the accuracy of the obtained location information of the first identifier.
[0018] In one possible implementation, when the third information satisfies the first condition, controlling the position of the first identifier on the display screen to change includes: controlling the position of the first identifier on the display screen to change when the difference between the azimuth angle of the first device in the horizontal direction and the azimuth angle of the second device in the horizontal direction is greater than a first threshold, and / or the difference between the pitch angle of the first device in the vertical direction and the pitch angle of the second device in the vertical direction is greater than a second threshold; or controlling the position of the first identifier on the display screen to change when the difference between the change value of the azimuth angle of the first device in the horizontal direction and the change value of the azimuth angle of the second device in the horizontal direction is greater than a third threshold, and / or the difference between the change value of the pitch angle of the first device in the vertical direction and the change value of the pitch angle of the second device in the vertical direction is greater than a fourth threshold.
[0019] In this way, the first marker can be prevented from moving frequently when the posture changes of the first and second devices are small, thus improving the stability of the first marker.
[0020] In one possible implementation, controlling the position of the first identifier on the display screen based on the first information and the second information further includes: acquiring fourth information; the fourth information is used to indicate the angle information between the second device and the first device, and / or the distance information between the second device and the first device; and controlling the position of the first identifier on the display screen based on the first information, the second information, and the fourth information.
[0021] Thus, the position of the first identifier on the display screen can be determined based on the first information, the second information, and the fourth information, thereby controlling the display screen to display the first identifier.
[0022] In one possible implementation, when the third information satisfies the first condition, controlling the position of the first identifier on the display screen to change includes: calibrating the third information using angle information between the second device and the first device; and controlling the position of the first identifier on the display screen to change when the calibrated third information satisfies the first condition.
[0023] In this way, the accuracy of the third information can be improved, thereby improving the accuracy of the location information of the first identifier.
[0024] In one possible implementation, the posture of the first device is used to reflect the posture of the display screen.
[0025] For example, the first device may be a dongle device, the first device may be installed inside the display screen, or the first device may be installed in other locations in the vehicle.
[0026] In one possible implementation, obtaining the first information includes: obtaining first information from the first device from the first attitude detection module; the first device includes the first attitude detection module, or the first device communicates with the first attitude detection module.
[0027] For example, the first attitude detection module can be a first IMU module, which can be located in the first device, or it can be located outside the first device, such as the IMU module of a vehicle. In this way, the method of the embodiments of this application can be implemented without adding a new IMU module, saving resources.
[0028] In one possible implementation, obtaining the second information includes: obtaining second information from the second device from the second attitude detection module; the second device includes the second attitude detection module.
[0029] In one possible implementation, the posture of the second device is used to reflect the posture of the display screen.
[0030] For example, the second device can be a dongle device, which can be installed inside the display screen or in other locations within the vehicle. The first device can be a remote control device, which can acquire the first information, the second information, and the fourth information, calculate the location information of the first identifier, and send the location information of the first identifier to the second device. The second device then sends the location information of the first identifier to the display screen to display the first identifier. The location information of the first identifier can be obtained from either the dongle device or the remote control device, thus improving the reliability of obtaining the location information of the first identifier.
[0031] In one possible implementation, the second information includes: obtaining second information from the second device from the second attitude detection module; the second device includes the second attitude detection module, or the second device communicates with the second attitude detection module.
[0032] In one possible implementation, establishing a communication connection with the second device includes: the first device establishing a communication connection with the second device through one or more of the following modules: Bluetooth Low Energy module, Starlight Low Energy module, or Wireless Fidelity module.
[0033] This increases the flexibility of establishing communication connections between the first and second devices.
[0034] Secondly, embodiments of this application provide a display control method, the method comprising: establishing a communication connection between a first device and a second device; the second device sending second information to the first device, the second information being used to indicate the posture of the second device; the first device acquiring first information from the first device and second information from the second device, the first information being used to indicate the posture of the first device; and the first device controlling the position of a first identifier on a display screen according to the first information and the second information, the first identifier being used to indicate the focus position on the display screen.
[0035] In one possible implementation, controlling the position of the first identifier on the display screen based on the first information and the second information includes: determining third information based on the first information and the second information, the third information being used to indicate the difference between the first information and the second information; and controlling the position of the first identifier on the display screen to change when the third information satisfies a first condition.
[0036] In one possible implementation, the first information is used to indicate one or more of the following: angular velocity information of the first device in the three-axis direction, angular velocity information of the first device in the three-axis direction, acceleration information of the first device in the three-axis direction, azimuth angle of the first device in the horizontal direction and pitch angle in the vertical direction, or the change value of the azimuth angle of the first device in the horizontal direction and the change value of the pitch angle of the first device in the vertical direction.
[0037] In one possible implementation, the azimuth angle of the first device in the horizontal direction is determined by the angular velocity information of the first device in the three-axis directions; or, the azimuth angle of the first device in the horizontal direction is determined by the angular velocity information and acceleration information of the first device in the three-axis directions; the pitch angle of the first device in the vertical direction is determined by the angular velocity information of the first device in the three-axis directions; or, the pitch angle of the first device in the vertical direction is determined by the angular velocity information and acceleration information of the first device in the three-axis directions; the change value of the azimuth angle of the first device in the horizontal direction is determined by the azimuth angle of the first device in the horizontal direction; the change value of the pitch angle of the first device in the vertical direction is determined by the pitch angle of the first device in the vertical direction.
[0038] In one possible implementation, the second information is used to indicate one or more of the following: angular velocity information of the second device in the three-axis direction, angular velocity information of the second device in the three-axis direction, acceleration information of the second device in the three-axis direction, azimuth angle of the second device in the horizontal direction and pitch angle in the vertical direction, or the change value of the azimuth angle of the second device in the horizontal direction and the change value of the pitch angle of the second device in the vertical direction.
[0039] In one possible implementation, the azimuth angle of the second device in the horizontal direction is determined by the angular velocity information of the second device in the three-axis directions; or, the azimuth angle of the second device in the horizontal direction is determined by the angular velocity information and acceleration information of the second device in the three-axis directions; the pitch angle of the second device in the vertical direction is determined by the angular velocity information of the first device in the three-axis directions; or, the pitch angle of the second device in the vertical direction is determined by the angular velocity information and acceleration information of the second device in the three-axis directions; the change value of the azimuth angle of the second device in the horizontal direction is determined by the azimuth angle of the second device in the horizontal direction; the change value of the pitch angle of the second device in the vertical direction is determined by the pitch angle of the second device in the vertical direction.
[0040] In one possible implementation, the third information is used to indicate the difference between the azimuth angle of the first device in the horizontal direction and the azimuth angle of the second device in the horizontal direction, and the difference between the pitch angle of the first device in the vertical direction and the pitch angle of the second device in the vertical direction; or, the third information is used to indicate the cumulative amount of the difference between the change value of the azimuth angle of the first device in the horizontal direction and the change value of the azimuth angle of the second device in the horizontal direction, and the cumulative amount of the difference between the change value of the pitch angle of the first device in the vertical direction and the change value of the pitch angle of the second device in the vertical direction.
[0041] In one possible implementation, when the third information satisfies the first condition, controlling the position of the first identifier on the display screen to change includes: controlling the position of the first identifier on the display screen to change when the difference between the azimuth angle of the first device in the horizontal direction and the azimuth angle of the second device in the horizontal direction is greater than a first threshold, and / or the difference between the pitch angle of the first device in the vertical direction and the pitch angle of the second device in the vertical direction is greater than a second threshold; or controlling the position of the first identifier on the display screen to change when the difference between the change value of the azimuth angle of the first device in the horizontal direction and the change value of the azimuth angle of the second device in the horizontal direction is greater than a third threshold, and / or the difference between the change value of the pitch angle of the first device in the vertical direction and the change value of the pitch angle of the second device in the vertical direction is greater than a fourth threshold.
[0042] In one possible implementation, the first device controls the position of the first identifier on the display screen based on the first information and the second information, and further includes: the first device acquiring fourth information; the fourth information is used to indicate the angle information between the second device and the first device, and / or the distance information between the second device and the first device; the first device controls the position of the first identifier on the display screen based on the first information, the second information and the fourth information.
[0043] In one possible implementation, when the third information satisfies the first condition, controlling the position of the first identifier on the display screen to change includes: calibrating the third information using angle information between the second device and the first device; and controlling the position of the first identifier on the display screen to change when the calibrated third information satisfies the first condition.
[0044] In one possible implementation, the posture of the first device is used to reflect the posture of the display screen.
[0045] In one possible implementation, the first device acquiring first information includes: the first device acquiring first information from the first attitude detection module; the first device includes the first attitude detection module, or the first device communicates with the first attitude detection module.
[0046] In one possible implementation, the posture of the second device is used to reflect the posture of the display screen.
[0047] In one possible implementation, the second device acquires the second information by: the second device acquiring the second information from the second attitude detection module; the second device including the second attitude detection module, or the second device communicating with the second attitude detection module.
[0048] In one possible implementation, the first device establishes a communication connection with the second device by means of one or more of the following modules: a Bluetooth Low Energy module, a Starlight Low Energy module, or a Wireless Fidelity module.
[0049] Thirdly, embodiments of this application provide a display control system, including: a first device and a second device, the first device including a first posture detection module, and the second device including a second posture detection module; the first device is used to establish a communication connection with the second device; the second device is used to send second information to the first device, the second information being used to indicate the posture of the second device; the second information is obtained through the second posture detection module; the first device is used to obtain first information from the first device and second information from the second device, the first information being used to indicate the posture of the first device; the first information is obtained through the first posture detection module; the first device is used to control the position of a first identifier on the display screen according to the first information and the second information.
[0050] In one possible implementation, a first device is configured to determine third information based on first information and second information, the third information being used to indicate the difference between the first information and the second information; and, if the third information satisfies a first condition, to control the position of the first identifier on the display screen to change.
[0051] In one possible implementation, the first information is used to indicate one or more of the following: angular velocity information of the first device in the three-axis direction, angular velocity information of the first device in the three-axis direction, acceleration information of the first device in the three-axis direction, azimuth angle of the first device in the horizontal direction and pitch angle in the vertical direction, or the change value of the azimuth angle of the first device in the horizontal direction and the change value of the pitch angle of the first device in the vertical direction.
[0052] In one possible implementation, the azimuth angle of the first device in the horizontal direction is determined by the angular velocity information of the first device in the three-axis directions; or, the azimuth angle of the first device in the horizontal direction is determined by the angular velocity information and acceleration information of the first device in the three-axis directions; the pitch angle of the first device in the vertical direction is determined by the angular velocity information of the first device in the three-axis directions; or, the pitch angle of the first device in the vertical direction is determined by the angular velocity information and acceleration information of the first device in the three-axis directions; the change value of the azimuth angle of the first device in the horizontal direction is determined by the azimuth angle of the first device in the horizontal direction; the change value of the pitch angle of the first device in the vertical direction is determined by the pitch angle of the first device in the vertical direction.
[0053] In one possible implementation, the second information is used to indicate one or more of the following: angular velocity information of the second device in the three-axis direction, angular velocity information of the second device in the three-axis direction, acceleration information of the second device in the three-axis direction, azimuth angle of the second device in the horizontal direction and pitch angle in the vertical direction, or the change value of the azimuth angle of the second device in the horizontal direction and the change value of the pitch angle of the second device in the vertical direction.
[0054] In one possible implementation, the azimuth angle of the second device in the horizontal direction is determined by the angular velocity information of the second device in the three-axis directions; or, the azimuth angle of the second device in the horizontal direction is determined by the angular velocity information and acceleration information of the second device in the three-axis directions; the pitch angle of the second device in the vertical direction is determined by the angular velocity information of the first device in the three-axis directions; or, the pitch angle of the second device in the vertical direction is determined by the angular velocity information and acceleration information of the second device in the three-axis directions; the change value of the azimuth angle of the second device in the horizontal direction is determined by the azimuth angle of the second device in the horizontal direction; the change value of the pitch angle of the second device in the vertical direction is determined by the pitch angle of the second device in the vertical direction.
[0055] In one possible implementation, the third information is used to indicate the difference between the azimuth angle of the first device in the horizontal direction and the azimuth angle of the second device in the horizontal direction, and the difference between the pitch angle of the first device in the vertical direction and the pitch angle of the second device in the vertical direction; or, the third information is used to indicate the cumulative amount of the difference between the change value of the azimuth angle of the first device in the horizontal direction and the change value of the azimuth angle of the second device in the horizontal direction, and the cumulative amount of the difference between the change value of the pitch angle of the first device in the vertical direction and the change value of the pitch angle of the second device in the vertical direction.
[0056] In one possible implementation, the first device controls the position of the first identifier on the display screen to change when the difference between the azimuth angle of the first device in the horizontal direction and the azimuth angle of the second device in the horizontal direction is greater than a first threshold, and / or the difference between the pitch angle of the first device in the vertical direction and the pitch angle of the second device in the vertical direction is greater than a second threshold; or, the first device controls the position of the first identifier on the display screen to change when the difference between the change in the azimuth angle of the first device in the horizontal direction and the change in the azimuth angle of the second device in the horizontal direction is greater than a third threshold, and / or the difference between the change in the pitch angle of the first device in the vertical direction and the change in the pitch angle of the second device in the vertical direction is greater than a fourth threshold.
[0057] In one possible implementation, a first device is used to acquire fourth information; the fourth information is used to indicate the angle information between the second device and the first device, and / or the distance information between the second device and the first device; a processing module is used to control the position of the first identifier on the display screen according to the first information, the second information and the fourth information.
[0058] In one possible implementation, the first device is used to calibrate the third information using the angle information between the second device and the first device; and when the calibrated third information meets the first condition, the position of the first identifier on the display screen is controlled to change.
[0059] In one possible implementation, the posture of the first device is used to reflect the posture of the display screen.
[0060] In one possible implementation, a first device is used to obtain first information from a first attitude detection module; the first device includes the first attitude detection module, or the first device communicates with the first attitude detection module.
[0061] In one possible implementation, the posture of the second device is used to reflect the posture of the display screen.
[0062] In one possible implementation, a second device is used to obtain second information from the second attitude detection module; the second device includes the second attitude detection module, or the second device communicates with the second attitude detection module.
[0063] In one possible implementation, the first device is used to establish a communication connection with the second device through one or more of the following modules: Bluetooth Low Energy module, Starlight Low Energy module, or Wireless Fidelity module.
[0064] Fourthly, this application provides an electronic device including at least one processor and a memory, the memory being used to store computer-readable instructions, wherein when at least one processor reads the computer-readable instructions from the memory, the electronic device causes the electronic device to perform the method as described in the first aspect.
[0065] Fifthly, this application provides a computer-readable storage medium including a computer program that, when executed by a processor, performs the method of the first aspect or any one of the embodiments of the first aspect.
[0066] In a sixth aspect, this application provides a computer program product, which includes a computer program that, when executed by a processor, performs the method of the first aspect or any one of the embodiments of the first aspect.
[0067] In a seventh aspect, this application provides a chip system comprising: a processor, the processor being configured to retrieve and execute a computer program stored in a memory to perform the method of the first aspect or any embodiment of the first aspect.
[0068] The technical effects corresponding to aspects two through seven, and any one of their implementations, can be found in the first aspect and any one of its implementations, and will not be repeated here. Attached Figure Description
[0069] Figure 1 is a schematic diagram of a ranging principle provided in an embodiment of this application;
[0070] Figure 2 is a schematic diagram of an angle measurement principle provided in an embodiment of this application;
[0071] Figure 3 is a schematic diagram of a cursor display interface provided in an embodiment of this application;
[0072] Figure 4 is a schematic diagram of another cursor display interface provided in an embodiment of this application;
[0073] Figure 5 is a schematic diagram of the location of a first device provided in an embodiment of this application;
[0074] Figure 6 is a schematic diagram of a display control system provided in an embodiment of this application;
[0075] Figure 7 is a flowchart of a display control method provided in an embodiment of this application;
[0076] Figure 8 is a flowchart of another display control method provided in an embodiment of this application;
[0077] Figure 9 is a schematic diagram of antenna distribution in a device provided in an embodiment of this application;
[0078] Figure 10 is a schematic diagram of signal transmission between device antennas provided in an embodiment of this application;
[0079] Figure 11 is a schematic diagram of a coordinate system provided in an embodiment of this application;
[0080] Figure 12 is a schematic diagram of angle information between a first device and a second device provided in an embodiment of this application;
[0081] Figure 13 is a schematic diagram of the angle information of a first identifier provided in an embodiment of this application;
[0082] Figure 14 is a schematic diagram of a first identifier change provided in an embodiment of this application;
[0083] Figure 15 is a flowchart of another display control method provided in an embodiment of this application;
[0084] Figure 16 is a schematic diagram of the structure of an electronic device provided in an embodiment of this application;
[0085] Figure 17 is a schematic diagram of the structure of a chip system provided in an embodiment of this application. Detailed Implementation
[0086] In the embodiments of this application, the terms "exemplary" or "for example" are used to indicate that something is an example, illustration, or description. Any embodiment or design that is described as "exemplary" or "for example" in the embodiments of this application should not be construed as being more preferred or advantageous than other embodiments or design. Specifically, the use of the terms "exemplary" or "for example" is intended to present the relevant concepts in a specific manner.
[0087] In the embodiments of this application, the terms "first" and "second" are used for descriptive purposes only and should not be construed as indicating or implying relative importance or implicitly specifying the number of indicated technical features. Thus, a feature defined as "first" or "second" may explicitly or implicitly include one or more of that feature. In the description of this application, unless otherwise stated, "a plurality of" means two or more.
[0088] In this application, the term "at least one" means one or more, and the term "multiple" means two or more. For example, multiple second messages refer to two or more second messages. The terms "system" and "network" are often used interchangeably in this document.
[0089] It should be understood that the terminology used in the descriptions of the various examples in this document is for the purpose of describing the specific examples only and is not intended to be limiting.
[0090] It should also be understood that the term "and / or" as used herein refers to and covers any and all possible combinations of one or more of the associated listed items. The term "and / or" describes an association between related objects, indicating that three relationships can exist; for example, A and / or B can represent: A alone, A and B simultaneously, or B alone. Additionally, the character " / " in this application generally indicates that the preceding and following related objects are in an "or" relationship.
[0091] It should also be understood that, in the various embodiments of this application, the sequence number of each process does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute any limitation on the implementation process of the embodiments of this application.
[0092] It should be understood that the phrases "an embodiment," "an embodiment," and "a possible implementation" used throughout the specification mean that a specific feature, structure, or characteristic related to an embodiment or implementation is included in at least one embodiment of this application. Therefore, the phrases "in an embodiment," "an embodiment," or "a possible implementation" appearing throughout the specification do not necessarily refer to the same embodiment. Furthermore, these specific features, structures, or characteristics can be combined in any suitable manner in one or more embodiments.
[0093] First, some technical terms involved in the embodiments of this application will be introduced:
[0094] 1. Double-sided two-way ranging (DS-TWR)
[0095] DS-TWR is a technique for measuring the distance between two devices and can be used in wireless communication systems. This method calculates the distance between the devices by exchanging signals between them.
[0096] Figure 1 shows the ranging principle diagram of the DS-TWR method. Device A can send signal 1 to device B and record the time t1 when signal 1 is sent; device B receives signal 1 and records the time t2 when signal 1 is received. Device B sends signal 2 to device A and records the time t3 when signal 2 is sent; device A receives signal 2 and records the time t4 when signal 2 is received. Device A sends signal 3 to device B and records the time t5 when signal 3 is sent; device B receives signal 3 and records the time t6 when signal 3 is received. The time difference between device A sending signal 1 and receiving signal 2 is T1, the time difference between device B receiving signal 1 and sending signal 2 is T2, the time difference between device A receiving signal 2 and sending signal 3 is T3, and the time difference between device B sending signal 2 and receiving signal 3 is T4.
[0097] Device A can calculate the distance r between device A and device B, satisfying the following formula (1).
[0098] Among them, T prop Let r be the total time for the transmission of the three signals, and also the distance r between device A and device B.
[0099] 2. Angle of arrival (AOA)
[0100] AOA is used to indicate the angle of incidence of a signal from the transmitting device to the receiving device. The angle information between devices can be calculated using multiple antennas.
[0101] For example, Figure 2 shows the angle measurement principle diagram of the AOA method. Device A includes antenna 1, and device B includes antenna 2 and antenna 3. Antennas 2 and 3 of device B receive signals from antenna 1 and determine the phase difference between the arrival phase of the signal from antenna 2 and the arrival phase of the signal from antenna 3. The distance corresponding to the signal arrival phase difference between antenna 2 and antenna 3 is d*sin(θ) as shown in Figure 2, and the angle θ satisfies the following formula (2):
[0102] Where d is the distance between antenna 2 and antenna 3, c is the speed of light, and f carrier This is the carrier frequency of the Bluetooth signal.
[0103] With the development of Internet of Things (IoT) technology, pointing remote control technology has also been applied to areas such as television control. Users can more conveniently control their televisions by pointing at the remote control.
[0104] As shown in Figure 3, the TV can display a cursor pointing to the remote control. When the cursor moves to point at the remote control, it also moves accordingly, allowing the user to select menus on the TV and control the TV.
[0105] In some examples, the remote control can be equipped with an ultra-wideband (UWB) and an inertial measurement unit (IMU) to achieve precise control of the cursor on the TV screen through the UWB module and the IMU module.
[0106] In some examples, pointing remote control technology can be applied not only to televisions but also to other display interaction applications. For instance, it can be used in in-vehicle displays to expand the ways users can interact with them.
[0107] However, in a vehicle-mounted scenario, the vehicle is in motion while driving, and the movement of the vehicle may also cause the pointer to move. It is impossible to determine whether the data obtained by the IMU module in the remote control corresponds to the movement of the pointer to the remote control or the movement of the vehicle. The position of the pointer to the remote control on the vehicle display screen may change with the posture of the vehicle display screen, affecting the user experience.
[0108] To address the aforementioned issues, this application proposes a display control method. The display screen can acquire its own posture information and that of the remote control, and determine the cursor's position on the display screen based on these information. This avoids cursor position changes caused by variations in the display screen's posture when the vehicle is in motion, thus preventing inaccurate cursor placement and enabling precise control of the cursor on the display screen, thereby improving the user experience.
[0109] In some examples, the display control method in this application embodiment can also be applied to other systems consisting of a display screen in motion and a remote control. For example, the display screen in motion can be located in cars, trucks, motorcycles, buses, ships, airplanes, helicopters, lawnmowers, recreational vehicles, amusement park vehicles, construction equipment, trams, golf carts, trains, etc., and this application embodiment does not impose any particular limitation.
[0110] In some examples, Figure 4 is a schematic diagram of a display control scenario provided by an embodiment of this application, including a display screen 401 in a vehicle and a remote control 402. The display screen 401 is used to display a first identifier 403.
[0111] When the remote control 402 moves, the first identifier 403 in the display screen 401 also moves, so that the user can select the menu on the display screen 401 and operate the display screen 401.
[0112] In some examples, the vehicle may include a first device, the posture of which can be used to reflect the posture of the display screen. For example, the first device may be a dongle device, and the second device may be a remote control device.
[0113] In one scenario, the first device can be installed in the display screen.
[0114] For example, as shown in Figure 5(a), which is a right view of the display screen, it includes a display screen 501 and a first device 502. The first device 502 can be installed in the display screen 501, and the posture of the first device can reflect the posture of the vehicle display screen. The first device 502 can be installed at the bottom of the display screen 501; or, the first device 502 can be installed in the middle of the display screen 501; or, the first device 502 can be installed at the top of the display screen 501; or, the first device 502 can be installed in other positions on the display screen 501. This embodiment does not impose specific limitations on these locations.
[0115] In another scenario, the first device is installed at any location in the vehicle and can communicate with the display screen.
[0116] For example, as shown in Figure 5(b), which is a top view of a vehicle, it includes a vehicle 503, a display screen 504, and a first device 505. The first device can be a detachable device, which can be installed by the user at any position on the vehicle 503. The orientation of the first device 505 changes with the orientation of the vehicle 503, and the orientation of the display screen 504 also changes with the orientation of the vehicle 503. Therefore, the orientation of the first device 505 can also reflect the orientation of the display screen 504.
[0117] The first device 505 can communicate with the display screen 504. Subsequently, the first device 505 can send the location information of the first identifier to the display screen 504, and the display screen 504 can display the first identifier according to the location information of the first identifier.
[0118] In some examples, the vehicle may also include a second device, the posture of which can be used to reflect the posture of the display screen. For example, the second device may be a dongle device, may be installed in the display screen, or may be installed anywhere in the vehicle; the second device may communicate with the display screen. The first device is a remote control device. This application does not impose specific limitations in this regard.
[0119] Figure 6 is a schematic diagram of a display control system provided in an embodiment of this application. The system includes a first device 601, a second device 602, and a display screen 603. The first device 601 includes a first attitude detection module 6011, a first measurement module 6012, and a first communication module 6013.
[0120] The first attitude detection module 6011 is used to acquire first information indicating the attitude of the first device. For example, the first attitude detection module 6011 can be a first IMU module.
[0121] The first measurement module 6012 is used to obtain angle information between the first device 601 and the second device 602 and / or the first measurement module 6012 is used to obtain distance information between the first device 601 and the second device 602.
[0122] For example, the first measurement module 6012 can be a first UWB module, or the first measurement module 6012 can also be a first synchronous link low positioning (SLP) module.
[0123] In some examples, the first measurement module 6012 may also include a first processing module (not shown) for determining the position of the first identifier on the display screen 603 based on first information indicating the posture of the first device and second information indicating the posture of the second device.
[0124] For example, the first processing module may be a first microcontroller unit (MCU) module.
[0125] The first communication module 6013 is used to complete the communication between the first device 601 and the second device 602.
[0126] For example, the first communication module 6013 may be a first Bluetooth Low Energy (BLE) module, a first Synchronous Link Low Energy (SLE) module, or a first Wireless Fidelity (WIFI) module.
[0127] In some examples, the first communication module 6013 may also include a first processing module (not shown) for determining the position of the first identifier on the display screen 603 based on first information indicating the posture of the first device and second information indicating the posture of the second device.
[0128] For example, the first processing module can be a first MCU module.
[0129] The second device 602 includes a second attitude detection module 6021, a second measurement module 6022, and a second communication module 6023.
[0130] The second attitude detection module 6021 is used to acquire second information indicating the attitude of the second device. For example, the second attitude detection module 6021 can be a second IMU module.
[0131] The second measurement module 6022 is used to acquire angle measurement information between the first device 601 and the second device 602; and / or the second measurement module 6022 is used to acquire distance information between the first device 601 and the second device 602.
[0132] For example, the second measurement module 6022 can be a second UWB module, or the second measurement module 6022 can also be a second SLP module.
[0133] In some examples, the second measurement module 6022 may also include a second processing module (not shown) for determining the position of the first identifier on the display screen 603 based on first information indicating the posture of the first device and second information indicating the posture of the second device.
[0134] For example, the second processing module can be a second MCU module.
[0135] The second communication module 6023 is used to complete the communication between the first device 601 and the second device 602.
[0136] For example, the second communication module 6023 can be a second BLE module, a second SLE module, or a second WIFI module.
[0137] In some examples, the second communication module 6023 may also include a second processing module (not shown) for determining the position of the first identifier on the display screen 603 based on first information indicating the posture of the first device and second information indicating the posture of the second device.
[0138] For example, the second processing module can be a second MCU module.
[0139] In some examples, when the first measurement module 6012 of the first device is a first UWB module, the second measurement module 6022 of the second device is a second UWB module, the first communication module 6013 of the first device can be a first BLE module, and the second communication module 6023 of the second device can be a second BLE module. Alternatively, the first communication module 6013 of the first device can be a first WIFI module, and the second communication module 6023 of the second device can be a second WIFI module.
[0140] For example, the first device includes a first IMU module, a first UWB module, and a first BLE module; the second device includes a second IMU module, a second UWB module, and a second BLE module. Alternatively, the first device includes a first IMU module, a first UWB module, and a first WIFI module; the second device includes a second IMU module, a second UWB module, and a second WIFI module.
[0141] When the first measurement module 6012 of the first device is the first SLP module, the second measurement module 6022 of the second device is the second SLP module, the first communication module 6013 of the first device can be the first SLE module, and the second communication module 6023 of the second device can be the second SLE module.
[0142] For example, the first device includes a first IMU module, a first SLP module, and a first SLE module; the second device includes a second IMU module, a second SLP module, and a second SLE module.
[0143] Display screen 603 includes display module 6031 for displaying a first identifier. In some examples, display screen 603 can communicate with a first device 601 via a universal serial bus (USB). Alternatively, display screen 603 can communicate with a second device 602 via a universal serial bus (USB).
[0144] This application uses a display screen 603 in a vehicle as an example for illustration.
[0145] In some examples, where the posture of the first device can be used to reflect the posture of the display screen, the first posture detection module 6011 may also be located outside the first device.
[0146] For example, the first attitude detection module 6011 can be an IMU module in a vehicle, and the first device can obtain first information from the IMU module in the vehicle. This application embodiment does not impose specific limitations in this regard.
[0147] In some examples, where the posture of the second device can be used to reflect the posture of the display screen, the second posture detection module 6021 may also be located outside the second device.
[0148] For example, the second attitude detection module 6021 can be an IMU module in a vehicle, and the second device can obtain second information from the IMU module in the vehicle. This application embodiment does not impose specific limitations in this regard.
[0149] The structure of the display control system and the functions of each component have been described above. As shown in Figure 7, a flowchart of a display control method provided in this application embodiment is one example.
[0150] It should be noted that this method is not limited to the specific order shown in Figure 7 and below. It should be understood that in other embodiments, the order of some steps in this method can be interchanged according to actual needs, or some steps can be omitted or deleted. The method includes the following steps:
[0151] S701, The first device establishes a communication connection with the second device.
[0152] In some examples, the first device can discover the second device and establish a communication connection with it.
[0153] S702, The first device acquires the first information and the second information.
[0154] The first information is used to indicate the attitude of the first device, and the second information is used to indicate the attitude of the second device.
[0155] In some examples, the first device acquires first information through modules such as sensors. The second device acquires second information through modules such as sensors and sends the second information to the first device. Correspondingly, the first device can receive the second information from the second device to obtain the second information.
[0156] S703. The first device controls the position of the first identifier on the display screen based on the first information and the second information.
[0157] The first identifier is used to indicate the focus position on the display screen.
[0158] In some examples, the first identifier may be displaying a cursor at the focus position, or the first identifier may be highlighting the border of the focus position, changing the background color, blinking, changing the size, etc. The embodiments of this application do not impose specific limitations on this.
[0159] In this way, by controlling the posture of the first device and the posture of the second device, the position of the first icon on the display screen can be controlled. When the first device and the second device are in motion, the inaccurate position of the first icon on the display screen can be avoided, thus achieving precise control of the position of the first icon on the display screen and improving the user experience.
[0160] In other examples, the orientation of the second device can also be used to reflect the orientation of the display screen. For example, the second device can be a dongle device, and the first device can be a remote control device. This application does not specifically limit the devices indicated by the first and second devices.
[0161] In some examples, in S601 above, the communication connection established between the first device and the second device can be a wired connection, such as an Ethernet connection or a serial communication connection. Alternatively, the communication connection established between the first device and the second device can also be a wireless connection, such as a Bluetooth connection, a Wi-Fi connection, or a wireless fidelity connection. This application embodiment does not impose specific limitations on this.
[0162] For example, as shown in Figure 8, this embodiment of the application describes a method where a first device is installed in a display screen to reflect the orientation of the display screen, a second device is a remote control device, and a Bluetooth connection is established between the first device and the second device. The display control method may include the following steps:
[0163] S801, The first device establishes a communication connection with the second device.
[0164] In some examples, the first device includes a first BLE module, and the second device includes a second BLE module. The first device can establish a communication connection with the second BLE module in the second device through the first BLE module so as to transmit data subsequently.
[0165] In some examples, after the first device and the second device establish a communication connection, they can negotiate control parameters and / or measurement parameters to be transmitted through the first BLE module and the second BLE module. The control parameters may include parameters such as the frame format used by the first and second UWB modules and / or the resolution of the display screen. The measurement parameters may include parameters such as the phase calibration matrix for UWB angle measurement and / or the antenna delay for UWB angle measurement. It should be understood that the above are merely examples of data negotiated between the first and second devices; they can also negotiate other data, and this application embodiment does not impose specific limitations on this.
[0166] S802, the first UWB module of the first device obtains the fourth information.
[0167] In some examples, the fourth information is used to indicate the angle information between the second device and the first device, as well as the distance information between the second device and the first device.
[0168] In some examples, the first and second devices can use a UWB module to measure the distance between them using a two-way ranging method. This two-way ranging method includes single-sided two-way ranging (SS-TWR) and double-sided two-way ranging (DS-TWR). This application embodiment uses the DS-TWR method to obtain the distance information between the first and second devices as an example.
[0169] In some examples, as shown in Figure 9, the first device may include antenna 0, and the second device may include antenna 0, antenna 1, and antenna 2. Alternatively, the first device may include antenna 0, antenna 1, and antenna 2, and the second device may include antenna 0. Alternatively, the first device may include antenna 0, antenna 1, and antenna 2, and the second device may include antenna 0, antenna 1, and antenna 2. Alternatively, the first and second devices may include more or fewer antennas, and this application embodiment does not impose specific limitations in this regard.
[0170] This application provides an example where the first device may include antenna 0, and the second device may include antenna 0, antenna 1, and antenna 2.
[0171] In some examples, the first UWB module can determine the distance between the antennas of the two devices based on an antenna in the first device and an antenna in the second device, as the distance d between the first device and the second device.
[0172] For example, taking the antenna 0 of the first device and the antenna 0 of the second device as examples, the first UWB module can determine the distance between the antenna 0 of the first device and the antenna 0 of the second device according to the DS-TWR method using the antenna 0 of the first device and the antenna 0 of the second device, and take the distance between the antenna 0 of the first device and the antenna 0 of the second device as the distance d between the first device and the second device.
[0173] In other examples, where both the first device and the second device can have multiple antennas, the precise distance between the first device and the second device can be calculated using multiple antennas. This application does not impose specific limitations on this aspect.
[0174] In some examples, the first UWB module can also calculate the horizontal angle e and the vertical angle f between the first device and the second device using the AOA method through antenna 0 of the first device, antenna 0, antenna 1, and antenna 2 of the second device. As shown in Figure 10(a), the first UWB module can calculate the horizontal angle e between antenna 0 of the first device and antenna 0 of the second device using antenna 0 of the first device, antenna 0 of the second device, and antenna 2. This angle e is the horizontal angle between the first device and the second device. As shown in Figure 10(b), the first UWB module can calculate the vertical angle f between antenna 0 of the first device and antenna 0 of the second device using antenna 0 of the first device, antenna 0 of the second device, and antenna 1. This angle f is the vertical angle between the first device and the second device.
[0175] Alternatively, the first UWB module can also obtain the angle information between the second device and the first device in the horizontal direction, as well as the angle information between the second device and the first device in the vertical direction, through other means. This application embodiment does not impose specific limitations on this.
[0176] Thus, the first UWB module of the first device can obtain the distance d between the second device and the first device, the horizontal angle information e between the second device and the first device, and the vertical angle information f between the second device and the first device.
[0177] In some examples, the second UWB module of the second device can obtain the fourth information through the above method, and this application embodiment does not impose specific limitations on this.
[0178] Subsequently, the first UWB module can calculate the location information of the first identifier using the fourth information.
[0179] S803, The first device obtains the first information through the first IMU module.
[0180] In some examples, the first device includes a first IMU module, through which the first device can obtain first information for indicating the attitude of the first device.
[0181] In some examples, the first IMU module may include a gyroscope sensor. The IMU module can obtain the angular velocity information of the first device in the three-axis direction through the gyroscope sensor, thus determining that the first information is the angular velocity information of the first device in the three-axis direction.
[0182] Alternatively, the first IMU module may include a gyroscope sensor and an accelerometer sensor. The IMU module acquires the angular velocity information of the first device in the three-axis directions through the gyroscope sensor and the acceleration information of the first device in the three-axis directions through the accelerometer sensor. In this way, the first information can be determined to be the angular velocity information and the acceleration information of the first device in the three-axis directions.
[0183] In this way, the angular velocity information of the first device in the three-axis direction can be calibrated based on the acceleration information of the first device in the three-axis direction, thereby improving the accuracy of the angular velocity information of the first device in the three-axis direction.
[0184] This application uses the angular velocity information and acceleration information of the first device in the three-axis direction as examples to illustrate the embodiments.
[0185] In some examples, the first IMU module can establish a three-dimensional coordinate system centered on the vehicle's position at startup. Based on this three-dimensional coordinate system, the angular velocity information and acceleration information of the first device in the three-axis directions are obtained.
[0186] For example, as shown in Figure 11, a three-dimensional coordinate system (O-XYZ) is established with the vehicle as the center. The origin of the three-dimensional coordinate system can be located at the center of the vehicle, or at the center of the bottom plane of the vehicle, etc. This application embodiment does not impose specific limitations on this. In this application, the three-dimensional coordinate system is selected with the vehicle as the center (the center of the vehicle is located at the origin O of the three-dimensional coordinate system) as an example. The Z-axis represents the vertical direction of the vehicle, and the positive Z-axis direction is the opposite direction of gravitational acceleration; the X-axis represents the horizontal direction when the vehicle starts, and the positive X-axis direction is directly to the right when the vehicle starts; the Y-axis represents the forward and backward direction when the vehicle starts, and the positive Y-axis direction is directly in front when the vehicle starts. The unit of this three-dimensional coordinate system can be meters (m), or the unit of this three-dimensional coordinate system can be other than meters (m). This application embodiment does not impose specific limitations on this.
[0187] Once the vehicle starts, it can move along the three axes of this three-dimensional coordinate system. For example, when the vehicle turns right, it rotates clockwise around the Z-axis; when it turns left, it rotates counterclockwise around the Z-axis. When the vehicle goes uphill, it rotates counterclockwise around the X-axis; when it goes downhill, it rotates clockwise around the X-axis.
[0188] In some examples, the first IMU module can acquire the angular velocity and acceleration information of the first device in the XYZ three-axis directions, as shown in Figure 11.
[0189] In other examples, the first IMU module can establish a three-dimensional coordinate system centered on the vehicle at the previous moment. Based on this three-dimensional coordinate system, the angular velocity information and acceleration information of the first device in the three-axis directions at time t are obtained.
[0190] For example, at time t-1, a three-dimensional coordinate system as shown in Figure 11 is established with the vehicle at time t-1 as the center. Based on this three-dimensional coordinate system, the angular velocity information and acceleration information of the first device at time t in the three-axis directions are obtained. This angular velocity information and acceleration information are the changes in angular velocity and acceleration of the first device from time t-1 to time t.
[0191] It should be understood that the above-described method for obtaining the coordinate system and the angular velocity information and acceleration information of the first device in the three-axis directions is only one example. The embodiments of this application can also obtain the angular velocity information and acceleration information of the first device in the three-axis directions through other methods. The embodiments of this application do not impose specific limitations on this.
[0192] This application uses the vehicle's position at startup as the center to establish a three-dimensional coordinate system as an example for illustration.
[0193] In some examples, the first IMU module can also determine the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first device based on the acquired angular velocity information. Alternatively, the first IMU module can also determine the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first device based on the acquired angular velocity information and acceleration information. In this way, the first information can be determined as the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first device.
[0194] For example, the first IMU module can calculate the azimuth information in the horizontal direction and the pitch information in the vertical direction of the first device at time t based on the angular velocity information and acceleration information of the first device in the XYZ three-axis directions obtained at time t.
[0195] In some examples, the first IMU module can calculate the azimuth and elevation information of the first device using algorithms such as complementary filtering, Madgwick, Mahony, or Kalman filtering.
[0196] For example, the azimuth angle of the first device in the horizontal direction at time t can be... The vertical pitch angle of the first device at time t can be...
[0197] In some examples, the first IMU module can also determine the change in the horizontal azimuth angle and the change in the vertical pitch angle of the first device based on the current horizontal azimuth angle and the previous horizontal azimuth angle and the previous vertical pitch angle of the first device. This allows the first information to be determined as the change in the horizontal azimuth angle and the change in the vertical pitch angle of the first device.
[0198] For example, the first IMU module can calculate the change in the azimuth angle in the horizontal direction and the change in the pitch angle in the vertical direction of the first device at time t based on the angular velocity and acceleration information of the first device in the XYZ three-axis direction obtained at time t, and the angular velocity and acceleration information of the first device in the XYZ three-axis direction obtained at time t-1.
[0199] For example, the azimuth angle of the first device in the horizontal direction at time t can be... The vertical pitch angle of the first device at time t can be... The azimuth angle of the first device in the horizontal direction at time t-1 can be... The vertical pitch angle of the first device at time t can be... The change in the horizontal azimuth angle of the first device at time t can be: The change in the vertical pitch angle of the first device at time t can be:
[0200] In some examples, the first IMU module can also determine the change in the horizontal azimuth angle and the change in the vertical pitch angle of the first device based on the current horizontal azimuth angle and the previous horizontal azimuth angle and the previous vertical pitch angle of the first device.
[0201] In some examples, the first IMU module can also determine the changes in the horizontal azimuth angle and the vertical pitch angle of the first device based on the acquired changes in angular velocity and acceleration.
[0202] Thus, the first information can be determined as the change in the azimuth angle of the first device in the horizontal direction and the change in the pitch angle of the first device in the vertical direction.
[0203] S804, the first IMU module sends the first information to the first UWB module. Correspondingly, the first UWB module receives the first information from the first IMU module.
[0204] In some examples, the first IMU module can send the first information to the first UWB module through the internal interface of the first device. For example, the first IMU module can send the first information to the first UWB module through the universal asynchronous receiver / transmitter (UART) interface.
[0205] S805, the second device obtains the second information through the second IMU module.
[0206] In some examples, the second device includes a second IMU module, through which the second device can obtain second information to indicate the attitude of the second device.
[0207] The second device is located in the vehicle. The second IMU module can acquire the angular velocity and acceleration information of the second device in the XYZ three-axis directions as shown in Figure 11 in real time.
[0208] The process by which the second device obtains second information indicating the attitude of the second device through the second IMU module can refer to the process described above of the first device obtaining first information indicating the attitude of the first device through the first IMU module.
[0209] In some examples, the second IMU module can also determine the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the second device based on the acquired angular velocity information. Alternatively, the second IMU module can also determine the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the second device based on the acquired angular velocity information and acceleration information. In this way, the second information can be determined as the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the second device.
[0210] The azimuth angle of the second device in the horizontal direction at time t can be... The vertical pitch angle at time t can be
[0211] In some examples, the second IMU module can also determine the changes in the horizontal azimuth and vertical pitch of the second device based on the current horizontal azimuth and vertical pitch of the second device and the previous horizontal azimuth and vertical pitch of the second device. This allows the second information to be determined as the changes in the horizontal azimuth and vertical pitch of the second device.
[0212] For example, the second IMU module can calculate the change in the azimuth angle in the horizontal direction and the change in the pitch angle in the vertical direction of the second device at time t based on the angular velocity and acceleration information of the second device in the XYZ three-axis direction obtained at time t, and the angular velocity and acceleration information of the second device in the XYZ three-axis direction obtained at time t-1.
[0213] For example, the azimuth angle of the second device in the horizontal direction at time t can be... The vertical pitch angle of the second device at time t can be... The azimuth angle of the second device in the horizontal direction at time t-1 can be... The vertical pitch angle of the second device at time t can be... The change in the horizontal azimuth angle of the second device at time t can be... The change in the vertical pitch angle of the second device at time t can be...
[0214] S806, the second IMU module of the second device sends the second information to the first UWB module of the first device. Correspondingly, the first UWB module receives the second information from the second IMU module.
[0215] In some examples, the second IMU module of the second device can send the second information to the second BLE module. Correspondingly, the second BLE module receives the second information from the second IMU module. The second BLE module can also send the second information to the first BLE module of the first device. Correspondingly, the first BLE module receives the second information from the second BLE module. The first BLE module can also send the second information to the first UWB module. Correspondingly, the first UWB module receives the second information from the first BLE module.
[0216] It should be understood that the order of S803, S804 and S805, S806 can be adjusted, that is, S805 and S806 can be executed first, followed by S803 and S804. This application embodiment does not impose specific restrictions.
[0217] S807, the first UWB module determines the location information of the first identifier based on the first information, the second information and the fourth information.
[0218] In some examples, the first UWB module includes a first MCU module, which can determine the location information of the first identifier based on the first information, the second information, and the fourth information.
[0219] The first MCU module can determine the third information based on the first information and the second information. The third information is used to indicate the difference between the first information and the second information, or it can be represented as the angle information of the first identifier, such as the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first identifier.
[0220] In some examples, when the first information is the angular velocity information and acceleration information of the first device in the three-axis direction, and the second information is the angular velocity information and acceleration information of the second device in the three-axis direction, the first MCU module can determine the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first device based on the angular velocity information and acceleration information of the first device in the three-axis direction, and determine the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the second device based on the angular velocity information and acceleration information of the second device in the three-axis direction.
[0221] The third information can be used to indicate the difference between the azimuth angle of the first device in the horizontal direction and the azimuth angle of the second device in the horizontal direction, as well as the difference between the pitch angle of the first device in the vertical direction and the pitch angle of the second device in the vertical direction.
[0222] For example, the first MCU module can determine the azimuth angle of the first identifier in the horizontal direction and the pitch angle in the vertical direction based on the azimuth angle of the first device in the horizontal direction and the pitch angle in the vertical direction of the second device in the following manner 1.
[0223] Method 1:
[0224] The first MCU module can determine the azimuth angle of the first identifier based on the horizontal azimuth angle of the first device and the horizontal azimuth angle of the second device. The horizontal azimuth angle of the first identifier can be the difference between the horizontal azimuth angles of the first device and the second device.
[0225] For example, the azimuth angle of the first device in the horizontal direction, the azimuth angle of the second device in the horizontal direction, and the azimuth angle of the first marker in the horizontal direction satisfy the following formula (3):
[0226] in, The first identifier is the azimuth angle in the horizontal direction. The azimuth angle of the second device in the horizontal direction. The azimuth angle of the first device in the horizontal direction.
[0227] The first MCU module can determine the pitch angle of the first identifier in the vertical direction based on the pitch angle of the first device and the pitch angle of the second device in the vertical direction. The pitch angle of the first identifier in the vertical direction can be the difference between the pitch angle of the first device and the pitch angle of the second device in the vertical direction.
[0228] For example, the vertical pitch angle of the first device, the vertical pitch angle of the second device, and the vertical pitch angle of the first marker satisfy the following formula (4):
[0229] in, The first indicator is the vertical pitch angle. The pitch angle is the vertical direction of the second device. The pitch angle is the vertical angle of the first device.
[0230] In this way, the first MCU module can obtain the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first identifier.
[0231] In some examples, the first MCU module can determine the change in the horizontal azimuth angle and the change in the vertical pitch angle of the first device based on the horizontal azimuth angle and the vertical pitch angle of the first device; and determine the change in the horizontal azimuth angle and the change in the vertical pitch angle of the second device based on the horizontal azimuth angle and the vertical pitch angle of the second device.
[0232] The third information can also be used to indicate the cumulative difference between the change in the azimuth angle of the first device in the horizontal direction and the change in the azimuth angle of the second device in the horizontal direction, as well as the cumulative difference between the change in the pitch angle of the first device in the vertical direction and the change in the pitch angle of the second device in the vertical direction.
[0233] For example, the first MCU module can determine the first identifier's azimuth angle in the horizontal direction and the vertical pitch angle in the vertical direction based on the cumulative change value of the first device's azimuth angle in the horizontal direction and the cumulative change value of the first device's pitch angle in the vertical direction, as well as the cumulative change value of the second device's azimuth angle in the horizontal direction and the cumulative change value of the second device's pitch angle in the vertical direction, in the following manner 2.
[0234] Method 2:
[0235] The first MCU module can determine the azimuth angle of the first identifier in the horizontal direction based on the changes in the azimuth angle of the first device and the second device in the horizontal direction. The azimuth angle of the first identifier in the horizontal direction is the cumulative amount of the difference between the changes in the azimuth angle of the first device and the changes in the azimuth angle of the second device in the horizontal direction.
[0236] For example, the change in the horizontal azimuth of the first device, the change in the horizontal azimuth of the second device, and the horizontal azimuth of the first marker satisfy the following formula (5):
[0237] in, Let be the azimuth angle of the first marker in the horizontal direction at time t. Let be the azimuth angle of the first marker in the horizontal direction at time t-1. Let be the change in the horizontal azimuth angle of the second device from time t-1 to time t, satisfying... in Let be the change in the horizontal azimuth angle of the second device at time t. This represents the change in the horizontal azimuth angle of the second device at time t-1. Let be the change in the horizontal azimuth angle of the first device from time t-1 to time t, satisfying... in Let be the change in the horizontal azimuth angle of the first device at time t. This represents the change in the horizontal azimuth angle of the first device at time t-1.
[0238] The first MCU module can determine the pitch angle of the first identifier in the vertical direction based on the pitch angle of the first device and the pitch angle of the second device in the vertical direction. The pitch angle of the first identifier in the vertical direction can be the cumulative amount of the difference between the pitch angle of the first device and the pitch angle of the second device in the vertical direction.
[0239] For example, the change in the vertical pitch angle of the first device, the change in the vertical pitch angle of the second device, and the vertical pitch angle of the first marker satisfy the following formula (6):
[0240] in, Let be the pitch angle in the vertical direction of the first marker at time t. Let be the pitch angle in the vertical direction of the first marker at time t-1. The change in the vertical pitch angle of the second device from time t-1 to time t satisfies in Let be the change in the vertical pitch angle of the second device at time t. The value of the change in the vertical pitch angle of the second device at time t-1; Let be the change in the vertical pitch angle of the first device from time t-1 to time t, satisfying... in Let be the change in the vertical pitch angle of the first device at time t. This represents the change in the vertical pitch angle of the first device at time t-1.
[0241] Thus, in the above method 2, the changes in the azimuth angle of the first device in the horizontal direction, the changes in the pitch angle of the first device in the vertical direction, the changes in the azimuth angle of the second device in the horizontal direction, and the changes in the pitch angle of the second device in the vertical direction are instantaneous data, which prevents the azimuth angle and pitch angle acquired by the IMU module from accumulating errors over time and improves the accuracy of the obtained azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first identifier.
[0242] Specifically, a three-dimensional coordinate system is established in the first IMU module with the vehicle at the previous moment as the center. Based on this three-dimensional coordinate system, and by acquiring the angular velocity information and acceleration information of the first device in the three-axis directions at time t, the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first identifier can also be determined by the above-mentioned method 2.
[0243] The above method obtains the azimuth angle in the horizontal direction and the pitch angle in the vertical direction of the first identifier. In some examples, the first MCU module can also calibrate the azimuth angle and pitch angle of the first identifier using the angle information between the first device and the second device.
[0244] In one example, the first IMU module can use the horizontal angular information between the first device and the second device as the azimuth angle of the first identifier.
[0245] Alternatively, the first IMU module can perform a weighted calculation on the horizontal angle information between the first and second devices and the azimuth angle of the first identifier to obtain the calibrated azimuth angle of the first identifier. The weights of the horizontal angle information between the first and second devices and the azimuth angle of the first identifier can be allocated according to actual needs, and this embodiment does not limit this.
[0246] For example, taking the angle e in the horizontal direction between the first device and the second device at time t obtained by the first UWB module as an example, then the azimuth angle of the first identifier... Calibration can be performed using the following formula (7):
[0247] in, The azimuth angle of the first marker in the horizontal direction after calibration. Let 'a' be the azimuth angle of the first identifier in the horizontal direction before calibration, 'a' be a constant, and 'e' be the angle information between the first and second devices in the horizontal direction. The weight of the azimuth angle of the first identifier in the horizontal direction is (1-a), and the weight of the angle information between the first and second devices is 'a'.
[0248] For example, as shown in Figure 12(a), it is a schematic diagram of the first azimuth angle in the horizontal direction.
[0249] In some examples, the first IMU module can use the angular information between the first device and the second device in the vertical direction as the azimuth angle of the first identifier.
[0250] Alternatively, the first IMU module can perform a weighted calculation on the vertical angle information between the first and second devices and the azimuth angle of the first identifier to obtain the calibrated azimuth angle of the first identifier. The weights of the vertical angle information between the first and second devices and the azimuth angle of the first identifier can be allocated according to actual needs, and this embodiment does not limit this.
[0251] For example, taking the angle f between the first device and the second device in the vertical direction at time t obtained by the first UWB module as an example, then the azimuth angle of the first identifier... Calibration can be performed using the following formula (8):
[0252] in, The pitch angle in the vertical direction of the first marker after calibration. Let be the vertical pitch angle of the first identifier before calibration, b be a constant, and f be the vertical angle information between the first and second devices. The weight of the vertical pitch angle of the first identifier is (1-b), and the weight of the angle information between the first and second devices is b.
[0253] For example, as shown in Figure 12(b), it is a schematic diagram of the first vertical pitch angle.
[0254] In some examples, the first MCU module can also calibrate the horizontal azimuth angle of the second device using the angle information between the first and second devices. This is so that subsequent calculations can be performed based on the calibrated horizontal azimuth angle of the second device.
[0255] For example, the azimuth angle of the second device in the horizontal direction Calibration can be performed using the following formula (9):
[0256] in, The azimuth angle of the second device in the horizontal direction after calibration. The azimuth angle of the first device in the horizontal direction. The azimuth angle of the first horizontal direction after calibration.
[0257] Thus, the first MCU module can obtain the azimuth angle of the first identifier in the horizontal direction after calibration. And the pitch angle in the vertical direction of the first indicator
[0258] In this embodiment, the azimuth angle of the first horizontal direction after calibration is used. And the vertical pitch angle of the first marker Let's take an example to illustrate.
[0259] In some examples, the first MCU module can calculate the horizontal coordinate of the first identifier on the display screen using a first trigonometric function based on the distance information between the first device and the second device and the azimuth angle of the first identifier in the horizontal direction.
[0260] When calculating the horizontal coordinate of the first identifier on the display screen, the initial position of the first identifier on the display screen must be referenced. The initial position of the first identifier on the display screen can be the position of the first device on the display screen, or it can be the position of the antenna of the first device on the display screen.
[0261] For example, when the second device points to antenna 0 in the first device, the position of the first identifier on the display screen is (x0, y0). For example, as shown in Figure 13(a), it is a schematic diagram of the change in the horizontal coordinate of the first identifier on the display screen. The second device points to the first device.
[0262] In some examples, the first trigonometric function can be the tangent function. The first MCU module can use the tangent function based on the distance information between the first device and the second device and the azimuth angle of the first identifier in the horizontal direction. The horizontal coordinate x of the first identifier on the display screen satisfies the following formula (10):
[0263] Where d is the distance between the first device and the second device; x0 is the initial horizontal coordinate of the first identifier on the display screen. The first identifier is the azimuth angle in the horizontal direction.
[0264] In some examples, the first MCU module can calculate the vertical coordinate of the first identifier on the display screen using a first trigonometric function based on the distance information between the first device and the second device and the vertical pitch angle of the first identifier.
[0265] When calculating the vertical coordinate of the first identifier on the display screen, the initial position of the first identifier on the display screen must be referenced. The initial position of the first identifier on the display screen can be the position of the first device on the display screen, or it can be the position of the antenna of the first device on the display screen.
[0266] For example, when the second device points to antenna 0 in the first device, the position of the first identifier on the display screen is (x0, y0). For example, as shown in Figure 13(b), it is a schematic diagram of the change of the vertical coordinate of the first identifier on the display screen.
[0267] In some examples, the first trigonometric function can be the tangent function. The first MCU module can use the tangent function based on the distance information between the first device and the second device and the vertical pitch angle. The vertical coordinate y of the first identifier on the display screen satisfies the following formula (11):
[0268] Where d is the distance between the first device and the second device; y0 is the initial horizontal coordinate of the first identifier on the display screen. The first identifier is the pitch angle in the vertical direction.
[0269] In this way, the first MCU module can determine the location information of the first identifier.
[0270] S808, the first UWB module of the first device sends the location information of the first identifier to the display module of the display screen. Correspondingly, the display module of the display screen receives the location information of the first identifier from the first UWB module of the first device.
[0271] In some examples, the first UWB module of the first device can send the location information of the first identifier to the first BLE module, and the first BLE module can send the location information of the first identifier to the display module of the display via USB.
[0272] S809, The display module of the display screen displays the first identifier on the display screen according to the position information of the first identifier.
[0273] For example, as shown in Figure 14, the display module of the display screen determines the position B(x, y) of the first identifier based on the initial position A(x0, y0) of the first identifier, according to the horizontal coordinate x and the vertical coordinate y of the first identifier, and displays the first identifier at position B on the display screen. The origin of the coordinate system of position B(x, y) can be position A, or the origin of the coordinate system of position B(x, y) can be the upper left corner of the display screen; this embodiment does not impose specific limitations on this.
[0274] In this way, when the vehicle is in motion, the position of the first identifier can be changed due to the change in the posture of the first device, which would lead to inaccurate display position of the first identifier on the display screen. This enables precise control of the first identifier on the display screen and improves the user experience.
[0275] The above embodiments are described using the example of a first UWB module acquiring first information, second information, and fourth information, and a first MCU module within the first UWB module determining the location information of the first identifier based on the first information, second information, and fourth information. In some examples, the first BLE module may also include a first MCU module, where the first MCU module acquires the first information, second information, and fourth information, and determines the location information of the first identifier based on the first information, second information, and fourth information. Subsequently, the first device can send the location information of the first identifier determined by the first MCU module in the first BLE module to the display screen via a USB interface to display the first identifier.
[0276] The above embodiments are described using the establishment of a Bluetooth connection between the first device and the second device as an example. The first device and the second device communicate through a BLE module, and obtain the fourth information through a UWB module. In some examples, the first device and the second device can also establish a Starlink connection, communicating through an SLE module, and obtaining the fourth information through an SLP module.
[0277] Alternatively, other connections may be established between the first device and the second device, and this application embodiment does not impose specific limitations on this.
[0278] In some examples, the first MCU module can also determine whether the third information meets the first condition. If the third information meets the first condition, the module can control the position of the first identifier on the display screen to change.
[0279] In some examples, if the difference between the horizontal azimuth angle of the first device and the horizontal azimuth angle of the second device is greater than a first threshold, and / or the difference between the vertical pitch angle of the first device and the vertical pitch angle of the second device is greater than a second threshold, the position of the first identifier on the display screen is controlled to change.
[0280] The first threshold and the second threshold can be user-defined. The first threshold and the second threshold can be the same or different. This application embodiment does not impose specific restrictions on this.
[0281] For example, the first threshold can be 0.5 degrees and the second threshold can be 1 degree.
[0282] In other words, if the difference between the horizontal azimuth angle of the first device and the horizontal azimuth angle of the second device is large, greater than 0.5 degrees, the position of the first sign on the display screen will be controlled to change in the horizontal direction; if the difference between the vertical pitch angle of the first device and the vertical pitch angle of the second device is large, greater than 1 degree, the position of the first sign on the display screen will be controlled to change in the vertical direction.
[0283] Alternatively, if the difference between the change in the horizontal azimuth angle of the first device and the change in the horizontal azimuth angle of the second device is greater than a third threshold, and / or the difference between the change in the vertical pitch angle of the first device and the change in the vertical pitch angle of the second device is greater than a fourth threshold, the position of the first identifier on the display screen is controlled to change.
[0284] The third and fourth thresholds can be user-defined. The first, second, third and fourth thresholds can be the same or different. This application does not impose specific restrictions on this.
[0285] For example, the third threshold can be 0.3 degrees and the fourth threshold can be 0.4 degrees.
[0286] In other words, if the difference between the change in the horizontal azimuth angle of the first device and the change in the horizontal azimuth angle of the second device is large, greater than 0.3 degrees, the position of the first mark on the display screen will be controlled to change in the horizontal direction.
[0287] If the difference between the vertical pitch angle change of the first device and the vertical pitch angle change of the second device is large, greater than 0.4 degrees, the position of the first mark on the display screen will be controlled to change vertically.
[0288] In this way, the first marker can be prevented from moving frequently when the posture changes of the first and second devices are small, thus improving the stability of the first marker.
[0289] In some examples, as shown in Figure 15, the second device can also be installed in the display screen to reflect the screen's orientation. The first device is a remote control device. Taking the establishment of a Bluetooth connection between the first and second devices as an example, the display control method can include the following steps:
[0290] The contents of S1501-S1507 can be referred to as S801-S807 above, and will not be repeated here.
[0291] In S1502, the fourth information can be obtained through the second UWB module. The second UWB module can send the fourth information to the first UWB module through the second BLE module and the first BLE module. This application embodiment does not impose specific limitations on this.
[0292] S1508, the first UWB module of the first device sends the location information of the first identifier to the second BLE module of the second device. Correspondingly, the second BLE module of the second device receives the location information of the first identifier from the first UWB module of the first device.
[0293] In some examples, the first UWB module can send the location information of the first identifier to the first BLE module. Correspondingly, the first BLE module receives the location information of the first identifier from the first UWB module, and can then send the location information of the first identifier to the second BLE module of the second device. Correspondingly, the second BLE module of the second device receives the location information of the first identifier from the first BLE module.
[0294] S1509, the second BLE module of the second device sends the location information of the first identifier to the display module of the display screen.
[0295] In some examples, the second BLE module of the second device can send the location information of the first identifier to the display module of the display via USB.
[0296] S1510, The display module of the display screen displays the first identifier on the display screen according to the position information of the first identifier.
[0297] For example, as shown in Figure 14, the display module of the display screen determines the position B(x, y) of the first identifier based on the initial position A(x0, y0) of the first identifier, according to the horizontal coordinate x in the horizontal direction and the vertical coordinate y in the vertical direction of the first identifier, and displays the first identifier at position B on the display screen.
[0298] In this way, the position information of the first identifier can be calculated in the device used to reflect the posture of the display screen, or in the remote control device, thereby improving the reliability of obtaining the position information of the first identifier.
[0299] It should be understood that some operations in the processes of the above method embodiments may be optionally combined, and / or the order of some operations may be optionally changed. Furthermore, the execution order between the steps of each process is merely exemplary and does not constitute a limitation on the execution order between steps; other execution orders are also possible. It is not intended to indicate that the execution order is the only possible order in which these operations can be performed. Those skilled in the art will conceive of various ways to reorder the operations described herein. Additionally, it should be noted that process details relating to one embodiment of this document are similarly applicable to other embodiments, or different embodiments may be combined.
[0300] Furthermore, some steps in the method embodiments can be equivalently replaced with other possible steps. Alternatively, some steps in the method embodiments may be optional and can be deleted in certain use cases. Or, other possible steps may be added to the method embodiments.
[0301] Furthermore, the above-described method embodiments can be implemented individually or in combination.
[0302] Figure 16 shows a schematic diagram of an electronic device according to an embodiment of this application. The electronic device can be a first device or a second device. The electronic device 1600 includes a transceiver module 1601 and a processing module 1602. The electronic device 1600 is used to execute the above-described display control method, for example, to execute the display control method shown in Figure 7. Of course, the electronic device 1600 may also include other modules, or the electronic device 1600 may include fewer modules. This application does not specifically limit the specific form and implementation of the electronic device.
[0303] Transceiver module 1601 is used to establish a communication connection with the second device;
[0304] The transceiver module 1601 is used to acquire first information and second information. The first information is used to indicate the attitude of the first device, and the second information is used to indicate the attitude of the second device.
[0305] The processing module 1602 is used to control the position of the first identifier on the display screen according to the first information and the second information. The first identifier is used to indicate the focus position on the display screen.
[0306] The operation and / or function of each module in the electronic device 1600 are respectively to implement the corresponding process of the display control method in the above method embodiment. All relevant contents of each step involved in the above method embodiment can be referred to the functional description of the corresponding functional unit. For the sake of brevity, they will not be repeated here.
[0307] Optionally, the electronic device 1600 shown in FIG. 16 may further include a storage module (not shown in FIG. 16) storing programs or instructions. When the transceiver module 1601 and the processing module 1602 execute the program or instructions, the electronic device 1600 shown in FIG. 16 can perform the display control method in the above-described method embodiments. In some examples, the storage module may store first information and second information.
[0308] The technical effects of the electronic device 1600 shown in Figure 16 can be referred to the technical effects of the display control method in the above method embodiments, and will not be repeated here.
[0309] This application also provides a chip system, as shown in FIG17. The chip system 1700 includes at least one processor 1701 and at least one interface circuit 1702. As an example, when the chip system 1700 includes one processor and one interface circuit, the processor can be the processor 1701 shown in the solid box in FIG17 (or the processor 1701 shown in the dashed box), and the interface circuit can be the interface circuit 1702 shown in the solid box in FIG17 (or the interface circuit 1702 shown in the dashed box). When the chip system 1700 includes two processors and two interface circuits, the two processors include the processor 1701 shown in the solid box and the processor 1701 shown in the dashed box in FIG17, and the two interface circuits include the interface circuit 1702 shown in the solid box and the interface circuit 1702 shown in the dashed box in FIG17. This is not a limitation.
[0310] Processor 1701 and interface circuit 1702 can be interconnected via lines. For example, interface circuit 1702 can be used to receive signals. As another example, interface circuit 1702 can be used to send signals to other devices (e.g., processor 1701). Exemplarily, interface circuit 1702 can read instructions stored in memory and send those instructions to processor 1701. When the instructions are executed by processor 1701, the rendering device can perform the steps in the above embodiments. Of course, this chip system may also include other discrete devices, and this application embodiment does not specifically limit this.
[0311] For example, the chip system may be a field programmable gate array (FPGA), an application-specific integrated circuit (ASIC), a system on a chip (SoC), a central processing unit (CPU), a network processor (NP), a digital signal processor (DSP), a microcontroller unit (MCU), a programmable logic device (PLD), or other integrated chips.
[0312] It should be understood that each step in the above method embodiments can be completed by integrated logic circuits in the processor hardware or by instructions in software form. The method steps disclosed in the embodiments of this application can be directly manifested as being executed by a hardware processor, or being executed by a combination of hardware and software modules in the processor.
[0313] This application also provides a computer storage medium storing computer instructions that, when executed on an electronic device, cause the electronic device to perform the method described in the above method embodiments.
[0314] This application provides a computer program product, which includes a computer program or instructions that, when run on a computer, cause the computer to perform the method described in the above method embodiments.
[0315] In addition, this application also provides an apparatus, which may specifically be a chip, component or module. The apparatus may include a connected processor and a memory. The memory is used to store computer execution instructions. When the apparatus is running, the processor can execute the computer execution instructions stored in the memory to cause the apparatus to perform the methods in the above-described method embodiments.
[0316] In this embodiment, the electronic device, computer storage medium, computer program product or chip are all used to execute the corresponding methods provided above. Therefore, the beneficial effects they can achieve can be referred to the beneficial effects in the corresponding methods provided above, and will not be repeated here.
[0317] Through the above description of the embodiments, those skilled in the art will understand that, for the sake of convenience and brevity, only the division of the above functional modules is used as an example. In actual applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above.
[0318] In the several embodiments provided in this application, it should be understood that the disclosed apparatus and methods can be implemented in other ways. The embodiments can be combined with or referenced to each other without conflict. The apparatus embodiments described above are merely illustrative; for example, the division of modules or units is only a logical functional division, and in actual implementation, there may be other division methods. For example, multiple units or components may be combined or integrated into another device, or some features may be ignored or not executed. Furthermore, the coupling or direct coupling or communication connection shown or discussed may be through some interfaces; the indirect coupling or communication connection between devices or units may be electrical, mechanical, or other forms.
[0319] The units described as separate components may or may not be physically separate. A component shown as a unit can be one or more physical units; that is, it can be located in one place or distributed in multiple different locations. Some or all of the units can be selected to achieve the purpose of this embodiment according to actual needs.
[0320] Furthermore, the functional units in the various embodiments of this application can be integrated into one processing unit, or each unit can exist physically separately, or two or more units can be integrated into one unit. The integrated unit can be implemented in hardware or as a software functional unit.
[0321] If the integrated unit is implemented as a software functional unit and sold or used as an independent product, it can be stored in a readable storage medium. Based on this understanding, the technical solutions of the embodiments of this application, in essence, or the parts that contribute to the prior art, or all or part of the technical solutions, can be embodied in the form of a software product. This software product is stored in a storage medium and includes several instructions to cause a device (which may be a microcontroller, chip, etc.) or processor to execute all or part of the steps of the methods of the various embodiments of this application. The aforementioned storage medium includes various media capable of storing program code, such as USB flash drives, portable hard drives, read-only memory (ROM), random access memory (RAM), magnetic disks, or optical disks.
[0322] The above content is only a specific implementation of this application, but the protection scope of this application is not limited thereto. Any changes or substitutions that can be easily conceived by those skilled in the art within the technical scope disclosed in this application should be covered within the protection scope of this application.
Claims
1. A display control method, characterized in that, The method includes: Establish a communication connection with the second device; Acquire first information and second information, wherein the first information is used to indicate the attitude of the first device and the second information is used to indicate the attitude of the second device; Based on the first information and the second information, control the position of the first identifier on the display screen.
2. The method according to claim 1, characterized in that, The step of controlling the position of the first identifier on the display screen based on the first information and the second information includes: A third piece of information is determined based on the first information and the second information, and the third information is used to indicate the difference information between the first information and the second information. If the third information satisfies the first condition, the position of the first identifier on the display screen is changed.
3. The method according to claim 1 or 2, characterized in that, The first information is used to indicate one or more of the following: angular velocity information of the first device in the three-axis direction, angular velocity information of the first device in the three-axis direction, acceleration information of the first device in the three-axis direction, azimuth angle of the first device in the horizontal direction and pitch angle in the vertical direction, or the change value of azimuth angle of the first device in the horizontal direction and the change value of pitch angle of the first device in the vertical direction.
4. The method according to any one of claims 1-3, characterized in that, The azimuth angle of the first device in the horizontal direction is determined by the angular velocity information of the first device in the three-axis directions; or, the azimuth angle of the first device in the horizontal direction is determined by the angular velocity information and acceleration information of the first device in the three-axis directions; the pitch angle of the first device in the vertical direction is determined by the angular velocity information of the first device in the three-axis directions; or, the pitch angle of the first device in the vertical direction is determined by the angular velocity information and acceleration information of the first device in the three-axis directions. The change in the azimuth angle of the first device in the horizontal direction is determined by the azimuth angle of the first device in the horizontal direction; the change in the pitch angle of the first device in the vertical direction is determined by the pitch angle of the first device in the vertical direction.
5. The method according to any one of claims 1-4, characterized in that, The second information is used to indicate one or more of the following: the angular velocity information of the second device in the three-axis direction, the angular velocity information of the second device in the three-axis direction, the acceleration information of the second device in the three-axis direction, the azimuth angle of the second device in the horizontal direction and the pitch angle in the vertical direction, or the change value of the azimuth angle of the second device in the horizontal direction and the change value of the pitch angle of the second device in the vertical direction.
6. The method according to any one of claims 1-5, characterized in that, The horizontal azimuth angle of the second device is determined by the angular velocity information of the second device in the three-axis directions; or, the horizontal azimuth angle of the second device is determined by the angular velocity information and acceleration information of the second device in the three-axis directions; the vertical pitch angle of the second device is determined by the angular velocity information of the first device in the three-axis directions; or, the vertical pitch angle of the second device is determined by the angular velocity information and acceleration information of the second device in the three-axis directions. The change in the azimuth angle of the second device in the horizontal direction is determined by the azimuth angle of the second device in the horizontal direction; the change in the pitch angle of the second device in the vertical direction is determined by the pitch angle of the second device in the vertical direction.
7. The method according to claim 5 or 6, characterized in that, The third information is used to indicate the difference between the azimuth angle of the first device in the horizontal direction and the azimuth angle of the second device in the horizontal direction, as well as the difference between the pitch angle of the first device in the vertical direction and the pitch angle of the second device in the vertical direction. Alternatively, the third information may be used to indicate the cumulative difference between the change in the azimuth angle of the first device in the horizontal direction and the change in the azimuth angle of the second device in the horizontal direction, as well as the cumulative difference between the change in the pitch angle of the first device in the vertical direction and the change in the pitch angle of the second device in the vertical direction.
8. The method according to claim 7, characterized in that, When the third information satisfies the first condition, controlling the position of the first identifier on the display screen to change includes: If the difference between the azimuth angle of the first device in the horizontal direction and the azimuth angle of the second device in the horizontal direction is greater than a first threshold, and / or the difference between the pitch angle of the first device in the vertical direction and the pitch angle of the second device in the vertical direction is greater than a second threshold, the position of the first identifier on the display screen is controlled to change. Alternatively, if the difference between the change in the horizontal azimuth angle of the first device and the change in the horizontal azimuth angle of the second device is greater than a third threshold, and / or the difference between the change in the vertical pitch angle of the first device and the change in the vertical pitch angle of the second device is greater than a fourth threshold, the position of the first identifier on the display screen is controlled to change.
9. The method according to any one of claims 1-8, characterized in that, Controlling the position of the first identifier on the display screen based on the first information and the second information further includes: Obtain fourth information; the fourth information is used to indicate the angle information between the second device and the first device, and / or the distance information between the second device and the first device; Based on the first information, the second information, and the fourth information, the position of the first identifier on the display screen is controlled.
10. The method according to any one of claims 2-9, characterized in that, When the third information satisfies the first condition, controlling the position of the first identifier on the display screen to change includes: The third information is calibrated using the angle information between the second device and the first device; If the calibrated third information meets the first condition, the position of the first identifier on the display screen is changed.
11. The method according to any one of claims 1-10, characterized in that, The posture of the first device is used to reflect the posture of the display screen.
12. The method according to claim 11, characterized in that, The acquisition of the first information includes: First information is obtained from the first device from the first attitude detection module; the first device includes the first attitude detection module, or the first device communicates with the first attitude detection module.
13. The method according to any one of claims 1-12, characterized in that, The acquisition of the second information includes: Second information is obtained from the second device from the second attitude detection module; the second device includes the second attitude detection module.
14. The method according to any one of claims 1-10, characterized in that, The posture of the second device is used to reflect the posture of the display screen.
15. The method according to claim 14, characterized in that, The acquisition of the second information includes: The second information is obtained from the second device from the second attitude detection module; the second device includes the second attitude detection module, or the second device communicates with the second attitude detection module.
16. The method according to any one of claims 1-15, characterized in that, Establishing a communication connection with the second device includes: The first device establishes a communication connection with the second device through one or more of the following modules: Bluetooth Low Energy module, Starlight Low Energy module, or Wireless Fidelity module.
17. A display control method, characterized in that, The method includes: The first device establishes a communication connection with the second device; The second device sends a second message to the first device, the second message being used to indicate the attitude of the second device; The first device acquires first information from the first device and second information from the second device, wherein the first information is used to indicate the attitude of the first device; The first device controls the position of the first identifier on the display screen based on the first information and the second information.
18. The method according to claim 17, characterized in that, The second device sends a second message to the first device, including: The second device acquires the second information through the second attitude detection module; The second device sends the second information to the first device.
19. The method according to claim 17 or 18, characterized in that, The posture of the first device is used to reflect the posture of the display screen.
20. The method according to claim 17, characterized in that, The posture of the second device is used to reflect the posture of the display screen.
21. A display control system, characterized in that, include: A first device and a second device, wherein the first device includes a first attitude detection module and the second device includes a second attitude detection module; The first device is used to establish a communication connection with the second device; The second device is used to send second information to the first device, the second information being used to indicate the attitude of the second device; The second information is obtained through the second attitude detection module; The first device is configured to acquire first information from the first device and second information from the second device, wherein the first information is used to indicate the attitude of the first device; The first information is obtained through the first attitude detection module; The first device is configured to control the position of the first identifier on the display screen based on the first information and the second information.
22. The system according to claim 21, characterized in that, The posture of the first device is used to reflect the posture of the display screen.
23. The system according to claim 21, characterized in that, The posture of the second device is used to reflect the posture of the display screen.
24. An electronic device, characterized in that, include: A processor and a memory, the memory being used to store computer-readable instructions that, when at least one of the processors reads the computer-readable instructions from the memory, cause the electronic device to perform the method as claimed in any one of claims 1-16, or the method as claimed in any one of claims 17-20.
25. A computer-readable storage medium storing instructions, characterized in that, The computer-readable storage medium includes a computer program that, when executed by a processor, implements the method as described in any one of claims 1-16, or the method as described in any one of claims 17-20.
26. A computer program product, characterized in that, The computer program product includes a computer program that, when executed by a processor, implements the method as described in any one of claims 1-16, or the method as described in any one of claims 17-20.