Equipment display control methods, electronic equipment and communication systems

Abstract

This application discloses a device display control method, electronic device, and communication system, relating to the field of wireless remote control technology. It can accurately determine the position of a display object (such as a cursor) on a display device, providing users with a better device control experience. This solution determines the position of the display object based on the position of the control device pointing at the display screen. Therefore, regardless of whether it is a multi-display device scenario or not, it can provide users with a very convenient, immersive, and precise device control experience.

Description

[0001] This application claims priority to the following Chinese patent applications filed on January 18, 2023, with application number 202310097484.5, entitled "Positioning Method, Positioning System and Electronic Device"; filed on July 18, 2023, with application number 202310884005.4, entitled "A Remote Control Cursor Display Method and Device"; and filed on September 8, 2023, with application number 202311164310.2, entitled "Device Display Control Method, Electronic Device and Communication System". It also claims priority to the following international patent application filed on November 27, 2023, with application number PCT / CN2023 / 134243, entitled "Positioning Method, Positioning System and Electronic Device", all of which are incorporated herein by reference. Technical Field

[0002] This application relates to the field of wireless remote control technology, and in particular to a device display control method, electronic device and communication system. Background Technology

[0003] In human-computer interaction, control devices such as remote controls, air mice, or wearable devices are typically used to send control commands to the display device via wired or wireless means to control the display device. Determining the cursor position on the display screen corresponding to the control device is a crucial step in this process.

[0004] Currently, the relative position change of the cursor is usually determined based on the relative pose change of the control device, and thus the cursor's position is determined, such as... Figure 1 As shown, the change in the cursor's position relative to the initial cursor position can be determined based on the change in the control device's pose relative to the initial pose, thus determining the cursor's position. The initial cursor position is often a preset default position. Since the initial cursor position is preset rather than the actual position pointed to by the control device, the subsequent cursor position may not necessarily be the actual position pointed to by the control device. In other words, there is a discrepancy between the cursor position displayed on the screen and the actual position pointed to by the control device, resulting in a poor user experience. Summary of the Invention

[0005] This application provides a device display control method, which can provide a display scheme for a remote control cursor applicable to any scenario, accurately determine the cursor presentation position on the display device, and provide users with a better device control experience.

[0006] To achieve the above objectives, this application adopts the following technical solution:

[0007] In a first aspect, a device display control method is provided. The method is applied to at least one display device, which includes a first display device, the first display device including a first positioning module and a first display screen. The method includes: the first positioning module receiving first positioning information from a control device; the first display device following a first movement trajectory of the control device and presenting a corresponding display object on the first display screen based on the first positioning information; when the pointing position of the first movement trajectory moves out of a first edge area of ​​the first display screen, the first display device stops presenting the corresponding display object on the first display screen.

[0008] As an example, the first positioning module can be used to determine the pointing position of a control device by sending and receiving positioning information (such as first positioning information) with other devices. Exemplarily, the first positioning module may include, but is not limited to, one or more of an ultra-wideband radio (UWB) positioning module, a multi-antenna millimeter-wave radar positioning module, a three-dimensional electromagnetic coil positioning module, a three-dimensional ultrasonic positioning module, etc. The first positioning information may include one or more of the following: UWB signals, millimeter-wave radar signals, electromagnetic signals, and ultrasonic signals.

[0009] As an example, the first edge region of the first display screen can be any edge region of the first display screen, such as the upper edge region, lower edge region, left edge region, or right edge region. When the first display screen has a special shape (such as a circle, ellipse, etc.), the first edge region of the first display screen can be an edge region of the first display screen near a predefined boundary. Taking a circular first display screen as an example, the first edge region of the first display screen can be a predefined edge region near a first boundary, where the first boundary can be the boundary corresponding to the range of 315° to 45°, the boundary corresponding to the range of 45° to 135°, the boundary corresponding to the range of 135° to 225°, and the boundary corresponding to the range of 225° to 315°, with the center point of the first display screen as the center.

[0010] As an example, the displayed objects, such as icons, cursors, components, virtual avatars, and images, can be determined based on the specific application scenario and device functions, without any specific limitations.

[0011] The solution provided in the first aspect above, since the movement trajectory and pointing position of the control device are determined by the display device (such as the first display device) through sending and receiving positioning information with the control device, allows the display device to display a cursor on the screen when the pointing position of the control device enters the edge area of ​​the display screen, following the movement trajectory of the control device. When the pointing position of the control device moves out of any edge area of ​​the display screen (such as the upper edge, lower edge, left edge, or right edge), the display device stops displaying the cursor on the screen. Therefore, it can bring users a very convenient, immersive, and precise device control experience. For example, compared with conventional techniques that determine the image presentation position based on the relative pose change of the control device, this solution can not only solve the problem of the deviation between the presentation position of the displayed object and the pointing position of the control device, but also solve the problem of frame jamming when the displayed object moves out of the edge of the display screen.

[0012] As one possible implementation, the method further includes: after the pointing position of the first movement trajectory moves out of the first edge region, the first positioning module receives second positioning information from the control device; when the pointing position of the second movement trajectory is outside the first edge region, the first display device does not display the corresponding display object on the first display screen; when it is determined that the pointing position of the third movement trajectory moves into the first edge region, the first display device follows the third movement trajectory of the control device and displays the corresponding display object on the first display screen based on the second positioning information. Thus, when the pointing position of the control device moves out of any edge region of the display screen (such as the upper edge region, lower edge region, left edge region, or right edge region), the display device no longer displays the cursor on the display screen; and when the pointing position of the control device moves back into any edge region of the display screen, the display device can display the cursor on the display screen again. Based on this, the convenience, immersive experience, and accuracy of the user's device display operation can be greatly enhanced.

[0013] As one possible implementation, the first display device follows the first movement trajectory of the control device and presents a corresponding display object on the first display screen based on the first positioning information. This includes: the first display device following the first movement trajectory of the control device and presenting a display object display trajectory on the first display screen that matches the first movement trajectory based on the first positioning information. For example, in scenarios such as handwriting tablets and demonstrations, the display device can follow the movement trajectory of the control device and present the display trajectory of handwriting and other display objects on the display screen based on the positioning information. The solution provided in this application is highly adaptable and does not limit the specific display form of the interface effect presented by the display screen following the movement trajectory of the control device; it can be determined according to the specific application scenario and device function.

[0014] As one possible implementation, the above method further includes: the first display device determining the corresponding pointing position on the first display screen based on the first positioning information; and the first display device presenting corresponding interface effects when displaying the displayed object when the pointing position is located within a preset control hot zone. For example, in a game scenario, when the pointing position of the control device is located within the preset control hot zone, the display device can present pre-set special effects at the pointing position and / or the corresponding display area (such as the preset control hot zone), such as the game protagonist image, game special effects (such as bubble effects, firework effects, aiming effects, hit effects, etc.). The solution provided in this application is highly adaptable and does not limit the specific display form of the interface effects presented by the display screen following the movement trajectory of the control device; it can be determined according to the specific application scenario and device function.

[0015] As one possible implementation, the at least one display device further includes a second display device. The second display device and the first display device have a first positional relationship. The second display device includes a second positioning module and a second display screen. The method further includes: after the pointing position of the first movement trajectory moves out of the first edge area of ​​the first display screen, the second positioning module receives third positioning information from the control device; when the pointing position of the second movement trajectory is outside the first edge area, the first display device does not display the corresponding display object on the first display screen; when the pointing position of the fourth movement trajectory is determined to move into the second edge area of ​​the second display screen, the second display device follows the fourth movement trajectory of the control device and displays the corresponding display object on the second display screen based on the third positioning information. Thus, even when the distance between the first display screen and the second display screen is large, accurate display of the display object can still be achieved, providing users with an immersive and precise cursor control and device operation experience. Furthermore, compared to conventional techniques that determine the image presentation position based on the relative pose change of the control device, this solution does not suffer from the problem of unsmooth object movement when the display object moves across.

[0016] As one possible implementation, the at least one display device further includes a second display device, which includes a second positioning module and a second display screen. The method further includes: after the pointing position of the first movement trajectory moves out of the first edge area of ​​the first display screen, the second positioning module receives third positioning information from the control device; when the pointing position of the second movement trajectory moves into the second edge area of ​​the second display screen, the second display device follows a fourth movement trajectory of the control device and presents the corresponding display object on the second display screen based on the third positioning information. Thus, even when the first and second display screens are close together, accurate display of the display object can still be achieved, providing users with an immersive and precise cursor control and device operation experience. Furthermore, compared to conventional techniques that present display objects in a default position, this solution avoids the problem of unsmooth object movement when the display object moves across a surface.

[0017] As one possible implementation, the orientational relationship between the second display device and the first display device changes from a first relationship to a second relationship. The method further includes: when the pointing position of the fourth movement trajectory moves out of the third edge region of the second display screen, the second display device stops displaying the corresponding object on the second display screen; when the pointing position of the fifth movement trajectory is outside the third edge region, the corresponding object is not displayed on the second display screen; the first positioning module receives fourth positioning information from the control device; when the pointing position of the sixth movement trajectory is determined to move into the fourth edge region of the first display screen, the first display device follows the sixth movement trajectory of the control device and displays the corresponding object on the first display screen based on the fourth positioning information. For example, the orientational relationship between the second display device and the first display device changes from a first relationship to a second relationship, such as by swapping the positions of the second and first display devices. Thus, when the orientational relationship between the first and second display screens changes, no user configuration is required. The display device can sense the change in orientational relationship by sending and receiving positioning information with the control device, obtain the latest pointing direction from the control device, and thus continue to accurately display the object.

[0018] As one possible implementation, the second display device is an integrated display device. The method further includes: when the screen resolution of the second display changes, the second positioning module receives fifth positioning information from the control device; when the pointing position of the fourth movement trajectory is on the second display, the second display device follows the fourth movement trajectory of the control device and presents the corresponding display object on the second display based on the fifth positioning information. Thus, for an integrated display device, when the screen resolution changes, no user configuration is required; the display device can determine the latest pointing position of the control device based on the latest screen resolution, thereby continuing to accurately display the display object.

[0019] As one possible implementation, the second display device is a split-type display device. The method further includes: when the screen resolution and / or focal length of the second display changes, the second positioning module receives fifth positioning information from the control device; when the pointing position of the fourth movement trajectory is on the second display, the second display device follows the fourth movement trajectory of the control device and presents the corresponding display object on the second display based on the fifth positioning information. Thus, for a split-type display device, when the screen resolution or focal length of the display device changes, no user configuration is required; the display device can determine the latest pointing of the control device based on the latest screen resolution or focal length, thereby continuing to accurately display the display object.

[0020] As one possible implementation, the method further includes: during the process of following the first movement trajectory of the control device and presenting the corresponding display object on the first display screen based on the first positioning information, when the orientation relationship between the control device and the first display device changes, the first display device receives sixth positioning information from the control device; the first display device follows the first movement trajectory of the control device and presents the corresponding display object on the first display screen based on the sixth positioning information. Thus, when the distance between the user and the display screen changes, without requiring any configuration operations from the user, the display device can sense the change by sending and receiving positioning information with the control device and adaptively adjust the display effect, thereby continuing to accurately display the display object.

[0021] As one possible implementation, the method further includes: a first positioning module determining the pointing position of the first movement trajectory based on first information, wherein the first information includes: the first movement trajectory, first positioning information, and the size of the first display screen. Based on this, it can be ensured that the first positioning module can obtain the actual pointing position of the control device, thereby providing the necessary foundation for the accurate presentation of subsequent images.

[0022] As one possible implementation, the aforementioned first information further includes: the historical pointing position of the first movement trajectory and the historical presentation position of the displayed object. Thus, based on conventional techniques for determining the image presentation position based on the relative pose change of the control device, the presentation position of the displayed object can be calibrated based on the pointing position of the control device. For example, the presentation position of the displayed object can be calibrated based on the pointing position of the control device when the image presentation position determined based on the relative pose change of the control device deviates from the pointing position of the control device by more than a preset range, or after a preset time period. Based on this, the continuous presentation of the displayed object can be guaranteed.

[0023] In one possible implementation, the first positioning module of the first display device includes: a first antenna array, the first antenna array including a plurality of first antenna elements, at least two of the plurality of first antenna elements being distributed in a first direction and a second direction respectively, the first direction being perpendicular to the second direction; the control device includes a second antenna array, the second antenna array including a plurality of second antenna elements; the first positioning module receiving first positioning information from the control device includes: the first antenna array receiving the first positioning information from the second antenna array of the control device.

[0024] As one possible implementation, presenting the corresponding display object on the first display screen based on the first positioning information includes: determining the position of the display object presented on the first display device according to the first positioning information received from the second antenna array and the second positioning information sent by the first antenna array.

[0025] As one possible implementation, the first antenna element is provided with at least three, and the second antenna element is provided with at least two.

[0026] In one possible implementation, the plurality of first antenna elements are respectively a first antenna, a second antenna, and a third antenna, wherein the first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on the side of the first antenna in the first direction, and the third antenna is located on the side of the first antenna in the second direction.

[0027] As one possible implementation, the distance between any two first antenna elements having the function of receiving the first signal is less than or equal to the wavelength of the first signal; and / or, the distance between any two second antenna elements having the function of receiving the second signal is less than or equal to the wavelength of the second signal.

[0028] As one possible implementation, the first antenna is a transceiver antenna, or the first antenna includes a receiving antenna and a transmitting antenna.

[0029] As one possible implementation, the multiple first antenna elements are arranged in an L-shape, a triangle, or a rectangular array.

[0030] As one possible implementation, the plane formed by the first direction and the second direction is parallel to the display interface of the first electronic device.

[0031] As one possible implementation, the first antenna array is located on the upper side of the display device.

[0032] Secondly, this application provides a positioning method applied to a system including a first electronic device and a second electronic device. The first electronic device is provided with a first antenna array, which includes a plurality of first antenna elements. At least two of the plurality of first antenna elements are distributed in a first direction and a second direction, respectively, and the first direction is perpendicular to the second direction.

[0033] The second electronic device is provided with a second antenna array, which includes multiple second antenna elements;

[0034] The method includes: determining the position of a first cursor displayed on the first electronic device based on a first signal transmitted by the second antenna array and a second signal transmitted by the first antenna array.

[0035] This application can accurately display the position of the first cursor on the first electronic device through the mutual positioning of the first antenna array and the second antenna array, thereby improving the accuracy of the second antenna array positioning and enhancing the user experience in spatial pointing operations.

[0036] In one possible implementation, determining the position of the first cursor displayed on the first electronic device based on the first signal transmitted by the second antenna array and the second signal transmitted by the first antenna array specifically includes:

[0037] The first coordinate of the second antenna array in the three-dimensional coordinate system in which the first antenna array is located is measured based on the first signal;

[0038] The deflection angle of the second antenna array relative to the first direction and the second direction is measured based on the second signal;

[0039] The second coordinate is obtained based on the first coordinate and the deflection angle;

[0040] The position of the first cursor is determined based on the second coordinate.

[0041] Specifically, by using the first antenna array to obtain the first signal transmitted by the second antenna array, the relative coordinates of the second antenna array with respect to the first antenna array can be obtained, i.e., the first coordinates. These first coordinates can be used to locate the spatial position of the second antenna array. By using the second signal transmitted by the second antenna array with respect to the first antenna array, the deflection angle of the second antenna array with respect to the first direction X and the second direction Y can be determined. Finally, the final second coordinates can be obtained based on the first coordinates and the deflection angles. Thus, through the mutual positioning of the first and second antenna arrays, the absolute coordinates of the second antenna array with respect to the first electronic device can be obtained. These absolute coordinates can be displayed on the first electronic device in the form of a cursor.

[0042] Specifically, if the radiating surface of the first antenna array is parallel to the display interface of the first electronic device, the second coordinate is the position of the cursor that can be displayed on the first electronic device by operating the second electronic device. Furthermore, if the radiating surface of the first antenna array is not parallel to the display interface of the first electronic device, the second coordinate needs to be further calculated based on the physical positional relationship between the first antenna array and the display interface, and the calculated cursor position on the display interface is obtained.

[0043] In one possible implementation, determining the position of the first cursor based on the second coordinates specifically includes:

[0044] Based on the second coordinates and the size of the first electronic device, determine the position of the first cursor that can be displayed on the first electronic device.

[0045] The second coordinate can be associated with the size of the first electronic device. If the second coordinate is within the size range of the first electronic device in the first direction or the corresponding coordinate value in the second direction, a first cursor can be displayed on the first electronic device according to the second coordinate. The first cursor can move within the display interface of the first electronic device according to the movement of the second electronic device, which has good directional accuracy and can improve the user experience.

[0046] In one possible implementation, a third coordinate is obtained based on the first coordinate and the deflection angle, and the position of a second cursor that cannot be displayed on the first electronic device is determined based on the third coordinate and the size of the first electronic device.

[0047] The third coordinate can be associated with the size of the first electronic device. If the coordinate value of the third coordinate in the first direction X or the second direction Y exceeds the size range of the first electronic device, it means that the position for displaying the cursor obtained based on the third coordinate cannot fall within the range of the first electronic device. In this case, the cursor position obtained is the second cursor position that cannot be displayed on the first electronic device. Therefore, if the third coordinate is outside the range of the first electronic device, even if the second electronic device moves, the cursor will not be displayed on the first electronic device, thus avoiding the problem of inaccurate pointing.

[0048] In one possible implementation, at least three first antenna elements and at least two second antenna elements are provided. At least some of the at least three first antenna elements have signal receiving and / or signal transmitting functions, and the at least three first antenna elements are arranged in a predetermined pattern to facilitate the calculation of the first coordinates. At least two second antenna elements may also have signal receiving and / or signal transmitting functions, and the at least two second antenna elements are also arranged in a predetermined pattern to facilitate the calculation of the deflection angle.

[0049] In one possible implementation, the plurality of first antenna elements are a first antenna, a second antenna, and a third antenna, wherein the first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on the side of the first antenna in the first direction, and the third antenna is located on the side of the first antenna in the second direction.

[0050] By positioning the first antenna at the intersection of the first and second directions, a coordinate system can be easily established, with the first antenna serving as the origin of the coordinate system. Furthermore, by positioning the second and third antennas at the first and second directions of the first antenna, respectively, the phase in the first and second directions can be easily obtained, thus facilitating the calculation of the first coordinate.

[0051] In one possible implementation, the distance between any two first antenna elements having the function of receiving the first signal is less than or equal to the wavelength of the first signal; and / or, the distance between any two second antenna elements having the function of receiving the second signal is less than or equal to the wavelength of the second signal, so that each first antenna element used to receive the signal can receive the first signal almost simultaneously, each second antenna element can receive the second signal almost simultaneously, and each first antenna element can obtain a phase parameter based on the first signal, and each second antenna element can obtain a deflection angle based on the second signal.

[0052] In one possible implementation, the second antenna is provided with one or more at intervals in the first direction, and the third antenna is provided with one or more at intervals in the second direction. When both the second and third antennas are provided in single units, the arrangement of the antennas is convenient, and the calculation of the first coordinates is also easier. When both the second and third antennas are provided in multiple units, the first antenna array can have better radiation performance. Of course, it is also possible to have one second antenna and multiple third antennas, or multiple second antennas and one third antenna, thereby achieving flexible arrangement of the antennas.

[0053] In one possible implementation, the first signal includes a time parameter and a first phase parameter;

[0054] The step of measuring the first coordinates of the second antenna array in the three-dimensional coordinate system where the first antenna array is located based on the first signal specifically includes:

[0055] The distance between the first antenna array and the second antenna array is obtained based on the time parameter;

[0056] The first coordinates are obtained based on the distance and the first phase parameter.

[0057] The distance between the first antenna array and the second antenna array can be accurately obtained based on the time parameter. At the same time, the accuracy of the first coordinate calculation can be improved by combining the first phase parameter in the first signal.

[0058] In one possible implementation, the first antenna may have the function of transmitting a second signal, and the distance between the first antenna array and the second antenna array may specifically be a first distance between the first antenna and the second antenna array. Obtaining the first coordinates based on the distance and the first phase parameter specifically includes:

[0059] The first phase difference between the second antenna and the first antenna, and the second phase difference between the third antenna and the first antenna are obtained based on the first phase parameter.

[0060] The x-axis and z-axis coordinates in the first coordinate system are obtained based on the first distance, the distance between the second antenna and the first antenna, and the first phase difference; the y-axis coordinate is obtained based on the first distance, the distance between the third antenna and the first antenna, and the second phase difference.

[0061] The first phase parameters obtained by the second and third antennas are both within the same signal period. The first coordinates can be accurately calculated based on the first distance and the first phase difference and second phase difference obtained from the first phase parameters.

[0062] In one possible implementation, the second antenna array includes a fourth antenna, a fifth antenna, and a sixth antenna, wherein the fifth antenna is located on one side of the fourth antenna in a third direction, and the sixth antenna is located on one side of the fourth antenna in a fourth direction, wherein the third direction is perpendicular to the fourth direction.

[0063] The fourth antenna can be located at the intersection of the third direction and the fourth direction. By placing the fifth and sixth antennas in the third direction and the fourth direction of the fourth antenna, respectively, it is easy to obtain the deflection angle of the second antenna array relative to the first and second directions.

[0064] In one possible implementation, the second signal includes a second phase parameter;

[0065] Measuring the deflection angle of the second antenna array relative to the first direction and the second direction based on the second signal specifically includes:

[0066] The deflection angle is obtained based on the second phase parameter, thereby improving the accuracy of the deflection angle calculation.

[0067] In one possible implementation, obtaining the deflection angle based on the second phase parameter specifically includes:

[0068] The third phase difference between the fifth antenna and the fourth antenna, and the fourth phase difference between the sixth antenna and the fourth antenna are obtained based on the second phase parameter.

[0069] The first deflection angle of the second antenna array in the first direction is obtained based on the third phase difference, and the second deflection angle of the second antenna array in the second direction is obtained based on the fourth phase difference.

[0070] The second phase parameters obtained by the fifth and sixth antennas are both within the same signal period. The deflection angle can be accurately calculated based on the third and fourth phase differences obtained from the second phase parameters.

[0071] In one possible implementation, the second antenna array includes a fourth antenna, a fifth antenna, and an accelerometer, wherein the fifth antenna is located on one side of the fourth antenna in a third direction, the accelerometer is located on one side of the fourth antenna in a fourth direction, and the third direction is perpendicular to the fourth direction.

[0072] The second signal includes a second phase parameter;

[0073] Measuring the deflection angle of the second antenna array relative to the first direction and the second direction based on the second signal specifically includes:

[0074] The third phase difference between the fifth antenna and the fourth antenna is obtained based on the second phase parameter;

[0075] The first deflection angle of the second antenna array in the first direction is obtained based on the third phase difference, and the second deflection angle of the second antenna array in the second direction is obtained based on the second phase parameter.

[0076] Among them, the acceleration sensor can replace the function of the sixth antenna, thereby reducing the arrangement of one antenna. That is, only the fourth and fifth antennas need to be arranged on the second electronic device. The acceleration sensor can work with the fifth antenna to obtain the deflection angle of the second antenna array.

[0077] In one possible implementation, obtaining the distance between the first antenna array and the second antenna array based on the time parameter specifically includes:

[0078] Detect the first time point at which the second antenna array emits the first signal;

[0079] Detect the second time point at which the first antenna array receives the first signal;

[0080] The distance is obtained based on the first time point, the second time point, and the predetermined speed value.

[0081] The distance measurement method is a one-way ranging method. This method requires precise time synchronization between the first and second antenna arrays, enabling ranging through a single signal transmission and reception, thus simplifying operation. For ease of calculation, the predetermined velocity value can be the speed of light; however, other velocity values ​​can be used when velocity interference or errors exist. Furthermore, when the first antenna array includes the aforementioned first antenna with signal transmission function, the distance between the first and second antenna arrays can specifically be the distance between the first antenna and the second antenna array.

[0082] In one possible implementation, obtaining the distance between the first antenna array and the second antenna array based on the time parameter specifically includes:

[0083] Detect the first time point at which the second antenna array emits the first signal;

[0084] Detect the second time point at which the first antenna array receives the first signal;

[0085] Detect the delay time of the first antenna array in processing the first signal;

[0086] Detect the third time point at which the first antenna array emits the second signal;

[0087] The fourth time point at which the second antenna array receives the second signal is detected;

[0088] The distance is obtained based on the first time point, the second time point, the delay duration, the third time point, the fourth time point, and the predetermined speed value.

[0089] The distance measurement method is a two-way ranging method. This method can be used if the clocks of the second antenna array and the first antenna array are not synchronized. This method can take into account the delay factor of signal processing, making the distance measurement more accurate. For ease of calculation, the predetermined velocity value can be the speed of light, or other speeds, which will not be elaborated further here.

[0090] In one possible implementation, the first antenna is a transceiver antenna, meaning that the first antenna can have the function of receiving and transmitting signals, and the function can be switched by a switch, thereby reducing the number of antennas, saving space, and facilitating antenna arrangement.

[0091] In one possible implementation, the first antenna includes a receiving antenna and a transmitting antenna, that is, the first antenna includes two antennas, the transmitting antenna is used to transmit signals and the receiving antenna is used to receive signals. The first antenna does not require a switching switch, and the corresponding transmission and reception functions can be realized by each antenna.

[0092] In one possible implementation, the multiple first antenna elements are arranged in an L-shape, a triangle, or a rectangular array, which facilitates the flexible arrangement of each first antenna element.

[0093] In one possible implementation, the plane formed by the first direction and the second direction is parallel to the display interface of the first electronic device, which facilitates the geometric calculation of the coordinate values ​​of each coordinate point in the first coordinate and helps to improve the accuracy of the first coordinate.

[0094] Thirdly, this application also provides a positioning system, wherein the positioning system is used to implement the positioning method provided in the first aspect of this application, the positioning system comprising: a first electronic device and a second electronic device;

[0095] The first electronic device is provided with a first antenna array and a first module circuit. The first antenna array is used to transmit a second signal and to receive a first signal transmitted by the second antenna array in the second electronic device. The first module circuit is electrically connected to the first antenna array.

[0096] The second electronic device is equipped with a second antenna array and a second module circuit. The second antenna array is used to transmit the first signal and to receive the second signal; the second module circuit is electrically connected to the second antenna array.

[0097] The first module circuit or the second module circuit is used to determine the position of the first cursor displayed on the first electronic device based on the first signal and the second signal.

[0098] The positioning system can accurately display the position of the first cursor on the first electronic device through the mutual positioning of the first antenna array and the second antenna array, which improves the accuracy of the second antenna array and also enhances the user experience in spatial pointing operations.

[0099] In one possible implementation, the first module circuit includes a control unit, a computing unit, a transmitter, and a receiver;

[0100] The transmitter is connected to the first antenna array and is used to control the first antenna array to transmit the second signal;

[0101] The receiver is connected to the first antenna array and is used to control the first antenna array to receive the first signal;

[0102] The calculation unit is used to calculate the phase parameters in the first signal;

[0103] The control unit is used to control the operation of the receiver and the transmitter, and is also used to calculate the first coordinates of the second antenna array based on the calculation results of the calculation unit.

[0104] In one possible implementation, the first antenna array includes a first antenna, a second antenna, and a third antenna. The first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on one side of the first antenna in the first direction, and the third antenna is located on the other side of the first antenna in the second direction. The second antenna and the third antenna are electrically connected to the receiver, respectively.

[0105] The first antenna is a transceiver antenna; the first module circuit also includes a switching switch, which is electrically connected to the first antenna, the transmitter and the receiver respectively, and the switching switch is used to switch the first antenna to be electrically connected to the transmitter or to the receiver.

[0106] The first antenna can be used to receive and transmit signals. Its function can be switched by a switch, thereby reducing the number of antennas, saving space, and facilitating antenna arrangement.

[0107] In one possible implementation, the first antenna array includes a first antenna, a second antenna, and a third antenna. The first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on one side of the first antenna in the first direction, and the third antenna is located on the other side of the first antenna in the second direction. The second antenna and the third antenna are electrically connected to the receiver, respectively.

[0108] The first antenna includes a transmitting antenna and a receiving antenna, wherein the transmitting antenna is electrically connected to the transmitter and the receiving antenna is electrically connected to the receiver.

[0109] The first antenna includes two antennas: a transmitting antenna for transmitting signals and a receiving antenna for receiving signals. The first antenna does not require a switching switch, and the corresponding transmitting and receiving functions can be realized by each antenna separately.

[0110] In one possible implementation, one receiver is provided, and the receiver is electrically connected to a first antenna element in the first antenna array that has the function of receiving signals. Thus, a single receiver can achieve the signal reception function of multiple first antenna elements, allowing multiple first antenna elements to receive signals almost simultaneously, and enabling the calculation of a first coordinate based on the phase difference between the various first antenna elements. In another possible implementation, multiple receivers are provided, and each receiver is electrically connected to one of the first antenna elements in the first antenna array that has the function of receiving signals.

[0111] Among them, the receivers can be synchronized through a synchronization signal, thereby obtaining the phase difference between the first antenna elements.

[0112] In one possible implementation, the second module circuit includes a control unit, a computing unit, a transmitter, and a receiver;

[0113] The transmitter is connected to the second antenna array and is used to control the second antenna array to transmit the first signal;

[0114] The receiver is connected to the second antenna array and is used to control the second antenna array to receive the second signal;

[0115] The calculation unit is used to calculate the phase parameters in the second signal;

[0116] The control unit is used to control the operation of the receiver and the transmitter, and is also used to calculate the deflection angle of the second antenna array based on the calculation results of the calculation unit.

[0117] Fourthly, this application also provides an electronic device, which is a first electronic device. The first electronic device is provided with a first antenna array, which includes a plurality of first antenna elements. At least two of the plurality of first antenna elements are distributed in a first direction and a second direction, respectively. The first direction is perpendicular to the second direction. The first antenna array is used to receive signals transmitted by a second antenna array on a second electronic device and determine the position of a first cursor displayed on the first electronic device based on the signals.

[0118] The first electronic device provided in this application is capable of receiving signals from the second antenna array via the first antenna array and sending signals to the second antenna array via the first antenna array. The second antenna array is capable of processing the signals it receives, thereby achieving mutual positioning through the signals exchanged between the first and second antenna arrays. This allows the absolute coordinates of the second antenna array relative to the first electronic device to be obtained, and the second antenna array can accurately point to a specified location of the first electronic device.

[0119] In one possible implementation, the plurality of first antenna elements are a first antenna, a second antenna, and a third antenna, wherein the first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on the side of the first antenna in the first direction, and the third antenna is located on the side of the first antenna in the second direction.

[0120] In one possible implementation, the distance between any two first antenna elements capable of receiving the first signal is less than or equal to the wavelength of the first signal. This allows each first antenna element capable of receiving the signal to receive the first signal almost simultaneously, and enables each first antenna element to obtain phase parameters based on the first signal.

[0121] Fifthly, a display device includes a positioning module and a display screen; wherein the positioning module is used to send and receive positioning information with a control device; the display screen is used to present interface effects; and the positioning module and the display screen are used to support the display device in implementing the method described in either the first or second aspect.

[0122] In a sixth aspect, a computer-readable storage medium is provided that stores computer program instructions that, when executed by a processor, implement the method as described in any possible implementation of the first or second aspect.

[0123] In a seventh aspect, a computer program product comprising instructions is provided, which, when run on a computer, causes the computer to implement the method as described in any possible implementation of the first or second aspect.

[0124] Eighthly, a chip system is provided, comprising processing circuitry and a storage medium storing computer program instructions; when executed by the processor, the computer program instructions implement the method as described in any possible implementation of the first or second aspect. The chip system may be composed of chips or may include chips and other discrete devices. Attached Figure Description

[0125] Figure 1 This is a schematic diagram illustrating the presentation process of a remote control cursor in a typical single-display device scenario.

[0126] Figure 2 This is a schematic diagram illustrating the presentation process of a remote control cursor in a typical multi-display device scenario.

[0127] Figure 3 This application provides a schematic diagram of a device remote control system architecture in a single-display device scenario.

[0128] Figure 4 A schematic diagram illustrating the presentation process of a remote control cursor in a single-display device scenario, provided as an embodiment of this application;

[0129] Figure 5 This application provides a schematic diagram of a device remote control system architecture in a multi-display device scenario.

[0130] Figure 6 A schematic diagram illustrating the presentation process of a remote control cursor in a multi-display device scenario, provided as an embodiment of this application;

[0131] Figure 7 The device display control method flow in a single-device scenario provided in the embodiments of this application Figure 1 ;

[0132] Figure 8 This application provides a schematic diagram of a method for determining the coordinate system of a display screen based on a multi-antenna UWB positioning method, as illustrated in an embodiment of the present application.

[0133] Figure 9 A flowchart illustrating how to determine the coordinate system of a display screen using a multi-antenna UWB positioning method is provided in this application embodiment;

[0134] Figure 10 A schematic diagram illustrating another method for determining the coordinate system of a display screen based on a multi-antenna UWB positioning method provided in this application embodiment;

[0135] Figure 11 This application provides a schematic diagram of a process for determining the pointing position of a control device.

[0136] Figure 12 A three-dimensional electromagnetic coil positioning system architecture diagram provided for embodiments of this application;

[0137] Figure 13 This application provides a schematic diagram illustrating the determination of the pointing position of a control device based on a three-dimensional electromagnetic coil positioning method, as an embodiment of the present application.

[0138] Figure 14 A schematic diagram illustrating a method for determining the pose of a control device based on a three-dimensional electromagnetic coil positioning method, provided as an embodiment of this application;

[0139] Figure 15 The device display control method flow in a single-device scenario provided in the embodiments of this application Figure 2 ;

[0140] Figure 16 This is a schematic diagram illustrating a cursor rendering effect provided in an embodiment of this application.

[0141] Figure 17 This is a flowchart of a device display control method in a multi-device scenario provided in an embodiment of this application;

[0142] Figure 18 The cursor traversal process in a multi-device scenario provided in the embodiments of this application Figure 1 ;

[0143] Figure 19 A schematic diagram of the cursor crossing process provided in the embodiments of this application. Figure 1 ;

[0144] Figure 20 The cursor traversal process in a multi-device scenario provided in the embodiments of this application Figure 2 ;

[0145] Figure 21 A schematic diagram of the cursor crossing process provided in the embodiments of this application. Figure 2 ;

[0146] Figure 22 The cursor traversal process in a multi-device scenario provided in the embodiments of this application Figure 3 ;

[0147] Figure 23 A schematic diagram illustrating the update result of the coordinate system of the display carrier when the orientation of the projector changes, as provided in an embodiment of this application.

[0148] Figure 24 A schematic diagram illustrating the update result of the coordinate system of the display carrier when the projector's orientation changes, as provided in another embodiment of this application.

[0149] Figure 25 This is a schematic diagram illustrating the process of a cursor traversing between display devices with different attributes, provided in an embodiment of this application.

[0150] Figure 26 An architecture diagram of the positioning system provided in the embodiments of this application;

[0151] Figure 27 A schematic diagram of the structure of the first electronic device provided in the embodiments of this application;

[0152] Figure 28 This application provides an embodiment of the arrangement of a first antenna array on a first electronic device.

[0153] Figure 29 This is a schematic diagram of one arrangement of the first antenna element;

[0154] Figure 30 This is a schematic diagram of another arrangement of the first antenna element;

[0155] Figure 31 This is another schematic diagram of the arrangement of the first antenna element;

[0156] Figure 32 This is a schematic diagram of the structure of the second electronic device provided in an embodiment of this application;

[0157] Figure 33 A diagram showing the arrangement of the second linear array on a second electronic device, provided as an embodiment of this application;

[0158] Figure 34 A model diagram for calculating the first coordinates provided in an embodiment of this application;

[0159] Figure 35 A schematic diagram of a one-way ranging method provided in an embodiment of this application;

[0160] Figure 36 A schematic diagram of a two-way ranging method provided in an embodiment of this application;

[0161] Figure 37 Another model diagram for calculating the first coordinate provided in the embodiments of this application;

[0162] Figure 38 Another model diagram for calculating the first coordinates provided in this application embodiment;

[0163] Figure 39 A flowchart illustrating a positioning method provided in one embodiment of this application;

[0164] Figure 40 A flowchart of a positioning method provided in another embodiment of this application.

[0165] Figure label:

[0166] 100 - First electronic device;

[0167] 110 - Power Module;

[0168] 120 - First antenna array;

[0169] 120a - First antenna element;

[0170] 121 - First Antenna;

[0171] 121a - Transmitting antenna;

[0172] 122 - Second day line;

[0173] 123 - Third antenna;

[0174] 130 - First module circuit;

[0175] 131 - Control Unit;

[0176] 132 - Computational Unit;

[0177] 133 - Transmitter;

[0178] 134 - Receiver;

[0179] 135 - Toggle switch;

[0180] 140-processor;

[0181] 150 - Transmission interface;

[0182] 160 - Display interface;

[0183] 200 - Second electronic device;

[0184] 210 - Power Module;

[0185] 220-Second day linear array;

[0186] 221 - Fourth Antenna;

[0187] 221a - Transmitting antenna;

[0188] 222 - Fifth Antenna;

[0189] 223 - Sixth Antenna;

[0190] 230 - Second module circuit;

[0191] 231-Control Unit;

[0192] 232 - Computational Unit;

[0193] 233-Transmitter;

[0194] 234 - Receiver;

[0195] 235 - Toggle switch;

[0196] 240-processor;

[0197] 250 - Transmission interface. Detailed Implementation

[0198] The technical solutions of the embodiments of this application will be described below with reference to the accompanying drawings. In the description of the embodiments of this application, unless otherwise stated, " / " means "or," for example, A / B can mean A or B; "and / or" in this text is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent: A existing alone, A and B existing simultaneously, and B existing alone. Furthermore, in the description of the embodiments of this application, "multiple" refers to two or more than two.

[0199] In the following text, the terms "first," "second," etc., are used only to distinguish different descriptive objects and do not limit the position, order, priority, quantity, or content of the described objects. For example, if the described object is a "field," then the ordinal numbers before "field" in "first field" and "second field" do not limit the position or order of the "fields," nor do "first" and "second" limit whether the "fields" they modify are in the same message, nor do they restrict the order of "first field" and "second field." Similarly, if the described object is a "level," then the ordinal numbers before "level" in "first level" and "second level" do not limit the priority of the "levels." Furthermore, the quantity of the described objects is not limited by ordinal numbers and can be one or more; for example, in "first display device," the number of "devices" can be one or more. Furthermore, the objects modified by different prefixes can be the same or different. For example, if the object being described is "device," then "first display device" and "second display device" can be devices of the same type or different types. Similarly, if the object being described is "information," then "first information" and "second information" can be information with the same content or information with different content. In summary, the use of ordinal numbers and other prefixes used to distinguish the objects being described in this application does not constitute a limitation on the objects being described. The description of the objects being described is based on the claims or the context of the embodiments, and should not constitute an unnecessary limitation due to the use of such prefixes.

[0200] Furthermore, in the embodiments of this application, "connection" can be a direct connection or an indirect connection; in addition, it can refer to an electrical connection or a communication connection; for example, the connection of two electrical components A and B can refer to A and B being directly connected, or it can refer to A and B being indirectly connected through other electrical components or connection media, or it can refer to A and B being indirectly connected through other communication devices or communication media, as long as it enables communication between A and B.

[0201] As mentioned above, when determining the presentation position of display objects such as cursors, the cursor displacement is often determined based on the relative pose changes of the control device, thereby determining the cursor's presentation position. For example, the cursor displacement relative to the historical cursor presentation position can be determined based on the pose changes of the control device relative to historical poses, where historical poses include the initial pose, the most recently determined pose, etc., and historical cursor presentation positions include the initial cursor presentation position, the most recently presented cursor presentation position, etc.

[0202] In the above-mentioned scheme for determining the cursor position based on the relative pose change of the control device, the initial cursor position corresponding to the initial pose of the control device is usually a preset default position, which is unrelated to the actual pose of the control device. Therefore, the cursor position is not necessarily the actual pointing position of the control device. In other words, there is a deviation between the cursor position on the display device and the actual pointing position of the control device, resulting in a poor user experience. For example, even when the control device is actually pointing outside the display screen, the cursor will still be displayed on the screen. Figure 1 When the control device in pose A1 is actually pointing to position B1 outside the display screen, the cursor is displayed on... Figure 1 The cursor on the display screen is shown at position C1. For example, when the control device is actually pointing to the first position on the display screen, the cursor is displayed at a second position, where the first and second positions are different. Figure 1 When the control device, positioned at A2, is actually pointing to position B2, the cursor is displayed at position C2 on the screen. For example... Figure 1 When the control device, which is in pose A3, is actually pointing to position B3, the cursor is displayed at position C3 on the screen.

[0203] Furthermore, when a scheme based on the relative pose change of the control device to determine the cursor position is applied in a single-display device scenario, the cursor will typically remain at the edge of the display screen (referred to as the frame) when the actual pointing position of the control device moves off the screen. For example, when the control device with a pose of A4 is actually pointing... Figure 1 When the cursor is at position B4 outside the display screen, it will get stuck. Figure 1 The edge position of the display screen is C4. Furthermore, when the pose of the control device is... Figure 1 The pose A4 shown changes as follows Figure 1 When the shown pose A5 is obtained, although the actual pointing position of the control device is changed from... Figure 1 The change shown in B4 is as follows Figure 1 As shown in B5, but the cursor position C5 is based on... Figure 1 The position of the card frame shown is determined by the cursor position C4. In this case, the deviation between the cursor position and the actual pointing position of the control device will be aggravated, resulting in a worse user experience.

[0204] Alternatively, when a scheme based on the relative pose changes of control devices to determine the cursor's position is applied in a multi-display-device scenario, when the cursor leaves its current device (e.g., the first display device) and moves to a corresponding display device (e.g., the second display device), the second display device will continue to display the cursor from the first display device. Since the device currently containing the cursor is unaware of other surrounding display devices, the positional relationships between the multiple display devices usually need to be pre-set. For example... Figure 2 As shown, after the orientation relationships between the first, second, and third display devices are pre-set, when the cursor leaves the first display device and moves to the second display device located above the first display device, the second display device continues to display the cursor; or when the cursor leaves the first display device and moves to the third device located to the right of the first display device, the third device continues to display the cursor. However, this solution requires that the orientation relationships between multiple display devices be pre-determined and set. Figure 2 When the orientation of multiple display devices changes and the settings are not updated in a timely manner, the cursor display logic will not automatically adjust to the changes in the orientation of the display devices. This may result in a mismatch between the cursor display and the actual scene, affecting the user experience. Furthermore, this solution only considers the orientation of multiple display devices; it does not perform adaptive cursor display adjustments based on differences in the type, screen size, and screen resolution of the display devices, nor does it adjust the cursor display based on the specific distance between the screens of the multiple display devices. For example, when the cursor is in… Figure 2 When the cursor moves between two display devices that are far apart, it will directly enter the display of the other device after moving out of the edge area of ​​the display of one device. The jump in viewing distance will cause the cursor to move unsmoothly, affecting the user's operation experience. Similarly, when the cursor moves between two display devices with different display resolutions, the difference in display resolution may cause the actual coordinates of the cursor to appear differently on the two displays. This will also cause the cursor to move unsmoothly due to the jump in viewing distance, affecting the user's operation experience.

[0205] Furthermore, in the scheme of determining the cursor position based on the relative pose change of the control device, the displacement of the cursor and the angle change of the control device are in a fixed proportional relationship regardless of how far the control device is from the display screen. This will result in the same angle deflection corresponding to the same cursor movement distance when the user operates the cursor at different distances, thus the user's operation experience is very different when operating the cursor at different distances.

[0206] To address the problems existing in the conventional methods for determining the cursor position, this application provides a device display control method. This method can determine the cursor position based on the direction of the control device, thereby solving problems such as the deviation between the cursor position and the actual direction of the control device, the frame problem when the cursor moves out of the edge of the display screen, and the inability of the cursor presentation logic to automatically perceive the orientation relationship between the displays of multiple display devices, the type of multiple display devices, the display size of multiple display devices, the display resolution of multiple display devices, and the distance between the displays of multiple display devices.

[0207] It should be noted that the cursor described in this application embodiment is a cursor in a broad sense, and the display form of the cursor can be various, including but not limited to arrows, dots, editable icons, etc. In some embodiments, the display form of the cursor can be adaptively displayed based on different interfaces, such as in the form of an editable icon in an editable document, or in the form of an arrow in a folder interface. This application embodiment does not make specific limitations. The following embodiments use "cursor" as an example.

[0208] In this embodiment, both the control device and the display device include a wireless positioning unit. The wireless positioning units of the control device and the display device can mutually locate each other by transmitting and receiving positioning information. For example, the wireless positioning units of the control device and the display device can determine the intersection point of the plane where the control device is pointing and the display screen is located by transmitting and receiving positioning information. This intersection point is the pointing position of the control device. When the pointing position of the control device is on the display screen, the display device can follow the movement trajectory of the control device and present the corresponding interface effect on the display screen. When the pointing position of the control device is not on the display screen, the display device does not present the corresponding interface effect on the display screen.

[0209] As an example, the interface effects presented on the display screen may include, but are not limited to, presenting display objects (such as icons, cursors, components, virtual avatars, images, etc.) at the pointing position of the control device, displaying corresponding viewing angle effects according to the pointing position of the control device, and presenting pre-set special effects in the corresponding display area (such as a preset control hotspot) according to the pointing position of the display control device. In the following embodiments, the cursor is used as an example to specifically introduce the solution provided by the embodiments of this application. For display objects of other display forms, the specific implementation process of cursor presentation can also be referred to.

[0210] For example, in a demonstration scenario, the interface displayed on the screen might show a cursor pointing at the location indicated by the control device.

[0211] For example, in a game scene, the interface effects displayed on the screen may include displaying the game protagonist's image at the location pointed to by the control device, displaying the game protagonist's image at the location pointed to by the control device from a preset perspective, displaying game equipment at the location pointed to by the control device, displaying game effects (such as bubble effects, firework effects, etc.) at the location pointed to by the control device, and displaying game effects (such as aiming effects, hit effects, etc.) in the corresponding display area according to the location pointed to by the control device.

[0212] For example, in a handwriting tablet scenario, the interface effect presented on the display screen is such as displaying the stylus image and handwriting at the position pointed to by the control device, and displaying handwriting in the corresponding display area (such as the historical trajectory of the stylus image) according to the position pointed to by the control device.

[0213] It should be noted that the interface effects presented on the display screen by the above-described display device following the movement trajectory of the control device are only examples. In actual applications, the effects can be determined according to the specific application scenario, device functions, etc. For example, in some embodiments, the display device can present icons, virtual images and special effects from a preset perspective on the display screen while following the movement trajectory of the control device. For instance, when the pointing position of the control device is located in a preset control hot zone, the display device can present icons along with corresponding virtual images and special effects from a preset perspective.

[0214] As an example, when locating each other by sending and receiving positioning information, the control device or the display device can determine the direction of the control device, the coordinate system of the display screen of the display device, and the pose of the display screen of the display device relative to the control device by sending and receiving positioning information. Then, the intersection point of the direction of the control device and the plane where the display screen of the display device is located is determined, which is the direction position of the control device. Finally, the direction position of the control device is used as the cursor display position.

[0215] In some implementations, the display device can determine the coordinate system of the display screen and send it to the control device. The control device can then determine the direction of the control device and the pose of the display screen relative to the control device. Based on the above information, the control device can determine the direction position and then send the direction position to the display device so that the display device can display the cursor at the corresponding position.

[0216] In other implementations, the control device can determine the direction of the control device and send it to the display device. The display device can then determine the coordinate system of the display screen and the pose of the display screen relative to the control device. Based on the above information, the control device can determine the pointing position and display a cursor at the corresponding position.

[0217] The implementation subject of the computing control device is not specifically limited in this application embodiment, and can be determined according to the actual device function or application scenario.

[0218] In some examples, the control device described in this application embodiment may include, but is not limited to, a remote control, an air mouse, or a portable device. For example, a portable device may include, but is not limited to, a smartphone, smartwatch, smart bracelet, phone watch, smart ring, smart glasses, augmented reality (AR) / virtual reality (VR) game controller, etc. Alternatively, the control device may also be other types or structures of wearable devices, handheld devices, head-mounted devices, etc. with remote control functionality, which are not limited in this application embodiment.

[0219] In some examples, the display device described in this application embodiment may include, but is not limited to, netbooks, tablet computers, handwriting tablets, in-vehicle computers, personal computers (PCs), smart TVs, laser TVs, AR / VR devices (such as VR glasses), projection devices (such as projectors), motion-sensing game consoles, etc. Alternatively, the display device may also be other types or structures of electronic devices with display functions, which are not limited in this application embodiment.

[0220] For example, please refer to Figure 3 , Figure 3 This illustration shows a schematic diagram of a device remote control system architecture in a single-display device scenario according to an embodiment of this application. The device remote control system includes a control device 310 and a first display device 320. The first display device 320 is used for interface display, and the control device 310 is used for display control and / or operation control of the first display device 320.

[0221] like Figure 3 As shown, the control device 310 includes a processing unit 310-1, a power management unit (PMU) 310-2, a wireless positioning unit 310-3, and a communication unit 310-4.

[0222] The processing unit 310-1 may be a central processing unit (CPU). In some embodiments, the processing unit 310-1 may include one or more interfaces. Interfaces may include, but are not limited to, inter-integrated circuit (I2C) interfaces, inter-integrated circuit sound (I2S) interfaces, pulse code modulation (PCM) interfaces, universal asynchronous receiver / transmitter (UART) interfaces, mobile industry processor interfaces (MIPI), and general-purpose input / output (GPIO) interfaces.

[0223] The processing unit 310-1 may also include a storage unit for storing instructions and data. In some embodiments, the storage unit in the processing unit 310-1 is a cache memory. This storage unit can store instructions or data that the processing unit 310-1 has just used or is recurring. If the processing unit 310-1 needs to use the instruction or data again, it can directly retrieve it from the storage unit. This avoids repeated access, reduces the waiting time of the processing unit 310-1, and thus improves the efficiency of the system.

[0224] The power management unit 310-2 is used to connect the battery and the processing unit 310-1. The power management unit 310-2 receives input from the battery and supplies power to the processing unit 310-1, the wireless positioning unit 310-3, and the communication unit 310-4. For example, the power management unit 310-2 can convert the power level to a level suitable for each module, such as the processing unit 310-1, the wireless positioning unit 310-3, and the communication unit 310-4, to provide power. The power management module 310-2 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management unit 310-2 may also be located within the processing unit 310-1.

[0225] The wireless positioning unit 310-3 is used to determine the orientation of the control device 310.

[0226] In some embodiments of this application, the wireless positioning unit 310-3 can also be used to determine the pose of the display screen (denoted as the first display screen) of the first display device 320 relative to the control device 320, and to determine the intersection point of the direction of the control device 310 and the plane where the first display screen is located, i.e., the direction of the control device 310.

[0227] For example, the wireless positioning unit 310-3 may include, but is not limited to, one or more of the following: a multi-antenna ultra-wideband radio (UWB) positioning module, a multi-antenna millimeter-wave radar positioning module, a three-dimensional electromagnetic coil positioning module, and a three-dimensional ultrasonic positioning module. The wireless positioning unit 310-3 can use one or more of the above modules to mutually send and receive positioning information with the wireless positioning unit 320-3 of the first display device 320 to determine the orientation of the control device 310 and the pose of the first display screen relative to the control device 320. The positioning information may include one or more of the following: UWB signals, millimeter-wave radar signals, electromagnetic signals, and ultrasonic signals.

[0228] The communication unit 310-4 is used to handle communication between the control device and other devices, such as the first display device 320. For example, the communication unit 310-4 may include, but is not limited to, one or more of the following: a communication interface, an antenna, a mobile communication module, a wireless communication module, a modem processor, and a baseband processor.

[0229] The communication interface may include, but is not limited to, wired communication interfaces such as Universal Serial Bus (USB).

[0230] Antennas are used to transmit and receive electromagnetic wave signals.

[0231] The mobile communication module can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the control device 310. The mobile communication module may include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. The mobile communication module can receive electromagnetic waves via an antenna, filter and amplify the received electromagnetic waves, and transmit them to a modem processor for demodulation. The mobile communication module can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna. In some embodiments, at least some functional modules of the mobile communication module can be housed in the processing unit 310-1. In some embodiments, at least some functional modules of the mobile communication module and at least some modules of the processing unit 310-1 can be housed in the same device.

[0232] The modem processor may include a modulator and a demodulator. The modulator modulates a low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processing unit 310-1 and may be integrated into the same device as the mobile communication module or other functional modules.

[0233] The wireless communication module can provide solutions for wireless communication applications on the control device 310, including wireless local area networks (WLAN) (such as WiFi), Bluetooth (BT), UWB, global navigation satellite system (GNSS), near field communication (NFC), and infrared (IR) technologies. The wireless communication module can be one or more devices integrating at least one communication processing module. The wireless communication module receives electromagnetic waves via an antenna, modulates and filters the electromagnetic wave signal, and sends the processed signal to the processing unit 310-1. The wireless communication module can also receive signals to be transmitted from the processing unit 310-1, modulate and amplify them, and then convert them into electromagnetic waves for radiation via the antenna.

[0234] In other embodiments of this application, the control device 310 can receive the first coordinate system where the first display screen is located from the first display device 320 through a wired communication interface or a wireless communication module, and send the pointing position of the control device 310 to the first display device 320.

[0235] In some embodiments of this application, the control device 310 can send the direction of the control device 310 to the first display device 320 through a wired communication interface or a wireless communication module, so that the first display device 320 can determine the direction of the control device 310 based on this.

[0236] In some embodiments of this application, the control device 310 can send display control commands to the first display device 320 via a wired communication interface or a wireless communication module, such as opening a file, drawing lines, returning, etc.

[0237] In some embodiments, such as Figure 3As shown, the control device 310 may further include a motion measurement unit 310-5, such as an inertial measurement unit (IMU). The motion attitude detection unit 310-5 may include, but is not limited to, one or more of an accelerometer, gyroscope, angular acceleration sensor, and magnetic sensor, for measuring the motion attitude of the control device 310.

[0238] In this embodiment of the application, the control device 310 can obtain the changes in position and attitude of the control device 310 through the motion measurement unit 310-5, so as to determine the displacement of the cursor relative to the historical cursor presentation position based on the relative pose change of the control device, and thus determine the presentation position of the cursor.

[0239] like Figure 3 As shown, the first display device 320 includes a processing unit 320-1, a power management unit 320-2, a wireless positioning unit 320-3, a display unit 320-4, and a communication unit 320-5.

[0240] The processing unit 320-1 may be a CPU. In some embodiments, the processing unit 320-1 may include one or more interfaces. The interfaces may include, but are not limited to, I2C interfaces, I2S interfaces, PCM interfaces, UART interfaces, MIPI, GPIO interfaces, etc.

[0241] The processing unit 320-1 may also include a storage unit for storing instructions and data. In some embodiments, the storage unit in the processing unit 320-1 is a cache memory. This storage unit can store instructions or data that the processing unit 320-1 has just used or is recurring. If the processing unit 320-1 needs to use the instruction or data again, it can directly retrieve it from the storage unit. This avoids repeated accesses, reduces the waiting time of the processing unit 320-1, and thus improves the efficiency of the system.

[0242] The power management unit 320-2 is used to connect the battery and the processing unit 320-1. The power management unit 320-2 receives input from the battery and supplies power to the processing unit 320-1, the wireless positioning unit 320-3, and the communication unit 310-4. For example, the power management unit 310-2 can convert the power level to a level suitable for each module, such as the processing unit 310-1, the wireless positioning unit 310-3, the display unit 320-4, and the communication unit 320-5, based on their respective characteristics. The power management module 320-2 can also be used to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage current, impedance). In some other embodiments, the power management unit 320-2 may also be located within the processing unit 320-1.

[0243] The wireless positioning unit 320-3 can be used to determine the first coordinate system in which the first display screen is located.

[0244] In some embodiments of this application, the wireless positioning unit 320-3 can also be used to determine the pose of the first display screen relative to the control device 320, and to determine the intersection point of the direction of the control device 310 and the plane where the first display screen is located, i.e., the direction of the control device 310.

[0245] For example, the wireless positioning unit 320-3 may include, but is not limited to, one or more of the following: a UWB positioning module, a multi-antenna millimeter-wave radar positioning module, a three-dimensional electromagnetic coil positioning module, and a three-dimensional ultrasonic positioning module. The wireless positioning unit 320-3 can use one or more of the above modules to send and receive positioning information with the wireless positioning unit 310-3 of the remote control device 310 to determine the first coordinate system where the first display screen is located or the pose of the first display screen relative to the control device 320.

[0246] Display unit 320-4 is used to display images, videos, etc. For example, display unit 320-4 may include a display screen.

[0247] In this embodiment, the display unit 320-4 can be used to display content. In some embodiments, the display unit 320-4 can also be used to display a cursor at the pointing position of the control device 310.

[0248] It should be noted that, in the embodiments of this application, the display unit 320-4 can be integrated with other modules such as the processing unit 320-1, power management unit 320-2, wireless positioning unit 320-3, and communication unit 320-5 (i.e., an integrated display device), or it can be independent of other modules such as the processing unit 320-1, power management unit 320-2, wireless positioning unit 320-3, and communication unit 320-5 (i.e., a separate display device). The embodiments of this application do not impose specific limitations.

[0249] In this application embodiment, the concept of a display screen is broad, referring to a display carrier. For example, when the first display device 320 is an integrated display device such as a television or PC, the display carrier can be a display panel, etc.; when the first display device 320 is a separate display device such as a projector, the display carrier can be a screen, wall, ceiling, etc. Furthermore, the display screen described in this application embodiment can be flat or curved, without limitation.

[0250] The communication unit 320-5 is used to handle communication matters between the first display device 320 and other devices, such as the control device 320. For example, the communication unit 320-5 may include, but is not limited to, one or more of the following: a communication interface, an antenna, a mobile communication module, a wireless communication module, a modem processor, and a baseband processor.

[0251] The communication interface may include, but is not limited to, wired communication interfaces such as USB.

[0252] Antennas are used to transmit and receive electromagnetic wave signals.

[0253] The mobile communication module can provide solutions for wireless communication, including 2G / 3G / 4G / 5G, applied to the first display device 320. The mobile communication module may include at least one filter, switch, power amplifier, low noise amplifier (LNA), etc. The mobile communication module can receive electromagnetic waves via an antenna, and perform filtering, amplification, and other processing on the received electromagnetic waves before transmitting them to a modem processor for demodulation. The mobile communication module can also amplify the signal modulated by the modem processor and convert it into electromagnetic waves for radiation via the antenna. In some embodiments, at least some functional modules of the mobile communication module may be housed in the processing unit 320-1. In some embodiments, at least some functional modules of the mobile communication module and at least some modules of the processing unit 320-1 may be housed in the same device.

[0254] The modem processor may include a modulator and a demodulator. The modulator modulates a low-frequency baseband signal to be transmitted into a mid-to-high frequency signal. The demodulator demodulates a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. In some embodiments, the modem processor may be a separate device. In other embodiments, the modem processor may be independent of the processing unit 320-1 and may be integrated into the same device as the mobile communication module or other functional modules.

[0255] The wireless communication module can provide solutions for wireless communication applications on the first display device 320, including WLAN (such as WiFi network), BT, UWB, GNSS, NFC, IR, etc. The wireless communication module can be one or more devices integrating at least one communication processing module. The wireless communication module receives electromagnetic waves via an antenna, frequency-modulates and filters the electromagnetic wave signal, and sends the processed signal to the processing unit 320-1. The wireless communication module can also receive signals to be transmitted from the processing unit 320-1, frequency-modulate and amplify them, and then convert them into electromagnetic waves for radiation via the antenna.

[0256] In some embodiments of this application, the first display device 320 can send the first coordinate system where the first display screen is located to the control device 310 through a wired communication interface or a wireless communication module, and receive the pointing position of the control device 310 from the control device 310.

[0257] In other embodiments of this application, the first display device 320 may receive the direction of the control device 310 from the control device 310 via a wired communication interface or a wireless communication module.

[0258] In some embodiments of this application, the first display device 320 can receive control commands from the control device 310, such as opening a file, drawing lines, or returning, through a wired communication interface or a wireless communication module.

[0259] In this embodiment, the device display control method determines the cursor position based on the pointing position of the control device. Therefore, when the pointing position of the control device is not on the display screen, the display device does not display the cursor. Only when the pointing position of the control device enters the edge area of ​​the display screen will the display device display the cursor at the pointing position of the control device. Thus, this solution can provide users with a very convenient, immersive, and precise cursor control and device operation experience in a single display device scenario.

[0260] For example, please refer to Figure 4 , Figure 4 This illustration shows a schematic diagram of the presentation process of a remote control cursor in a single-display device scenario, according to an embodiment of this application. Figure 4 The single display device scenario shown includes a control device 310 and a first display device 320. The first display device 320 is used for interface display, and the control device 310 is used for display control and / or operation control of the first display device 320.

[0261] like Figure 4As shown, when the control device 310 in pose A1 points to position B1 outside the display screen, since position B1 is not on the first display screen, the first display device 320 does not display a cursor. When the control device 310 in pose A2 points to position B2, since position B2 is on the first display screen, the first display device 320 displays a cursor at position B2. Similarly, when the control device 310 in pose A3 points to position B3, the first display device 320 displays a cursor at position B3. When the control device 310 in pose A4 points to position B4 outside the display screen, since position B4 is not on the first display screen, the first display device 320 does not display a cursor. When the pose of the control device 310 changes from pose A4 to A5, since position B5 returns to the first display screen, the first display device 320 displays a cursor at position B5.

[0262] As can be seen, compared to Figure 1 The diagram illustrates the presentation process of the remote control cursor in a single-display device scenario. Figure 4 In the single-display device scenario shown, during the presentation of the remote control cursor, since the cursor presentation position of the first display device 320 (i.e., the pointing position of the control device 310) is referenced by the pointing position of the control device 310, the first display device 320 does not present the cursor when the pointing position of the control device 310 is not on the first display screen; only when the pointing position of the control device 310 enters the edge area of ​​the first display screen will the first display device 320 present the cursor at the pointing position of the control device 310. Furthermore, when the pointing position of the control device 310 moves out of the first display screen, the cursor does not get stuck in the frame. Thus, when the pointing position of the control device 310 enters the edge area of ​​the first display screen, the first display device 320 can follow the movement trajectory of the control device 310 to present the corresponding interface effect (such as displaying a cursor) on the first display screen; when the pointing position of the control device 310 moves out of any edge area of ​​the first display screen (such as the upper edge area, lower edge area, left edge area, or right edge area), the first display device 320 will not continue to present the corresponding interface effect (such as not displaying a cursor) on the first display screen. Therefore, this solution can bring users a very convenient, immersive, and accurate cursor presentation, cursor control, and device operation experience in a single display device scenario.

[0263] For example, please refer to Figure 5 , Figure 5This illustration shows a schematic diagram of a device remote control system architecture in a multi-display device scenario provided by an embodiment of this application. The device remote control system includes a control device 310, a first display device 320, and a second display device 330. The first and second display devices 320 are used for interface display, and the control device 310 is used for display control and / or operation control of the first display device 320 or the second display device 330.

[0264] like Figure 5 As shown, the control device 310 includes a processing unit 310-1, a power management unit 310-2, a wireless positioning unit 310-3, and a communication unit 310-4.

[0265] The wireless positioning unit 310-3 is used to determine the orientation of the control device 310.

[0266] In some embodiments of this application, the wireless positioning unit 310-3 can also be used to determine the pose of the display screen of the first display device 320 (i.e., the first display screen) and the display screen of the second display device 330 (denoted as the second display screen) relative to the control device 320, and determine the intersection point of the direction of the control device 310 and the plane where the first display screen is located, i.e., the direction position of the control device 310, based on the above information.

[0267] For example, the wireless positioning unit 310-3 can use one or more of the following: a UWB positioning module, a multi-antenna millimeter-wave radar positioning module, a three-dimensional electromagnetic coil positioning module, and a three-dimensional ultrasonic positioning module, to send and receive positioning information with the wireless positioning unit 320-3 of the first display device 320 and the wireless positioning unit 330-3 of the second display device 330 to determine the orientation of the control device 310, the pose of the first display screen relative to the control device 320, and the pose of the second display screen relative to the control device 320.

[0268] The communication unit 310-4 is used to handle communication between the control device and other devices, such as the first display device 320 or the second display device 330.

[0269] In other embodiments of this application, the control device 310 may receive the first coordinate system of the first display screen from the first display device 320, the second coordinate system of the second display screen from the second display device 330, and send the pointing position of the control device 310 to the first display device 320 or the second display device 330 via a wired communication interface or a wireless communication module.

[0270] In some embodiments of this application, the control device 310 can send the direction of the control device 310 to the first display device 320 or the second display device 330 through a wired communication interface or a wireless communication module, so that the first display device 320 can determine the direction of the control device 310 based on this.

[0271] In some embodiments of this application, the control device 310 can send display control commands, such as opening a file, drawing lines, or returning, to the first display device 320 or the second display device 330 via a wired communication interface or a wireless communication module.

[0272] In some embodiments, such as Figure 5 As shown, the control device 310 may also include a motion measurement unit 310-5, such as an IMU. The motion attitude detection unit 310-5 may include, but is not limited to, one or more accelerometers, gyroscopes, angular accelerometers, magnetometers, etc., for measuring the motion attitude of the control device 310.

[0273] For detailed information on the processing unit 310-1, power management unit 310-2, wireless positioning unit 310-3, communication unit 310-4, and motion attitude detection unit 310-5, please refer to the above description. Figure 3 The introduction will not be repeated here.

[0274] like Figure 3 As shown, the first display device 320 includes a processing unit 320-1, a power management unit 320-2, a wireless positioning unit 320-3, a display unit 320-4, and a communication unit 320-5. The second display device 330 includes a processing unit 330-1, a power management unit 330-2, a wireless positioning unit 330-3, a display unit 330-4, and a communication unit 330-5.

[0275] For detailed information on the processing unit 320-1, power management unit 320-2, wireless positioning unit 320-3, display unit 320-4, and communication unit 320-5, please refer to the above description. Figure 3 The details of the processing unit 330-1, power management unit 330-2, wireless positioning unit 330-3, display unit 330-4, and communication unit 330-5 will not be repeated here. Furthermore, for details regarding the processing unit 330-1, power management unit 330-2, wireless positioning unit 330-3, display unit 330-4, and communication unit 330-5, please refer to the specific descriptions of these units above; they will not be repeated here.

[0276] In this embodiment, the first display device 320 and the second display device 330 can be display devices of the same type, screen size, or screen resolution. For example, the first display device 320 can be a television 1, and the second display device 330 can be a television 2, with the television 1 and television 2 having the same screen size and / or screen resolution. Alternatively, the first display device 320 and the second display device 330 can be display devices of different types, screen sizes, or screen resolutions. For example, the first display device 320 can be a projector, and the second display device 330 can be a television, with the projector and television having different types, screen sizes, and screen resolutions. Regarding the multiple display device scenarios, the specific types, screen sizes, or screen resolutions of the multiple display devices are not limited in this embodiment.

[0277] In this embodiment, the device display control method determines the cursor position based on the pointing position of the control device. Therefore, when the pointing position of the control device is not on the display screen, the display device does not display the cursor. Only when the pointing position of the control device enters the edge area of ​​the display screen will the display device display the cursor at the pointing position of the control device. Furthermore, this solution does not require pre-setting the positional relationship between multiple display devices. When connecting cursors between multiple display devices, it can automatically sense whether the pointing position of the control device is on the display screen of a certain display device. Therefore, it is unaffected by changes in the positional relationship between multiple display devices and can always accurately traverse the cursor. Moreover, this solution is not affected by differences in the type of multiple display devices, screen size, screen resolution, or distance between multiple screens. Therefore, this solution can provide users with a very convenient, immersive, and precise cursor control and device operation experience in multi-display device scenarios.

[0278] For example, please refer to Figure 6 , Figure 6 This illustration shows a schematic diagram of the presentation process of a remote control cursor in a multi-display device scenario according to an embodiment of this application. Figure 6 The multi-display device scenario shown includes a control device 310, a first display device 320, and a second display device 330. The first display device 320 and the second display device 330 are used for interface display, and the control device 310 is used for display control and / or operation control of the first display device 320 or the second display device 330.

[0279] like Figure 6As shown, when the control device 310 in pose A6 points to position B6 on the first display screen, the first display device 320 displays a cursor at position B6. When the control device 310 in pose A7 moves out of the first display screen and is no longer on the second display screen, neither the first display device 320 nor the second display device 330 displays a cursor. When the control device 310 in pose A8 moves into the second display screen, the second display device 330 displays a cursor at position B8.

[0280] As can be seen, compared to Figure 2 The diagram illustrates the presentation process of the remote control cursor in a typical multi-display device scenario. Figure 6 During the presentation of the remote control cursor in the multi-display device scenario, since the position of the cursor presented by the first display device 320 (i.e., the pointing position of the control device 310) is referenced by the pointing position of the control device 310, when the pointing position of the control device 310 is not on the display screen of any display device, none of the multiple display devices will present the cursor; only when the pointing position of the control device 310 enters the edge area of ​​the display screen of a certain display device (such as the first display device 320 or the second display device 330) will that display device present the cursor at the pointing position of the control device 310. Thus, when the pointing position of the control device 310 enters the edge area of ​​the first display screen, the first display device 320 can follow the movement trajectory of the control device 310 to present corresponding interface effects (such as displaying a cursor) on the first display screen. When the pointing position of the control device 310 moves from the first display device 320 to the second display device 330, if the pointing position of the control device 310 moves out of any edge area of ​​the first display screen (such as the upper edge area, lower edge area, left edge area, or right edge area) and does not enter the edge area of ​​the second display screen, the first display device 320 will not continue to present corresponding interface effects (such as not displaying a cursor) on the first display screen. When the pointing position of the control device 310 enters the edge area of ​​the second display screen, the second display device 330 can follow the movement trajectory of the control device 310 to present corresponding interface effects (such as displaying a cursor) on the second display screen. Among them, when displaying a cursor, the display device (such as the first display device 320 or the second display device 330) can follow the movement trajectory of the control device 310 to present a cursor display trajectory on the display screen that matches the movement trajectory.

[0281] In this embodiment of the application, "the pointing position of the control device enters the edge area of ​​the display screen" means that the pointing position of the control device moves from outside the display screen into the edge area of ​​the display screen, and "the pointing position of the control device moves out of any edge area of ​​the display screen" means that the pointing position of the control device moves from any edge area of ​​the display screen out of the display screen.

[0282] And, when Figure 6 Even if the orientational relationship between the first display device 320 and the second display device 330 changes, it will not affect the accurate crossing of the cursor during cursor continuation. Furthermore, regardless of... Figure 6 Whether the first display device 320 and the second display device 330 are the same in terms of type, screen size, screen resolution, etc., and how far apart the screens of the first display device 320 and the second display device 330 are, will not affect the accurate display of the cursor. For example, assuming that the positional relationship between the first display device 320 and the second display device 330 changes from a first relationship to a second relationship, when determining the pointing position of the control device 310, the pointing position of the control device 310 can be determined according to the latest second relationship. When the pointing position of the control device 310 does not enter the edge area of ​​any screen, neither the first display device 320 nor the second display device 330 will display the corresponding display object. Only when the pointing position of the control device 310 enters the edge area of ​​the first screen or the second screen will the cursor appear on the corresponding screen following the movement trajectory of the control device.

[0283] And, when Figure 6 When the orientation relationship between the first display device 320 or the second display device 330 and the remote control device 310 changes, or when the screen resolution and / or focal length of the first display device 320 or the second display device 330 changes, the accurate movement of the cursor during cursor transitions will still not be affected. For example, when the screen resolution and / or focal length of the display device (such as the first display device 320 or the second display device 330) changes, the pointing position of the control device 310 can be determined based on the latest screen resolution and / or focal length. When the pointing position of the control device 310 does not enter the edge area of ​​any display screen, neither the first display device 320 nor the second display device 330 will display the corresponding object. Only when the pointing position of the control device 310 enters the edge area of ​​the first or second display screen will the cursor appear on the corresponding display screen following the movement trajectory of the control device. For example, when the orientation relationship between the display device (such as the first display device 320 or the second display device 330) and the remote control device 310 changes, the pointing position of the control device 310 can be determined according to the latest orientation relationship. When the pointing position of the control device 310 does not enter the edge area of ​​any display screen, neither the first display device 320 nor the second display device 330 will display the corresponding display object. Only when the pointing position of the control device 310 enters the edge area of ​​the first display screen or the second display screen will a cursor appear on the corresponding display screen following the movement trajectory of the control device.

[0284] In summary, the solution provided in this application embodiment can also bring users a very convenient, immersive, and precise cursor control and device operation experience in multi-display device scenarios.

[0285] It is understood that this application Figure 3 The schematic structure does not constitute a specific limitation on the control device 310 and the first display device 320, and Figure 5 The illustrated structure does not constitute a specific limitation on the control device 310, the first display device 320, or the second display device 330. In other embodiments of this application, the control device 310, the first display device 320, or the second display device 330 may include more or fewer components than illustrated, or combine some components, or split some components, or have different component arrangements. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0286] For example, the control device 310, the first display device 320, or the second display device 330 may further include one or more of the following: a memory (including an external memory interface and an internal memory), a charging management unit, an audio module, a speaker, a receiver, a microphone, a headphone jack, buttons, and a camera. As another example, the control device 310, the first display device 320, or the second display device 330 may also include one or more sensors such as a touch sensor, a pressure sensor, a barometric pressure sensor, a distance sensor, a proximity sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, and a bone conduction sensor.

[0287] It should be noted that the embodiments of this application do not limit the number of displays included in the display device (such as the first display device or the second display device). In some embodiments, the display device may include multiple displays and a wireless positioning unit, which can be used to determine the coordinates of the multiple displays. Alternatively, in some embodiments, the display device may include multiple displays and multiple wireless positioning units, with the multiple wireless positioning units respectively used to determine the coordinates of the multiple displays.

[0288] The following will describe in detail a device display control method provided in the embodiments of this application, in conjunction with scenario 1 and scenario 2.

[0289] Scenario 1: Single display device scenario

[0290] In the single-display-device scenario, there are a control device 310 and a first display device 320. The first display device 320 is used for interface display, and the control device 310 is used for display control and / or operation control of the first display device 320.

[0291] In some examples, during the process of the first display device 320 displaying a cursor according to the direction of the control device 310, the first display device 320 can determine the first coordinate system of its own display screen (such as the first display screen) by exchanging and receiving positioning information with the control device 310, and then send the first coordinate system to the control device 310. The control device 310 can determine its own direction, the first pose of the first display screen relative to the control device 320, and the intersection point of the direction of the control device 310 and the plane where the first display screen is located (i.e., the direction position of the control device 310) by exchanging and receiving positioning information with the first display device 320. When the direction position of the control device 310 is on the first display screen, the control device 310 sends the direction position of the control device 310 to the first display device 320, so that the first display device 320 can display the cursor at the direction position of the control device 310. The first display device 320 and the control device 310 can exchange and receive positioning information through their respective wireless positioning units.

[0292] For example, please refer to Figure 7 , Figure 7 A flowchart of a device display control method according to an embodiment of this application is shown. Figure 7 As shown, the device display control method provided in this application embodiment may include the following S701-S707:

[0293] S701: The control device 310 establishes a communication connection with the first display device 320.

[0294] The communication connection established between the control device 310 and the first display device 320 may include, but is not limited to, wired communication connections and wireless communication connections. Wireless communication connections may include, but are not limited to, Bluetooth connections and WiFi P2P connections.

[0295] S702: The first display device 320 determines the first coordinate system in which its own display screen (i.e., the first display screen) is located.

[0296] As one possible implementation, such as Figure 7 As shown, the first display device 320 can determine the first coordinate system in which the first display screen is located by exchanging and receiving positioning information with the control device 310.

[0297] As one possible implementation, the first display device 320 can determine the first coordinate system of the first display screen based on one or more of the following methods: multi-antenna UWB positioning, multi-antenna millimeter-wave radar positioning, three-dimensional electromagnetic coil positioning, and three-dimensional ultrasonic positioning. Among these, multi-antenna UWB positioning methods include multi-antenna time difference of arrival (TDOA) positioning, multi-antenna time of flight (TOF) ranging, and multi-antenna angle of arrival (AOA) positioning. For example, the positioning information may include one or more of the following: UWB signals, millimeter-wave radar signals, electromagnetic signals, and ultrasonic signals. This application does not limit the specific method used by the first display device 320 to determine the first coordinate system; it can be determined based on the actual device structure, function, and application scenario.

[0298] In some embodiments, if the first display device 320 includes M antennas (M≥3), and the plane formed by the equivalent centers of the M antennas coincides with or is parallel to the display screen, the first coordinate system in which the first display screen is located can be determined using a multi-antenna UWB positioning method. Please refer to... Figure 8 , Figure 8 Taking the first display device 320 as an example of an integrated display device, a schematic diagram of a method for determining the coordinate system of the display screen based on the multi-antenna UWB positioning method provided in this application embodiment is shown.

[0299] like Figure 8 As shown, the first display screen is equipped with a first antenna (e.g., a transmitting antenna), a second antenna (e.g., a receiving antenna), a third antenna (e.g., a horizontal antenna), and a fourth antenna (e.g., a vertical antenna). The first display device 320 can be positioned using a multi-antenna UWB positioning method. Figure 9Steps S901-S903 illustrate the construction of a first coordinate system for the first display screen. Specifically, S901 involves the first display device 320 transmitting positioning information to the control device 310 and performing multi-antenna time difference of arrival (TDOA) measurements; S902 involves the first display device 320 calculating the distance *r* between the multiple antennas of the control device 310 and the multiple antennas of the first display device 320 based on the TDOA measurements; and S903 involves the first display device 320 calculating the horizontal deflection angle and vertical elevation angle between the multiple antennas of the control device 310 and the multiple antennas of the first display device 320 based on the TDOA measurements, and combining this with the distance *r* to calculate the position of the equivalent center of the multiple antennas of the first display device 320, thereby constructing the first coordinate system for the first display screen. Furthermore, the first display device 320 can determine the plane containing the M antennas based on the positions of the multiple equivalent centers. Since the distance between the first display screen and the M antennas is known, the first display device 320 can further determine the positional relationship of the first display screen relative to the plane containing the M antennas, and further determine the first plane containing the first display screen based on this.

[0300] For example, if the distance between multiple equivalent centers and the first display screen is 0, then the first plane containing the first display screen is the plane containing the multiple equivalent centers; if the distance between the multiple equivalent centers and the first display screen is not 0 (e.g., d, where d is a vector value), then the first plane containing the first display screen is a plane parallel to the plane containing the multiple equivalent centers and at a distance d from the plane containing the multiple equivalent centers. Figure 8 The example only uses the case where the distance between multiple equivalent center locations and the first display screen is 0.

[0301] It is understandable that once the first coordinate system in which the first display screen is located is determined, since the size information of the first display screen and the positional relationship between the first display screen and the M antennas are known, the first display device 320 can construct the first coordinate system in which the first display screen is located based on this.

[0302] like Figure 8 As shown, the first coordinate system can be a coordinate system where the origin O1 is located at the geometric centers of the M antennas, the X1O1Y1 plane coincides with the first plane where the first display screen is located, and the Z1 axis conforms to the right-hand screw rule with the X1 and Y1 axes. Of course, Figure 8 The first coordinate system shown is merely an example, and this application does not impose specific limitations on the construction principles of the first coordinate system. For example, the origin O1 can also be set at the center of an edge of the first display screen (such as the center of the left edge) or at other locations on the first plane.

[0303] It should be noted that, Figure 8Taking the case where the first display device 320 is an integrated display device as an example, this article describes the specific process of determining the coordinates of the display screen based on the multi-antenna UWB positioning method. For the case where the first display device 320 is a split display device, such as the first display device 320 being... Figure 10 The projector shown has a first display screen that is Figure 10 The principle for determining the coordinates of the display screen is the same as shown in the example screen. Figure 8 Example shown. For instance, the projector (i.e., the first display device 320) has M antennas on its main unit. The projector can also be based on a multi-antenna UWB positioning method, through... Figure 9 Steps S901-S903 show the determination of the positions of the equivalent centers of the M antennas. Furthermore, the projector can determine the plane containing the M antennas based on the positions of the multiple equivalent centers. Further, since the size information of the screen (i.e., the first display screen) and the positional relationship between the screen and the M antennas are known, the projector can further determine the positional relationship of the first display screen relative to the plane containing the M antennas, and thus construct a first coordinate system for the screen.

[0304] In the case where the first display device 320 is a projector and the first display screen is a screen, the first display device 320 can determine the positional relationship between the screen and the M antennas, as well as the screen's size information, based on one or more of the following data: the focal length parameter of the projector, the projection distance of the projector, and the projection skew angle of the projector. For example, the focal length parameter of the projector can be manually set or a default value; the projection distance or projection skew angle of the projector can be measured using methods such as multi-point TOF ranging.

[0305] S703: The first display device 320 sends first information to the control device 310. The first information includes the first coordinate system in which the display screen (i.e. the first display screen) of the first display device 320 is located and the size of the first display screen.

[0306] S704: The control device 310 determines the orientation of the control device 310 and the first position of the first display screen relative to the control device 310.

[0307] As one possible implementation, the first display device 320 can determine the orientation of the control device 310 and the first position of the first display screen relative to the control device 310 by exchanging and receiving positioning information with the control device 310.

[0308] As one possible implementation, the control device 310 can determine its orientation and the first pose of the first display screen relative to the control device 310 based on one or more of the following methods: multi-antenna UWB positioning, multi-antenna millimeter-wave radar positioning, three-dimensional electromagnetic coil positioning, and three-dimensional ultrasonic positioning. For example, the positioning information may include one or more of the following: UWB signal, millimeter-wave radar signal, electromagnetic signal, and ultrasonic signal. Among these, multi-antenna UWB positioning methods include TDOA positioning, TOF ranging, and AOA positioning. This application does not limit the specific method used by the control device 310; it can be determined based on the actual device structure, function, and application scenario.

[0309] In some embodiments, if the control device 310 includes N antennas (N≥3), and the plane formed by the equivalent centers of the N antennas is perpendicular to the axis of the control device 310, the direction of the control device 310 can be determined by the multi-antenna UWB positioning method.

[0310] like Figure 8 As shown, the control device 310 is equipped with a fifth antenna (such as a datum antenna), a sixth antenna (such as a horizontal antenna), and a seventh antenna (such as a vertical antenna). The control device 310 can perform positioning based on the multi-antenna UWB method, through... Figure 11 Steps S1101-S1103 show how to determine the positions of the equivalent centers of the N antennas. Furthermore, the control device 310 can determine the plane containing the N antennas based on the positions of multiple equivalent centers. Figure 11 S1101 shows: the control device 310 transmits positioning information to the first display device 320 and performs multi-antenna time difference of arrival measurement; S1102 shows: the control device 310 calculates the distance r between the multiple antennas of the first display device 320 and the multiple antennas of the control device 310 based on the multi-antenna time difference of arrival measurement results; S1103 shows: the control device 310 calculates the horizontal deflection angle and vertical elevation angle between the multiple antennas of the first display device 320 and the multiple antennas of the control device 310 based on the multi-antenna time difference of arrival measurement results, and calculates the position of the equivalent center of the multiple antennas of the control device 310 in the first coordinate system based on the distance r, thereby determining the direction of the control device 310. For example, since the plane formed by the equivalent centers of N antennas is perpendicular to the axis of the control device 310, the direction of the control device 310 can be determined based on the equivalent centers of the N antennas. Figure 8 The control device 310 shown points to P.

[0311] Furthermore, such as Figure 11 As shown, after calculating the positions of the equivalent centers of the multiple antennas of the control device 310, the control device 310 can also... Figure 11Steps S1104-S1105 show the determination of the first orientation of the first display screen relative to the control device 310. Among these steps... Figure 11 S1104 is shown as follows: the control device 310 receives the signal transmitted by the first display device 320 through N antennas and calculates the phase difference between the signals received by the N antennas; S1105 is shown as follows: the control device 310 calculates the horizontal deflection angle and vertical pitch angle of the first display screen relative to the control device 310, and determines the first pose of the first display screen relative to the control device 310 in combination with the above distance r.

[0312] S705: Control device 310 determines the first position on the plane where the first display screen is located.

[0313] For example, such as Figure 11 As shown in S1106, the control device 310 can calculate the first position of the plane where the first display screen is located based on the calculated first pose and the direction of the control device 310.

[0314] It should be noted that the above embodiments only use the multi-antenna UWB positioning method as an example to introduce the specific process of determining the pointing position of the control device 310. However, the embodiments of this application do not limit the specific methods and processes for determining the pointing of the control device 310, determining the pose of the first display device 320 relative to the control device 310, and determining the pointing position of the control device 310. For example, in some embodiments, if the first display device 320 and the control device 330 include a three-axis magnetic field transmitting coil (such as a magnetic sensor including a three-axis magnetic field transmitting coil), the pose of the control device 310 can be determined by the three-dimensional electromagnetic coil positioning method, and then the pointing position of the control device 310 can be determined based on this.

[0315] In this method, a three-dimensional electromagnetic coil has coils made of wires in each of the three dimensions. When current flows through the coil, a magnetic field is generated. The principle of the three-dimensional electromagnetic coil positioning method is to utilize the effect of the magnetic field and achieve positioning through the electromagnetic induction principle of the magnetic coil. Figure 12 As shown, the transmitting sensor includes a triaxial magnetic field transmitting coil, a driving circuit (i.e., an excitation source), and a processing unit. The receiving sensor includes a triaxial magnetic field transmitting coil, an amplification circuit, a sampling and detection unit, and a processing unit. The triaxial magnetic field transmitting coil of the transmitting sensor can emit electromagnetic signals according to the drive circuit, which is controlled by the processing unit. The receiving sensor can sense the electromagnetic signals from the transmitting sensor through the triaxial magnetic field transmitting coil, and obtain the pose of the control device 310 after processing by the amplification circuit, the sampling and detection unit, and the processing unit.

[0316] Please refer to Figure 13 , Figure 13Taking the first display device 320 as an example of an integrated display device, a schematic diagram of a method for determining the coordinate system of the display screen based on the three-dimensional electromagnetic coil positioning method provided in this application embodiment is shown.

[0317] like Figure 13 As shown, a first three-axis magnetic field emitting coil is provided on the first display screen, and a second three-axis magnetic field emitting coil is provided on the control device 310. The first display device 320 can emit electromagnetic signals through the first three-axis magnetic field emitting coil. After the control device 310 senses the electromagnetic signal from the first three-axis magnetic field emitting coil through the second three-axis magnetic field emitting coil, it can calculate the position and pose of the control device 310 based on this signal.

[0318] For example, the first display device 320 can be established based on the first triaxial magnetic field emitting coil. Figure 13 The coordinate system O1-X1Y1Z1 is shown, where the origin of the coordinate system O1-X1Y1Z1 can be the location of the first triaxial magnetic field transmitting coil, the X1O1Z1 plane is the plane where the first display screen is located, and the Z1 axis conforms to the left-hand screw rule with respect to the X1 and Y1 axes. The magnetic induction intensity at the location of the first triaxial magnetic field transmitting coil in this coordinate system O1-X1Y1Z1 is... Figure 14 As shown in B x B y B z The control device 310 can be established based on the second three-axis magnetic field transmitting coil. Figure 13 The coordinate system shown is O2-X2Y2Z2. Assume that control device 310 detects the magnetic induction intensity in this coordinate system using a second triaxial magnetic field transmitting coil. Figure 14 As shown in B x＇ B y＇ B z＇ Wherein, the coordinate system O2-X2Y2Z2 is rotated relative to O1-X1Y1Z1 along the three axes by the following angles. Figure 14 The values ​​α, β, and γ are shown. Based on this, the following formula can be obtained:

[0319]

[0320] In the above formula, R is the rotation matrix, and the formula for calculating R is as follows:

[0321]

[0322] Based on the above formula, the pose (x, y, z, α, β, γ) of the control device 310 can be calculated. After obtaining the pose of the control device 310, the direction of the control device 310 and the coordinates of the intersection point of the direction of the control device 310 and the first display screen (i.e., the direction position of the control device 310) can be calculated based on the trigonometric function relationship.

[0323] S706: If the first position is located on the first display screen, the control device 310 sends second information to the first display device 320, the second information including the coordinate information of the first position.

[0324] It is understandable that knowing the size of the first display screen and the first coordinate system in which the first display screen is located allows us to obtain the first coordinate range of the first display screen within the first coordinate system. Furthermore, we can determine whether the first position is located on the first display screen by judging whether the first position is within the first coordinate range.

[0325] When the first position is on the first display screen, the control device 310 can send the coordinate information of the first position to the first display device 320, so that the first display device 320 can display a cursor at the first position according to the second information; when the first position is not on the first display screen, the control device 310 can do nothing, so the first display device 320 will not display a cursor.

[0326] S707: The first display device 320 presents a cursor at a first position based on the second information.

[0327] In some examples, during the process of the first display device 320 displaying a cursor according to the direction of the control device 310, the control device 310 can send its own direction to the first display device 320. The first display device 320 can determine the first coordinate system in which its own display screen (i.e., the first display screen) is located and the first pose of the first display screen relative to the control device 320, and based on the above information, determine the intersection point of the direction of the control device 310 and the plane in which the first display screen is located (i.e., the direction position of the control device 310), and when the direction position of the control device 310 is located on the first display screen, the cursor is displayed at the direction position of the control device 310.

[0328] For example, please refer to Figure 15 , Figure 15 A flowchart of another device display control method provided in an embodiment of this application is shown. Figure 15 As shown, a device display control method provided in this application embodiment may include the following steps S1501-S1506:

[0329] S1501: The control device 310 establishes a communication connection with the first display device 320.

[0330] For a detailed introduction to S1501, please refer to the introduction of S701 above, which will not be repeated here.

[0331] S1502: Control device 310 determines the orientation of control device 310.

[0332] For a detailed introduction to S1502, please refer to the introduction of S704 above, which will not be repeated here.

[0333] S1503: The control device 310 sends the direction of the control device 310 to the first display device 320.

[0334] S1504: The first display device 320 determines the first coordinate system in which its own display screen (i.e., the first display screen) is located and the first pose of the first display screen relative to the control device 310.

[0335] For a detailed description of how the first display device 320 determines the first coordinate system in which its own display screen (i.e., the first display screen) is located, please refer to the description of S702 above. For a detailed description of how the first display device 320 determines the first pose of the first display screen relative to the control device 310, please refer to the process in step S704 above where the control device 310 determines the first pose of the first display screen relative to the control device 310. This will not be repeated here.

[0336] S1505: The first display device 320 determines the first position of the control device 310 pointing to the plane where the first display screen is located.

[0337] For a detailed description of how the first display device 320 determines the first position of the control device 310 pointing to the plane where the first display screen is located, please refer to the process in step S705 above, where the control device 310 determines the first position of the control device 310 pointing to the plane where the first display screen is located. It will not be repeated here.

[0338] S1506: If the first position is located on the first display screen, the first display device 320 displays a cursor at the first position.

[0339] It is understood that, since the device display control method provided in this application embodiment determines whether the display screen displays a cursor based on the position of the control device pointing to the plane where the display screen is located, and the specific display position of the cursor when it appears on the display screen, the display device does not display a cursor when the pointing position of the control device is not on the display screen. Only when the pointing position of the control device enters the edge area of ​​the display screen will the display device display a cursor at the pointing position of the control device (e.g., ...). Figure 4(As shown). Thus, when the pointing position of the control device enters the edge area of ​​the display screen, the display device can follow the movement trajectory of the control device and display the cursor on the screen; when the pointing position of the control device moves out of any edge area of ​​the display screen (such as the top edge, bottom edge, left edge, or right edge), the display device will no longer display the cursor on the screen. Therefore, compared with conventional technology, it not only solves the problem of deviation between the cursor display position and the pointing position of the control device, but also solves the problem of the cursor getting stuck when it moves out of the edge of the display screen.

[0340] Furthermore, since the cursor's display position is the pointing position of the control device, the deviation between the cursor's display position and the axial pointing position of the control device 310 in its actual pose will be very small. For example, as... Figure 16 As shown, the cursor position is typically within a preset range S near the axial pointing position of the control device 310 in its actual pose. This preset range is usually very small. For example, due to measurement and / or calculation errors of the wireless positioning unit 310-3 of the control device 310 and / or the measurement and / or calculation errors of the wireless positioning unit 320-3 of the first display device 320, the cursor position may deviate from the axial pointing position of the control device 310 in its actual pose. This deviation is typically within 10° (in some embodiments, the deviation may be within 3°, or even within 1°). Therefore, the device display control method provided in this application embodiment can bring users a more precise cursor control experience.

[0341] In summary, the device display control method provided in this application embodiment can bring users a very convenient, immersive, and precise device operation experience.

[0342] In some embodiments, to ensure continuous cursor display, the cursor position can be determined based on the relative pose change of the control device after ensuring the cursor enters the edge area of ​​the display screen. If the cursor position determined based on the relative pose change of the control device deviates from the direction of the control device by more than a preset range, or after a preset time period, the cursor position can be calibrated using the direction of the control device. The preset range of the direction of the control device is, for example, the overlap range between a cone deflected by an angle φ around the direction of the control device and the display screen.

[0343] For example, in the initial stage, the control device 310 and the first display device 320 can perform relevant measurements and calculations through the wireless positioning unit to determine the first position of the control device 310 pointing to the plane of the first display screen. If the first position is not on the first display screen, subsequent pointing position determination is performed as needed according to a preset frequency. When the pointing position of the control device 310 enters the edge area of ​​the first display screen, the control device 310 can measure the motion posture of the control device 310 through the motion measurement unit 310-5 (such as an IMU), so that the first display device 310 can determine the displacement of the cursor relative to the historical cursor presentation position based on the relative pose change of the control device 310, and thus determine the cursor presentation position. Furthermore, in the process of determining the cursor presentation position based on the relative pose change of the control device 310, the pointing position of the control device can be used to calibrate the cursor presentation position at preset time intervals, or when the cursor presentation position deviates from the pointing position of the control device by more than a preset range. And, after the cursor moves out of the edge area of ​​the first display screen, the relevant measurements and calculations can be switched to the wireless positioning unit to determine the pointing position of the control device 310.

[0344] Based on this, not only can the cursor's display deviation be kept within a very small range, ensuring accurate cursor presentation, but also the continuous presentation of the cursor on the display screen can be guaranteed.

[0345] In some embodiments, during the process of determining the cursor's presentation position based on the relative pose change of the control device 310, the cursor's displacement relative to the historical cursor presentation position can be dynamically adjusted in conjunction with the distance between the control device 310 and the first display device 320. For example, when the distance between the control device 310 and the first display device 320 is within the range of D1-D2, the cursor displacement ratio is adjusted based on the result of the relative pose change of the control device 310 multiplied by the distance; when the distance between the control device 310 and the first display device 320 is less than D1, the cursor displacement ratio is adjusted based on the result of the relative pose change of the control device 310 multiplied by D1; when the distance between the control device 310 and the first display device 320 is greater than D2, the cursor displacement ratio is adjusted based on the result of the relative pose change of the control device 310 multiplied by D2. Based on this, it can also be ensured that when the control device 310 manipulates the cursor at different distances, the cursor movement distance corresponding to the same pose change can be dynamically adjusted, so that the user's operation experience is basically consistent when manipulating the cursor at different distances.

[0346] It should be noted that in Scenario 1 above, the display device showing a cursor on the screen following the movement trajectory of the control device is only an example. In actual applications, it can be determined according to the specific application scenario, device functions, etc. For example, the interface effects displayed on the screen can also include, but are not limited to, displaying icons, components, virtual images, etc. at the location pointed to by the control device; displaying corresponding viewing angle effects according to the location pointed to by the control device; and displaying pre-set special effects in the corresponding display area (such as a preset control hotspot) according to the location pointed to by the control device.

[0347] For example, in a game scenario, the interface effects displayed on the screen can include showing the game protagonist's image from a preset perspective at the control device's pointing location, displaying game equipment at the control device's pointing location, displaying game effects (such as bubble effects, firework effects, etc.) at the control device's pointing location, and displaying game effects (such as aiming effects, hit effects, etc.) in the corresponding display area based on the control device's pointing location. Similarly, in a handwriting tablet scenario, the interface effects displayed on the screen can include showing the stylus image and handwriting at the control device's pointing location, and displaying handwriting in the corresponding display area (such as along the historical path of the stylus image) based on the control device's pointing location. Furthermore, the display device can also follow the movement trajectory of the control device to display both a cursor and a virtual image and effects from a preset perspective on the screen. For example, when the control device's pointing location is within a preset control hotspot, the display device can simultaneously display a virtual image and effects from a corresponding preset perspective while displaying the object.

[0348] In cases where the display device presents interface effects such as components, virtual images, viewing angles, and special effects on the display screen following the movement trajectory of the control device, when the pointing position of the control device moves out of the edge area of ​​the display screen, the display device may no longer update the above interface effects or may no longer display any interface effects. This application embodiment does not impose specific limitations and depends on the actual application scenario and device functions.

[0349] Scenario 2: Multi-display device scenario

[0350] In the multi-display device scenario, there are control device 310, first display device 320 and second display device 330. The first display device 320 and second display device 330 are used for interface display, and control device 310 is used for display control and / or operation control of the first display device 320 or the second display device 330.

[0351] In some examples, during the process of the first display device 320 or the second display device 330 displaying the cursor according to the direction of the control device 310, the first display device 320 can determine the first coordinate system of its own display screen (such as the first display screen) by sending and receiving positioning information with the control device 310, and send the first coordinate system of the first display screen to the control device 310. The second display device 330 can determine the first coordinate system of its own display screen (such as the second display screen) by sending and receiving positioning information with the control device 310, and send the second coordinate system of the second display screen to the control device 310. The control device 310 can determine its own orientation, the first and second display screens relative to the control device 320, and the intersection point of the control device 310's orientation with the planes of the first and second display screens (i.e., the orientation position of the control device 310) by exchanging and receiving positioning information with the first display device 320 and the second display device 330. When the control device 310's orientation position is on the first display screen, it sends this position to the first display device 320 so that the first display device 320 can display a cursor at that position. Alternatively, when the control device 310's orientation position is on the second display screen, it sends this position to the second display device 330 so that the second display device 330 can display a cursor at that position. The first display device 320 and the control device 310, or the second display device 330 and the control device 310, can exchange and receive positioning information via their respective wireless positioning units.

[0352] For example, please refer to Figure 17 , Figure 17 A flowchart of a device display control method according to an embodiment of this application is shown. Figure 17 As shown, the device display control method provided in this application embodiment may include the following S1701-S1707:

[0353] S1701: The control device 310 establishes a communication connection with the first display device 320 and the second display device 330.

[0354] For a detailed description of the communication connection established between the control device 310 and the first display device 320 and the second display device 330, please refer to the process of establishing the communication connection between the control device 310 and the first display device 320 in step S701 above, which will not be repeated here.

[0355] S1702: The first display device 320 determines the first coordinate system in which its own display screen (i.e., the first display screen) is located.

[0356] For a detailed introduction to S1702, please refer to the introduction of S702 above, which will not be repeated here.

[0357] S1703: The first display device 320 sends first information to the control device 310. The first information includes the first coordinate system in which the first display screen is located and the size of the first display screen.

[0358] For a detailed introduction to S1703, please refer to the introduction of S703 above, which will not be repeated here.

[0359] S1704: The second display device 330 determines the second coordinate system in which its own display screen (i.e., the second display screen) is located.

[0360] For a detailed introduction to S1704, please refer to the process in step S702 above where the first display device 320 determines the first coordinate system in which the first display screen is located. It will not be repeated here.

[0361] S1705: The second display device 330 sends third information to the control device 310, the third information including the second coordinate system where the second display screen is located and the size of the second display screen.

[0362] For a detailed description of S1705, please refer to the process in step S703 above where the first display device 320 sends the first information to the control device 310. It will not be repeated here.

[0363] S1706: The control device 310 determines the orientation of the control device 310, the first position of the first display screen relative to the control device 310, and the second position of the second display screen relative to the control device 310.

[0364] For a detailed description of how the control device 310 determines the orientation of the control device 310 and the first display screen relative to the control device 310, please refer to the description of S704 above. For a detailed description of how the control device 310 determines the second pose of the second display screen relative to the control device 310, please refer to the process of the control device 310 determining the first pose of the first display screen relative to the control device 310 in step S704 above. It will not be repeated here.

[0365] S1707: The control device 310 determines the first position of the control device 310 pointing to the plane where the first display screen is located and the second position of the control device 310 pointing to the plane where the second display screen is located.

[0366] For a detailed description of how the control device 310 determines the first position of the plane where the first display screen is located, please refer to the description of S705 above. For a detailed description of how the control device 310 determines the second position of the plane where the second display screen is located, please refer to the process of how the control device 310 determines the first position of the plane where the first display screen is located in step S705 above. It will not be repeated here.

[0367] If the first position is located on the first display screen, the first display device 320 executes S1709-1 after the control device 310 executes S1708-1; if the second position is located on the second display screen, the second display device 330 executes S1709-2 after the control device 310 executes S1708-2.

[0368] S1708-1: Control device 310 sends second information to first display device 320, the second information including the coordinate information of the first position.

[0369] For a detailed introduction to S1708-1, please refer to the introduction of S706 above, which will not be repeated here.

[0370] S1709-1: The first display device 320 presents a cursor at a first position based on the second information.

[0371] For a detailed introduction to S1709-1, please refer to the introduction of S707 above, which will not be repeated here.

[0372] S1708-2: The control device 310 sends fourth information to the second display device 330, the fourth information including the coordinate information of the second position.

[0373] For a detailed description of S1708-2, please refer to the process in step S706 above where the control device 310 sends the second information to the first display device 320. It will not be repeated here.

[0374] S1709-2: The second display device 330 presents the cursor at the second position according to the fourth information.

[0375] For a detailed introduction to S1709-2, please refer to the process in step S707 above where the first display device 320 presents the cursor at the first position based on the second information. It will not be repeated here.

[0376] In some embodiments, the first position of the control device 310 pointing to the plane where the first display screen is located is on the first display screen, but the second position of the control device 310 pointing to the plane where the second display screen is located is not on the second display screen. In this case, the control device 310 does not execute S1708-2 and the second display device 330 does not execute S1709-2.

[0377] In some embodiments, the first position of the control device 310 pointing to the plane where the first display screen is located is not on the first display screen, but the second position of the control device 310 pointing to the plane where the second display screen is located is on the second display screen. In this case, the control device 310 does not execute S1708-1 and the first display device 320 does not execute S1709-1.

[0378] In some embodiments, the first position of the control device 310 pointing to the plane of the first display screen is located on the first display screen, and the second position of the control device 310 pointing to the plane of the second display screen is located on the second display screen. In this case, as an example, the control device 310 executes both S1708-1 and S1708-2, and then the first display device 320 executes S1709-1 and the second display device 330 executes S1709-2. As another example, the control device 310 executes both S1708-1 and S1708-2, and the first display device 320 and the second display device 330 negotiate to determine whether the cursor is displayed on the first display screen or the second display screen. When it is determined that the cursor is displayed on the first display screen, the first display device 320 executes S1708-1, or when it is determined that the cursor is displayed on the second display screen, the second display device 330 executes S1708-2. 708-2, wherein the factors considered in the negotiation between the first display device 320 and the second display device 330 may include, but are not limited to, one or more of the following: the distance between the display device and the control device, the function of the display device, whether the display device displays a content interface, and which display device the cursor was last displayed on. This application embodiment does not make specific limitations. As another example, the control device 310 may determine whether the cursor is displayed on the first display screen or the second display screen based on preset rules. When it is determined that the cursor is displayed on the first display screen, S1708-1 is executed and then S1709-1 is executed by the first display device 320. Alternatively, when it is determined that the cursor is displayed on the second display screen, S1708-2 is executed and then S1709-2 is executed by the first display device 320. The preset rules may include, for example, proximity priority, continuity priority, original display device priority, etc. This application embodiment does not make specific limitations.

[0379] It should be noted that the above embodiments only use the example that the first coordinate system constructed by the first display device 320 and the second coordinate system constructed by the second display device 320 can be constructed based on the actual plane where their respective displays are located, that is, the first coordinate system and the second coordinate system are different. In some embodiments, the first display device 320 and the second display device 320 can also construct a unified coordinate system. In this case, the first display device 320 also sends the coordinate information of the first display screen in the above-mentioned unified coordinate system to the control device 310. Similarly, the second display device 330 also sends the coordinate information of the second display screen in the above-mentioned unified coordinate system to the control device 310 so that the control device 310 can perform subsequent confirmation of the first position and the second position based on this.

[0380] It is understood that, since the device display control method provided in this application embodiment determines whether a cursor appears on the display screen based on the position of the control device pointing to the plane where the display screen is located, and which display device displays the cursor at which position, regardless of the orientation relationship between multiple display devices, there is no need to pre-configure the orientation relationship between multiple display devices. The control device can calculate the specific position pointed to by the control device, and when the position pointed to by the control device is not on the display screen of any display device, none of the multiple display devices will display a cursor. Only when the position pointed to by the control device enters the edge area of ​​the display screen of a certain display device will that display device display a cursor at the position pointed to by the control device 310. Therefore, this solution can also bring users a very convenient, immersive, and precise cursor control and device operation experience in multi-display device scenarios.

[0381] For example, consider the cursor changing from being displayed on the first display screen to being displayed on the second display screen, where the first and second display screens are adjacent to each other. Please refer to [reference needed]. Figure 18 , Figure 18 A flowchart illustrating a cursor traversal process according to an embodiment of this application is shown. Figure 18 As shown, a cursor crossing process provided in this application embodiment may include S1801-S1813 (where S1801-S1809 is the first display screen presentation stage, and S1810-S1813 is the second display screen presentation stage):

[0382] S1801: The control device 310 establishes a communication connection with the first display device 320 and the second display device 330.

[0383] S1802: The first display device 320 determines the first coordinate system in which the first display screen is located.

[0384] S1803: The first display device 320 sends first information to the control device 310. The first information includes the first coordinate system in which the first display screen is located and the size of the first display screen.

[0385] S1804: The second display device 330 determines the second coordinate system in which the second display screen is located.

[0386] S1805: The second display device 330 sends third information to the control device 310, the third information including the second coordinate system where the second display screen is located and the size of the second display screen.

[0387] S1806: The control device 310 determines the first orientation of the control device 310, the first position of the first display screen relative to the control device 310, and the second position of the second display screen relative to the control device 310.

[0388] S1807: The control device 310 determines a first position on the plane where the first display screen is located and a second position on the plane where the second display screen is located, wherein the first position is located on the first display screen.

[0389] S1808: The control device 310 sends second information to the first display device 320, the second information including the coordinate information of the first position.

[0390] S1809: The first display device 320 presents a cursor at a first position based on the second information.

[0391] S1810: The control device 310 determines the second orientation of the control device 310, the third pose of the first display screen relative to the control device 310, and the fourth pose of the second display screen relative to the control device 310.

[0392] S1811: The control device 310 determines a third position on the plane where the first display screen is located and a fourth position on the plane where the second display screen is located, wherein the fourth position is located on the second display screen.

[0393] S1812: The control device 310 sends fifth information to the second display device 330, the fifth information including the coordinate information of the fourth position.

[0394] S1813: The second display device 330 presents a cursor at the fourth position based on the fifth information.

[0395] For example, please refer to Figure 19 ,in Figure 19 This illustrates the situation where the first and second displays are located close to each other, based on... Figure 18 The cursor crossing process shown can be achieved. Figure 19 The effect shown is when the cursor moves from the first display screen to the second display screen. The entire process is convenient for the user and provides an immersive, precise cursor control and device operation experience.

[0396] For example, consider the cursor changing from being displayed on the first screen to being displayed on the second screen, where the first and second screens are far apart. Please refer to [reference needed]. Figure 20 , Figure 20 A flowchart illustrating another cursor traversal process provided in an embodiment of this application is shown. Figure 20 As shown, a cursor crossing process provided in this application embodiment may include S2001-S2015 (where S2001-S2009 is the first display screen presentation stage, S2010-S2011 is the cursor crossing stage, and S2012-S2015 is the second display screen presentation stage):

[0397] S2001: The control device 310 establishes a communication connection with the first display device 320 and the second display device 330.

[0398] S2002: The first display device 320 determines the first coordinate system in which the first display screen is located.

[0399] S2003: The first display device 320 sends first information to the control device 310. The first information includes the first coordinate system in which the first display screen is located and the size of the first display screen.

[0400] S2004: The second display device 330 determines the second coordinate system in which the second display screen is located.

[0401] S2005: The second display device 330 sends third information to the control device 310, the third information including the second coordinate system where the second display screen is located and the size of the second display screen.

[0402] S2006: The control device 310 determines the first orientation of the control device 310, the first position of the first display screen relative to the control device 310, and the second position of the second display screen relative to the control device 310.

[0403] S2007: The control device 310 determines a first position on the plane where the first display screen is located and a second position on the plane where the second display screen is located, wherein the first position is located on the first display screen.

[0404] S2008: The control device 310 sends second information to the first display device 320, the second information including the coordinate information of the first position.

[0405] S2009: The first display device 320 presents a cursor at a first position based on the second information.

[0406] S2010: The control device 310 determines the third orientation of the control device 310, the fifth pose of the first display screen relative to the control device 310, and the sixth pose of the second display screen relative to the control device 310.

[0407] S2011: The control device 310 determines the fifth position of the plane where the first display screen is located and the sixth position of the plane where the second display screen is located, wherein the fifth position is not on the first display screen and the sixth position is not on the second display screen.

[0408] S2012: The control device 310 determines the second orientation of the control device 310, the third pose of the first display screen relative to the control device 310, and the fourth pose of the second display screen relative to the control device 310.

[0409] S2013: The control device 310 determines a third position on the plane where the first display screen is located and a fourth position on the plane where the second display screen is located, wherein the fourth position is located on the second display screen.

[0410] S2014: Control device 310 sends fifth information to second display device 330, the fifth information including the coordinate information of the fourth position.

[0411] S2015: The second display device 330 presents a cursor at the fourth position based on the fifth information.

[0412] For example, please refer to Figure 21 ,in Figure 21 This illustrates the situation where the first and second displays are far apart, based on... Figure 20 The cursor crossing process shown can be achieved. Figure 21 The effect shown is the cursor moving from the first display screen to the second display screen. The entire process is convenient for the user, providing an immersive and precise cursor control and device operation experience. Furthermore, as... Figure 19 and Figure 21 As can be seen, no matter how far apart the displays of the first display device 320 and the second display device 330 are, it will not affect the accurate display of the cursor.

[0413] In addition, since the device display control method provided in this application embodiment determines whether the display screen displays a cursor based on the position of the control device pointing to the plane where the display screen is located, and the specific display position of the cursor when it is displayed on the display screen, the accurate crossing of the cursor will not be affected when the position of any display device's display screen changes.

[0414] For example, taking the change in the position of the display screen of the first display device 320 as an example, please refer to... Figure 22 , Figure 22 A flowchart illustrating another cursor traversal process provided in an embodiment of this application is shown. Figure 22 As shown, a cursor crossing process provided in this application embodiment may include S2201-S2215 (where S2201-S2209 is the first display screen presentation stage, S2210-S2211 is the information update stage, and S2212-S2215 is the second display screen presentation stage):

[0415] S2201: The control device 310 establishes a communication connection with the first display device 320 and the second display device 330.

[0416] S2202: The first display device 320 determines the first coordinate system in which the first display screen is located.

[0417] S2203: The first display device 320 sends first information to the control device 310. The first information includes the first coordinate system in which the first display screen is located and the size of the first display screen.

[0418] S2204: The second display device 330 determines the second coordinate system in which the second display screen is located.

[0419] S2205: The second display device 330 sends third information to the control device 310, the third information including the second coordinate system where the second display screen is located and the size of the second display screen.

[0420] S2206: The control device 310 determines the first orientation of the control device 310, the first pose of the first display screen relative to the control device 310, and the second pose of the second display screen relative to the control device 310.

[0421] S2207: The control device 310 determines a first position on the plane where the first display screen is located and a second position on the plane where the second display screen is located, wherein the first position is located on the first display screen.

[0422] S2208: The control device 310 sends second information to the first display device 320, the second information including the coordinate information of the first position.

[0423] S2209: The first display device 320 presents a cursor at a first position based on the second information.

[0424] S2210: When the pose of the first display device 320 changes, the first display device 320 determines the third coordinate system in which the first display screen is located.

[0425] S2211: The first display device 320 sends the sixth information to the control device 310. The sixth information includes the third coordinate system in which the first display screen is located and the size of the first display screen.

[0426] S2212: The control device 310 determines the fourth orientation of the control device 310, the seventh pose of the first display screen relative to the control device 310, and the eighth pose of the second display screen relative to the control device 310.

[0427] S2213: The control device 310 determines the seventh position of the plane where the first display screen is located and the eighth position of the plane where the second display screen is located, wherein the eighth position is located on the first display screen.

[0428] S2214: The control device 310 sends the seventh information to the second display device 330, the seventh information including the coordinate information of the eighth position.

[0429] S2215: The second display device 330 presents the cursor at the eighth position according to the seventh information.

[0430] For example, taking a projector as an example where the first display device 320 is a projector, when the position or angle of the projector shifts, such as by Figure 23 The pose change shown in (a) is as follows: Figure 23 When the orientation shown in (b) is changed, the pose of the projector's display carrier will change. Since the projector updates the size of its display carrier and the coordinate system of the display carrier to the control device 310 (e.g., the origin changes from O1 to O1', the X1 axis changes to the X1' axis, the Y1 axis changes to the Y1' axis, and the Z1 axis changes to the Z1' axis), the control device 310 also acquires the orientation of the display carrier relative to the control device 310 in real time. Therefore, as shown in (b), the pose of the display carrier will change. Figure 23 As shown, even after the projector's position changes, the control device 310 can still achieve precise control over the cursor display on the new projection interface.

[0431] For example, taking a projector as the first display device 320, when the display size parameters of the projector change, the size of the display medium of the projector will change, such as from... Figure 24 The dimensional change shown in (a) is as follows: Figure 24 The dimensions are shown in (b) in the diagram. Because the projector updates the size of its display carrier and the coordinate system of the display carrier to the control device 310 (e.g., the origin changes from O1 to O1', the X1 axis changes to the X1' axis, the Y1 axis changes to the Y1' axis, and the Z1 axis changes to the Z1' axis), the control device 310 also acquires the attitude of the display carrier relative to the control device 310 in real time. Therefore, as shown in (b) in the diagram... Figure 23As shown, even after the display size parameters of the projector change, the control device 310 can still achieve precise control over the cursor display on the new projection interface.

[0432] Furthermore, based on the device display control method provided in this application embodiment, since the cursor is presented by the first display device 320 and the third display device 330 respectively based on the pointing position of the control device 310 and according to their own specific attributes, such as type, screen size, and screen resolution, even if the first display device 320 and the second display device 330 have different types, screen sizes, screen resolutions, or one or more other attributes, the cursor can still move continuously and smoothly from the first display device 320 to the second display device 330, thus improving the user's operating experience.

[0433] For example, please refer to Figure 25 , Figure 25 Taking a projector as an example, and a television as an example, the illustration shows a schematic diagram of a cursor traversing between display devices with different attributes, provided in an embodiment of this application. Figure 25 As shown, even if the projector and television differ in one or more attributes such as type, screen size, and screen resolution, the cursor movement is unaffected by differences in device attributes. Before the cursor travels from the projector's display surface to the television, the projector determines the control device's pointing position based on its own coordinate system, screen size, and pose relative to the control device, and then displays the cursor accordingly. Similarly, after the cursor travels from the projector's display surface to the television, the television determines the control device's pointing position based on its own screen's coordinate system, screen size, and pose relative to the control device, and then displays the cursor accordingly. Therefore, the entire cursor movement process is unaffected by differences in device attributes, enabling continuous and smooth cursor movement and improving the user's control experience.

[0434] It should be noted that, in addition, the above-described multi-display device scenario embodiment only uses the example of a display device sending its own coordinate system to the control device 310, and the control device 310 determining its own orientation, the pose of the display screen relative to the control device 320, and the intersection point of the control device 310's orientation with the plane where the display screen is located (i.e., the orientation position of the control device 310). In practical applications, the entity that determines the orientation position of the control device 310 is not limited. For example, each display device can also determine the intersection point of the control device 310's orientation with the plane where its own display screen is located. For this implementation method, please refer to the implementation process of the relevant embodiment in Scenario 1, which will not be elaborated here.

[0435] Furthermore, the above-described embodiments in the multi-display device scenario only use the cursor crossing from the first display device to the second display device as an example. In actual applications, the actual crossing scenario of the cursor is not limited. For example, the cursor can also cross from the second display device to the first display device.

[0436] Furthermore, the embodiments described above in the multi-display-device scenario only use the first and second display devices as examples. In practical applications, the number of display devices is not limited. For scenarios that also include a third display device, the process of the cursor moving between the first and second display devices described above can also be referred to. This will not be elaborated further here.

[0437] It should be noted that in Scenario 2 above, the cursor following the movement trajectory of the control device as it moves between the first and second displays is merely an example. In actual applications, the specific interface effects can vary depending on the specific application scenario, device functions, etc. For example, in Scenario 2, it is also possible to achieve the effect of components, virtual avatars, perspective effects, and special effects moving between the first and second displays; furthermore, in Scenario 2, it is also possible to achieve the effect of the interface changing after the movement.

[0438] For example, when the first display screen and the second display screen are in the same game scene, when the pointing position of the control device moves from the first display screen to the second display screen, the game protagonist's image, game equipment, and game effects (such as bubble effects, firework effects, aiming effects, hit effects, etc.) can also move from the first display screen to the second display screen simultaneously.

[0439] For example, when the first display screen is in a game scene and the second display screen is in a handwriting tablet scene, when the pointing position of the control device moves from the first display screen to the second display screen, the interface effect changes simultaneously from the image of the game protagonist, game equipment, game effects (such as bubble effects, firework effects, aiming effects, hit effects, etc.) to the image of the stylus and / or handwriting.

[0440] For example, when the first display screen is in a game scene and the second display screen is in a demonstration scene, when the pointing position of the control device moves from the first display screen to the second display screen, the interface effect simultaneously changes from the game protagonist image, game equipment, game effects (such as bubble effects, firework effects, aiming effects, hit effects, etc.) to the cursor.

[0441] Similarly, if the first and second displays are in the same handwriting tablet scene or demonstration scene, the interface effect may not change after crossing over; or if the first display is in a handwriting tablet scene and the second display is in a game scene, the first display is in a demonstration scene and the second display is in a game scene, the first display is in a demonstration scene and the second display is in a handwriting tablet scene, the first display is in a handwriting tablet scene and the second display is in a demonstration scene, etc., the interface effect may also change after crossing over, which will not be elaborated here.

[0442] In scenario 2 above, the interface effects presented on the first or second display screen may include, but are not limited to, presenting display objects (such as icons, components, virtual images, etc.) at the pointing position of the control device, displaying corresponding viewing angle effects according to the pointing position of the control device, and presenting pre-set special effects in the corresponding display area (such as a preset control hot zone) according to the pointing position of the display control device. This application embodiment does not make specific limitations and depends on the actual application scenario and device functions.

[0443] In addition, in scenario 2 above, when the pointing position of the control device moves out of the edge area of ​​the first display screen but does not enter the edge area of ​​the second display screen, the first display screen may no longer update the above interface effect or may no longer display any interface effect. This application embodiment does not make specific limitations, but depends on the actual application scenario and device function, etc.

[0444] In the above description of the positioning process between the control device and the display device, it was mentioned that methods such as multi-antenna UWB or three-dimensional electromagnetic coil positioning can be used to achieve the positioning of the pointing position and the display of the cursor. Below, embodiments of this application further provide a possible implementation of the positioning system.

[0445] Figure 26 This application provides an example of a possible positioning system architecture diagram, with reference to... Figure 26 The system includes a first electronic device 100 and a second electronic device 200. The first electronic device 100 is equipped with a first antenna array 120, and the second electronic device 200 is equipped with a second antenna array 220. The first antenna array 120 can establish a three-dimensional coordinate system based on its relative position on the first electronic device 100. The first antenna array 120 and the second antenna array 220 can be mutually positioned, so that the coordinates of the second antenna array 220 are accurately displayed on the display interface of the first electronic device 100.

[0446] For example, the first electronic device 100 can be a television, computer, projector, or other electronic device with a display interface, such as the first display device 320 or the second display device 320 mentioned above. The second electronic device 200 can be a remote control, mobile phone, or other electronic device with the function of remotely controlling the first electronic device 100, such as the control device 310 mentioned above. This application does not limit the specific form of the first electronic device 100 and the second electronic device 200. In this embodiment, for ease of explanation, the first electronic device 100 is a large screen with display function, and the second electronic device 200 is a remote control, which can be called a directional remote control. For example, after the remote control is paired with the television, the first antenna array 120 in the television and the second antenna array 220 in the remote control can be positioned to each other, so that the coordinates of the remote control are displayed on the television screen. The coordinates can be displayed on the screen in the form of dots, arrows, stars, crosses, hands, etc.

[0447] Figure 27 This is a schematic diagram of the structure of the first electronic device 100 provided in the embodiments of this application, with reference to... Figure 27 The first electronic device 100 may include a processor 140, a transmission interface, a power module 110, a first antenna array 120, a first module circuit 130, etc.

[0448] It is understood that the structure illustrated in the embodiments of the present invention does not constitute a specific limitation on the first electronic device 100. In other embodiments of this application, the first electronic device 100 may include more or fewer components than illustrated, or combine some components, or split some components, or arrange different components. The illustrated components may be implemented in hardware, software, or a combination of software and hardware. In addition, the interface connection relationships between the modules illustrated in the embodiments of the present invention are merely illustrative and do not constitute a structural limitation on the first electronic device 100. In other embodiments of this application, the first electronic device 100 may also employ different interface connection methods, or a combination of multiple interface connection methods.

[0449] Processor 140 may include one or more processing units, which may be independent devices or integrated into one or more processors. For example, processor 210 may be a central processing unit (CPU), an application-specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of this application, such as one or more digital signal processors (DSPs), or one or more field-programmable gate arrays (FPGAs).

[0450] The transmission interface 150 can be a wired interface such as Universal Serial Bus (USB) or a standard wireless interface related to Business Transaction Events (BTE). The transmission interface 150 can be used to connect a charger to charge the first electronic device 100, or it can be used to transmit data between the first electronic device 100 and peripheral devices, such as data transmission between the first electronic device 100 and the second electronic device 200.

[0451] The power module 110 is used to supply power to components such as the processor 140 of the first electronic device 100.

[0452] Figure 28 The arrangement diagram of the first antenna array 120 on the first electronic device 100 provided in the embodiments of this application is shown in the figure below. Figure 28 The first antenna array 120 can be disposed at any position on the first electronic device 100. For example, the first antenna array 120 can be disposed on the outside of the first electronic device 100, such as on the upper frame of the first electronic device 100, or on an object that maintains a certain distance from the first electronic device 100. The "object" can be an independent device, such as a desk or stand. The first electronic device 100 and the first antenna array 120 can be placed on different stands that maintain a certain distance from each other. Of course, the first antenna array 120 can also be disposed inside the electronic device in a hidden or semi-hidden manner. This embodiment does not limit this.

[0453] For example, when considering controlling cursor movement on a display via a remote control, an accelerometer and gyroscope sensor could be incorporated into the remote control to sense its rotation and translation. Based on the sensor readings, the relative displacement of the remote control relative to the display could be calculated, which would then be reflected as cursor movement on the display, thus enabling interaction between the remote control and the display. However, this design only obtains the relative displacement of the remote control relative to the display. Since the remote control cannot be matched to the display's size, its absolute displacement within the display's dimensions cannot be obtained. This leads to a mismatch between the user's actual intention and the cursor movement on the display when the remote control is actually pointing or moving. For instance, even when the remote control is pointed outside the display's view, the cursor will still appear on the screen, and the cursor can still be moved while the remote control is in motion. This results in an inability to accurately perceive the pointing direction and position during the entire remote control recognition process.

[0454] Therefore, in this embodiment of the application, another design is considered, namely, a first antenna array 120 is set on the side of the first electronic device 100, and a second antenna array 220 is set on the side of the second electronic device 200. Both the first antenna array 120 and the second antenna array 220 can transmit and receive signals and can achieve mutual positioning, thereby obtaining the absolute coordinates of the second antenna array 220 relative to the first electronic device 100. The second antenna array 220 can accurately point to a specified position of the first electronic device 100. Specifically, once the position of the first antenna array 120 on the first electronic device 100 is determined, the first antenna array 120 can establish a three-dimensional coordinate system based on its relative position on the first electronic device 100. This three-dimensional coordinate system takes into account the relative position of the first antenna array 120 with respect to the display interface 160 of the first electronic device 100. When the first antenna array 120 and the second antenna array 220 of the second electronic device 200 are mutually positioned, if the detected coordinates of the second antenna array 220 do not exceed the range of the display interface 160, the coordinates of the second antenna array 220 can be accurately displayed within the range of the display interface 160. However, if the coordinates of the second antenna array 220 exceed the range of the display interface 160, the coordinates of the second antenna array 220 will not be displayed within the display interface 160, thereby avoiding the problem of inaccurate pointing.

[0455] The first antenna array 120 may specifically include a plurality of first antenna elements 120a, which are arranged according to a predetermined positional relationship. For example... Figure 29 This is a schematic diagram of one arrangement of the first antenna element 120a, referring to... Figure 29 The number of first antenna elements 120a is three, and the three first antenna elements 120a are arranged in an "L" shape; Figure 30Another schematic diagram of the arrangement of the first antenna unit 120a, refer to Figure 30 , the number of the first antenna units 120a is four, and the four first antenna units 120a are arranged in a "square" shape; Figure 31 Another schematic diagram of the arrangement of the first antenna unit 120a, refer to Figure 31 , the number of the first antenna units 120a is three, and the three first antenna units 120a are arranged in a "pin" shape. Among various arrangement forms of at least three first antenna units 120a, there are at least two antennas distributed in the first direction X and the second direction Y respectively, and the first direction X is perpendicular to the second direction Y. Among them, the first direction X can be used as the horizontal axis of the three-dimensional coordinate system, the second direction Y can be used as the vertical axis of the three-dimensional coordinate system, and there can be a set geometric relationship between the plane formed by the first direction X and the second direction Y and the display interface of the first electronic device 100, so as to facilitate the calculation of the coordinates of the second antenna array 220.

[0456] The second antenna array 220 can send a first signal, and the first antenna array 120 can receive this first signal; correspondingly, the first antenna array 120 can send a second signal, and the second antenna array 220 can receive this second signal. The first antenna array 120 and the second antenna array 220 can operate in the ultra-high frequency (UHF) band, and the coverage frequency band of UHF is 3 - 30 GHz. For example, the operating frequency points that may be used are 5.8 GHz, 7.9 GHz, 24 GHz, etc. Among them, 7.9 GHz can cover the ultra-wideband (UWB) band.

[0457] Refer to Figure 27 , the first module circuit 130 may include a control unit 131, a transmitter 133, a receiver 134, a calculation unit 132, etc. Among them, the control unit 131 can control the operation of the transmitter 133 and the calculation unit 132; the transmitter 133 is used to control the first antenna array 120 to send a second signal, and the receiver 134 is used to control the first antenna array 120 to receive the first signal from the second antenna array 220; the calculation unit 132 can calculate the phase parameters in the received first signal and feedback the calculation result to the control unit 131, and the control unit 131 can further calculate the first coordinates of the second antenna array 220 according to the result feedback by the calculation unit 132.

[0458] In addition, Figure 32 Schematic diagram of the structure of the second electronic device 200 provided by the embodiment of the present application, refer to Figure 32The second electronic device 200 may also have the same components as those in the first electronic device 100. Specifically, the second electronic device 200 may include a processor 240, a transmission interface 250, a power module 210, a second antenna array 220, a second module circuit 230, etc. The processor 240, transmission interface 250, and power module 210 in the second electronic device 200 have the same functions as the processor 140, transmission interface 150, and power module 110 in the first electronic device 100, and will not be described in detail here.

[0459] The second linear array 220 is used to transmit a first signal and receive a second signal. The second module circuit 230 is electrically connected to the second linear array 220 and is used to measure the deflection angle of the second linear array 220 relative to the first and second directions based on the second signal.

[0460] As explained above, this embodiment requires mutual positioning between the first antenna array 120 and the second antenna array 220 to obtain the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100. Specifically, on the one hand, the first antenna array 120 needs to obtain the relative coordinates of the second antenna array 220 with respect to the first antenna array 120, i.e., the first coordinates, based on the first signal transmitted by the second antenna array 220. These first coordinates can locate the spatial position of the second antenna array 220.

[0461] On the other hand, the second linear array 220 is mounted on the second electronic device 200. When operating the second electronic device 200, the second electronic device 200 itself can rotate freely at the first coordinate position, thereby causing the second linear array 220 to rotate. This rotation affects the phase of the signal received by the second linear array 220, thus changing the values ​​of the first coordinate in the first and second directions, causing the actual pointing position of the second linear array 220 to not correspond to the first coordinate position. Therefore, this embodiment considers the situation of the second electronic device 200 rotating itself. After the first antenna array 120 locates the first coordinate of the second linear array 220 based on the first signal sent by the second linear array 220, the deflection angle of the second linear array 220 itself relative to the first direction X and the second direction Y can be located by the second linear array 220 based on the second signal sent by the first antenna array 120. Furthermore, the final second coordinate can be obtained based on the first coordinate and the deflection angle.

[0462] In some embodiments, if the radiating surface of the first antenna array 120 is parallel to the display interface 160 of the first electronic device 100, the second coordinate is the position of the cursor that can be displayed on the first electronic device 100 by operating the second electronic device 200; in other embodiments, if the radiating surface of the first antenna array 120 is not parallel to the display interface 160 of the first electronic device, the second coordinate needs to be further converted according to the physical positional relationship between the first antenna array 120 and the display interface 160, and the cursor position presented on the display interface 160 is obtained after the conversion.

[0463] Among them, reference Figure 32 The second module circuit 230 may also include a control unit 231, a transmitter 233, a receiver 234, and a computing unit 232. The control unit 231 controls the operation of the transmitter 233 and the computing unit 232; the transmitter 233 controls the second antenna array 220 to transmit a first signal, and the receiver 234 controls the second antenna array 220 to receive a second signal from the first antenna array 120; the computing unit 232 calculates the phase parameters in the received second signal and feeds the calculation results back to the control unit 231, which can further calculate the deflection angle of the second antenna array 220 based on the results fed back by the computing unit 232.

[0464] Either the first module circuit 130 or the second module circuit 230 can be used to calculate the second coordinate based on the first coordinate and the deflection angle. In one embodiment, after the second linear array 220 obtains the deflection angle, it can transmit the result to the first module circuit 130 via a transmission interface. The first module circuit 130 can then calculate the second coordinate based on the first coordinate and the deflection angle. In another embodiment, after the second linear array 220 obtains the deflection angle, it can calculate the second coordinate through the second module circuit 230, and then transmit the result to the first module circuit 130 via a transmission interface. If the second coordinate falls within the display interface size range of the first electronic device 100, it can be displayed on the first electronic device 100.

[0465] Therefore, the system provided in this application embodiment, on the one hand, by setting a first antenna array 120 on the first electronic device 100 and a second antenna array 220 on the second electronic device 200, can realize long-distance interaction between the first electronic device 100 and the second electronic device 200 without relying on a moving plane; on the other hand, by the mutual positioning of the first antenna array 120 and the second antenna array 220, the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100 can be obtained, which improves the accurate positioning of the second antenna array 220 and also improves the operating experience in spatial pointing operations.

[0466] Optionally, refer to Figure 3 The system comprises at least three first antenna elements 120a and at least two second antenna elements. The distance L between any two of the at least three first antenna elements 120a that have signal receiving capabilities is less than or equal to the wavelength λ of the first signal. The first antenna array 120 and the second antenna array 220 can have the same arrangement. For example, the first antenna array 120 may include three first antenna elements 120a, and the second antenna array 220 may include three second antenna elements, with the arrangement of the three first antenna elements 120a being the same as that of the three second antenna elements. However, in other embodiments, the first antenna array 120 and the second antenna array 220 can have different arrangements. For example, the first antenna array 120 may include three first antenna elements 120a, and the second antenna array 220 may include two second antenna elements, with the arrangement of the three first antenna elements 120a being different from that of the two second antenna elements.

[0467] In this embodiment, the arrangement of the first antenna array 120 is used as an example for explanation.

[0468] It is understandable that the wavelength can be calculated based on the wave speed and frequency. In this embodiment, the first antenna array 120 needs to receive the first signal transmitted by the second antenna array 220. The wavelength of the first signal can be calculated based on the frequency of the first signal and the wave speed of the electromagnetic wave. The distance between any two first antenna elements 120a is limited based on the wavelength. Since the shape of the antenna is not an absolutely regular shape, the equivalent center of the antenna can be used as the starting or ending point for measuring the distance. That is, the distance between any two first antenna elements 120a is the equivalent center spacing of each antenna. By making the distance between any two first antenna elements 120a with signal receiving function less than or equal to the wavelength of the first signal, each first antenna element 120a used for receiving signals can receive the first signal almost simultaneously, and each first antenna element 120a can obtain phase parameters based on the first signal. The first coordinates can be further calculated based on the phase parameters.

[0469] Accordingly, Figure 33 The arrangement diagram of the second linear array 220 on the second electronic device 200 provided in the embodiments of this application is shown in the figure. Figure 33 The second second antenna element in the second antenna array 220 can be used to receive the second signal transmitted by the first antenna array 120. By making the distance L' between any two second second antenna elements less than or equal to the wavelength λ of the second signal, each second second antenna element used to receive the signal can receive the second signal almost simultaneously, and each second second antenna element can obtain the phase parameter based on the second signal. The deflection angle can be obtained based on the phase parameter.

[0470] In other words, by making the distance between any two first antenna elements 120a and the distance between any two second antenna elements less than the wavelength of the corresponding received signal, this embodiment can obtain the first coordinates and deflection angle based on the phase parameters of the received signal, thereby enabling the positioning of the second antenna array 220 in three-dimensional space and obtaining the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100, thus improving the positioning accuracy and enhancing the user experience of operating the second electronic device 200.

[0471] The first module circuit 130 includes one or more receivers 134. For example, when there is only one receiver 134, it can be electrically connected to the second antenna 122, the third antenna 123, and the first antenna 121 via a high-speed switch. This allows one receiver 134 to receive signals from three first antenna elements 120a, enabling the three antennas to receive signals almost simultaneously and calculate the first coordinates based on the phase difference between each first antenna element 120a. Furthermore, when there are multiple receivers 134, each receiver 134 is connected to one first antenna element 120a. The receivers 134 can be synchronized using a synchronization signal, thus also obtaining the phase difference between the first antenna elements 120a.

[0472] Correspondingly, the second module circuit 230 also includes one or more receivers 234. The arrangement of the receivers 234 and the second antenna unit in the second module circuit 230 can be the same as the arrangement of the receivers 134 and the first antenna unit in the first module circuit 130. For example, when there is one receiver 234, one receiver 234 is electrically connected to each of the second antenna units, and one receiver 234 can realize the signal reception function of three second antenna units; when there are multiple receivers 234, each receiver 234 is connected to one second antenna unit, and the receivers 234 can be synchronized through a synchronization signal, so that the three second antenna units can receive signals almost simultaneously, and the deflection angle can be calculated based on the phase difference between the two second antenna units.

[0473] Optionally, when there are multiple receivers 134 or 234, the number of antennas electrically connected to one of the receivers can also be multiple.

[0474] Optionally, refer to Figure 27 and Figure 28 At least three first antenna elements 120a can be a first antenna 121, a second antenna 122 and a third antenna 123, respectively. The second antenna 122 is located on one side of the first antenna 121 in the first direction X, and the third antenna 123 is located on one side of the first antenna 121 in the second direction Y.

[0475] The first antenna 121 can transmit or receive signals, and the origin of the three-dimensional coordinate system can be defined through the first antenna 121.

[0476] For example, the first antenna 121 can be an independent transceiver antenna. The first module circuit 130 includes a transmitter 133 and a switch 135. The transmitter 133 is connected to the first antenna 121 through the switch 135, and the switch 135 can be used to switch between signal transmission and signal reception functions. In this embodiment, the position of the first antenna 121 is the origin of the three-dimensional coordinate system, which facilitates coordinate calculation.

[0477] In another embodiment, the first antenna 121 may also include a transmitting antenna 121a and a receiving antenna. The transmitting antenna 121a is connected to the transmitter 133 for transmitting signals, and the receiving antenna is connected to the receiver 134 for receiving signals. In this embodiment, the transmitting antenna in the first antenna 121 is the origin of the three-dimensional coordinate system, which facilitates coordinate calculation.

[0478] In addition, in some other embodiments, the origin of the three-dimensional coordinate system can also be defined at a location other than the first antenna 121, which is not limited in this embodiment.

[0479] For ease of explanation, the following explanation will take the first antenna 121 as an independent transceiver antenna as an example.

[0480] In one embodiment, the first antenna 121 serves as the origin of a three-dimensional coordinate system, with a first direction being the x-axis and a second direction being the y-axis. The second antenna 122 is located on the x-axis, and the third antenna 123 is located on the y-axis, such that the first antenna 121, the second antenna 122, and the third antenna 123 are arranged in an "L" shape. The distances between the second antenna 122 and the first antenna 121, and between the third antenna 123 and the first antenna 121, are all less than or equal to the wavelength of the first signal.

[0481] Based on the structure of the first antenna array 120 provided in this embodiment, the positioning method will be described in detail below with reference to the accompanying drawings.

[0482] When operating the second electronic device 200, the second electronic device 200 and the first electronic device 100 are usually kept at a distance, that is, the first antenna array 120 and the second antenna array 220 are kept at a distance, so that the second antenna array 220, the first antenna 121 and the second antenna 122 form a triangle, and the second antenna array 220, the first antenna 121 and the third antenna 123 also form a triangle, so that the value of the first coordinate (x,y,z) can be calculated according to the triangle and the relevant principles of electromagnetic waves.

[0483] Specifically, Figure 34 A model diagram for calculating the first coordinates provided in an embodiment of this application, referring to... Figure 34 In the triangle formed by the second antenna array 220, the first antenna 121, and the second antenna 122, for ease of explanation, the distance between the second antenna array 220 and the first antenna 121 can be defined as the first distance r, the second distance between the second antenna array 220 and the second antenna 122 as r', and the third distance between the second antenna 122 and the first antenna 121 as d.

[0484] Figure 35 This is a schematic diagram of a one-way ranging method provided in an embodiment of this application, referring to... Figure 35 For calculating the first distance r, if the clocks of the second linear array 220 and the first antenna 121 are precisely synchronized, a one-way ranging method can be used, which includes the following steps:

[0485] Step a1: Detect the first time point t1 when the second day's linear array 220 emits the first signal.

[0486] Step a2: Detect the second time point t2 when the first antenna 121 receives the first signal.

[0487] Step a3: Obtain the first distance d based on the first time point, the second time point, and the speed of light.

[0488] Where t2-t1 is the propagation time of the electromagnetic wave between the second antenna array 220 and the first antenna 121, and the propagation speed of the electromagnetic wave is the speed of light c. Multiplying this time by the speed of light gives the first distance r, which can be represented by the following formula:

[0489] r = (t2 - t1) × c.

[0490] also, Figure 36 This is a schematic diagram of a two-way ranging method provided in an embodiment of this application, referring to... Figure 36 For calculating the first distance r, if the clocks of the second linear array 220 and the first antenna 121 are not synchronized, a two-way ranging method can be used, which includes the following steps:

[0491] Step b1: Detect the first time point t3 when the second day's linear array 220 emits the first signal.

[0492] Step b2: Detect the second time point t4 at which the first antenna 121 receives the first signal.

[0493] Step b3: Detect the delay t' of the first antenna 121 processing the first signal.

[0494] Step b4: Detect the third time point t5 when the first antenna 121 emits the second signal.

[0495] Step b5: Detect the fourth time point t6 when the second linear array 220 receives the second signal on the second day.

[0496] Step b6: Obtain the straight-line distance based on the first time point, the second time point, the delay duration, the third time point, the fourth time point, and the speed of light.

[0497] Since the clocks of the second antenna array 220 and the first antenna 121 are not synchronized, a signal delay t' needs to be considered between the transmission and reception of the first antenna 121, where t' = t5 - t4; t4 - t3 is the propagation time of the electromagnetic wave from the second antenna array 220 to the first antenna 121, and t6 - t5 is the propagation time of the electromagnetic wave from the first antenna 121 to the second antenna array 220. The durations of t4 - t3 and t6 - t5 are equal. Specifically, the first distance r can be calculated using the following formula:

[0498]

[0499] For the calculation of the second distance r', since there is a third distance d between the second antenna 122 and the first antenna 121, there is a phase difference p' between the signals received by the second antenna 122 and the first antenna 121. This phase difference p' can be positive or negative in the coordinate system. Based on this phase difference p', the frequency f of the first signal, and the speed of light c, the distance difference p between the first distance r and the second distance r' can be calculated. This distance difference p can be calculated according to the following formula:

[0500]

[0501] When the second antenna array 220 transmits the first signal, the first antenna 121 and the second antenna 122 can receive the first signal respectively and obtain the phase parameters respectively, thereby obtaining the phase difference p' between the first antenna 121 and the second antenna 122. After obtaining the distance difference p, the second distance r' can be calculated, that is, r' = rp.

[0502] Reference Figure 34 For the third distance d, it can be directly determined by arranging the second antenna 122 and the first antenna 121. Therefore, the lengths of the three sides of the triangle formed by the first antenna 121, the second antenna 122, and the second antenna array 220 can all be known. The angle between the line connecting the second antenna array 220 and the first antenna 121 and the line connecting the second antenna 122 and the first antenna 121 can be defined as α. The first coordinate of the second antenna array 220 in the three-dimensional coordinate system is (x, y, z), which can be obtained according to the following formula:

[0503]

[0504] r 2 = x 2 + z 2 ; (3)

[0505] Among them, x in formulas (2) and (3) is the coordinate value corresponding to the second antenna array 220 on the x-axis in the three-dimensional coordinate system, and z is the coordinate value corresponding to the second antenna array 220 on the z-axis in the three-dimensional coordinate system. According to formulas (1) and (2), the x value in the first coordinate can be obtained, and according to formulas (1) to (3), the z value in the first coordinate can be calculated.

[0506] Correspondingly, according to the principle of calculating the x value and z value in the first coordinate as described above, the y value in the first coordinate can be calculated, which will not be elaborated here.

[0507] Thus, through the above method, all the numerical values of the first coordinate (x, y, z) can be obtained.

[0508] In another embodiment, Figure 37 Figure 37 is a model diagram for calculating the first coordinate provided by an embodiment of the present application. Referring to Figure 37 Figure 37 , the second antenna 122 is on the x-axis of the three-dimensional coordinate system, and the third antenna 123 is located on one side of the first antenna 121 in the y-axis direction, but not on the y-axis, so that the positional distribution of the first antenna 121, the third antenna 123, and the second antenna 122 is in a "pin" shape, an acute triangle, an obtuse triangle, etc.

[0509] In this embodiment, for the triangle formed by the first antenna 121, the second antenna 122, and the second antenna array 220, since the second antenna 122 is on the x-axis, the calculation of the x value and z value in the first coordinate in this embodiment can still be obtained by the above method.

[0510] Referring to Figure 37 Figure 37Since the third antenna 123 is not located on the y-axis, it cannot be directly calculated based on the triangle formed by the first antenna 121, the third antenna 123 and the second antenna array 220. Instead, it is necessary to determine the projection point y1 of the third antenna 123 on the y-axis, and use the projection point y1, the first antenna 121 and the second antenna array 220 to determine the triangle, and calculate the y value in the first coordinate based on the triangle. In this system, the line connecting the third antenna 123 and the first antenna 121 has an angle β1 with the y-axis. The phase difference between the third antenna 123 and the first antenna 121 can be converted into the component of the phase difference on the y-axis based on the angle β1. Based on the component of the phase difference on the y-axis, the distance from the projection point y1 of the third antenna 123 on the y-axis to the second antenna array 220 can be calculated. The distance from the projection point y1 to the first antenna 121 can be calculated based on the distance between the third antenna 123 and the first antenna 121 and the angle β1. The distance between the second antenna array 220 and the first antenna 121 can still be calculated using the unidirectional ranging method or the bidirectional ranging method described above. Thus, the side lengths of the triangle determined by the projection point y1, the first antenna 121, and the second antenna array 220 can be obtained, and the y-value of the first coordinate can be calculated using the above method.

[0511] Furthermore, in some other embodiments, Figure 38 Another model diagram for calculating the first coordinates provided in this application embodiment, referring to... Figure 38 For the x and z values, the triangle can also be determined by the projection point of the third antenna 123 on the x-axis, the first antenna 121 and the second antenna array 220, and the x and z values ​​of the first coordinate can be calculated according to the above method.

[0512] Specifically, refer to Figure 38 An angle β2 exists between the line connecting the third antenna 123 and the first antenna 121 and the x-axis. The phase difference between the third antenna 123 and the first antenna 121 can be converted into the x-axis component of the phase difference based on the angle β2. Based on the x-axis component of the phase difference, the distance from the projection point x1 of the third antenna 123 on the x-axis to the second antenna array 220 can be calculated. The distance from the projection point x1 to the first antenna 121 can be calculated based on the distance between the third antenna 123 and the first antenna 121 and the angle β2. The distance between the second antenna array 220 and the first antenna 121 can still be calculated using the unidirectional ranging method or the bidirectional ranging method described above. Thus, the side lengths of the triangle determined by the projection point x1, the first antenna 121, and the second antenna array 220 can be obtained, and the x and z values ​​of the first coordinate can be calculated using the above method.

[0513] Optionally, the second antenna array 220 includes at least two second antenna units. When there are two second antenna units, they need to work together with an acceleration sensor. Among them, the acceleration sensor and one of the second antenna units are distributed in the third direction and the fourth direction respectively, and the third direction and the fourth direction are perpendicular. The other second antenna unit can be located at the intersection of the third direction and the fourth direction, serving as the origin of the coordinate system formed by the third direction and the fourth direction. Exemplarily, the second antenna unit located on one side of the origin in the third direction can be used to obtain a horizontal signal, and the acceleration sensor on one side of the origin in the fourth direction is used to obtain a vertical signal, and further obtain the deflection angle of the second antenna array based on the horizontal signal and the vertical signal.

[0514] When there are more than three second antenna units, at least two of the at least three second antenna units are distributed in the third direction and the fourth direction respectively.

[0515] Among them, both the third direction and the fourth direction are in the reference system of the second electronic device 200 itself, that is, the third direction and the fourth direction have no association with the first direction X, the second direction Y, and the world coordinate system respectively. The second antenna array 220 can be set at any position of the second electronic device 200. For better signal transceiver performance, the second antenna array 220 is set at the end of the second electronic device 200, and this end is the end of the second electronic device 200 facing the first electronic device 100 during use.

[0516] Among them, the third direction and the fourth direction are two mutually perpendicular directions relative to the end of the second electronic device 200. By setting the second antenna units in two mutually perpendicular directions respectively, it is possible to obtain the deflection angle of the second antenna array 220 relative to the first direction X and the second direction Y according to the phase difference between the antennas, and thus obtain the second coordinate according to the first coordinate and the deflection angle, that is, the absolute coordinate of the second column of antennas within the size range of the first electronic device 100.

[0517] Among them, the second antenna array 220 and the first antenna array 120 can have the same antenna arrangement form. Each antenna in both can be arranged in an "L" shape, a "pin" shape, a rectangular array, etc., which is beneficial for calculating parameters such as the phase difference and deflection angle of the antennas and achieving precise positioning. Of course, in some other embodiments, as described above, the second antenna array 220 and the first antenna array 120 can also have different arrangement forms, which will not be elaborated here.

[0518] Optionally, refer to Figure 32 and Figure 33The second antenna array 220 includes at least three second antenna elements, which can be a fourth antenna 221, a fifth antenna 222, and a sixth antenna 223. The fifth antenna 222 is located on the side of the fourth antenna 221 facing a third direction, and the sixth antenna 223 is located on the side of the fourth antenna 221 facing a fourth direction, thus forming an "L"-shaped structure. The fourth antenna 221 is a transceiver antenna, while the fifth and sixth antennas 222 and 223 are both receiving antennas. The distance between any two of the fourth antenna 221, fifth antenna 222, and sixth antenna 223 is less than or equal to the wavelength of the second signal. (Refer to...) Figure 32 The fourth antenna 221 can be an independent antenna. This independent fourth antenna 221 can be connected to the transmitter via a switch 235, which allows switching between signal transmission and signal reception functions. Alternatively, in other embodiments, the fourth antenna 221 may include a transmitting antenna 221a and a receiving antenna. The transmitting antenna 221a is connected to the transmitter 233 for transmitting signals, and the receiving antenna is connected to the receiver 234 for receiving signals.

[0519] When the first antenna array 120 transmits the second signal, the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 can all receive the second signal and obtain the phase difference between the fifth antenna 222 and the fourth antenna 221, as well as the phase difference between the sixth antenna 223 and the fourth antenna 221, based on the phase parameters in the second signal. Since the distance between any two of the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 is less than or equal to the wavelength of the second signal, the first deflection angle θ1 of the second antenna array 220 relative to the first direction and the second deflection angle θ2 of the second antenna array 220 relative to the second direction can be obtained based on the phase difference. Combined with the first coordinates (x, y, z), the final two-dimensional coordinates (x+z×tanθ1, y+z×tanθ2) of the second antenna array 220 projected onto the display interface 160 of the first electronic device 100 can be obtained.

[0520] Optionally, the plane formed by the first direction X and the second direction Y is parallel to the display interface of the first electronic device 100. The equivalent center of each first antenna element 120a in the first antenna array 120 can be located on the plane formed by the first direction X and the second direction Y, which facilitates the geometric calculation of the coordinate values ​​of each coordinate point in the first coordinate system and helps to improve the accuracy of the first coordinate system.

[0521] Of course, in some other embodiments, the equivalent center of each first antenna element 120a in the first antenna array 120 may not be coplanar with the display interface 160 of the first electronic device 100, as long as the geometric relationship between each first antenna element 120a and the display interface 160 of the first electronic device 100 can be determined.

[0522] This application also provides a positioning method. The positioning method provided by this application will be described in detail below with reference to the accompanying drawings and specific embodiments.

[0523] This positioning method can be applied to a system including a first electronic device 100 and a second electronic device 200. The first electronic device 100 is provided with a first antenna array 120, which includes a plurality of first antenna elements 120a. At least two of the plurality of first antenna elements 120a are distributed in a first direction and a second direction, respectively. The first direction is perpendicular to the second direction. The second electronic device 200 is provided with a second antenna array 220, which includes a plurality of second antenna elements.

[0524] Figure 39 The flowchart of the positioning method provided in the embodiments of this application is shown below. Figure 39 The method includes the following steps:

[0525] Step S1: Determine the position of the first cursor displayed on the first electronic device 100 based on the first signal sent by the second antenna array 220 and the second signal sent by the first antenna array 120.

[0526] This application can achieve precise pointing of the second antenna array 220 to a specified location by mutual positioning of the first antenna array 120 and the second antenna array 220. Specifically, the absolute coordinates of the second antenna array 220 relative to the first electronic device 100 can be obtained, and the second antenna array can achieve precise pointing of the first electronic device 100 to a specified location. Specifically, after the position of the first antenna array 120 on the first electronic device 100 is determined, the first antenna array 120 can establish a three-dimensional coordinate system based on its relative position on the first electronic device 100. This three-dimensional coordinate system takes into account the relative position of the first antenna array 120 relative to the display interface 160 of the first electronic device 100. When the first antenna array 120 and the second antenna array 220 of the second electronic device 200 are mutually positioned, if the detected coordinates of the second antenna array 220 do not exceed the range of the display interface 160, the coordinates of the second antenna array 220 can be accurately displayed within the range of the display interface 160 in the form of a first cursor, thereby improving the precise positioning of the second antenna array 220 and also improving the user experience in spatial pointing operations.

[0527] Furthermore, when the coordinates of the second linear array 220 exceed the size range of the first electronic device 100, the coordinates determined in this case can be defined as the second cursor position, which will not be displayed in the display interface 160, thereby avoiding the problem of inaccurate pointing.

[0528] Specifically, Figure 40 A flowchart of a positioning method provided in another embodiment of this application is shown below. Figure 40 Step S1 specifically includes:

[0529] Step S11: Measure the first coordinates of the second antenna array in the three-dimensional coordinate system where the first antenna array is located based on the first signal. The first coordinates can be calculated by the first electronic device 100 or the second electronic device 200, and the calculation result is sent to the first electronic device 100.

[0530] Step S12: Measure the deflection angle of the second antenna array relative to the first direction and the second direction based on the second signal. This deflection angle can be calculated by the second electronic device 200, or by the first electronic device 100; this embodiment does not limit the calculation.

[0531] Step S13: Obtain the second coordinate based on the first coordinate and the deflection angle.

[0532] Step S14: Determine the position of the first cursor based on the second coordinates. As explained above, depending on the different positional relationships between the radiating surface of the first antenna array 120 and the display interface 160 of the first electronic device 100, the second coordinates can be the position of the first cursor, or the position of the first cursor can be obtained by converting the second coordinates. This will not be elaborated further here.

[0533] In this embodiment, the second electronic device 200 can rotate freely at the first coordinate position, which in turn causes the second linear array 220 to rotate. This rotation affects the phase of the signal received by the second linear array 220, thereby changing the values ​​of the first coordinate in the first and second directions. This results in the actual pointing position of the second linear array 220 not corresponding to the first coordinate position. Therefore, this embodiment considers the rotation of the second electronic device 200 itself. After the first antenna array 120 locates the first coordinate of the second linear array 220 based on the first signal sent by the second linear array 220, the second linear array 220 can be located by the second signal sent by the first antenna array 120 to determine its own deflection angle relative to the first and second directions. Furthermore, the final second coordinate can be obtained by following the first coordinate and the deflection angle.

[0534] The positioning method provided in this application embodiment, on the one hand, enables long-distance interaction between the first electronic device 100 and the second electronic device 200 by setting a first antenna array 120 on the first electronic device 100 and a second antenna array 220 on the second electronic device 200, without relying on a moving plane; on the other hand, it can achieve mutual positioning of the first antenna array 120 and the second antenna array 220, taking into account the rotation of the second electronic device 200 during use, and by calculating the deflection angle of the second antenna array 220 relative to the first antenna array 120 in the first and second directions, the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100 can be obtained, which improves the accurate positioning of the second antenna array 220 and also improves the user experience in spatial pointing operations.

[0535] In one specific implementation, the first antenna element 120a comprises a first antenna 121, a second antenna 122, and a third antenna 123. The second antenna 122 is located on one side of the first antenna 121 in the first direction, and the third antenna 123 is located on one side of the first antenna in the second direction. The first signal includes a time parameter and a first phase parameter. Specifically, step S11 includes:

[0536] Step S111: Obtain the first distance between the first antenna 121 and the second antenna array 220 based on the time parameter. This time parameter is the flight time of the signal between the transmission and reception times, and may also include the time consumed by signal processing. The first distance can be calculated based on the above duration.

[0537] Reference Figure 35 and Figure 36 The first distance r is the straight-line distance between the second antenna array 220 and the first antenna 121. As explained above, the first distance r can be calculated using a one-way ranging method or a two-way ranging method. In both methods, the first distance r can be calculated based on the time of signal transmission or reception, or by combining the delay time of signal processing. This will not be elaborated further here.

[0538] Step S112: Obtain the first phase difference between the second antenna 122 and the first antenna 121, and the second phase difference between the third antenna 123 and the first antenna 121, based on the first phase parameters. The first antenna array 220 can analyze the phase parameters from the received first signal, and further obtain the phase difference based on these phase parameters.

[0539] Step S113: Obtain the x-axis and z-axis coordinates in the first coordinate system based on the first distance r, the distance between the second antenna 122 and the first antenna 121, and the first phase difference; obtain the y-axis coordinates in the first coordinate system based on the first distance r, the distance between the third antenna 123 and the first antenna 121, and the second phase difference.

[0540] Among them, reference Figure 34 As explained above, the distance between the second antenna 122 and the second antenna array 220 can be calculated based on the first phase difference, and the x and z values ​​in the first coordinate system can be further calculated. (Refer to...) Figure 37 Figure 37 The distance between the third antenna 123 and the second antenna array 220 can be calculated based on the second phase difference, and the y value in the first coordinate can be further calculated, thus obtaining all the values ​​of the first coordinate (x, y, z).

[0541] As a specific implementation, the second linear array 220 includes a fourth antenna 221, a fifth antenna 222, and a sixth antenna 223. The fifth antenna 222 is located on the side of the fourth antenna 221 in the third direction, and the sixth antenna 223 is located on the side of the origin antenna in the fourth direction. The second signal includes a second phase parameter. Specifically, step S12 includes:

[0542] Step S121: Obtain the third phase difference between the fifth antenna 222 and the fourth antenna 221, and the fourth phase difference between the sixth antenna 223 and the fourth antenna 221, based on the second phase parameter.

[0543] Step S122: Obtain the first deflection angle θ1 of the second linear array 220 in the first direction based on the third phase difference, and obtain the second deflection angle θ2 of the second linear array 220 in the second direction based on the fourth phase difference.

[0544] Among them, since the distance between any two of the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 is less than or equal to the wavelength of the second signal, the first deflection angle θ1 of the second antenna array 220 relative to the first direction and the second deflection angle θ2 of the second antenna array 220 relative to the second direction can be obtained corresponding to the phase difference. Combining with the first coordinates (x, y, z), the two-dimensional coordinates (x + z×tanθ1, y + z×tanθ2) of the second antenna array 220 projected onto the display interface of the first electronic device 100 can be obtained. Among them, for the case where the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 form a triangle or a "pin" shape, the distance between any two receiving antennas is less than or equal to the wavelength of the second signal, and the unique deflection angle can be determined by the horizontal components of some antennas. In addition, for the case where the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 form a rectangular array or a "square" shape, the distance between any two receiving antennas is less than or equal to 1 / 2 of the wavelength of the second signal, so that the unique deflection angle can be directly determined.

[0545] Thus, for the influence of the rotation of the second electronic device 200 on the coordinate accuracy, this embodiment considers to achieve correction by measuring the first deflection angle θ1 and the second deflection angle θ2. On the basis of obtaining the first coordinates of the second antenna array 220, generally, a gyroscope is considered to be set in the second electronic device 200. However, the gyroscope can only detect the rotation of the second electronic device 200 itself and cannot be synchronized with the size of the display interface of the first electronic device 100. For example, when the coordinates of the second electronic device 200 exceed the size range of the display interface of the first electronic device 100, the gyroscope will still detect the rotation of the second electronic device 200 and transmit the rotation signal to the first electronic device 100, causing the cursor on the display interface of the first electronic device 100 to move randomly and making it impossible to obtain an accurate pointing. In this embodiment, the method of measuring the deflection angle is adopted, that is, by measuring the first deflection angle θ1 and the second deflection angle θ2, the angle correction of the second antenna array 220 in the three-dimensional coordinate system can be achieved, and the three-dimensional coordinate system is associated with the size of the first electronic device 100, so that the absolute coordinates of the second antenna array 220 within the size range of the display interface of the first electronic device 100 can be accurately obtained. When the coordinates of the second antenna array 220 exceed the size range of the display interface of the first electronic device 100, the coordinates of the second antenna array 220 are not displayed on the display interface of the first electronic device 100, thus improving the control experience.

[0546] In addition, in some other embodiments, the second antenna array includes a fourth antenna, a fifth antenna, and an accelerometer, wherein the fifth antenna is located on one side of the fourth antenna in a third direction, the accelerometer is located on one side of the fourth antenna in a fourth direction, and the third direction is perpendicular to the fourth direction; the second signal includes a second phase parameter;

[0547] Step S12 specifically includes:

[0548] Step S123: Obtain the third phase difference between the fifth antenna and the fourth antenna based on the second phase parameter.

[0549] Step S124: Obtain the first deflection angle of the second linear array in the first direction based on the third phase difference, and obtain the second deflection angle of the second linear array in the second direction based on the second phase parameter.

[0550] The acceleration sensor can replace the sixth antenna in the aforementioned embodiment. The acceleration sensor can obtain the second deflection angle, and thus can obtain the second coordinate by combining the first deflection angle and the first coordinate. This will not be elaborated further here.

[0551] It should be understood that the various solutions in the embodiments of this application can be used in reasonable combinations, and the explanations or descriptions of the various terms appearing in the embodiments can be referenced or explained to each other in the various embodiments.

[0552] It should also be understood that, in the various embodiments of this application, the order of the above-mentioned processes does not imply the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute a limitation on the implementation process of the embodiments of this application.

[0553] It is understood that electronic devices (such as control devices or display devices) include hardware structures and / or software modules corresponding to perform the respective functions in order to achieve the functions of any of the embodiments described above. Those skilled in the art should readily recognize that, based on the units and algorithm steps of the examples described in conjunction with the embodiments disclosed herein, this application can be implemented in hardware or a combination of hardware and computer software. Whether a function is implemented in hardware or by computer software driving hardware depends on the specific application and design constraints of the technical solution. Those skilled in the art can use different methods to implement the described functions for each specific application, but such implementation should not be considered beyond the scope of this application.

[0554] This application embodiment can divide electronic devices (such as control devices or display devices) into functional modules. For example, each function can be divided into its own functional module, or two or more functions can be integrated into one processing module. The integrated module can be implemented in hardware or as a software functional module. It should be noted that the module division in this application embodiment is illustrative and only represents one logical functional division; other division methods may be used in actual implementation.

[0555] It should also be understood that the various modules in an electronic device (such as a control device or display device) can be implemented in software and / or hardware, without specific limitations. In other words, electronic devices are presented in the form of functional modules. Here, "module" can refer to application-specific integrated circuits (ASICs), circuits, processors and memories that execute one or more software or firmware programs, integrated logic circuits, and / or other devices that can provide the above functions.

[0556] In an alternative approach, when data transmission is implemented using software, it can be implemented entirely or partially in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, all or part of the processes or functions described in the embodiments of this application are implemented. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another. For example, the computer instructions can be transmitted from one website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, fiber optic, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) means. The computer-readable storage medium can be any available medium that a computer can access or a data storage device such as a server or data center that integrates one or more available media. The available medium can be a magnetic medium (e.g., floppy disk, hard disk, magnetic tape), an optical medium (e.g., digital video disk (DVD)), or a semiconductor medium (e.g., solid-state disk (SSD)).

[0557] The steps of the methods or algorithms described in the embodiments of this application can be implemented in hardware or by a processor executing software instructions. The software instructions can consist of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, hard disks, portable hard disks, compact disc read-only memory (CD-ROM), or any other form of storage medium well known in the art. An exemplary embodiment couples a storage medium to a processor, enabling the processor to read information from and write information to the storage medium. Of course, the storage medium can also be a component of the processor. The processor and storage medium can reside in an application-specific integrated circuit (ASIC). Alternatively, the ASIC can reside in an electronic device (such as a control device or display device). Of course, the processor and storage medium can also exist as discrete components.

[0558] Through the above description of the embodiments, those skilled in the art can clearly understand that, for the sake of convenience and brevity, the division of the above functional modules is only used as an example. In practical applications, the above functions can be assigned to different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The above are merely exemplary embodiments of this application and are not intended to limit this application. For those skilled in the art, this application can have various modifications and variations. Any modifications, equivalent substitutions, improvements, etc., made within the spirit and principles of this application should be included within the protection scope of this application.

Claims

1. A device display control method, characterized in that, The method is applied to at least one positioning module, the at least one positioning module including a first positioning module, the first positioning module including a first antenna array, the first antenna array including at least three first antenna elements, at least two of the at least three first antenna elements being distributed in a first direction and at least two being distributed in a second direction, the first positioning module being mounted on a first display device, the method including: The first antenna array of the first positioning module receives a first signal from the second antenna array of the control device, and the distance between any two first antenna elements among the plurality of first antenna elements that have the function of receiving the first signal is less than or equal to the wavelength of the first signal. The first antenna array sends a second signal to the second antenna array, wherein the first signal and the second signal are used to determine the position of a first cursor corresponding to a first pointing position of the control device, and the first cursor is displayed on the first display device.

2. The method according to claim 1, characterized in that, The method further includes: The first antenna array receives a third signal from the second antenna array; The first antenna array sends a fourth signal to the second antenna array, wherein the third signal and the fourth signal are used to determine a second pointing position, wherein the second pointing position is a pointing position included on the first moving trajectory of the control device, and the second pointing position is the position after moving out of the first edge area of ​​the first display screen of the first display device. The first moving trajectory moves from the first display screen of the first display device towards the first edge area. When the control device points to the second pointing position, no corresponding cursor is displayed on the first display screen.

3. The method according to claim 2, characterized in that, The method further includes: The first antenna array receives the fifth signal from the second antenna array; The first antenna array sends a sixth signal to the second antenna array, wherein the fifth signal and the sixth signal are used to determine the position of the second cursor corresponding to the third pointing position of the control device, wherein the third pointing position is the pointing position included on the second movement trajectory of the control device, the second movement trajectory moves from outside the first display screen toward the first edge region and moves to the first display screen, and the second cursor is displayed on the first display screen.

4. The method according to claim 2, characterized in that, The at least one positioning module further includes a second positioning module, the second positioning module being mounted on a second display device, the second display device being positioned after the first moving trajectory has moved out of the first display screen, the method further including: After the first moving trajectory moves out of the first edge area of ​​the first display screen, the third antenna array of the second positioning module receives a seventh signal from the second antenna array of the control device. The third antenna array includes a plurality of third antenna elements, at least two of which are distributed in the first direction and the second direction respectively. The third antenna array sends an eighth signal to the second antenna array, wherein the seventh signal and the eighth signal are used to determine the position of the third cursor corresponding to the fourth pointing position of the control device, and the third cursor is displayed on the second display device.

5. The method according to any one of claims 1-4, characterized in that, The first signal and the second signal include one of the following signals: ultra-wideband broadcast (UWB) signal and millimeter-wave radar signal.

6. The method according to any one of claims 1-4, characterized in that, The first antenna array and / or the second antenna array operate in ultra-high frequency (UHF).

7. The method according to any one of claims 1-4, characterized in that, The first signal and the second signal are used to determine the position of the first cursor corresponding to the first pointing position of the control device, including: the first signal, the second signal and the size of the first display screen are used to determine the position of the first cursor corresponding to the first pointing position of the control device.

8. The method according to claim 1, characterized in that, At least three first antenna elements include a first antenna, a second antenna, and a third antenna. The first antenna is located at the intersection of a first direction and a second direction. The second antenna is located on one side of the first antenna in the first direction. The third antenna is located on one side of the first antenna in the second direction. The first direction is perpendicular to the second direction.

9. The method according to claim 8, characterized in that, The first antenna is a transceiver antenna, or the first antenna includes a receiving antenna and a transmitting antenna.

10. The method according to claim 1 or 8, characterized in that, At least three of the first antenna elements are arranged in an L-shape, a triangle, or a rectangular array.

11. The method according to claim 8 or 9, characterized in that, The plane formed by the at least three first antenna elements is parallel to the first display screen of the first display device.

12. The method according to any one of claims 1-4 and 8-9, characterized in that, The first antenna array is located above the first display device.

13. A positioning module system, wherein the positioning module system includes at least one positioning module, the at least one positioning module being configured to perform the device display control method as described in any one of claims 1-12.

14. A display control system, comprising a positioning module system as described in claim 13 and at least one display device, wherein at least one positioning module in the positioning module system is respectively mounted on a corresponding at least one display device, and the at least one display device is used to display a cursor corresponding to the pointing position of the control device.

15. A display control system, characterized in that: The display control system includes at least one display device, the at least one display device including a first display device, the first display device including a first positioning module and a first display screen, the first positioning module including a first antenna array, the first antenna array including at least three first antenna elements, at least two of the at least three first antenna elements being distributed in a first direction and at least two in a second direction, the first positioning module being mounted on the first display device, the system including: The first antenna array of the first positioning module is used to receive a first signal from the second antenna array of the control device, wherein the distance between any two of the at least three first antenna elements having the function of receiving the first signal is less than or equal to the wavelength of the first signal. The first antenna array is further configured to send a second signal to the second antenna array, wherein the first signal and the second signal are used to determine the position of a first cursor corresponding to a first pointing position of the control device; The first display screen is used to display the first cursor.

16. The system according to claim 15, characterized in that, The first antenna array is also used to receive a third signal from the second antenna array; The first antenna array is further configured to send a fourth signal to the second antenna array, wherein the third signal and the fourth signal are used to determine a second pointing position, wherein the second pointing position is a pointing position included on the first moving trajectory of the control device, and the second pointing position is a position after moving out of the first edge area of ​​the first display screen of the first display device, and the first moving trajectory moves from the first display screen of the first display device toward the first edge area; When the control device points to the second pointing position, the first display device does not display the corresponding cursor on the first display screen.

17. The system according to claim 15 or 16, characterized in that, The first antenna array is also used to receive a fifth signal from the second antenna array; The first antenna array is further configured to send a sixth signal to the second antenna array, wherein the fifth signal and the sixth signal are configured to determine the position of the second cursor corresponding to the third pointing position of the control device, wherein the third pointing position is a pointing position included on the second movement trajectory of the control device, the second movement trajectory moves from outside the first display screen toward the first edge region and moves to the first display screen; The first display screen is used to display the second cursor.

18. The system according to claim 16, characterized in that, The at least one display device further includes a second display device, the second display device including a second positioning module and a second display screen, the second positioning module including a third antenna array, the third antenna array including at least three third antenna elements, at least two of the at least three third antenna elements being distributed in a first direction and at least two being distributed in a second direction, the second positioning module being mounted on the second display device, the second display device being positioned after the first display screen has moved out of the position indicated by the first movement trajectory, the system further includes: After the first moving trajectory moves out of the first edge area of ​​the first display screen, the third antenna array is used to receive a seventh signal from the second antenna array of the control device; The third antenna array is also used to send an eighth signal to the second antenna array, wherein the seventh signal and the eighth signal are used to determine the position of the third cursor corresponding to the fourth pointing position of the control device; The second display screen is used to display the third cursor.

19. The system according to claim 15 or 16, characterized in that, The first signal and the second signal include one of the following signals: ultra-wideband broadcast (UWB) signal and millimeter-wave radar signal.

20. The system according to claim 15 or 16, characterized in that, The first antenna array and / or the second antenna array operate in ultra-high frequency (UHF).

21. The system according to claim 15 or 16, characterized in that, The first signal and the second signal are used to determine the position of the first cursor corresponding to the first pointing position of the control device, including: the first signal, the second signal and the size of the first display screen are used to determine the position of the first cursor corresponding to the first pointing position of the control device.

22. The system according to claim 15, characterized in that, At least three first antenna elements include a first antenna, a second antenna, and a third antenna. The first antenna is located at the intersection of a first direction and a second direction. The second antenna is located on one side of the first antenna in the first direction. The third antenna is located on one side of the first antenna in the second direction. The first direction is perpendicular to the second direction.

23. The system according to claim 22, characterized in that, The first antenna is a transceiver antenna, or the first antenna includes a receiving antenna and a transmitting antenna.

24. The system according to claim 15 or 22, characterized in that, At least three of the first antenna elements are arranged in an L-shape, a triangle, or a rectangular array.

25. The system according to claim 15, 16, 22 or 23, characterized in that, The plane formed by the at least three first antenna elements is parallel to the first display screen of the first display device.

26. The system according to any one of claims 15, 16, 22 or 23, characterized in that, The first antenna array is located above the first display device.

27. The system according to claim 16, characterized in that, The first display screen is also used to follow the first movement trajectory of the control device and present a display trajectory of a display object that matches the first movement trajectory, wherein the display trajectory of the display object includes the display of the first cursor.

28. The system according to claim 27, characterized in that, The system also includes: When the position indicated by the first movement trajectory is located in a preset control hot zone, the first display screen is also used to present corresponding interface effects when displaying the display object.

29. A control system, characterized in that: The system includes the positioning module system and control device as described in claim 13, the control device including a second antenna array, the second antenna array including a plurality of second antenna elements, the distance between any two second antenna elements having the function of receiving the first signal being less than or equal to the wavelength of the first signal, wherein the system further includes: The second antenna array is used to send a first signal to the first antenna array of the first positioning module in the positioning module system; The second antenna array is also used to receive a second signal from the first antenna array.

30. The system according to claim 29, characterized in that, The control device is further configured to obtain the position of a first cursor corresponding to the first pointing position of the control device based on the first signal and the second signal, and send the position of the first cursor to a first display device on which the first positioning module is installed.

31. The system according to claim 29, characterized in that, The plurality of second antenna elements include a first antenna, a second antenna, and a third antenna. The first antenna is located at the intersection of a first direction and a second direction. The second antenna is located on one side of the first antenna in the first direction. The third antenna is located on one side of the first antenna in the second direction. The first direction is perpendicular to the second direction.

32. The system according to claim 31, characterized in that, The first antenna is a transceiver antenna, or the first antenna includes a receiving antenna and a transmitting antenna.

33. The system according to claim 29 or 31, characterized in that, Multiple second antenna elements are arranged in an L-shape, a triangle, or a rectangular array.

34. The system according to claim 29 or 30, characterized in that, The plurality of second antenna units include a first antenna and a second antenna, and the control device further includes a motion measurement unit (IMU) for measuring the motion attitude of the control device.

35. A control system, characterized in that, The control system includes the display control system and control device as described in claim 14, or the display control system and control device as described in any one of claims 15-28, wherein... The control device includes a second antenna array, the second antenna array including multiple second antenna elements, wherein the distance between any two second antenna elements having the function of receiving the first signal is less than or equal to the wavelength of the first signal, and the system further includes: The second antenna array is used to send a first signal to the first antenna array of the first positioning module in the positioning module system; The second antenna array is also used to receive a second signal from the first antenna array.

36. The system according to claim 35, characterized in that, The control device is further configured to obtain the position of a first cursor corresponding to the first pointing position of the control device based on the first signal and the second signal, and send the position of the first cursor to a first display device on which the first positioning module is installed.

37. The system according to claim 35, characterized in that, The plurality of second antenna elements include a first antenna, a second antenna, and a third antenna. The first antenna is located at the intersection of a first direction and a second direction. The second antenna is located on one side of the first antenna in the first direction. The third antenna is located on one side of the first antenna in the second direction. The first direction is perpendicular to the second direction.

38. The system according to claim 37, characterized in that, The first antenna is a transceiver antenna, or the first antenna includes a receiving antenna and a transmitting antenna.

39. The system according to any one of claims 35-37, characterized in that, Multiple second antenna elements are arranged in an L-shape, a triangle, or a rectangular array.

40. The system according to claim 35 or 36, characterized in that, The plurality of second antenna units include a first antenna and a second antenna, and the control device further includes a motion measurement unit (IMU) for measuring the motion attitude of the control device.

Images