Device display control method, electronic device and communication system

Abstract

This application discloses a device display control method, an electronic device, and a communication system, which relate to the field of wireless remote control technology. This can accurately determine the presentation position of a display object (e.g., a cursor) corresponding to a control device on a display device, providing a better device control experience for users. In this solution, the presentation position of the display object is determined based on the position where the control device is pointing on the display. Therefore, a convenient, immersive, and accurate device control experience can be provided to users in both single-display device scenarios and multi-display device scenarios.

Description

[Technical Field]

[0001] This application is a continuation of Chinese Patent Application No. 202310097484.5, entitled "POSITIONING METHOD, POSITIONING SYSTEM, AND ELECTRONIC DEVICE," filed with the State Intellectual Property Office of China on January 18, 2023; Chinese Patent Application No. 202310884005.4, entitled "REMOTE CONTROL CURSOR DISPLAY METHOD AND APPARATUS," filed with the State Intellectual Property Office of China on July 18, 2023; Chinese Patent Application No. 202311164310.2, entitled "DEVICE DISPLAY CONTROL METHOD, ELECTRONIC DEVICE, AND COMMUNICATION SYSTEM," filed with the State Intellectual Property Office of China on September 8, 2023; and Chinese Patent Application No. 202311164310.2, entitled "POSITIONING METHOD, POSITIONING SYSTEM, AND ELECTRONIC DEVICE," filed with the World Intellectual Property Organization on November 27, 2023. This application claims priority to International Patent Application No. PCT / CN2023 / 134243 entitled "A METHOD FOR IMPROVING A ...

[0002] The present application relates to the field of wireless remote control technology, and in particular to a device display control method, an electronic device, and a communication system. [Background technology]

[0003] During man-machine interaction, a control device such as a remote control, an air mouse, or a wearable device is usually used to control a display device and send control commands to the display device in a wired or wireless manner. In the process of controlling a display device, determining the presentation position of a cursor corresponding to the control device on the display of the display device is an important step.

[0004] Currently, the relative position change of the cursor is usually determined based on the relative attitude change of the control device, and then the position of the cursor is determined. As shown in FIG. 1, the change of the cursor relative to the initial presentation position of the cursor can be determined based on the attitude change of the control device relative to the initial attitude, and then the position of the cursor is determined. The initial presentation position of the cursor is usually a preset default position. Because the initial presentation position of the cursor is preset but not actually pointed by the control device, the subsequent presentation position of the cursor is not necessarily the actual pointing position of the control device. That is, there is a discrepancy between the presentation position of the cursor on the display device and the actual pointing position of the control device. As a result, the user's control experience is poor during the usage process. Summary of the Invention [Means for solving the problem]

[0005] The present application provides a device display control method to provide a remote control cursor display solution applicable to any scenario, accurately determine the presentation position of the cursor corresponding to the control device on the display device, and provide users with a better device control experience.

[0006] In order to achieve the aforementioned objectives, the following technical solutions are used in this application:

[0007] According to a first aspect, there is provided a device display control method, the method being applied to at least one display device, the at least one display device including a first display device, the first display device including a first positioning module and a first display, the method including: the first positioning module receiving first positioning information from a control device; the first display device following a first movement trajectory of the control device and displaying a corresponding object on the first display based on the first positioning information; and when a pointing position of the first movement trajectory moves outside a first edge region of the first display, the first display device no longer displaying the corresponding display object on the first display.

[0008] In one example, the first positioning module may be configured to transmit and receive positioning information (e.g., first positioning information) to and from another device to determine a pointing position of the control device. For example, the first positioning module may include, but is not limited to, one or more of an antenna ultra wide band radio (UWB) wireless positioning module, a multi-antenna millimeter wave radar positioning module, a three-dimensional electromagnetic coil positioning module, a three-dimensional ultrasonic positioning module, etc. The first positioning information may include one or more of the following information: UWB signals, millimeter wave radar signals, electromagnetic signals, and ultrasonic signals.

[0009] In one example, the first edge region of the first display may be any edge region of the first display, such as the top edge region, bottom edge region, left edge region, or right edge region. If the first display has a special shape (e.g., a circle or an ellipse), the first edge region of the first display may be an edge region of the first display that is close to a predetermined boundary. For example, the first display is a circle. The first edge region of the first display may be a predetermined edge region that is close to the first boundary. If the center point of the first display is used as the center of the circle, the first boundary is a boundary corresponding to a range of 315° to 45°, a boundary corresponding to a range of 45° to 135°, a boundary corresponding to a range of 135° to 225°, or a boundary corresponding to a range of 225° to 315°.

[0010] In one example, the display objects, such as icons, cursors, components, virtual images, or images, may be determined based on a particular application scenario and device capabilities, and are not specifically limited.

[0011] In the solution provided in the first aspect, a display device (e.g., a first display device) determines the movement trajectory and pointing position of the control device by transmitting and receiving positioning information to and from the control device. In this way, after the pointing position of the control device enters an edge region of the display, the display device can track the movement trajectory of the control device and display a cursor on the display. When the pointing position of the control device leaves any edge region of the display (e.g., the top edge region, the bottom edge region, the left edge region, or the right edge region), the display device no longer displays the cursor on the display. Therefore, a convenient, immersive, and accurate device control experience can be provided to the user. For example, compared to conventional techniques in which the presentation position of an image is determined based on a relative attitude change of the control device, this solution can solve the problem of misalignment between the presentation position of a display object and the pointing position of the control device, and can also solve the problem of the display object being stuck to a frame when it leaves the edge of the display.

[0012] In a possible implementation, the method further includes: after the pointing position of the first movement trajectory moves outside the first edge region, the first positioning module receives second positioning information from the control device; if the pointing position of the second movement trajectory exceeds the first edge region, the first display device skips displaying the corresponding display object on the first display; and if it is determined that the pointing position of the third movement trajectory has moved into the first edge region, the first display device follows the third movement trajectory of the control device and displays the corresponding display object on the first display based on the second positioning information. In this way, when the pointing position of the control device moves outside any edge region of the display (e.g., the top edge region, the bottom edge region, the left edge region, or the right edge region), the display device no longer displays the cursor on the display; and when the pointing position of the control device moves again into any edge region of the display, the display device can display the cursor on the display again. Based on this, the convenience, immersive experience, and accuracy in the process of users performing device display control can be greatly improved.

[0013] In a possible implementation, the first display device following the first movement trajectory of the control device and displaying a corresponding object on the first display based on the first positioning information includes the first display device following the first movement trajectory of the control device and displaying a display trajectory of a display object that matches the first movement trajectory on the first display based on the first positioning information. For example, in scenarios such as a handwriting tablet scenario and a demonstration scenario, the display device can follow the movement trajectory of the control device and display a display trajectory of a display object, such as handwriting, on the display based on the positioning information. The solution provided in the present application is highly adaptable. The specific display format of the interface effect displayed by the display following the movement trajectory of the control device is not limited and may be determined based on the specific application scenario and device capabilities.

[0014] In a possible implementation, the method further includes the first display device determining a corresponding pointing position on the first display based on the first positioning information, and when the pointing position is within a preset control hot area, the first display device displaying a corresponding interface effect when the display object is displayed. For example, in a game scenario, when the pointing position of the control device is within a preset control hot area, the display device can display a preset special effect, such as a game hero image or a game special effect (e.g., a bubble special effect, a fireworks special effect, a targeting special effect, or a hit special effect), at the pointing position and / or the display area corresponding to the pointing position (e.g., the preset control hot area). The solution provided in the present application is highly adaptable. The specific display format of the interface effect displayed by the display following the movement trajectory of the control device is not limited and may be determined based on the specific application scenario and the device's capabilities.

[0015] In a possible implementation, the at least one display device further includes a second display device, an orientation relationship between the second display device and the first display device is a first relationship, and the second display device includes a second positioning module and a second display. The method further includes: after the pointing position of the first movement trajectory moves outside the first edge region of the first display, the second positioning module receives third positioning information from the control device; if the pointing position of the second movement trajectory exceeds the first edge region, the first display device skips displaying the corresponding display object on the first display; and if it is determined that the pointing position of the fourth movement trajectory has moved into the second edge region of the second display, the second display device follows the fourth movement trajectory of the control device and displays the corresponding display object on the second display based on the third positioning information. In this way, the display object can be accurately displayed even when the first display is far away from the second display. This provides the user with an immersive and accurate cursor control and device control experience. In addition, compared to the prior art in which the presentation position of an image is determined based on the relative attitude change of the control device, this solution does not encounter the problem of the displayed object not traversing smoothly when the displayed object is traversed.

[0016] In a possible implementation, the at least one display device further includes a second display device, the second display device including a second positioning module and a second display. The method further includes: after the pointing position of the first movement trajectory moves outside the first edge region of the first display, the second positioning module receives third positioning information from the control device; and when it is determined that the pointing position of the second movement trajectory has moved into the second edge region of the second display, the second display device follows a fourth movement trajectory of the control device and displays a corresponding display object on the second display based on the third positioning information. In this way, when the first display is close to the second display, the display object can also be displayed accurately. This provides the user with an immersive and accurate cursor control and device control experience. In addition, compared to conventional techniques in which display objects are displayed at default positions, this solution does not encounter the problem of display objects not traversing smoothly when traversing.

[0017] In a possible implementation, the orientation relationship between the second display device and the first display device changes from the first relationship to the second relationship, and the method further includes: when the pointing position of the fourth movement trajectory moves outside the third edge region of the second display, the second display device no longer displays the corresponding display object on the second display; when the pointing position of the fifth movement trajectory exceeds the third edge region, the corresponding display object is not displayed on the second display; the first positioning module receives fourth positioning information from the control device; and when it is determined that the pointing position of the sixth movement trajectory has moved into the fourth edge region of the first display, the first display device follows the sixth movement trajectory of the control device and displays the corresponding display object on the first display based on the fourth positioning information. For example, the orientation relationship between the second display device and the first display device changes from the first relationship to the second relationship, e.g., the positions of the second display device and the first display device are swapped. In this way, after the positional relationship between the first display and the second display changes, the display device can detect the change in orientation relationship by sending and receiving positioning information to and from the control device, obtain the latest pointing direction of the control device, and continue to accurately display the display object, without the need for the user to perform any related configuration actions.

[0018] In a possible implementation, the second display device is an integrated display device, and the method further includes, when the screen resolution of the second display changes, the second positioning module receiving fifth positioning information from the control device, and when the pointing position of the fourth movement trajectory is on the second display, the second display device following the fourth movement trajectory of the control device and displaying a corresponding display object on the second display based on the fifth positioning information. In this way, in the case of an integrated display device, after the screen resolution of the display changes, the display device can determine the latest pointing direction of the control device based on the latest screen resolution to continue accurately displaying the display object without the need for a user to perform a related configuration operation.

[0019] In a possible implementation, the second display device is a split display device, and the method further includes, when a screen resolution and / or a focal length corresponding to the second display changes, the second positioning module receiving fifth positioning information from the control device, and when a pointing position of the fourth movement trajectory is on the second display, the second display device following the fourth movement trajectory of the control device and displaying a corresponding display object on the second display based on the fifth positioning information. In this way, in the case of a split display device, after the screen resolution or focal length of the display device changes, the display device can determine an updated pointing direction of the control device based on the updated screen resolution or latest focal length and continue to accurately display the display object without the need for a user to perform a related configuration operation.

[0020] In a possible implementation, the method further includes, in the process of tracking a first movement trajectory of the control device and displaying a corresponding display object on the first display based on the first positioning information, if an orientation relationship between the control device and the first display device changes, the first display device receiving sixth positioning information from the control device, and the first display device tracking the first movement trajectory of the control device and displaying the corresponding display object on the first display based on the sixth positioning information. In this way, after a distance between the user and the display changes, the display device can detect the change by transmitting and receiving positioning information to and from the control device and adaptively adjust the display effect to continue to accurately display the display object, without the need for the user to perform a related configuration operation.

[0021] In a possible implementation, the method further includes the first positioning module determining a pointing position of the first movement trajectory based on the first information, the first information including the first movement trajectory, the first positioning information, and the size of the first display, based on which the first positioning module can obtain an actual pointing position of the control device, thereby ensuring a necessary basis for subsequent accurate presentation of the image.

[0022] In a possible implementation, the first information further includes a historical pointing position of the first movement trajectory and a historical presentation position of the display object. In this way, based on a conventional technique in which the presentation position of an image is determined based on a relative attitude change of the control device, the presentation position of the display object can be calibrated based on the pointing position of the control device. For example, if the presentation position of the image determined based on a relative attitude change of the control device deviates from the pointing direction of the control device by more than a predetermined range, or after a predetermined period of time has elapsed, the presentation position of the display object can be calibrated based on the pointing position of the control device. Based on this, continuous presentation of the display object can be ensured.

[0023] In a possible implementation, the first positioning module of the first display device includes a first antenna array, the first antenna array includes a plurality of first antenna elements, at least two of the plurality of first antenna elements are respectively distributed in a first direction and a second direction, the first direction is perpendicular to the second direction, the control device includes a second antenna array, the second antenna array includes a plurality of second antenna elements, and receiving the first positioning information from the control device by the first antenna array includes receiving the first positioning information from the second antenna array of the control device.

[0024] In a possible implementation, displaying the corresponding display object on the first display based on the first positioning information includes determining a position of the display object displayed on the first display device based on the first positioning information received from the second antenna array and the second second positioning information transmitted by the first antenna array.

[0025] In a possible implementation, at least three first antenna elements are arranged and at least two second antenna elements are arranged.

[0026] In a possible implementation, the multiple first antenna elements are a first antenna, a second antenna, and a third antenna, where the first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on a side of the first antenna that is in the first direction, and the third antenna is located on a side of the first antenna that is in the second direction.

[0027] In a possible implementation, the distance between any two first antenna elements within the plurality of first antenna elements and capable of receiving a first signal is equal to or less than the wavelength of the first signal, and / or the distance between any two second antenna elements within the plurality of second antenna elements and capable of receiving a second signal is equal to or less than the wavelength of the second signal.

[0028] In a possible implementation, the first antenna is an integrated transmitting and receiving antenna, or the first antenna includes a receiving antenna and a transmitting antenna.

[0029] In a possible implementation, the plurality of first antenna elements are distributed in an L-shaped, triangular, or rectangular array.

[0030] In a possible implementation, the plane containing the first direction and the second direction is parallel to the display interface of the first electronic device.

[0031] In a possible implementation, the first antenna array is located above the display device.

[0032] According to a second aspect, the present application provides a positioning method, the positioning method being applied to a system including a first electronic device and a second electronic device, wherein a first antenna array is disposed on the first electronic device, the first antenna array including a plurality of first antenna elements, at least two of the plurality of first antenna elements being distributed in a first direction and a second direction, respectively, and the first direction being perpendicular to the second direction; a second antenna array disposed on the second electronic device, the second antenna array including a plurality of second antenna elements; The method includes determining a position of a first cursor displayed on the first electronic device based on a first signal transmitted by a second antenna array and a second signal transmitted by the first antenna array.

[0033] In the present application, the positions of the first antenna array and the second antenna array relative to each other can be determined so that the position of the first cursor can be accurately displayed on the first electronic device, and the positioning of the second antenna array becomes more accurate, thereby improving the operating experience in spatial pointing operations.

[0034] In a possible implementation, determining a position of a first cursor displayed on the first electronic device based on the first signal transmitted by the second antenna array and the second signal transmitted by the first antenna array includes: determining, based on the first signal, first coordinates of the second antenna array in a three-dimensional coordinate system in which the first antenna array is located; measuring a deflection angle of the second antenna array relative to the first direction and the second direction based on the second signal; obtaining a second coordinate based on the first coordinate and the deflection angle; and determining a position of the first cursor based on the second coordinates.

[0035] The relative coordinates of the second antenna array relative to the first antenna array, i.e., first coordinates, can be acquired by the first antenna array based on the first signal transmitted by the second antenna array. The first coordinates can be used to determine the spatial position of the second antenna array. The second antenna array can acquire the deflection angles of the second antenna array relative to the first direction X and the second direction Y based on the second signal transmitted by the first antenna array through positioning. Finally, the final second coordinates can be acquired based on the first coordinates and the deflection angles. Thus, to obtain the absolute coordinates of the second antenna array relative to the first electronic device, the positions of the first antenna array and the second antenna array relative to each other can be determined, and the absolute coordinates can be displayed on the first electronic device in the form of a cursor.

[0036] When the radiation plane of the first antenna array is parallel to the display interface of the first electronic device, the second coordinate is the position of a cursor that can be displayed on the first electronic device through an operation on the second electronic device. In addition, when the radiation plane of the first antenna array is not parallel to the display interface of the first electronic device, the second coordinate needs to be further transformed based on the physical positional relationship between the first antenna array and the display interface to obtain the position of the cursor displayed on the display interface after the transformation.

[0037] In a possible implementation, determining the position of the first cursor based on the second coordinates includes: Specifically, determining a position of a first cursor that may be displayed on the first electronic device based on the second coordinates and the size of the first electronic device.

[0038] The second coordinate may be associated with the size of the first electronic device. If the coordinate value corresponding to the second coordinate in the first direction or the second direction is within a size range corresponding to the first electronic device, the first cursor may be displayed on the first electronic device based on the second coordinate, and the first cursor may move within the display interface of the first electronic device based on the movement of the second electronic device. This has good directionality and can improve the operation experience.

[0039] In a possible implementation, a third coordinate is obtained based on the first coordinate and the deflection angle, and the position of a second cursor that cannot be displayed on the first electronic device is determined based on the third coordinate and the size of the first electronic device.

[0040] The third coordinate may be associated with the size of the first electronic device. If the coordinate value of the third coordinate in the first direction X or the second direction Y exceeds the size range corresponding to the first electronic device, it indicates that the position acquired based on the third coordinate and used to display the cursor cannot be within the range of the first electronic device. In this case, the acquired cursor position is the position of a second cursor that cannot be displayed on the first electronic device. Therefore, if the third coordinate exceeds the range of the first electronic device, even if the second electronic device moves, the cursor will not be displayed on the first electronic device, thereby avoiding the problem of inaccurate pointing.

[0041] In a possible implementation, at least three first antenna elements are arranged and at least two second antenna elements are arranged. At least some of the at least three first antenna elements have signal receiving and / or signal transmitting functions. A specific arrangement configuration exists between the at least three first antenna elements to facilitate calculation of the first coordinate. At least two of the second antenna elements may also have signal receiving and / or signal transmitting functions. Also, a specific arrangement configuration exists between the at least two second antenna elements to facilitate calculation of the deflection angle.

[0042] In a possible implementation, the multiple first antenna elements are a first antenna, a second antenna, and a third antenna, where the first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on a side of the first antenna that is in the first direction, and the third antenna is located on a side of the first antenna that is in the second direction.

[0043] The first antenna is positioned at the intersection of the first direction and the second direction, so that a coordinate system can be established, and the first antenna is used as the origin of the coordinate system. Furthermore, the second antenna and the third antenna are positioned in the first direction and the second direction of the first antenna, respectively, so that the phases of the first direction and the second direction can be obtained separately to facilitate calculation of the first coordinate.

[0044] In a possible implementation, the distance between any two first antenna elements in the plurality of first antenna elements capable of receiving a first signal is equal to or less than the wavelength of the first signal, and / or the distance between any two second antenna elements in the plurality of second antenna elements capable of receiving a second signal is equal to or less than the wavelength of the second signal. Thus, the first antenna elements configured to receive signals can receive the first signals substantially simultaneously, the second antenna elements can receive the second signals substantially simultaneously, each first antenna element can obtain a phase parameter based on the first signal, and each second antenna element can obtain a deflection angle based on the second signal.

[0045] In a possible implementation, one second antenna or multiple second antennas are arranged at intervals in the first direction, and one third antenna or multiple third antennas are arranged at intervals in the second direction. When one second antenna and one third antenna are arranged, it is convenient to arrange each antenna and also convenient to calculate the first coordinate. When multiple second antennas and multiple third antennas are arranged, the first antenna array may have better radiation performance. Of course, one second antenna and multiple third antennas may be arranged alternatively. Multiple second antennas and one third antenna may also be arranged. This allows flexible arrangement of each antenna.

[0046] In a possible implementation, the first signal includes a time parameter and a first phase parameter; Measuring first coordinates of the second antenna array in a three-dimensional coordinate system in which the first antenna array is located based on the first signal includes: obtaining a distance between the first antenna array and the second antenna array based on the time parameter; and obtaining a first coordinate based on the distance and the first phase parameter.

[0047] The distance between the first antenna array and the second antenna array can be accurately obtained based on the time parameter, and the calculation accuracy of the first coordinate can be improved by combining the first phase parameter of the first signal.

[0048] In a possible implementation, the first antenna may have a function of transmitting a second signal, and the aforementioned distance between the first antenna array and the second antenna array may specifically be a first distance between the first antenna and the second antenna array, and obtaining the first coordinate based on the distance and the first phase parameter includes: obtaining a first phase difference between the second antenna and the first antenna and a second phase difference between the third antenna and the first antenna based on the first phase parameter; Specifically, the method includes obtaining an x-axis coordinate value and a z-axis coordinate value in the first coordinate system based on the first distance, the distance between the second antenna and the first antenna, and the first phase difference, and obtaining a y-axis coordinate value in the first coordinate system based on the first distance, the distance between the third antenna and the first antenna, and the second phase difference.

[0049] The first phase parameters acquired by the second antenna and the third antenna are both within the same signal cycle, and the first coordinate can be obtained by accurate calculation based on the first distance and the first and second phase differences acquired based on the first phase parameters.

[0050] In a possible implementation, the second antenna array includes a fourth antenna, a fifth antenna, and a sixth antenna, the fifth antenna being positioned on a side of the fourth antenna in a third direction, and the sixth antenna being positioned on a side of the fourth antenna in a fourth direction, the third direction being perpendicular to the fourth direction.

[0051] The fourth antenna may be positioned at an intersection of the third direction and the fourth direction, and the fifth and sixth antennas are positioned in the third and fourth directions of the fourth antenna, respectively, so that the deflection angles of the second antenna array relative to the first and second directions can be obtained.

[0052] In a possible implementation, the second signal includes a second phase parameter; Measuring a deflection angle of the second antenna array relative to the first direction and the second direction based on the second signal includes: It specifically includes obtaining the deflection angle based on the second phase parameter, so that the accuracy of the calculation of the deflection angle can be improved.

[0053] In a possible implementation, obtaining the deflection angle based on the second phase parameter includes: obtaining a third phase difference between the fifth antenna and the fourth antenna and a fourth phase difference between the sixth antenna and the fourth antenna based on the second phase parameter; Specifically, the method includes obtaining a first deflection angle of the second antenna array in a first direction based on the third phase difference, and obtaining a second deflection angle of the second antenna array in a second direction based on the fourth phase difference.

[0054] The second phase parameters acquired by the fifth antenna and the sixth antenna are both within the same signal cycle, and the deflection angle can be obtained through accurate calculation based on the third phase difference and the fourth phase difference, which are obtained based on the second phase parameter.

[0055] In a possible implementation, the second antenna array includes a fourth antenna, a fifth antenna, and an acceleration sensor, the fifth antenna being located on a side of the fourth antenna in a third direction, the acceleration sensor being located on a side of the fourth antenna in a fourth direction, and the third direction being perpendicular to the fourth direction; the second signal includes a second phase parameter; Measuring a deflection angle of the second antenna array relative to the first direction and the second direction based on the second signal includes: obtaining a third phase difference between the fifth antenna and the fourth antenna based on the second phase parameter; Specifically, the method includes obtaining a first deflection angle of the second antenna array in a first direction based on the third phase difference, and obtaining a second deflection angle of the second antenna array in a second direction based on the second phase parameter using the acceleration sensor.

[0056] The acceleration sensor may replace the sixth antenna to implement the function, so that one antenna may be eliminated, i.e., only two antennas, i.e., the fourth antenna and the fifth antenna, are disposed on the second electronic device. The acceleration sensor may cooperate with the fifth antenna to obtain the deflection angle of the second antenna array.

[0057] In a possible implementation, obtaining the distance between the first antenna array and the second antenna array based on the time parameter includes: Detecting a first time point at which the second antenna array transmits a first signal; Detecting a second time when the first antenna array receives the first signal; Specifically, the method includes obtaining the distance based on the first time point, the second time point, and the preset speed value.

[0058] The distance measurement method is a one-way ranging method. A prerequisite for using this method is that the clock of the first antenna array is accurately synchronized with the clock of the second antenna array. By transmitting and receiving signals only once, distance measurement can be implemented, making operation easier. To facilitate calculation, the preset speed value may be the speed of light. Of course, if there is speed interference and error, a different speed value may be used instead. Additionally, if the first antenna array includes the aforementioned first antenna with a signal transmission function, the distance between the first antenna array and the second antenna array may specifically be the distance between the first antenna and the second antenna array.

[0059] In a possible implementation, obtaining the distance between the first antenna array and the second antenna array based on the time parameter includes: Detecting a first time point at which the second antenna array transmits a first signal; Detecting a second time when the first antenna array receives the first signal; Detecting a duration of a delay for the first antenna array to process the first signal; Detecting a third time when the first antenna array transmits the second signal; and Detecting a fourth time when the second antenna array receives the second signal; Specifically, the method includes obtaining a distance based on the first time point, the second time point, the duration of the delay, the third time point, the fourth time point, and a preset speed value.

[0060] The distance measurement method is a two-way ranging method. This method can be used when the clock of the second antenna array is not synchronized with the clock of the first antenna array. In this method, the delay factor of signal processing can be taken into account so that the distance measurement becomes more accurate. For ease of calculation, the preset speed value may be the speed of light or another speed. Details will not be described again in this specification.

[0061] In a possible implementation, the first antenna may be an integrated transmitting and receiving antenna, specifically, the first antenna may have the function of receiving and transmitting signals. The function switching can be implemented by using a changeover switch, thereby reducing the number of antennas, saving space, and facilitating antenna placement.

[0062] In a possible implementation, the first antenna includes a receive antenna and a transmit antenna, i.e., the first antenna includes two antennas. The transmit antenna is configured to transmit a signal, and the receive antenna is configured to receive a signal. The first antenna does not require a changeover switch, and the corresponding receive or transmit function can be implemented by using each antenna.

[0063] In a possible implementation, the plurality of first antenna elements are distributed in an L-shaped, triangular, or rectangular array, which facilitates flexible placement of each first antenna element.

[0064] In one possible implementation, the plane including the first direction and the second direction is parallel to the display interface of the first electronic device, which can facilitate geometric calculation of each coordinate point value in the first coordinate system and improve the accuracy of the first coordinate system.

[0065] According to a third aspect, the present application further provides a positioning system configured to implement the positioning method provided in the first aspect of the present application. The positioning system includes a first electronic device and a second electronic device, a first antenna array and a first modular circuit disposed on the first electronic device, the first antenna array configured to transmit a second signal and configured to receive the first signal transmitted by the second antenna array in the second electronic device, the first modular circuit electrically connected to the first antenna array; a second antenna array and a second modular circuit disposed on the second electronic device, the second antenna array configured to transmit the first signal and receive the second signal, the second modular circuit electrically connected to the second antenna array; The first modular circuit or the second modular circuit is configured to determine a position of a first cursor displayed on the first electronic device based on the first signal and the second signal.

[0066] The positioning system can determine the relative positions of the first antenna array and the second antenna array, so that the position of the first cursor can be accurately displayed on the first electronic device. The positioning of the second antenna array becomes more accurate, and the operating experience in spatial pointing operations is improved.

[0067] In a possible implementation, the first modular circuit includes a control unit, a computing unit, a transmitter, and a receiver; a transmitter coupled to the first antenna array and configured to control the first antenna array to transmit a second signal; the receiver is coupled to the first antenna array and configured to control the first antenna array to receive the first signal; the calculation unit is configured to calculate a phase parameter in the first signal; The control unit is configured to control the receiver and the transmitter to operate, and is further configured to obtain a first coordinate of the second antenna array through calculation based on the calculation result of the calculation unit.

[0068] In a possible implementation, the first antenna array includes a first antenna, a second antenna, and a third antenna, the first antenna being located at an intersection of a first direction and a second direction, the second antenna being located on a side of the first antenna in the first direction, and the third antenna being located on a side of the first antenna in the second direction, and the second antenna and the third antenna being separately electrically connected to the receiver; The first antenna is an antenna integrated with transmitting and receiving, and the first modular circuit further includes a changeover switch, the changeover switch being separately electrically connected to the first antenna, the transmitter, and the receiver, and the changeover switch being configured to switch between an electrical connection of the first antenna to the transmitter and an electrical connection of the first antenna to the receiver.

[0069] The first antenna may have the function of receiving and transmitting signals, and the function switching can be implemented by using a changeover switch, thereby reducing the number of antennas, saving space, and facilitating antenna placement.

[0070] In a possible implementation, the first antenna array includes a first antenna, a second antenna, and a third antenna, the first antenna being located at an intersection of a first direction and a second direction, the second antenna being located on a side of the first antenna in the first direction, and the third antenna being located on a side of the first antenna in the second direction, and the second antenna and the third antenna being separately electrically connected to the receiver; The first antenna includes a transmitting antenna and a receiving antenna, the transmitting antenna being electrically connected to the transmitter and the receiving antenna being electrically connected to the receiver.

[0071] The first antenna includes two antennas, a transmit antenna configured to transmit a signal, and a receive antenna configured to receive a signal, and the first antenna does not require a changeover switch, and corresponding receive or transmit functions can be implemented by using each antenna.

[0072] In a possible implementation, one receiver is disposed, and the receiver is in the first antenna array and electrically connected to a first antenna element having a signal receiving function. Therefore, the signal receiving functions of multiple first antenna elements can be implemented by using one receiver, so that the multiple first antenna elements can receive signals approximately simultaneously, and the first coordinate can be calculated based on the phase difference between the first antenna elements. In a possible implementation, multiple receivers are disposed, and each of the receivers is in the first antenna array and electrically connected to one first antenna element having a signal receiving function.

[0073] Synchronization may be performed between the receivers by using a synchronization signal to obtain the phase difference between the first antenna elements.

[0074] In a possible implementation, the second modular circuit includes a control unit, a computing unit, a transmitter, and a receiver; the transmitter is coupled to the second antenna array and configured to control the second antenna array to transmit the first signal; a receiver coupled to the second antenna array and configured to control the second antenna array to receive the second signal; the calculation unit is configured to calculate a phase parameter in the second signal; The control unit is configured to control the receiver and the transmitter to operate, and is further configured to obtain a deflection angle of the second antenna array through calculation based on the calculation result of the calculation unit.

[0075] According to a fourth aspect, the present application further provides an electronic device, the electronic device being a first electronic device. A first antenna array is disposed on the first electronic device, the first antenna array including a plurality of first antenna elements, at least two of the plurality of first antenna elements being distributed in a first direction and a second direction, the first direction being perpendicular to the second direction, and the first antenna array is configured to receive a signal transmitted by a second antenna array on a second electronic device and determine, based on the signal, a position of a first cursor displayed on the first electronic device.

[0076] In the first electronic device provided in the present application, the signal transmitted by the second antenna array can be received by the first antenna array, and the signal can be further transmitted by the first antenna array to the second antenna array. The second antenna array can process the signal received by the second antenna array, so that the positions of the antenna arrays relative to each other can be determined by using the signal transmitted between the first antenna array and the second antenna array. In this way, the absolute coordinates of the second antenna array relative to the first electronic device can be obtained. The second antenna array can accurately point to a location specified by the first electronic device.

[0077] In a possible implementation, the multiple first antenna elements are a first antenna, a second antenna, and a third antenna, where the first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on a side of the first antenna that is in the first direction, and the third antenna is located on a side of the first antenna that is in the second direction.

[0078] In a possible implementation, the distance between any two first antenna elements within the plurality of first antenna elements capable of receiving the first signal is equal to or less than the wavelength of the first signal. In this manner, the first antenna elements configured to receive the signal can receive the first signal substantially simultaneously, and each first antenna element can obtain a phase parameter based on the first signal.

[0079] According to a fifth aspect, there is provided a display device, the display device including a positioning module and a display, the positioning module configured to transmit and receive positioning information to and from a control device, the display configured to display interface effects, and the positioning module and the display configured to support the display device in implementing a method according to either the first or second aspect.

[0080] According to a sixth aspect, there is provided a computer-readable storage medium having stored thereon computer program instructions which, when executed by a processor, implement a method according to any one of the possible implementations of the first or second aspect.

[0081] According to a seventh aspect, there is provided a computer program product comprising instructions which, when run on a computer, enable the computer to perform a method according to any one of the possible implementations of the first or second aspect.

[0082] According to an eighth aspect, a chip system is provided. The chip system includes a processing circuit and a storage medium. The storage medium stores computer program instructions. When the computer program instructions are executed by a processor, a method according to any one of the possible implementations of the first or second aspect is implemented. The chip system may include a chip, or may include a chip and another discrete component. [Brief explanation of the drawings]

[0083] [Figure 1] FIG. 1 is a schematic diagram of a remote control cursor presentation process in a conventional single display device scenario. [Figure 2] FIG. 1 is a schematic diagram of a remote control cursor presentation process in a conventional multi-display device scenario. [Figure 3] FIG. 1 is a schematic diagram of the architecture of a device remote control system in a single display device scenario according to an embodiment of the present application. [Figure 4] FIG. 1 is a schematic diagram of a remote control cursor presentation process in a single display device scenario according to an embodiment of the present application. [Figure 5] FIG. 1 is a schematic diagram of the architecture of a device remote control system in a multi-display device scenario according to an embodiment of the present application. [Figure 6] FIG. 1 is a schematic diagram of a remote control cursor presentation process in a multi-display device scenario according to an embodiment of the present application. [Figure 7] 1 is a flowchart 1 of a device display control method in a single device scenario according to an embodiment of the present application; [Figure 8] 1 is a schematic diagram of a method for determining a coordinate system in which a display is located based on a multi-antenna UWB positioning method according to an embodiment of the present application; [Figure 9] 4 is a flowchart for determining a coordinate system in which a display is located based on a multi-antenna UWB positioning method according to an embodiment of the present application. [Figure 10] 1 is a schematic diagram of another method for determining a coordinate system in which a display is located based on a multi-antenna UWB positioning method according to an embodiment of the present application; [Figure 11] FIG. 2 is a schematic diagram of a process for determining a pointing position of a control device according to an embodiment of the present application. [Figure 12]FIG. 1 is a diagram of the architecture of a three-dimensional electromagnetic coil positioning system according to an embodiment of the present application. [Figure 13] 1 is a schematic diagram of determining the pointing position of a control device based on a three-dimensional electromagnetic coil positioning method according to an embodiment of the present application; [Figure 14] 1 is a schematic diagram of determining the attitude of a control device based on a three-dimensional electromagnetic coil positioning method according to an embodiment of the present application; [Figure 15] 2 is a flowchart 2 of a device display control method in a single device scenario according to an embodiment of the present application; [Figure 16] 1 is a schematic diagram of a cursor presentation effect according to an embodiment of the present application; [Figure 17] 1 is a flowchart of a device display control method in a multi-device scenario according to an embodiment of the present application; [Figure 18A] 1 is a flowchart 1 of a cursor traversal process in a multi-device scenario according to an embodiment of the present application. [Figure 18B] 1 is a flowchart 1 of a cursor traversal process in a multi-device scenario according to an embodiment of the present application. [Figure 19] 1 is a schematic diagram 1 of a cursor traversal process according to an embodiment of the present application; [Figure 20A] 2 is a flowchart 2 of a cursor traversal process in a multi-device scenario according to an embodiment of the present application. [Figure 20B] 2 is a flowchart 2 of a cursor traversal process in a multi-device scenario according to an embodiment of the present application. [Figure 21] 2 is a schematic diagram 2 of a cursor traversal process according to an embodiment of the present application; [Figure 22A] 3 is a flowchart 3 of a cursor traversal process in a multi-device scenario according to an embodiment of the present application. [Figure 22B]3 is a flowchart 3 of a cursor traversal process in a multi-device scenario according to an embodiment of the present application. [Figure 23] 10 is a schematic diagram of the result of updating the coordinate system in which the display carrier is located when the orientation of the projector changes according to an embodiment of the present application; [Figure 24] FIG. 10 is another schematic diagram of the result of updating the coordinate system in which the display carrier is located when the orientation of the projector changes according to an embodiment of the present application; [Figure 25] FIG. 2 is a schematic diagram of a process for cursor traversal between display devices with different attributes according to an embodiment of the present application. [Figure 26] FIG. 1 is a diagram of the architecture of a positioning system according to an embodiment of the present application. [Figure 27] 1 is a schematic diagram of the structure of a first electronic device according to an embodiment of the present application; [Figure 28] FIG. 2 is a diagram illustrating an arrangement of a first antenna array on a first electronic device according to an embodiment of the present application. [Figure 29] FIG. 2 is a schematic diagram of the arrangement of the first antenna element. [Figure 30] FIG. 10 is a schematic diagram of another arrangement of the first antenna element. [Figure 31] FIG. 10 is a schematic diagram of yet another arrangement of the first antenna element. [Figure 32] FIG. 2 is a schematic diagram of the structure of a second electronic device according to an embodiment of the present application. [Figure 33] FIG. 10 is a diagram of an arrangement of a second antenna array on a second electronic device according to an embodiment of the present application. [Figure 34] FIG. 1 is a diagram of a model for calculating a first coordinate according to an embodiment of the present application. [Figure 35] FIG. 1 is a schematic diagram of a one-way ranging method according to an embodiment of the present application; [Figure 36] FIG. 1 is a schematic diagram of a two-way ranging method according to an embodiment of the present application; [Figure 37] FIG. 10 is a diagram of another model for calculating a first coordinate according to an embodiment of the present application. [Figure 38] FIG. 10 is a diagram of yet another model for calculating a first coordinate according to an embodiment of the present application. [Figure 39] 1 is a flowchart of a positioning method according to an embodiment of the present application; [Figure 40] 4 is a flowchart of a positioning method according to another embodiment of the present application; DETAILED DESCRIPTION OF THE INVENTION

[0084] The following describes the technical solutions in the embodiments of the present application with reference to the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, " / " means "or" unless otherwise specified. For example, A / B can indicate A or B. In this specification, "and / or" only describes a related relationship to describe related objects and indicates that three relationships may exist. For example, A and / or B can indicate the following three cases: when only A exists, when both A and B exist, and when only B exists. In addition, in the description of the embodiments of the present application, "multiple" means two or more.

[0085] In the following, terms such as "first" and "second" are used merely to distinguish between different described objects and do not limit the position, order, priority, quantity, content, etc. of the described objects. For example, if the object being described is a "field," the ordinal number before "field" in "first field" and "second field" does not limit the position or sequence of the "field," and "first" and "second" do not limit whether the "fields" modified by "first" and "second" are in the same message, nor do they limit the sequence of the "first field" and "second field." In another example, if the described object is a "level," the ordinal number before "level" in "first level" and "second level" does not limit the priority between the "levels." In another example, the number of described objects is not limited by the ordinal number and may be one or more. A "first display device" is described as an example. There may be one or more "devices." Furthermore, the objects modified by different prefix words may be the same or different. For example, if the object being described is a "device," the "first display device" and the "second display device" may be the same type of device or different types of devices. In another example, if the object being described is "information," the "first information" and the "second information" may be information having the same content or information having different content. In conclusion, in the embodiments of the present application, the use of prefix words such as ordinal numbers used to distinguish the described objects does not constitute a limitation on the described objects. Please refer to the context description in the claims or embodiments for an explanation of the described objects. The use of such prefix words should not constitute an unnecessary limitation.

[0086] Additionally, in the embodiments of the present application, "connection" may refer to a direct connection or an indirect connection, or may refer to an electrical connection or a communication connection. For example, a connection between two electrical elements A and B may mean that A is directly connected to B, or that A is indirectly connected to B by using another electrical element or connection medium, or that A is indirectly connected to B by using another communication device or communication medium, provided that A and B can communicate with each other.

[0087] As described above, when the presentation position of a display object such as a cursor is currently determined, the displacement of the cursor is typically determined based on a relative change in the attitude of the control device, and then the presentation position of the cursor is determined. For example, the displacement of the cursor relative to the historical presentation position of the cursor may be determined based on a change in the attitude of the control device relative to the historical attitude. The historical attitude may be the initial attitude, the last determined attitude, etc. The historical presentation position of the cursor may be the initial presentation position of the cursor, the last presentation position of the cursor, etc.

[0088] In the aforementioned solutions, in which the cursor presentation position is determined based on the relative attitude change of the control device, the initial presentation position of the cursor corresponding to the initial attitude of the control device is usually a preset default position and is not related to the actual attitude of the control device. Therefore, the cursor presentation position is not necessarily the actual pointing position of the control device, i.e., there is a discrepancy between the cursor presentation position on the display device and the actual pointing position of the control device. As a result, the user's control experience is insufficient during use. For example, when the control device actually points beyond the display, the cursor is still displayed on the display. As shown in FIG. 1, if the control device in attitude A1 actually points to position B1 beyond the display, the cursor is displayed at cursor presentation position C1 on the display shown in FIG. 1. In another example, when the control device actually points to a first position on the display, the cursor is displayed at a second position on the display, and the first position is different from the second position. As shown in FIG. 1, when the control device in attitude A2 actually points to position B2, the cursor is displayed at position C2 on the display. As shown in FIG. 1, when the control device having the attitude A3 actually points to the position B3, the cursor is displayed at the position C3 on the display.

[0089] In addition, when the solution in which the cursor presentation position is determined based on the relative attitude change of the control device is applied to a single display device scenario, when the actual pointing position of the control device moves outside the display, the cursor typically remains at the edge of the display (this is simply referred to as stuck-on-frame). For example, when a control device having attitude A4 actually points to position B4 beyond the display shown in FIG. 1, the cursor remains at edge position C4 of the display shown in FIG. 1. Also, when the attitude of the control device changes from attitude A4 shown in FIG. 1 to attitude A5 shown in FIG. 1, the actual pointing position of the control device changes from B4 shown in FIG. 1 to B5 shown in FIG. 1, but the cursor presentation position C5 is determined based on the stuck-on-frame position shown in FIG. 1, i.e., the cursor presentation position C4. In this case, the discrepancy between the cursor presentation position and the actual pointing position of the control device becomes larger. This results in a poorer control experience for the user.

[0090] Alternatively, a solution in which the cursor presentation position is determined based on the relative attitude change of the control device is applied to a multi-display device scenario. When the cursor leaves a device where the cursor is currently located (e.g., a first display device) and moves to a display device with a corresponding orientation (e.g., a second display device), the second display device follows the first display device to continue displaying the cursor. Because the device where the cursor is currently located does not detect other surrounding display devices, the orientation relationship between multiple display devices usually needs to be set in advance. As shown in FIG. 2 , after the orientation relationship between the first display device, the second display device, and the third display device is set in advance, when the cursor moves from the first display device to the second display device above the first display device, the second display device continues to display the cursor following the first display device, or when the cursor moves from the first display device to the third device to the right of the first display device, the third device continues to display the cursor following the first display device. However, a prerequisite for implementing this solution is that the orientation relationship between multiple display devices needs to be determined and set in advance. If the orientation relationship between the multiple display devices shown in FIG. 2 changes and the settings are not updated in a timely manner, the cursor presentation logic will not automatically adjust with the change in orientation between the display devices. This may cause a discrepancy between the cursor presentation and the actual scenario, affecting the user experience. In addition, this solution only considers the orientation relationship between the multiple display devices. Adaptive cursor presentation adjustment is not performed when the display types, display sizes, display resolutions, etc. of the multiple display devices are different, and adaptive cursor presentation adjustment is not performed based on a specific distance between the displays of the multiple display devices. For example, when a cursor traverses between two display devices far apart from each other as shown in FIG. 2, after the cursor moves outside the edge area of the display of one device, the cursor directly enters the display of the other device, and the jump point within the viewing distance causes the cursor to traverse unevenly. This affects the user's control experience.In another example, when a cursor traverses between two display devices with different display resolutions, the presentation position corresponding to the actual coordinates of the cursor may not match on the two displays due to the different display resolutions. As a result, there are jumps in the viewing distance when the cursor traverses, causing the cursor to traverse unsmoothly. This affects the user's control experience.

[0091] In addition, in a solution in which the presentation position of the cursor is determined based on the relative attitude change of the control device, regardless of how far the control device is from the display, the displacement of the cursor is a constant ratio to the angle change of the control device. As a result, even when a user controls the cursor at different distances, the cursor movement distance corresponding to the same deflection angle is consistent. Therefore, a user will have a significantly different control experience when controlling the cursor at different distances.

[0092] In order to solve the problems existing in the above-mentioned conventional solutions for determining the presentation position of a cursor, an embodiment of the present application provides a device display control method, in which the presentation position of the cursor can be determined based on the pointing direction of the control device, to solve problems such as the problem of misalignment between the presentation position of the cursor and the actual pointing position of the control device, the problem of the cursor being stuck to a frame when moving from the edge of the display, and the problem that the cursor presentation logic cannot automatically detect the orientation relationship between the displays of the multiple display devices, the types of the multiple display devices, the sizes of the displays of the multiple display devices, the resolutions of the displays of the multiple display devices, or the distance between the displays of the multiple display devices.

[0093] It should be noted that the cursor in this embodiment of the present application is a cursor in a broad sense. The cursor may be displayed in various forms, including, but not limited to, icons such as an arrow, a dot, and editable characters. In some embodiments, the display format of the cursor may be adaptively displayed based on different interfaces. For example, the display format of the cursor may be in the form of editable characters in an editable file, or in the form of an arrow on a folder interface. This is not specifically limited in this embodiment of the present application. In the following embodiments, a "cursor" is used as an example.

[0094] In this embodiment of the present application, the control device and the display device each include a wireless positioning unit. The positions of the wireless positioning unit of the control device and the wireless positioning unit of the display device relative to each other may be determined through receiving and transmitting positioning information. For example, the wireless positioning unit of the control device and the wireless positioning unit of the display device may determine the position of the intersection of the pointing direction of the control device and the plane on which the display of the display device is located, i.e., the pointing position of the control device, by receiving and transmitting positioning information. When the pointing position of the control device is on the display, the display device can follow the movement trajectory of the control device and display corresponding interface effects on the display. When the pointing position of the control device is not on the display, the display device does not display the corresponding interface effects on the display.

[0095] In one example, the interface effects displayed on the display may include, but are not limited to, displaying a display object (such as an icon, cursor, component, virtual image, or image) at the pointing position of the control device, displaying a corresponding viewing angle effect based on the pointing position of the control device, displaying a preset special effect in a corresponding display area (such as a preset control hot area) based on the pointing position of the display control device, etc. In the following embodiments, an example in which the display object is a cursor is used to specifically describe the solutions provided in the embodiments of the present application. For display objects in other display formats, please refer to the specific implementation process of cursor presentation.

[0096] For example, in a demonstration scenario, an interface effect displayed on the display may be, for example, displaying a cursor at the pointing location of the control device.

[0097] As another example, in a gaming scenario, the interface effects displayed on the display may be, for example, displaying a game hero image at the pointing position of the control device, displaying a game hero image at a preset viewing angle at the pointing position of the control device, displaying a game device at the pointing position of the control device, displaying a game special effect (such as a bubble special effect or a firework special effect) at the pointing position of the control device, or displaying a game special effect (such as a targeting special effect or a hit special effect) in a corresponding display area based on the pointing position of the display control device.

[0098] As another example, in a handwriting tablet scenario, the interface effect displayed on the display may be, for example, displaying a stylus image and handwriting at the pointing location of the control device, or displaying handwriting in a corresponding display area (e.g., a historical trajectory traversed by the stylus image) based on the pointing location of the display control device.

[0099] It should be noted that the interface effect displayed on the display by the display device following the movement trajectory of the control device is merely an example. During actual application, the interface effect may be determined based on a specific application scenario, the capabilities of the device, etc. For example, in some embodiments, the display device may display an icon on the display by following the movement trajectory of the control device, as well as display a virtual image, special effects, etc. at a preset viewing angle. For example, when the pointing position of the control device is within a preset control hot area, the display device may display corresponding interface effects, such as a virtual image and special effects, at a preset viewing angle when displaying the icon.

[0100] In one example, when the positions of the control device and the display device relative to each other are determined by transmitting and receiving positioning information, the control device or the display device can determine the pointing direction of the control device, the coordinate system in which the display of the display device is located, and the attitude of the display of the display device relative to the control device by transmitting and receiving positioning information, and then determine the position of the intersection of the pointing direction of the control device and the plane in which the display of the display device is located, i.e., the pointing position of the control device. Finally, the pointing position of the control device is used as the presentation position of the cursor.

[0101] In some implementations, the display device can determine a coordinate system in which the display device's display is located and send the coordinate system to the control device. The control device determines the pointing direction of the control device and the attitude of the display device's display relative to the control device, determines the pointing position of the control device based on the foregoing information, and then sends the pointing position to the display device, which then displays a cursor at the corresponding position.

[0102] In some other implementations, the control device can determine a pointing direction of the control device and send the pointing direction to the display device, which determines a coordinate system in which the display of the display device is located and an orientation of the display of the display device relative to the control device, determines a pointing position of the control device based on the foregoing information, and displays a cursor at the corresponding position.

[0103] The executing entity for calculating the pointing position of the control device is not specifically limited in this embodiment of the present application, and can be determined based on the actual function or application scenario of the device.

[0104] In some examples, the control device in this embodiment of the present application may include, but is not limited to, a remote control, an air mouse, a portable device, etc. For example, the portable device may include, but is not limited to, a smartphone, a smart watch, a smart band, a phone watch, a smart ring, smart glasses, an augmented reality (AR) / virtual reality (VR) gamepad, etc. Alternatively, the control device may be a wearable device, a handheld device, a head-mounted device, etc. that has remote control functionality and is of another type or configuration. This is not limited in this embodiment of the present application.

[0105] In some examples, the display device in this embodiment of the present application may include, but is not limited to, a netbook, a tablet computer, a writing tablet, an in-vehicle computer, a personal computer (PC), a smart television, a laser television, an AR / VR device (such as VR glasses), a projection device (such as a projector), a haptic game console, etc. Alternatively, the display device may be an electronic device of another type or structure having a display function, which is not limited in this embodiment of the present application.

[0106] For example, see Figure 3. Figure 3 is a schematic diagram of the architecture of a device remote control system in a single-display device scenario according to one embodiment of the present application. The device remote control system includes a control device 310 and a first display device 320. The first display device 320 is configured to perform interface display, and the control device 310 is configured to perform display control, operation control, etc. on the first display device 320.

[0107] As shown in FIG. 3, the control device 310 includes a processing unit 310-1, a power management unit (PMU) 310-2, a radio positioning unit 310-3, and a communication unit 310-4.

[0108] The processing unit 310-1 may be, for example, a central processing unit (CPU). In some embodiments, the processing unit 310-1 may include one or more interfaces. The interfaces may include, but are not limited to, an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, etc.

[0109] A storage unit may also be disposed within the processing unit 310-1 and configured to store instructions and data. In some embodiments, the storage unit within the processing unit 310-1 is a cache. The storage unit may store instructions or data recently used or periodically used by the processing unit 310-1. When the processing unit 310-1 needs to use the instructions or data again, the instructions or data may be retrieved directly from the storage unit. This avoids repeated accesses and reduces the latency of the processing unit 310-1, thus improving system efficiency.

[0110] The power management unit 310-2 is configured to connect the battery and the processing unit 310-1. The power management unit 310-2 receives input from the battery and supplies power to the processing unit 310-1, the wireless positioning unit 310-3, the communication unit 310-4, etc. For example, the power management unit 310-2 may convert a power level to an appropriate level for each module based on the characteristics of each of the processing unit 310-1, the wireless positioning unit 310-3, the communication unit 310-4, and another module to supply power to the module. The power management module 310-2 may be further configured to monitor parameters such as battery capacity, battery cycle count, and battery health status (fault or impedance). In some other embodiments, the power management unit 310-2 may alternatively be located in the processing unit 310-1.

[0111] The radio positioning unit 310-3 is configured to determine the pointing direction of the control device 310.

[0112] In some embodiments of the present application, the wireless positioning unit 310-3 may be further configured to determine the attitude of the display of the first display device 320 (shown as the first display) relative to the control device 320 and to determine the position of the intersection of the pointing direction of the control device 310 and the plane in which the first display is located, i.e., the pointing position of the control device 310.

[0113] For example, the wireless positioning unit 310-3 may include, but is not limited to, one or more of a multi-antenna ultra wide band radio (UWB) wireless positioning module, a multi-antenna millimeter wave radar positioning module, a three-dimensional electromagnetic coil positioning module, a three-dimensional ultrasonic positioning module, etc. By using one or more of the aforementioned modules, the wireless positioning unit 310-3 can transmit and receive positioning information to and from the wireless positioning unit 320-3 of the first display device 320 to determine the pointing direction of the control device 310 and the attitude of the first display relative to the control device 320. The positioning information may include one or more of the following information: UWB signals, millimeter wave radar signals, electromagnetic signals, and ultrasonic signals.

[0114] The communication unit 310-4 is configured to handle communication events between the control device and other devices, such as the first display device 320. For example, the communication unit 310-4 may include, but is not limited to, one or more of a communication interface, an antenna, a mobile communication module, a wireless communication module, a modem processor, a baseband processor, etc.

[0115] The communication interface may include, but is not limited to, a wired communication interface such as a universal serial bus (USB) port.

[0116] The antenna is configured to transmit and receive electromagnetic signals.

[0117] The mobile communication module may be applied to the control device 310 to provide wireless communication solutions including 2G / 3G / 4G / 5G, etc. The mobile communication module may include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. The mobile communication module may receive electromagnetic waves via an antenna, perform processing such as filtering or amplification on the received electromagnetic waves, and then send the electromagnetic waves to a modem processor for demodulation. The mobile communication module may further amplify signals modulated by the modem processor and convert the signals into electromagnetic waves for emission via the antenna. In some embodiments, at least some functional modules of the mobile communication module may be located within the processing unit 310-1. In some embodiments, at least some functional modules in the mobile communication module may be located within the same component as at least some modules in the processing unit 310-1.

[0118] The modem processor may include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be communicated into a medium- to high-frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the low-frequency baseband signal obtained through demodulation to the baseband processor for processing. In some embodiments, the modem processor may be an independent component. In some other embodiments, the modem processor may be independent from the processing unit 310-1 and be located within the same component as the mobile communication module or another functional module.

[0119] The wireless communication module may be applied to the control device 310 to provide wireless communication solutions, including wireless local area networks (WLAN) (e.g., Wi-Fi networks), Bluetooth (BT), UWB, global navigation satellite system (GNSS), near field communication (NFC) technology, infrared (IR) technology, etc. The wireless communication module may be one or more components integrating at least one communication processing module. The wireless communication module receives electromagnetic waves through an antenna, performs frequency modulation and filtering on the electromagnetic wave signals, and transmits the processed signals to the processing unit 310-1. The wireless communication module may further receive signals to be communicated from the processing unit 310-1, perform frequency modulation and amplification on the signals, and convert the signals into electromagnetic waves for emission through the antenna.

[0120] In some other embodiments of the present application, by using a wired communication interface or a wireless communication module, the control device 310 can receive from the first display device 320 a first coordinate system in which the first display is located and transmit the pointing position of the control device 310, etc. to the first display device 320.

[0121] In some embodiments of the present application, the control device 310 can transmit the pointing direction of the control device 310 to the first display device 320 by using a wired communication interface or a wireless communication module, so that the first display device 320 determines the pointing position of the control device 310 based on this.

[0122] In some embodiments of the present application, the control device 310 can send display control instructions, such as opening a file, drawing a line, or going back, to the first display device 320 by using a wired communication interface or a wireless communication module.

[0123] 3, the control device 310 may further include a motion measurement unit 310-5, such as an inertial measurement unit (IMU). The motion attitude detection unit 310-5 may include, but is not limited to, one or more of an acceleration sensor, a gyroscope sensor, an angular acceleration sensor, a magnetic sensor, etc. to measure the motion attitude of the control device 310.

[0124] In this embodiment of the present application, the control device 310 can obtain changes in the position and attitude of the control device 310 by using the movement measurement unit 310-5, and determine the displacement of the cursor relative to the historical presentation position of the cursor based on the relative attitude change of the control device, and further determine the presentation position of the cursor.

[0125] As shown in FIG. 3, the first display device 320 includes a processing unit 320-1, a power management unit 320-2, a radio positioning unit 320-3, a display unit 320-4, and a communication unit 320-5.

[0126] The processing unit 320-1 may be, for example, a CPU. In some embodiments, the processing unit 320-1 may include one or more interfaces. The interfaces may include, but are not limited to, an I2C interface, an I2S interface, a PCM interface, a UART interface, a MIPI interface, a GPIO interface, etc.

[0127] A storage unit may also be disposed within the processing unit 320-1 and configured to store instructions and data. In some embodiments, the storage unit within the processing unit 320-1 is a cache. The storage unit may store instructions or data recently used or periodically used by the processing unit 320-1. When the processing unit 320-1 needs to use the instructions or data again, the instructions or data may be retrieved directly from the storage unit. This avoids repeated accesses, reduces the latency of the processing unit 320-1, and thus improves system efficiency.

[0128] The power management unit 320-2 is configured to connect the battery and the processing unit 320-1. The power management unit 320-2 receives input from the battery and supplies power to the processing unit 320-1, the wireless positioning unit 320-3, the communication unit 310-4, etc. For example, the power management unit 310-2 may convert the power to a level appropriate for each module based on the characteristics of each of the processing unit 310-1, the wireless positioning unit 310-3, the display unit 320-4, the communication unit 320-5, and other modules and supply power to the modules. The power management module 320-2 may be further configured to monitor parameters such as battery capacity, battery cycle count, and battery health status (leakage or impedance). In some other embodiments, the power management unit 320-2 may alternatively be located in the processing unit 320-1.

[0129] The wireless positioning unit 320-3 may be configured to determine a first coordinate system in which the first display is located.

[0130] In some embodiments of the present application, the wireless positioning unit 320-3 may be further configured to determine the attitude of the first display relative to the control device 320 and to determine the position of the intersection of the pointing direction of the control device 310 and the plane in which the first display is located, i.e., the pointing position of the control device 310.

[0131] For example, the wireless positioning unit 320-3 may include, but is not limited to, one or more of a UWB positioning module, a multi-antenna millimeter-wave radar positioning module, a three-dimensional electromagnetic coil positioning module, a three-dimensional ultrasonic positioning module, etc. The wireless positioning unit 320-3 may transmit and receive positioning information to and from the wireless positioning unit 310-3 of the remote control device 310 by using one or more of the aforementioned modules to determine a first coordinate system in which the first display is located or an attitude of the first display relative to the control device 320.

[0132] The display unit 320-4 is configured to display images, videos, etc. For example, the display unit 320-4 may include a display.

[0133] In this embodiment of the present application, the display unit 320-4 may be configured to display content. In some embodiments, the display unit 320-4 may be further configured to display a cursor at the pointing position of the control device 310.

[0134] It should be noted that in this embodiment of the present application, the display unit 320-4 may be integrated with other modules such as the processing unit 320-1, the power management unit 320-2, the radio positioning unit 320-3, and the communication unit 320-5 (i.e., an integrated display device), or may be independent from other modules such as the processing unit 320-1, the power management unit 320-2, the radio positioning unit 320-3, and the communication unit 320-5 (i.e., a separate display device), which is not specifically limited in this embodiment of the present application.

[0135] The display in this embodiment of the present application is a broad concept. The display is a display carrier. For example, if the first display device 320 is an integrated display device such as a television or a PC, the display carrier may be a display panel or the like. If the first display device 320 is a split display device such as a projector, the display carrier may be a curtain, a wall, a ceiling, or the like. In addition, the display in this embodiment of the present application may be flat or curved. This is not limited.

[0136] The communication unit 320-5 is configured to process communication events between the first display device 320 and other devices, such as the control device 320. For example, the communication unit 320-5 may include, but is not limited to, one or more of a communication interface, an antenna, a mobile communication module, a wireless communication module, a modem processor, a baseband processor, etc.

[0137] The communication interface may include, but is not limited to, a wired communication interface such as a USB port.

[0138] The antenna is configured to transmit and receive electromagnetic signals.

[0139] The mobile communication module may be applied to the first display device 320 and provide wireless communication solutions including 2G / 3G / 4G / 5G, etc. The mobile communication module may include at least one filter, switch, power amplifier, low-noise amplifier (LNA), etc. The mobile communication module may receive electromagnetic waves via an antenna, perform processing such as filtering or amplification on the received electromagnetic waves, and then send the electromagnetic waves to a modem processor for demodulation. The mobile communication module may further amplify the modulated signal by the modem processor and convert the signal into an electromagnetic wave for emission via the antenna. In some embodiments, at least some functional modules of the mobile communication module may be disposed within the processing unit 320-1. In some embodiments, at least some functional modules in the mobile communication module may be disposed within the same component as at least some modules in the processing unit 320-1.

[0140] The modem processor may include a modulator and a demodulator. The modulator is configured to modulate a low-frequency baseband signal to be communicated into a medium- to high-frequency signal. The demodulator is configured to demodulate a received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the low-frequency baseband signal obtained through demodulation to the baseband processor for processing. In some embodiments, the modem processor may be an independent component. In some other embodiments, the modem processor may be independent from the processing unit 320-1 and be located within the same component as the mobile communication module or another functional module.

[0141] The wireless communication module may be applied to the first display device 320 to provide wireless communication solutions including WLAN (e.g., WiFi network), BT, UWB, GNSS, NFC, IR, etc. The wireless communication module may be one or more components integrating at least one communication processing module. The wireless communication module receives electromagnetic waves through an antenna, performs frequency modulation and filtering on the electromagnetic wave signals, and transmits the processed signals to the processing unit 320-1. The wireless communication module may further receive signals to be communicated from the processing unit 320-1, perform frequency modulation and amplification on the signals, and convert the signals into electromagnetic waves for emission through the antenna.

[0142] In some embodiments of the present application, by using a wired communication interface or a wireless communication module, the first display device 320 can transmit to the control device 310 a first coordinate system in which the first display is located, and receive from the control device 310 the pointing position of the control device 310, etc.

[0143] In some other embodiments of the present application, the first display device 320 can receive the pointing direction of the control device 310 from the control device 310 by using a wired communication interface or a wireless communication module.

[0144] In some embodiments of the present application, the first display device 320 can receive control instructions, such as opening a file, drawing a line, or going back, from the control device 310 by using a wired communication interface or a wireless communication module.

[0145] In the device display control method provided in this embodiment of the present application, the cursor presentation position is determined based on the pointing position of the control device. Therefore, when the pointing position of the control device is not on the display of the display device, the display device does not display the cursor. The display device displays the cursor at the pointing position of the control device only when the pointing position of the control device enters the edge region of the display of the display device. Therefore, in a single-display device scenario, this solution can bring users a convenient, immersive, and accurate cursor control and device control experience.

[0146] For example, see Figure 4. Figure 4 is a schematic diagram of a remote control cursor presentation process in a single display device scenario according to an embodiment of the present application. The single display device scenario shown in Figure 4 includes a control device 310 and a first display device 320. The first display device 320 is configured to perform interface display, and the control device 310 is configured to perform display control, operation control, etc. on the first display device 320.

[0147] 4, when the control device 310 having the attitude A1 points to a position B1 beyond the display, the first display device 320 does not display a cursor because position B1 is not on the first display. When the control device 310 having the attitude A2 points to a position B2, the first display device 320 displays a cursor at the pointing position B2 of the control device 310 because position B2 is on the first display. Similarly, when the control device 310 having the attitude A3 points to a position B3, the first display device 320 displays a cursor at the pointing position B3 of the control device 310. When the control device 310 having the attitude A4 points to a position B4 beyond the display, the first display device 320 does not display a cursor because position B4 is not on the first display. When the attitude of the control device 310 changes from attitude A4 to attitude A5, position B5 returns to the first display, and therefore the first display device 320 displays the cursor at the pointing position B5 of the control device 310.

[0148] 1 , in the remote control cursor presentation process in the single-display device scenario shown in FIG. 4 , it can be learned that for each presentation position of the cursor on the first display device 320 (i.e., the pointing position of the control device 310), the pointing position of the control device 310 is referenced. Therefore, if the pointing position of the control device 310 is not on the first display, the first display device 320 does not display the cursor. The first display device 320 displays the cursor at the pointing position of the control device 310 only when the pointing position of the control device 310 enters the edge region of the first display. Also, when the pointing position of the control device 310 moves outside the first display, the cursor is not attached to the frame. In this way, after the pointing position of the control device 310 enters an edge region of the first display, the first display device 320 can follow the movement trajectory of the control device 310 and display a corresponding interface effect on the first display (e.g., display a cursor). When the pointing position of the control device 310 moves outside any edge region of the first display (e.g., the top edge region, the bottom edge region, the left edge region, or the right edge region), the first display device 320 no longer displays the corresponding interface effect on the first display (e.g., does not display a cursor). Therefore, in a single-display device scenario, this solution can bring users a convenient, immersive, and accurate cursor presentation, cursor control, and device control experience.

[0149] For another example, see Fig. 5. Fig. 5 is a schematic diagram of the architecture of a device remote control system in a multi-display device scenario according to an embodiment of the present application. The device remote control system includes a control device 310, a first display device 320, and a second display device 330. The first display device 320 and the second display device 330 are configured to perform interface display, and the control device 310 is configured to perform display control and / or operation control, etc. on the first display device 320 or the second display device 330.

[0150] As shown in FIG. 5, the control device 310 includes a processing unit 310-1, a power management unit 310-2, a radio positioning unit 310-3, and a communication unit 310-4.

[0151] The radio positioning unit 310-3 is configured to determine the pointing direction of the control device 310.

[0152] In some embodiments of the present application, the wireless positioning unit 310-3 may be further configured to determine the attitude of the display of the first display device 320 (i.e., the first display) and the display of the second display device 330 (shown as the second display) relative to the control device 320, and based on the aforementioned information, determine the position of the intersection of the pointing direction of the control device 310 and the plane in which the first display is located, i.e., the pointing position of the control device 310.

[0153] For example, the wireless positioning unit 310-3 can transmit and receive positioning information between the wireless positioning unit 320-3 of the first display device 320 and the wireless positioning unit 330-3 of the second display device 330 by using one or more of a UWB positioning module, a multi-antenna millimeter-wave radar positioning module, a three-dimensional electromagnetic coil positioning module, a three-dimensional ultrasonic positioning module, etc., to determine the pointing direction of the control device 310, the attitude of the first display relative to the control device 320, and the attitude of the second display relative to the control device 320.

[0154] The communication unit 310-4 is configured to handle communication events between the control device and another device, for example, the first display device 320 or the second display device 330.

[0155] In some other embodiments of the present application, by using a wired communication interface or a wireless communication module, the control device 310 can receive from the first display device 320 a first coordinate system in which the first display is located, and from the second display device 330 a second coordinate system in which the second display is located, and transmit the pointing position of the control device 310, etc. to the first display device 320 or the second display device 330.

[0156] In some embodiments of the present application, the control device 310 can transmit the pointing direction of the control device 310 to the first display device 320 or the second display device 330 by using a wired communication interface or a wireless communication module, so that the first display device 320 determines the pointing position of the control device 310 based on this.

[0157] In some embodiments of the present application, the control device 310 can send display control instructions, such as opening a file, drawing a line, or going back, to the first display device 320 or the second display device 330 by using a wired communication interface or a wireless communication module.

[0158] 5, the control device 310 may further include a motion measurement unit 310-5, for example, an IMU. The motion attitude detection unit 310-5 may include, but is not limited to, one or more of an acceleration sensor, a gyroscope sensor, an angular acceleration sensor, a magnetic sensor, etc., to measure the motion attitude of the control device 310.

[0159] For specific descriptions of the processing unit 310-1, the power management unit 310-2, the wireless positioning unit 310-3, the communication unit 310-4, and the motion posture detection unit 310-5, please refer to the above description of Figure 3. The details will not be described again in this specification.

[0160] 3, the first display device 320 includes a processing unit 320-1, a power management unit 320-2, a radio positioning unit 320-3, a display unit 320-4, and a communication unit 320-5. The second display device 330 includes a processing unit 330-1, a power management unit 330-2, a radio positioning unit 330-3, a display unit 330-4, and a communication unit 330-5.

[0161] For specific descriptions of the processing unit 320-1, the power management unit 320-2, the radio positioning unit 320-3, the display unit 320-4, and the communication unit 320-5, please refer to the above description of Figure 3. Details will not be described again herein. In addition, for the processing unit 330-1, the power management unit 330-2, the radio positioning unit 330-3, the display unit 330-4, and the communication unit 330-5, please refer to the above specific descriptions of the processing unit 320-1, the power management unit 320-2, the radio positioning unit 320-3, the display unit 320-4, and the communication unit 320-5, respectively. Details will not be described again herein.

[0162] The first display device 320 and the second display device 330 may be display devices with the same type, display size, or display resolution. For example, the first display device 320 may be a television 1, and the second display device 330 may be a television 2, with the television 1 and television 2 having the same display size and / or display resolution. The first display device 320 and the second display device 330 may also be display devices of different types, display sizes, or display resolutions. For example, the first display device 320 may be a projector, and the second display device 330 may be a television. The projector and the television have different types, display sizes, and display resolutions. In a multi-display device scenario, the specific types, display sizes, display resolutions, etc. of the multiple display devices are not limited in this embodiment of the present application.

[0163] In the device display control method provided in this embodiment of the present application, the presentation position of the cursor is determined based on the pointing position of the control device. Therefore, if the pointing position of the control device is not on the display of the display device, the display device does not display the cursor. The display device displays the cursor at the pointing position of the control device only when the pointing position of the control device enters an edge region of the display of the display device. In addition, in this solution, the orientation relationship between multiple display devices does not need to be set in advance. When the cursor is continuous across multiple display devices, it can automatically detect whether the pointing position of the control device is located on the display of a specific display device. Therefore, the cursor can always traverse accurately regardless of changes in the attitude relationship between the multiple display devices. In addition, this solution is not affected by different types of multiple display devices, different display sizes, different display resolutions, different distances between the multiple displays, etc. Therefore, in a multi-display device scenario, this solution can also bring users a convenient, immersive, and accurate cursor control and device control experience.

[0164] For example, see Fig. 6. Fig. 6 is a schematic diagram of a remote control cursor presentation process in a multi-display device scenario according to an embodiment of the present application. The multi-display device scenario shown in Fig. 6 includes a control device 310, a first display device 320, and a second display device 330. The first display device 320 and the second display device 330 are configured to perform interface display, and the control device 310 is configured to perform display control and / or operation control, etc. on the first display device 320 or the second display device 330.

[0165] 6, when the control device 310 having the attitude A6 points to a position B6 on the first display, the first display device 320 displays a cursor at the pointing position B6 of the control device 310. When the pointing position B7 of the control device 310 having the attitude A7 moves out of the first display and is no longer on the second display, neither the first display device 320 nor the second display device 330 displays a cursor. When the pointing position B8 of the control device 310 having the attitude A8 enters the second display, the second display device 330 displays a cursor at the pointing position B8 of the control device 310.

[0166] Compared with the process of presenting a remote control cursor in a conventional multi-display device scenario shown in FIG. 2 , in the process of presenting a remote control cursor in a multi-display device scenario shown in FIG. 6 , the first display device 320 can learn to display the position of the cursor (i.e., the pointing position of the control device 310) by referring to the pointing position of the control device 310. Therefore, when the pointing position of the control device 310 is not on the display of any of the display devices, the multiple display devices do not display the cursor. The display devices display the cursor at the pointing position of the control device 310 only when the pointing position of the control device 310 enters an edge region of the display of a display device (e.g., the first display device 320 or the second display device 330). In this way, after the pointing position of the control device 310 enters the edge region of the first display, the first display device 320 can follow the movement trajectory of the control device 310 and display a corresponding interface effect (e.g., display a cursor) on the first display. In the process of the pointing position of the control device 310 traversing from the first display device 320 to the second display device 330, when the pointing position of the control device 310 moves outside any edge region (e.g., the top edge region, the bottom edge region, the left edge region, or the right edge region) of the first display and does not enter the edge region of the second display, the first display device 320 no longer displays a corresponding interface effect on the first display (e.g., does not display a cursor). After the pointing position of the control device 310 enters the edge region of the second display, the second display device 330 can follow the movement trajectory of the control device 310 and display a corresponding interface effect on the second display (e.g., display a cursor). When the cursor is displayed, the display device (e.g., the first display device 320 or the second display device 330) can follow the movement trajectory of the control device 310 and display a cursor presentation trajectory that matches the movement trajectory on the display.

[0167] In this embodiment of the present application, the pointing position of the control device entering an edge region of the display means that the pointing position of the control device moves from outside the display to the edge region of the display, and the pointing position of the control device moving outside any edge region of the display means that the pointing position of the control device moves from any edge region of the display to outside the display.

[0168] In addition, when the orientation relationship between the first display device 320 and the second display device 330 shown in FIG. 6 changes, accurate traversal of the cursor as the cursor continues remains unaffected. Furthermore, regardless of whether the types, display sizes, display resolutions, etc. of the first display device 320 and the second display device 330 shown in FIG. 6 are the same, or regardless of the distance between the displays of the first display device 320 and the second display device 330, accurate display of the cursor remains unaffected. For example, assuming that the orientation relationship between the first display device 320 and the second display device 330 has changed from a first relationship to a second relationship, when the pointing position of the control device 310 is determined, the pointing position of the control device 310 may be determined based on the latest second relationship. When the pointing position of the control device 310 is not within the edge region of either display, neither the first display device 320 nor the second display device 330 displays the corresponding display object. Only when the pointing position of the control device 310 enters the edge region of the first display or the second display, the cursor is displayed on the corresponding display, following the movement trajectory of the control device.

[0169] 6 changes, or the screen resolution and / or focal length corresponding to the first display device 320 or the second display device 330 changes, the accurate traversal of the cursor as the cursor continues remains unaffected. For example, when the screen resolution and / or focal length corresponding to a display device (e.g., the first display device 320 or the second display device 330) changes and the pointing position of the control device 310 is determined, the pointing position of the control device 310 may be determined based on the latest screen resolution and / or latest focal length. When the pointing position of the control device 310 does not fall within the edge region of either display, neither the first display device 320 nor the second display device 330 displays the corresponding display object. Only when the pointing position of the control device 310 falls within the edge region of the first display or the second display is the cursor displayed on the corresponding display, following the movement trajectory of the control device. In another example, when the orientation relationship between a display device (e.g., the first display device 320 or the second display device 330) and the remote control device 310 changes and the pointing position of the control device 310 is determined, the pointing position of the control device 310 may be determined based on the latest orientation relationship. When the pointing position of the control device 310 does not fall within the edge region of either display, neither the first display device 320 nor the second display device 330 displays the corresponding display object. Only when the pointing position of the control device 310 falls within the edge region of the first display or the second display, is the cursor displayed on the corresponding display following the movement trajectory of the control device.

[0170] In conclusion, in a multi-display device scenario, the solution provided in this embodiment of the present application can also bring users a convenient, immersive and precise cursor control and device control experience.

[0171] 3 in the present application does not constitute a specific limitation on the control device 310 and the first display device 320, and the structure shown in FIG. 5 does not constitute a specific limitation on the control device 310, the first display device 320, and the second display device 330. In some other embodiments of the present application, the control device 310, the first display device 320, or the second display device 330 may include more or fewer components than those shown in the figures, or may combine some components, or may separate some components, or may have a different component arrangement. The components shown in the figures may be implemented by hardware, software, or a combination of software and hardware.

[0172] For example, the control device 310, the first display device 320, or the second display device 330 may further include one or more of a memory (including an external memory interface and an internal memory), a charging management unit, an audio module, a loudspeaker, a receiver, a microphone, a headset jack, buttons, a camera, etc. In another example, the control device 310, the first display device 320, or the second display device 330 may further include one or more sensors such as a touch sensor, a pressure sensor, an air pressure sensor, a distance sensor, an optical proximity sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, and a bone conduction sensor.

[0173] It should be noted that the number of displays included in the display device (e.g., the first display device or the second display device) is not limited in this embodiment of the present application. In some embodiments, the display device may include multiple displays and one wireless positioning unit. The wireless positioning unit may be configured to determine coordinates of the multiple displays. Alternatively, in some embodiments, the display device may include multiple displays and multiple wireless positioning units, each configured to determine coordinates of the multiple displays.

[0174] With reference to scenario 1 and scenario 2, the following will specifically describe the device display control method provided in this embodiment of the present application.

[0175] Scenario 1: Single display device scenario The single display device scenario includes a control device 310 and a first display device 320. The first display device 320 is configured to perform interface display, and the control device 310 is configured to perform display control, operation control, etc. on the first display device 320.

[0176] In some examples, in a process in which the first display device 320 displays a cursor based on the pointing direction of the control device 310, the first display device 320 may transmit and receive positioning information to and from the control device 310 to determine a first coordinate system in which the display (e.g., the first display) of the first display device 320 is located, and transmit the first coordinate system to the control device 310. The control device 310 may transmit and receive positioning information to and from the first display device 320 to determine the pointing direction of the control device 310 and a first attitude of the first display unit relative to the control device 320, determine the position of the intersection of the pointing direction of the control device 310 and a plane in which the first display unit is located (i.e., the pointing position of the control device 310), and, when the pointing position of the control device 310 is on the first display unit, transmit the pointing position of the control device 310 to the first display device 320, so that the first display device 320 displays a cursor at the pointing position of the control device 310. Positioning information may be transmitted and received between the first display device 320 and the control device 310 by using the respective wireless positioning units.

[0177] For example, see Figure 7. Figure 7 is a flowchart of a device display control method according to an embodiment of the present application. As shown in Figure 7, the device display control method provided in this embodiment of the present application may include the following steps S701 to S707.

[0178] S701: The control device 310 establishes a communication connection with the first display device 320.

[0179] The communication connection established between the control device 310 and the first display device 320 may include, but is not limited to, a wired communication connection and a wireless communication connection. The wireless communication connection may include, but is not limited to, a Bluetooth connection, a WiFi P2P connection, etc.

[0180] S702: The first display device 320 determines a first coordinate system in which the display of the first display device 320 (ie, the first display) is located.

[0181] In one possible implementation, as shown in FIG. 7, the first display device 320 can determine a first coordinate system in which the first display is located by sending and receiving positioning information to and from the control device 310.

[0182] In a possible implementation, the first display device 320 can determine a first coordinate system in which the first display is located based on one or more of the following methods: a multi-antenna UWB positioning method, a multi-antenna millimeter-wave radar positioning method, a three-dimensional electromagnetic coil positioning method, and a three-dimensional ultrasonic positioning method. The multi-antenna UWB positioning method is, for example, a multi-antenna time difference of arrival (TDOA) positioning method, a multi-antenna time of flight (TOF) ranging method, or a multi-antenna angle of arrival (AOA) positioning method. For example, the positioning information may include one or more of the following information: a UWB signal, a millimeter-wave radar signal, an electromagnetic signal, and an ultrasonic signal. The specific method used by the first display device 320 to determine the first coordinate system is not limited in this embodiment of the present application and may be determined based on the actual structure and actual function of the device, the application scenario, etc.

[0183] In some embodiments, when the first display device 320 includes M antennas (M≧3) and a plane including the equivalent centers of the M antennas coincides with or is parallel to the display, the first coordinate system in which the first display is located can be determined by using a multi-antenna UWB positioning method. See Figure 8. Figure 8 is a schematic diagram of a method for determining a coordinate system in which a display is located based on a multi-antenna UWB positioning method according to an embodiment of the present application, where an example is used in which the first display device 320 is an integrated display device.

[0184] As shown in FIG. 8, a first antenna (e.g., a transmitting antenna), a second antenna (e.g., a receiving antenna), a third antenna (e.g., a horizontal antenna), and a fourth antenna (e.g., a vertical antenna) are disposed on a first display. The first display device 320 can construct a first coordinate system in which the first display is located based on a multi-antenna UWB positioning method by using steps S901 to S903 shown in FIG. 9. In step S901, the first display device 320 transmits positioning information to the control device 310 and performs multi-antenna time difference of arrival measurement. In step S902, the first display device 320 obtains a distance r between the multiple antennas of the control device 310 and the multiple antennas of the first display device 320 through calculation based on the multi-antenna time difference of arrival measurement result. In step S903, the first display device 320 obtains the horizontal deflection angle and vertical pitch angle between the multiple antennas of the control device 310 and the multiple antennas of the first display device 320 through calculations based on the multi-antenna time difference of arrival measurement results, and obtains the positions of the equivalent centers of the multiple antennas of the first display device 320 through calculations in combination with the distance r to construct a first coordinate system in which the first display is located. In addition, the first display device 320 can determine a plane in which the M antennas are located based on the positions of the multiple equivalent centers. Because the distances between the first display and the M antennas are known, the first display device 320 can further determine the positional relationship of the first display with respect to the plane in which the M antennas are located, and based on this, can further determine the first plane in which the first display is located.

[0185] For example, if the distance between the multiple equivalent centers and the first display is 0, the first plane on which the first display is located is the plane on which the multiple equivalent centers are located. If the distance between the multiple equivalent centers and the first display is not 0 (e.g., the distance is d, and d is a vector value), the first plane on which the first display is located is a plane that is parallel to the plane on which the multiple equivalent centers are located and is a distance d from the plane on which the multiple equivalent centers are located. In Figure 8, the distance of 0 between the positions of the multiple equivalent centers and the first display is used only as an example.

[0186] It can be understood that after the first coordinate system in which the first display is located is determined, since the size information of the first display and the positional relationship between the first display and the M antennas are known, the first display device 320 can construct the first coordinate system in which the first display is located based on this.

[0187] As shown in Fig. 8, the first coordinate system may be a first coordinate system in which the coordinate origin O1 is located at the geometric center of the M antennas, the X1O1Y1 plane coincides with the first plane on which the first display is located, and the Z1, X1, and Y1 axes satisfy the right-hand spiral criterion. Of course, the first coordinate system shown in Fig. 8 is used only as an example, and the construction principle of the first coordinate system is not specifically limited in this application. For example, the coordinate origin O1 may alternatively be located at the edge center (e.g., the left edge center) of the first display or another position on the first plane.

[0188] It should be noted that in FIG. 8, the first display device 320 being an integrated display device is used only as an example to describe a specific process of determining the coordinates of the display based on the multi-antenna UWB positioning method. If the first display device 320 is a split display device, for example, if the first display device 320 is the projector shown in FIG. 10 and the first display is the curtain shown in FIG. 10, the principle of determining the coordinates of the display is the same as the example shown in FIG. 8. For example, M antennas are arranged on the projection host (i.e., the first display device 320) of the projector, and the projector may also determine the positions of the equivalent centers of the M antennas by using steps S901 to S903 shown in FIG. 9 based on the multi-antenna UWB positioning method. In addition, the projector may determine a plane on which the M antennas are located based on the positions of the multiple equivalent centers. Furthermore, since the size information of the curtain (i.e., the first display) and the positional relationship between the curtain and the M antennas are known, the projector can further determine the positional relationship of the first display with respect to the plane on which the M antennas are located, and based on this, construct a first coordinate system in which the curtain is located.

[0189] If the first display device 320 is a projector and the first display is a curtain, the first display device 320 can determine the positional relationship between the curtain and the M antennas and the size information of the curtain based on one or more data of the focal length parameter of the projection host, the projection distance of the projection host, and the projection skew angle of the projection host. For example, the focal length parameter of the projection host can be set manually or by default. The projection distance of the projection host or the projection skew angle of the projection host can be obtained through measurement based on a method such as multi-point TOF ranging.

[0190] S703: The first display device 320 sends first information to the control device 310, the first information including a first coordinate system in which the display of the first display device 320 (i.e., the first display) is located and the size of the first display.

[0191] S704: The control device 310 determines a pointing direction of the control device 310 and a first attitude of the first display relative to the control device 310.

[0192] In a possible implementation, the first display device 320 can send and receive positioning information to and from the control device 310 to determine the pointing direction of the control device 310 and the first attitude of the first display relative to the control device 310.

[0193] In a possible implementation, the control device 310 can determine the pointing direction of the control device 310 and the first attitude of the first display relative to the control device 310 based on one or more of the following methods: a multi-antenna UWB positioning method, a multi-antenna millimeter-wave radar positioning method, a three-dimensional electromagnetic coil positioning method, and a three-dimensional ultrasonic positioning method. For example, the positioning information may include one or more of the following information: a UWB signal, a millimeter-wave radar signal, an electromagnetic signal, and an ultrasonic signal. The multi-antenna UWB positioning method is, for example, a TDOA positioning method, a TOF ranging method, or an AOA positioning method. The specific method used by the control device 310 is not limited in this embodiment of the present application and may be determined based on the actual structure and actual function of the device, the application scenario, etc.

[0194] In some embodiments, when the control device 310 includes N antennas (N≧3) and a plane containing the equivalent centers of the N antennas is perpendicular to the axial direction of the control device 310, the pointing direction of the control device 310 can be determined by using a multi-antenna UWB positioning method.

[0195] As shown in FIG. 8, a fifth antenna (e.g., an origin antenna), a sixth antenna (e.g., a horizontal antenna), and a seventh antenna (e.g., a vertical antenna) are disposed on the control device 310. The control device 310 can determine the positions of the equivalent centers of the N antennas based on the multi-antenna UWB positioning method by using steps S1101 to S1103 shown in FIG. 11. In addition, the control device 310 can determine a plane on which the N antennas are located based on the positions of the multiple equivalent centers. In step S1101 shown in FIG. 11, the control device 310 transmits positioning information to the first display device 320 to perform multi-antenna time difference of arrival measurement. In step S1102, the control device 310 obtains a distance r between the multiple antennas of the first display device 320 and the multiple antennas of the control device 310 through calculation based on the multi-antenna time difference of arrival measurement result. In step S1103, the control device 310 obtains the horizontal deflection angles and vertical pitch angles between the multiple antennas of the first display device 320 and the multiple antennas of the control device 310 through calculations based on the multi-antenna time difference of arrival measurement results, and obtains the positions of the equivalent centers of the multiple antennas of the control device 310 in the first coordinate system through calculations combining the distance r, thereby determining the pointing direction of the control device 310. For example, since the plane including the equivalent centers of the N antennas is perpendicular to the axial direction of the control device 310, the pointing direction P of the control device 310 shown in FIG. 8 can be determined based on the equivalent centers of the N antennas.

[0196] 11 , after the positions of the equivalent centers of the multiple antennas of the control device 310 are obtained by calculation, the control device 310 can further determine a first attitude of the first display relative to the control device 310 by using steps S1104 and S1105 shown in FIG. 11 . S1104 shown in FIG. 11 is that the control device 310 receives signals transmitted by the first display device 320 by using N antennas and obtains the phase difference between the signals received by the N antennas through calculation. S1105 is that the control device 310 obtains the horizontal deflection angle and vertical pitch angle of the first display relative to the control device 310 through calculation, and determines the first attitude of the first display relative to the control device 310 with the combination of the distance r.

[0197] S705: The control device 310 determines a first position to which the control device 310 points on the plane on which the first display is located.

[0198] For example, as shown in S1106 of FIG. 11, the control device 310 may obtain a first position to which the control device 310 is pointing on a plane on which the first display is located through calculation based on a first attitude and pointing direction of the control device 310 obtained through calculation.

[0199] It should be noted that in the foregoing embodiments, the multi-antenna UWB positioning method is only used as an example to describe a specific process of determining the pointing position of the control device 310. However, the specific methods and processes of determining the pointing direction of the control device 310, determining the attitude of the first display device 320 relative to the control device 310, and determining the pointing position of the control device 310 are not limited in this embodiment of the present application. For example, in some embodiments, if the first display device 320 and the control device 330 include a three-axis magnetic field transmitting coil (e.g., a magnetic sensor including a three-axis magnetic field transmitting coil), the attitude of the control device 310 can be determined by using a three-dimensional electromagnetic coil positioning method to further determine the pointing position of the control device 310 based on the attitude.

[0200] The three-dimensional electromagnetic coil has coils formed by winding wire in each of the three dimensions. When a current passes through the coil, a magnetic field is generated. The principle of the three-dimensional electromagnetic coil positioning method is to implement positioning using the effect of the magnetic field and the electromagnetic induction principle of the magnetic coil. As shown in FIG. 12, the transmitting end sensor includes a three-axis magnetic field transmitting coil, a driving circuit (i.e., an excitation source), and a processing unit. The receiving end sensor includes a three-axis magnetic field transmitting coil, an amplification circuit, a sampling detection unit, and a processing unit. The three-axis magnetic field transmitting coil of the transmitting end sensor may transmit an electromagnetic signal based on the driving of the driving circuit, and the driving circuit is controlled by the processing unit. The receiving end sensor may detect the electromagnetic signal from the transmitting end sensor using the three-axis magnetic field transmitting coil and obtain the attitude of the control device 310 after processing by the amplification circuit, the sampling detection unit, the processing unit, etc.

[0201] Please refer to Fig. 13. Fig. 13 is a schematic diagram of a method for determining a coordinate system in which a display is located based on a three-dimensional electromagnetic coil positioning method according to an embodiment of the present application, using an example in which the first display device 320 is an integrated display device.

[0202] 13 , the first three-axis magnetic field transmitting coil is disposed on the first display, and the second three-axis magnetic field transmitting coil is disposed on the control device 310. The first display device 320 can transmit an electromagnetic signal by using the first three-axis magnetic field transmitting coil. After the control device 310 detects the electromagnetic signal from the first three-axis magnetic field transmitting coil by using the second three-axis magnetic field transmitting coil, the attitude of the control device 310 can be obtained through calculation based thereon.

[0203] For example, the first display device 320 may establish a coordinate system O1-X1Y1Z1 shown in FIG. 13 by using the first three-axis magnetic field transmitting coil as a reference, the coordinate origin of the coordinate system O1-X1Y1Z1 may be the position of the first three-axis magnetic field transmitting coil, the X1O1Z1 plane is the plane on which the first display is located, and the Z1 axis, X1 axis, and Y1 axis satisfy the left-handed spiral reference. In the coordinate system O1-X1Y1Z1, the magnetic induction strength at the position of the first three-axis magnetic field transmitting coil is expressed as B shown in FIG. x , B y , and B z By using the second three-axis magnetic field transmitting coil as a reference, the control device 310 can establish a coordinate system O2-X2Y2Z2 shown in FIG. 13. By using the second three-axis magnetic field transmitting coil, the control device 310 can determine that the magnetic induction strength in the coordinate system is B shown in FIG. x’ , B y’ , and B z’ The rotation angles of the coordinate system O2-X2Y2Z2 relative to O1-X1Y1Z1 along the three axis directions are α, β, and γ, respectively, as shown in FIG. 14. Based on this, the following equations can be obtained:

number

[0204] In the above formula, R is the rotation matrix, and the calculation formula for R is as follows:

number

[0205] Based on the above formula, the orientation (x, y, z, α, β, γ) of the control device 310 can be obtained through calculation. After the orientation of the control device 310 is obtained, the pointing direction of the control device 310 and the coordinate of the intersection between the pointing direction of the control device 310 and the first display (i.e., the pointing position of the control device 310) can be calculated based on a trigonometric function relationship.

[0206] S706: If the first position is on the first display, the control device 310 sends second information to the first display device 320, where the second information includes coordinate information of the first position.

[0207] It can be understood that if the size of the first display and the first coordinate system in which the first display is located are known, a first coordinate range of the first display in the first coordinate system can be obtained, and by determining whether the first position is within the first coordinate range, it can be determined whether the first position is located on the first display.

[0208] If the first position is on the first display, the control device 310 can transmit coordinate information of the first position to the first display device 320, which then displays a cursor at the first position based on the second information. If the first position is not on the first display, the control device 310 does not need to perform any processing. Thus, the first display device 320 does not display a cursor.

[0209] S707: The first display device 320 displays a cursor at the first position based on the second information.

[0210] In some examples, in the process in which the first display device 320 displays a cursor based on the pointing direction of the control device 310, the control device 310 may transmit the pointing direction of the control device 310 to the first display device 320. The first display device 320 determines a first coordinate system in which the display of the first display device 320 (i.e., the first display) is located and a first attitude of the first display relative to the control device 320, and based on the aforementioned information, determines the position of the intersection between the pointing direction of the control device 310 and the plane in which the first display is located (i.e., the pointing position of the control device 310), and when the pointing position of the control device 310 is on the first display, can display a cursor at the pointing position of the control device 310.

[0211] For example, see Fig. 15. Fig. 15 is a flowchart of another device display control method according to an embodiment of the present application. As shown in Fig. 15, the device display control method provided in this embodiment of the present application may include the following steps S1501 to S1506.

[0212] S1501: The control device 310 establishes a communication connection with the first display device 320.

[0213] For a specific description of S1501, please refer to the above description of S701, and the details will not be described again in this specification.

[0214] S1502: The control device 310 determines the pointing direction of the control device 310.

[0215] For a specific description of S1502, please refer to the above description of S704, and the details will not be described again in this specification.

[0216] S1503: The control device 310 transmits the pointing direction of the control device 310 to the first display device 320.

[0217] S1504: The first display device 320 determines a first coordinate system in which the display of the first display device 320 (i.e., the first display) is located and a first attitude of the first display relative to the control device 310.

[0218] For a specific description of the first display device 320 determining the first coordinate system in which the display of the first display device 320 (i.e., the first display) is located, please refer to the above description of S702. For a specific description of the first display device 320 determining the first orientation of the first display relative to the control device 310, please refer to the above process in which the control device 310 determines the first orientation of the first display relative to the control device 310 in step S704. The details will not be described again herein.

[0219] S1505: The first display device 320 determines a first position to which the control device 310 points on the plane on which the first display is located.

[0220] For a specific description of how the first display device 320 determines the first position to which the control device 310 points on the plane on which the first display is located, please refer to the above-mentioned process in which the control device 310 determines the first position to which the control device 310 points on the plane on which the first display is located in step S705. The details will not be described again in this specification.

[0221] S1506: If the first position is on the first display, the first display device 320 displays a cursor at the first position.

[0222] It will be understood that in the device display control method provided in this embodiment of the present application, whether the display displays a cursor and the specific presentation position of the cursor when the cursor is displayed on the display are determined based on the position of the control device on the plane on which the display is located. Therefore, if the pointing position of the control device is not on the display of the display device, the display device does not display the cursor. The display device displays the cursor at the pointing position of the control device only when the pointing position of the control device enters an edge region of the display of the display device (as shown in FIG. 4). In this way, after the pointing position of the control device enters an edge region of the display, the display device can follow the movement trajectory of the control device and display the cursor on the display. When the pointing position of the control device moves outside any edge region of the display (e.g., the top edge region, bottom edge region, left edge region, or right edge region), the display device no longer displays the cursor on the display. Therefore, compared to the prior art, the problem of misalignment between the presentation position of the cursor and the pointing position of the control device can be solved, and the problem of the cursor being stuck to a frame when moving from the edge of the display can also be solved.

[0223] In addition, because the cursor presentation position is the pointing position of the control device, the deviation between the cursor presentation position and the axial pointing position of the control device 310 in the actual posture is very small. For example, as shown in FIG. 16 , the cursor presentation position is usually within a preset range S near the axial pointing position of the control device 310 in the actual posture. The preset range is usually very small. For example, due to the influence of measurement and / or calculation errors of the wireless positioning unit 310-3 of the control device 310 and / or measurement and / or calculation errors of the wireless positioning unit 320-3 of the first display device 320, a deviation may occur between the cursor presentation position and the axial pointing position of the control device 310 in the actual posture. The deviation is usually within 10° (in some embodiments, the deviation may be within 3°, or even within 1°). Therefore, the device display control method provided in this embodiment of the present application can bring the user a more accurate cursor control experience.

[0224] In conclusion, the device display control method provided in this embodiment of the present application can bring users a convenient, immersive and accurate device control experience.

[0225] In some embodiments, to ensure continuous presentation of the cursor, after it is confirmed that the cursor has entered an edge region of the display, the presentation position of the cursor may be further determined based on a relative attitude change of the control device. If the presentation position of the cursor determined based on the relative attitude change of the control device deviates from the pointing direction of the control device by more than a preset range, or after a preset period has elapsed, the presentation position of the cursor is calibrated based on the pointing position of the control device. The preset range of the pointing direction of the control device is, for example, the overlap range between the display and a cone deflected by an angle φ around the pointing direction of the control device.

[0226] For example, in an initial stage, the control device 310 and the first display device 320 may perform related measurements and calculations by using a wireless positioning unit to determine a first position to be pointed by the control device 310 on a plane on which the first display is located. If the first position is not on the first display, the next pointing position is determined based on a preset frequency. After the pointing position of the control device 310 enters the edge region of the first display, the control device 310 may measure the movement attitude of the control device 310 by using a movement measurement unit 310-5 (e.g., an IMU). As a result, the first display device 310 may determine the displacement of the cursor relative to the historical presentation position of the cursor based on the relative posture change of the control device 310, and then further determine the presentation position of the cursor. Additionally, in the process of determining the presentation position of the cursor based on the relative attitude change of the control device 310, the presentation position of the cursor may be calibrated based on the pointing position of the control device at intervals of a preset time period, or the presentation position of the cursor may be calibrated based on the pointing position of the control device when the presentation position of the cursor deviates from the pointing direction of the control device beyond a preset range. Additionally, after the cursor moves outside the edge region of the first display, the wireless positioning unit may be used to perform related measurements and calculations to determine the pointing position of the control device 310.

[0227] This allows the display deviation of the cursor to always be kept within a small range, ensuring accurate presentation of the cursor and continuous presentation of the cursor on the display.

[0228] In some embodiments, in the process of determining the presentation position of the cursor based on the relative attitude change of the control device 310, the displacement of the cursor relative to the historical presentation position of the cursor may be further dynamically adjusted in combination with the distance between the control device 310 and the first display device 320. For example, when the distance between the control device 310 and the first display device 320 is within a range of D1 to D2, the cursor displacement ratio is adjusted based on the result of the relative attitude change of the control device 310 * distance. When the distance between the control device 310 and the first display device 320 is less than D1, the cursor displacement ratio is adjusted based on the result of the relative attitude change of the control device 310 * D1. When the distance between the control device 310 and the first display device 320 is greater than D2, the cursor displacement ratio is adjusted based on the result of the relative attitude change of the control device 310 * D2. Based on this, it can be further ensured that when the control device 310 controls the cursor at different distances, the cursor movement distance corresponding to the same posture change can be dynamically adjusted, so that the user has basically the same control experience when controlling the cursor at different distances.

[0229] It should be noted that in the above scenario 1, the display device following the movement trajectory of the control device and displaying a cursor on the display is merely used as an example, and may be determined based on a specific application scenario, device functions, etc. during actual application. For example, the interface effects displayed on the display may alternatively include, but are not limited to, displaying an icon, component, virtual image, picture, etc. at the pointing position of the control device, displaying a corresponding viewing angle effect based on the pointing position of the control device, displaying a preset special effect in a corresponding display area (such as a preset control hot area) based on the pointing position of the display control device, etc.

[0230] For example, in a gaming scenario, the interface effect displayed on the display may alternatively be, for example, displaying a game hero image at a preset viewing angle at the pointing position of the control device, displaying game equipment at the pointing position of the control device, displaying a game special effect (e.g., a bubble special effect or a firework special effect) at the pointing position of the control device, or displaying a game special effect (e.g., a target special effect or a hit special effect) in a corresponding display area based on the pointing position of the display control device. As another example, in a handwriting tablet scenario, the interface effect displayed on the display may alternatively be, for example, displaying a stylus image and handwriting at the pointing position of the control device, or displaying handwriting in a corresponding display area (e.g., a history trajectory passed by the stylus image) based on the pointing position of the display control device. In another example, the display device may alternatively follow the movement trajectory of the control device, display a cursor on the display, and also display virtual images, special effects, etc. at a preset viewing angle. For example, when the pointing position of the control device is within a preset control hot area, the display device may display corresponding interface effects, such as virtual images and special effects, at a preset viewing angle when displaying a display object.

[0231] When the display device follows the movement trajectory of the control device and displays interface effects such as components, virtual images, viewing angle effects, or special effects on the display, when the pointing position of the control device moves outside the edge area of the display of the display device, the display device may no longer update the interface effects or may no longer display the interface effects, which is not specifically limited in this embodiment of the present application and is determined based on the actual application scenario, device functions, etc.

[0232] Scenario 2: Multi-display device scenario The multi-display device scenario includes a control device 310, a first display device 320, and a second display device 330. The first display device 320 and the second display device 330 are configured to perform interface display, and the control device 310 is configured to perform display control and / or operation control, etc. on the first display device 320 or the second display device 330.

[0233] In some examples, in the process in which the first display device 320 or the second display device 330 displays a cursor based on the pointing direction of the control device 310, the first display device 320 can transmit and receive positioning information to and from the control device 310 to determine a first coordinate system in which the display of the first display device 320 (e.g., the first display) is located and transmit the first coordinate system in which the first display is located to the control device 310. The second display device 330 can transmit and receive positioning information to and from the control device 310 to determine a first coordinate system in which the display of the second display device 330 (e.g., the second display) is located and transmit the second coordinate system in which the second display is located to the control device 310. The control device 310 may transmit and receive positioning information between the first display device 320 and the second display device 330 to determine the pointing direction of the control device 310 and a first attitude of the first display unit and the second display unit relative to the control device 320, determine the position of the intersection of the pointing direction of the control device 310 and the plane on which the first display unit is located, or the position of the intersection of the pointing direction of the control device 310 and the plane on which the second display unit is located (i.e., the pointing position of the control device 310), and when the pointing position of the control device 310 is on the first display unit, transmit the pointing position of the control device 310 to the first display device 320 so that the first display device 320 displays a cursor at the pointing position of the control device 310. Alternatively, when the pointing position of the control device 310 is on the second display, the control device 310 can transmit the pointing position of the control device 310 to the second display device 330, so that the second display device 330 displays a cursor at the pointing position of the control device 310. Positioning information can be transmitted and received between the first display device 320 and the control device 310, or between the second display device 330 and the control device 310, by using the respective wireless positioning units.

[0234] For example, see Figure 17. Figure 17 is a flowchart of a device display control method according to an embodiment of the present application. As shown in Figure 17, the device display control method provided in this embodiment of the present application may include the following steps S1701 to S1707.

[0235] S1701: The control device 310 establishes a communication connection to the first display device 320 and the second display device 330.

[0236] For a specific description of the control device 310 establishing a communication connection to the first display device 320 and the second display device 330, please refer to the above-mentioned process in which the control device 310 establishes a communication connection to the first display device 320 in step S701. The details will not be described again in this specification.

[0237] S1702: The first display device 320 determines a first coordinate system in which the display of the first display device 320 (ie, the first display) is located.

[0238] For a specific description of S1702, please refer to the above description of S702, and the details will not be described again in this specification.

[0239] S1703: The first display device 320 transmits first information to the control device 310, where the first information includes a first coordinate system in which the first display is located and a size of the first display.

[0240] For a specific description of S1703, please refer to the above description of S703, and the details will not be described again in this specification.

[0241] S1704: The second display device 330 determines a second coordinate system in which the display of the second display device 330 (ie, the second display) is located.

[0242] For a specific description of S1704, please refer to the above process in which the first display device 320 determines the first coordinate system in which the first display is located in step S702. The details will not be described again in this specification.

[0243] S1705: The second display device 330 transmits third information to the control device 310, where the third information includes a second coordinate system in which the second display is located and a size of the second display.

[0244] For a specific description of S1705, please refer to the above process in which the first display device 320 sends the first information to the control device 310 in step S703. The details will not be described again in this specification.

[0245] S1706: The control device 310 determines a pointing direction of the control device 310, a first orientation of the first display relative to the control device 310, and a second orientation of the second display relative to the control device 310.

[0246] Please refer to the above description of S704 for a specific description of the control device 310 determining the pointing direction of the control device 310 and the first attitude of the first display relative to the control device 310. Please refer to the above process of the control device 310 determining the first attitude of the first display relative to the control device 310 in step S704 for a specific description of the control device 310 determining the second attitude of the second display relative to the control device 310. The details will not be described again in this specification.

[0247] S1707: The control device 310 determines a first position to which the control device 310 points on a plane on which the first display is located and a second position to which the control device 310 points on a plane on which the second display is located.

[0248] For a specific description of the control device 310 determining the first position to which the control device 310 points on the plane on which the first display is located, please refer to the above description of S705. For a specific description of the control device 310 determining the second position to which the control device 310 points on the plane on which the second display is located, please refer to the above process in which the control device 310 determines the first position to which the control device 310 points on the plane on which the first display is located in step S705. The details will not be described again in this specification.

[0249] If the first position is on the first display, the first display device 320 executes S1709-1 after the control device 310 executes S1708-1. If the second position is on the second display, the second display device 330 executes S1709-2 after the control device 310 executes S1708-2.

[0250] S1708-1: The control device 310 transmits second information to the first display device 320, where the second information includes coordinate information of the first position.

[0251] For a specific description of S1708-1, please refer to the above description of S706, and the details will not be described again in this specification.

[0252] S1709-1: The first display device 320 displays a cursor at the first position based on the second information.

[0253] For a specific description of S1709-1, please refer to the above description of S707, and the details will not be described again in this specification.

[0254] S1708-2: The control device 310 transmits fourth information to the second display device 330, where the fourth information includes coordinate information of the second position.

[0255] For a specific description of S1708-2, please refer to the above process in which the control device 310 sends the second information to the first display device 320 in step S706. The details will not be described again in this specification.

[0256] S1709-2: The second display device 330 displays the cursor at the second position based on the fourth information.

[0257] For a specific description of S1709-2, please refer to the above-mentioned process in which the first display device 320 displays the cursor at the first position based on the second information in step S707. The details will not be described again in this specification.

[0258] In some embodiments, a first position pointed to by the control device 310 on a plane on which a first display is located is on the first display, but a second position pointed to by the control device 310 on a plane on which a second display is located is not on the second display. In this case, the control device 310 does not perform S1708-2, and the second display device 330 does not perform S1709-2.

[0259] In some embodiments, a first position pointed to by the control device 310 on a plane on which a first display is located is not on the first display, but a second position pointed to by the control device 310 on a plane on which a second display is located is on the second display. In this case, the control device 310 does not perform S1708-1, and the first display device 320 does not perform S1709-1.

[0260] In some embodiments, a first position pointed to by the control device 310 on a plane on which a first display is located is on the first display, and a second position pointed to by the control device 310 on a plane on which a second display is located is on the second display. In this case, for example, the control device 310 executes both S1708-1 and S1708-2, causing the first display device 320 to execute S1709-1 and the second display device 330 to execute S1709-2. In another example, the control device 310 executes both S1708-1 and S1708-2. The first display device 320 and the second display device 330 negotiate to determine whether the first display or the second display will display the cursor. The first display device 320 executes S1708-1 if it is determined that the first display is displaying the cursor, and the second display device 330 executes S1708-2 if it is determined that the second display is displaying the cursor. Factors considered during negotiation between the first display device 320 and the second display device 330 may include, but are not limited to, one or more of the following: the distance between the display device and the control device, the capabilities of the display device, whether an interface with content is displayed on the display device, the display device on which the cursor was most recently displayed, etc. This is not specifically limited in this embodiment of the present application. In another example, the control device 310 may determine whether the first display or the second display will display the cursor based on preset rules. If it is determined that the first display is displaying the cursor, the control device 310 executes S1708-1, and then the first display device 320 executes S1709-1, or if it is determined that the second display is displaying the cursor, the control device 310 executes S1708-2, and then the first display device 320 executes S1709-2. Pre-set rules such as one or more of proximity priority, continuity priority, and original display device priority are not specifically limited in this embodiment of the present application.

[0261] It should be noted that in the above-described embodiment, the first coordinate system constructed by the first display device 320 and the second coordinate system constructed by the second display device 320 may be constructed based on the actual plane on which the respective displays of the first display device 320 and the second display device 320 are located, i.e., the first coordinate system is different from the second coordinate system, which is used only as an example. In some embodiments, the first display device 320 and the second display device 320 may alternatively construct a unified coordinate system. In this case, the first display device 320 also transmits coordinate information of the first display in the unified coordinate system to the control device 310, and the second display device 330 also transmits coordinate information of the second display in the unified coordinate system to the control device 310, so that the control device 310 performs subsequent confirmation of the first position and the second position based on this.

[0262] It will be understood that in the device display control method provided in this embodiment of the present application, whether a display displays a cursor and which display device displays the cursor at which position are determined based on the position pointed to by the control device on the plane on which the displays are located. Therefore, regardless of the orientation relationship between the multiple display devices, the orientation relationship between the multiple display devices does not need to be configured in advance, and the control device can calculate the specific position to which the control device points. If the pointing position of the control device is not on the display of any of the display devices, the display device does not display the cursor. Only when the pointing position of the control device enters the edge region of the display of the display device, does the display device display the cursor at the pointing position of the control device 310. Therefore, in a multi-display device scenario, this solution can also bring users a convenient, immersive, and accurate cursor control and device control experience.

[0263] For example, the cursor changes from displaying on a first display to displaying on a second display, and the position of the first display is close to the position of the second display. See Figures 18A and 18B. Figures 18A and 18B are flowcharts of a cursor traversal process according to an embodiment of the present application. As shown in Figures 18A and 18B, the cursor traversal process provided in this embodiment of the present application may include S1801 to S1813 (S1801 to S1809 are presentation stages of the first display, and S1810 to S1813 are presentation stages of the second display).

[0264] S1801: The control device 310 establishes a communication connection to the first display device 320 and the second display device 330.

[0265] S1802: The first display device 320 determines a first coordinate system in which the first display is located.

[0266] S1803: The first display device 320 transmits first information to the control device 310, where the first information includes a first coordinate system in which the first display is located and a size of the first display.

[0267] S1804: The second display device 330 determines a second coordinate system in which the second display is located.

[0268] S1805: The second display device 330 transmits third information to the control device 310, where the third information includes a second coordinate system in which the second display is located and a size of the second display.

[0269] S1806: The control device 310 determines a first pointing direction of the control device 310, a first orientation of the first display relative to the control device 310, and a second orientation of the second display relative to the control device 310.

[0270] S1807: The control device 310 determines a first position to which the control device 310 points on a plane on which the first display is located and a second position to which the control device 310 points on a plane on which the second display is located, the first position being on the first display.

[0271] S1808: The control device 310 transmits second information to the first display device 320, where the second information includes coordinate information of the first position.

[0272] S1809: The first display device 320 displays a cursor at the first position based on the second information.

[0273] S1810: The control device 310 determines a second pointing direction of the control device 310, a third orientation of the first display relative to the control device 310, and a fourth orientation of the second display relative to the control device 310.

[0274] S1811: The control device 310 determines a third position to which the control device 310 points on a plane on which the first display is located and a fourth position to which the control device 310 points on a plane on which the second display is located, the fourth position being on the second display.

[0275] S1812: The control device 310 transmits fifth information to the second display device 330, where the fifth information includes coordinate information of the fourth position.

[0276] S1813: The second display device 330 displays the cursor at the fourth position based on the fifth information.

[0277] For example, see Fig. 19. Fig. 19 shows that when the position of the first display is close to the position of the second display, based on the cursor traversal process shown in Fig. 18A and Fig. 18B, an effect in which the cursor shown in Fig. 19 traverses and is displayed from the first display to the second display can be implemented. The entire process is convenient for users to operate and can bring users an immersive and accurate cursor control and device control experience.

[0278] In another example, the cursor changes from a display on a first display to a display on a second display, and the first display is far away from the second display. See FIGS. 20A and 20B. FIGS. 20A and 20B are flowcharts of another cursor traversal process according to an embodiment of the present application. As shown in FIGS. 20A and 20B, the cursor traversal process provided in this embodiment of the present application may include S2001 to S2015 (S2001 to S2009 are the first display presentation stages, S2010 and S2011 are cursor traversal stages, and S2012 to S2015 are the second display presentation stages).

[0279] S2001: The control device 310 establishes a communication connection to the first display device 320 and the second display device 330.

[0280] S2002: The first display device 320 determines a first coordinate system in which the first display is located.

[0281] S2003: The first display device 320 transmits first information to the control device 310, where the first information includes a first coordinate system in which the first display is located and a size of the first display.

[0282] S2004: The second display device 330 determines a second coordinate system in which the second display is located.

[0283] S2005: The second display device 330 transmits third information to the control device 310, where the third information includes a second coordinate system in which the second display is located and a size of the second display.

[0284] S2006: The control device 310 determines a first pointing direction of the control device 310, a first orientation of the first display relative to the control device 310, and a second orientation of the second display relative to the control device 310.

[0285] S2007: The control device 310 determines a first position to which the control device 310 points on a plane on which the first display is located and a second position to which the control device 310 points on a plane on which the second display is located, the first position being on the first display.

[0286] S2008: The control device 310 transmits second information to the first display device 320, where the second information includes coordinate information of the first position.

[0287] S2009: The first display device 320 displays a cursor at the first position based on the second information.

[0288] S2010: The control device 310 determines a third pointing direction of the control device 310, a fifth orientation of the first display relative to the control device 310, and a sixth orientation of the second display relative to the control device 310.

[0289] S2011: The control device 310 determines a fifth position to which the control device 310 points on a plane on which the first display is located and a sixth position to which the control device 310 points on a plane on which the second display is located, the fifth position not being on the first display and the sixth position not being on the second display.

[0290] S2012: The control device 310 determines a second pointing direction of the control device 310, a third orientation of the first display relative to the control device 310, and a fourth orientation of the second display relative to the control device 310.

[0291] S2013: The control device 310 determines a third position to which the control device 310 points on the plane on which the first display is located and a fourth position to which the control device 310 points on the plane on which the second display is located, the fourth position being on the second display.

[0292] S2014: The control device 310 transmits fifth information to the second display device 330, where the fifth information includes coordinate information of the fourth position.

[0293] S2015: The second display device 330 displays the cursor at the fourth position based on the fifth information.

[0294] For example, see FIG. 21. FIG. 21 shows that when the first display is far away from the second display, the effect of the cursor shown in FIG. 21 traversing from the first display to the second display and being displayed can be implemented based on the cursor traversal process shown in FIGS. 20A and 20B. The entire process is convenient for users to operate and can bring users an immersive and accurate cursor control and device control experience. In addition, as shown in FIGS. 19 and 21, it can be learned that the accurate display of the cursor is not affected no matter how long the distance between the displays of the first display device 320 and the second display device 330 is.

[0295] In addition, in the device display control method provided in this embodiment of the present application, whether the display displays a cursor and the specific presentation position of the cursor when the cursor is displayed on the display are determined based on the position the control device points to on the plane on which the display is located. Thus, when the display attitude of any display device changes, the accurate traversal of the cursor as it continues remains unaffected.

[0296] For example, the position of the display of the first display device 320 changes. See FIGS. 22A and 22B. FIGS. 22A and 22B are flowcharts of another cursor traversal process according to an embodiment of the present application. As shown in FIGS. 22A and 22B, the cursor traversal process provided in this embodiment of the present application may include S2201 to S2215 (S2201 to S2209 are first display presentation stages, S2210 and S2211 are information update stages, and S2212 to S2215 are second display presentation stages).

[0297] S2201: The control device 310 establishes a communication connection to the first display device 320 and the second display device 330.

[0298] S2202: The first display device 320 determines a first coordinate system in which the first display is located.

[0299] S2203: The first display device 320 transmits first information to the control device 310, where the first information includes a first coordinate system in which the first display is located and a size of the first display.

[0300] S2204: The second display device 330 determines a second coordinate system in which the second display is located.

[0301] S2205: The second display device 330 transmits third information to the control device 310, where the third information includes a second coordinate system in which the second display is located and a size of the second display.

[0302] S2206: The control device 310 determines a first pointing direction of the control device 310, a first orientation of the first display relative to the control device 310, and a second orientation of the second display relative to the control device 310.

[0303] S2207: The control device 310 determines a first position to which the control device 310 points on a plane on which the first display is located and a second position to which the control device 310 points on a plane on which the second display is located, the first position being on the first display.

[0304] S2208: The control device 310 transmits second information to the first display device 320, where the second information includes coordinate information of the first position.

[0305] S2209: The first display device 320 displays the cursor at the first position based on the second information.

[0306] S2210: If the orientation of the first display device 320 has changed, the first display device 320 determines a third coordinate system in which the first display is located.

[0307] S2211: The first display device 320 sends sixth information to the control device 310, where the sixth information includes a third coordinate system in which the first display is located and a size of the first display.

[0308] S2212: The control device 310 determines a fourth pointing direction of the control device 310, a seventh orientation of the first display relative to the control device 310, and an eighth orientation of the second display relative to the control device 310.

[0309] S2213: The control device 310 determines a seventh position to which the control device 310 points on the plane on which the first display is located and an eighth position to which the control device 310 points on the plane on which the second display is located, the eighth position being on the first display.

[0310] S2214: The control device 310 transmits seventh information to the second display device 330, where the seventh information includes coordinate information of the eighth position.

[0311] S2215: The second display device 330 displays the cursor at the eighth position based on the seventh information.

[0312] For example, the first display device 320 is a projector. If the position or angle of the projector shifts, for example, if it changes from the orientation shown in FIG. 23(a) to the orientation shown in FIG. 23(b), the orientation of the projector's display carrier changes. The projector updates the size of the projector's display carrier and the coordinate system in which the display carrier is located relative to the control device 310 (e.g., the coordinate origin changes from O1 to O1', the X1 axis changes to the X1' axis, the Y1 axis changes to the Y1' axis, and the Z1 axis changes to the Z1' axis), and the control device 310 also acquires the orientation of the display carrier relative to the control device 310 in real time. Therefore, as shown in FIG. 23, after the orientation of the projector changes, the control device 310 can still implement accurate control over cursor presentation on the new projection interface.

[0313] In another example, the first display device 320 is a projector. When the display size parameters of the projector change, the size of the display carrier of the projector changes. For example, the size shown in FIG. 24(a) changes to the size shown in FIG. 24(b). The projector updates the size of the display carrier of the projector and the coordinate system in which the display carrier is located to the control device 310 (e.g., the coordinate origin changes from O1 to O1', the X1 axis changes to the X1' axis, the Y1 axis changes to the Y1' axis, and the Z1 axis changes to the Z1' axis), and the control device 310 also acquires the orientation of the display carrier relative to the control device 310 in real time. Therefore, as shown in FIG. 23, after the display size parameters of the projector change, the control device 310 can still implement accurate control over cursor presentation on the new projection interface.

[0314] In addition, based on the device display control method provided in this embodiment of the present application, in the process of the cursor traversing between the first display device 320 and the second display device 330, the first display device 320 and the third display device 330 display the cursor separately based on the pointing position of the control device 310 and the specific attributes of the first display device 320 and the second display device 330, such as the display type, size, and display resolution. Therefore, even if the first display device 320 and the second display device 330 have different attributes, such as the type, size, and resolution, in the process of the cursor traversing from the first display device 320 to the second display device 330, the cursor can still traverse continuously and smoothly, which improves the user's control experience.

[0315] For example, see FIG. 25. FIG. 25 is a schematic diagram of a process in which a cursor traverses between display devices with different attributes according to an embodiment of the present application, using an example in which the first display device 320 is a projector and the second display device 330 is a television. As shown in FIG. 25, even if the projector and the television have different attributes, such as their types, display sizes, and display resolutions, before the cursor traverses from the projector's display carrier to the television, the projector determines the pointing position of the control device based on the coordinate system in which the projector's display carrier is located, the size of the projector's display carrier, and the orientation of the projector's display carrier relative to the control device, and displays the cursor in combination with the projector's actual attributes. In addition, after the cursor traverses from the projector's display carrier to the television, the television determines the pointing position of the control device based on the coordinate system in which the television's display is located, the size of the television's display, and the orientation of the television's display relative to the control device, and displays the cursor in combination with the television's actual attributes. Therefore, the entire cursor traversal process is not affected by different attributes of the device, and the cursor can traverse continuously and smoothly, which improves the user's control experience.

[0316] It should be noted that in the above-described embodiment in the multi-display device scenario, the display device transmits the coordinate system in which the display of the display device is located to the control device 310, and the control device 310 determines the pointing direction of the control device 310, the attitude of the display relative to the control device 320, and the position of the intersection between the pointing direction of the control device 310 and the plane in which the display is located (i.e., the pointing position of the control device 310), which is used only as an example. In actual application, the execution entity for determining the pointing position of the control device 310 is not limited. For example, each display device can alternatively determine the position of the intersection between the pointing direction of the control device 310 and the plane in which the display of the display device is located. For this implementation, please refer to the implementation process of the related embodiment in scenario 1. The details will not be described again in this specification.

[0317] In addition, in the above-described embodiment of the multi-display device scenario, the cursor traversing from the first display device to the second display device is only used as an example. In actual application, the actual traversal scenario of the cursor is not limited. For example, the cursor may alternatively traverse from the second display device to the first display device.

[0318] In addition, in the above-described embodiment of a multi-display device scenario, the first display device and the second display device are merely used as examples. In actual application, the number of display devices is not limited. If the scenario further includes a third display device, the above-described process of the cursor traversing between the first display device and the second display device can be referred to. Details will not be described again in this specification.

[0319] It should be noted that in the above-mentioned scenario 2, the cursor following the movement trajectory of the control device and traversing between the first display and the second display is used merely as an example. During actual application, the specific interface effect displayed may be determined based on the specific application scenario, the device's capabilities, etc. For example, in scenario 2, an effect of traversing components, virtual images, viewing angle effects, special effects, etc. between the first display and the second display may alternatively be implemented. In another example, in scenario 2, an effect of the interface effect changing after traversal may alternatively be implemented.

[0320] For example, when the first display and the second display are in the same game scenario and the pointing position of the control device traverses from the first display to the second display, a game hero image, game equipment, game special effects (e.g., bubble special effects, fireworks special effects, targeting special effects, or hit special effects), etc. may also traverse from the first display to the second display synchronously.

[0321] In another example, a first display is in a game scenario and a second display is in a handwriting tablet scenario, and when the pointing position of the control device traverses from the first display to the second display, the interface effect changes synchronously from a game hero image, game equipment, game special effects (e.g., bubble special effects, firework special effects, targeting special effects, or hit special effects), etc. to a stylus image, handwriting, etc.

[0322] In another example, a first display is in a game scenario and a second display is in a demonstration scenario, and when the pointing position of the control device traverses from the first display to the second display, the interface effect changes synchronously from a game hero image, a game device, a game special effect (e.g., a bubble special effect, a fireworks special effect, a targeting special effect, or a hit special effect), etc. to a cursor.

[0323] Similarly, the interface effect may not change after traversal when the first display and the second display are in the same writing tablet scenario, the same demonstration scenario, etc. Alternatively, the interface effect may change after traversal when the first display is in a writing tablet scenario and the second display is in a game scenario, or when the first display is in a demonstration scenario and the second display is in a game scenario, or when the first display is in a demonstration scenario and the second display is in a writing tablet scenario, or when the first display is in a writing tablet scenario and the second display is in a demonstration scenario, etc. The details will not be described again herein.

[0324] In the aforementioned Scenario 2, the interface effects displayed on the first display or the second display may alternatively include, but are not limited to, displaying a display object (such as an icon, component, virtual image, or image) at the pointing position of the control device, displaying a corresponding viewing angle effect based on the pointing position of the control device, displaying a preset special effect in a corresponding display area (such as a preset control hot area) based on the pointing position of the display control device, etc. This is not specifically limited in this embodiment of the present application and is determined based on the actual application scenario, device functions, etc.

[0325] In addition, in the aforementioned Scenario 2, when the pointing position of the control device moves outside the edge region of the first display and does not enter the edge region of the second display, the first display may no longer update the interface effect or may no longer display any interface effect, which is not specifically limited in this embodiment of the present application and is determined based on the actual application scenario, device functions, etc.

[0326] When the positioning process between the control device and the display device is described above, it is mentioned that the positioning of the pointing position and cursor presentation can be implemented in a manner such as multi-antenna UWB or three-dimensional electromagnetic coil positioning. The following more specifically provides one possible implementation of a positioning system according to one embodiment of the present application.

[0327] 26 is a diagram of a possible positioning system architecture according to one embodiment of the present application. Refer to FIG. 26. The system includes a first electronic device 100 and a second electronic device 200. A first antenna array 120 is disposed on the first electronic device 100, and a second antenna array 220 is disposed on the second electronic device 200. The first antenna array 120 can establish a three-dimensional coordinate system based on the relative position of the first antenna array 120 on the first electronic device 100. The positions of the first antenna array 120 and the second antenna array 220 relative to each other can be determined, and as a result, the coordinates of the second antenna array 220 are accurately displayed on a display interface of the first electronic device 100.

[0328] For example, the first electronic device 100 may be a television, a computer, a projector, or another electronic device with a display interface, i.e., the first display device 320 or the second display device 320 described above. The second electronic device 200 may be a remote control, a mobile phone, or another electronic device with a remote control function on the first electronic device 100, i.e., the control device 310 described above. The specific forms of the first electronic device 100 and the second electronic device 200 are not limited in this application. In this embodiment, for ease of explanation, an example in which the first electronic device 100 is a large screen with a display function and the second electronic device 200 is a remote control is used. The remote control may be referred to as a pointing remote control. For example, after the remote control is paired with a television, the relative positions of the first antenna array 120 in the television and the second antenna array 220 in the remote control may be determined, and the coordinates of the remote control may be displayed on the television screen. The coordinates may be displayed on the screen in patterns such as dots, arrows, stars, crosses, or handprints.

[0329] 27 is a schematic diagram of the structure of a first electronic device 100 according to an embodiment of the present application. Refer to Fig. 27. The first electronic device 100 may include a processor 140, a transmission interface, a power supply module 110, a first antenna array 120, a first modular circuit 130, etc.

[0330] It can be understood that the structure shown in this embodiment of the present invention does not constitute a specific limitation on the first electronic device 100. In some other embodiments of the present application, the first electronic device 100 may include more or fewer components than those shown in the figure, may combine some components, may split some components, or may have a different component arrangement. The components shown in the figure may be implemented by hardware, software, or a combination of software and hardware. In addition, the interface connection relationships between modules shown in this embodiment of the present invention are merely examples for explanation and do not constitute a limitation on the structure of the first electronic device 100. In some other embodiments of the present application, the first electronic device 100 may alternatively use different interface connection schemes or a combination of multiple interface connection schemes.

[0331] The processor 140 may include one or more processing units. Different processing units may be separate components or may be integrated into one or more processors. For example, the processor 210 may be a central processing unit (CPU), or an application specific integrated circuit (ASIC), or may be configured as one or more integrated circuits implementing embodiments of the present application, such as one or more microprocessors (digital signal processors, DSPs) or one or more field programmable gate arrays (FPGAs).

[0332] The transmitting interface 150 may be a wired interface, such as a Universal Serial Bus (USB) port, or may be a standard wireless interface, such as a Business Transaction Events (BTE)-related interface. The transmitting interface 150 may be configured to connect to a charger to charge the first electronic device 100, or to transmit data between the first electronic device 100 and a peripheral device, for example, to transmit data between the first electronic device 100 and the second electronic device 200.

[0333] The power supply module 110 is configured to provide power to the components of the first electronic device 100 , such as the processor 140 .

[0334] FIG. 28 is a diagram illustrating the arrangement of the first antenna array 120 on the first electronic device 100 according to one embodiment of the present application. Please refer to FIG. 28. The first antenna array 120 can be arranged at any position on the first electronic device 100. For example, the first antenna array 120 may be arranged outside the first electronic device 100, for example, on the frame of the first electronic device 100, or on an object at a specific distance from the first electronic device 100. The "object" may be an independent device, such as a desk or a rack. The first electronic device 100 and the first antenna array 120 may be arranged on different racks at a specific distance from each other. Of course, the first antenna array 120 may alternatively be arranged inside the electronic device in a hidden or semi-hidden manner. This is not limited in this embodiment.

[0335] For example, if a remote control is used to control the movement of a cursor on a display, an acceleration sensor and a gyroscope sensor may be placed on the remote control to detect the rotational and translational states of the remote control. The relative displacement of the remote control with respect to the display is calculated based on the values read by the sensors. The displacement can be converted into cursor movement on the display, thereby implementing interaction between the remote control and the display. However, with this design, only the relative displacement of the remote control with respect to the display can be obtained, and the remote control cannot fit to the size of the display. As a result, the absolute displacement of the remote control within the size of the display cannot be obtained, and when the remote control is operated to change the actual pointing direction and displacement, the cursor movement on the display does not correspond to the user's actual intention. For example, when the remote control is pointing to a position beyond the display, the cursor remains displayed on the display. When the remote control is moved, the cursor can be further controlled to move. As a result, the exact pointing direction and exact position cannot be detected in the overall remote control identification.

[0336] Therefore, in this embodiment of the present application, another design is considered. Specifically, the first antenna array 120 is disposed on the first electronic device 100 side, and the second antenna array 220 is disposed on the second electronic device 200 side. Both the first antenna array 120 and the second antenna array 220 can transmit and receive signals, and the positions of the antenna arrays relative to each other can be determined. In this manner, the absolute coordinates of the second antenna array 220 relative to the first electronic device 100 can be obtained. The second antenna array 220 can accurately point to a position specified by the first electronic device 100. Specifically, after the position of the first antenna array 120 on the first electronic device 100 is determined, the first antenna array 120 can establish a three-dimensional coordinate system based on the relative position of the first antenna array 120 on the first electronic device 100. The relative position of the first antenna array 120 with respect to the display interface 160 of the first electronic device 100 is also included in the three-dimensional coordinate system. When the positions of the first antenna array 120 and the second antenna array 220 relative to each other on the second electronic device 200 are determined, if the detected coordinates of the second antenna array 220 do not exceed the range of the display interface 160, the coordinates of the second antenna array 220 may be accurately displayed within the range of the display interface 160, or if the coordinates of the second antenna array 220 exceed the range of the display interface 160, the coordinates of the second antenna array 220 may not be displayed within the display interface 160, so that the problem of inaccurate pointing may be avoided.

[0337] The first antenna array 120 may specifically include a plurality of first antenna elements 120a, which are arranged based on a specified positional relationship. For example, FIG. 29 is a schematic diagram showing an arrangement of the first antenna elements 120a. See FIG. 29. There are three first antenna elements 120a, and the three first antenna elements 120a are arranged in an "L" shape. FIG. 30 is a schematic diagram showing another arrangement of the first antenna elements 120a. See FIG. 30. There are four first antenna elements 120a, and the four first antenna elements 120a are arranged in a "rectangle" shape. FIG. 31 is a schematic diagram showing yet another arrangement of the first antenna elements 120a. See FIG. 31. There are three first antenna elements 120a, and the three first antenna elements 120a are arranged in an "isosceles triangle" shape. In each of the arrangements of the at least three first antenna elements 120a, at least two antennas are respectively distributed in a first direction X and a second direction Y, where the first direction X is perpendicular to the second direction Y. The first direction X may be used as the horizontal axis of a three-dimensional coordinate system, and the second direction Y may be used as the vertical axis of the three-dimensional coordinate system. There may be a specified geometric relationship between a plane including the first direction X and the second direction Y and the display interface of the first electronic device 100. This may facilitate calculation of the coordinates of the second antenna array 220.

[0338] The second antenna array 220 can transmit a first signal, and the first antenna array 120 can receive the first signal. Correspondingly, the first antenna array 120 can transmit a second signal, and the second antenna array 220 can receive the second signal. The first antenna array 120 and the second antenna array 220 can operate at ultra high frequency (UHF). UHF covers 3 GHz to 30 GHz. For example, operating frequencies that can be used are 5.8 GHz, 7.9 GHz, 24 GHz, etc. The ultra wide band (UWB) frequency band can cover 7.9 GHz.

[0339] 27 , the first modular circuit 130 may include a control unit 131, a transmitter 133, a receiver 134, a calculation unit 132, etc. The control unit 131 can control the transmitter 133 and the calculation unit 132 to operate. The transmitter 133 is configured to control the first antenna array 120 to transmit a second signal. The receiver 134 is configured to control the first antenna array 120 to receive a first signal from the second antenna array 220. The calculation unit 132 may calculate a phase parameter in the received first signal and feed back the calculation result to the control unit 131. The control unit 131 can further calculate a first coordinate of the second antenna array 220 based on the result fed back by the calculation unit 132.

[0340] In addition, Figure 32 is a schematic diagram of the structure of a second electronic device 200 according to an embodiment of the present application. Please refer to Figure 32. The second electronic device 200 may also have the aforementioned components of the first electronic device 100. Specifically, the second electronic device 200 may include a processor 240, a transmitting interface 250, a power supply module 210, a second antenna array 220, a second modular circuit 230, etc. The processor 240, the transmitting interface 250, and the power supply module 210 in the second electronic device 200 have the same functions as the processor 140, the transmitting interface 150, and the power supply module 110 in the first electronic device 100. The details will not be described again herein.

[0341] The second antenna array 220 is configured to transmit a first signal and receive a second signal. The second modular circuit 230 is electrically connected to the second antenna array 220 and configured to measure a deflection angle of the second antenna array 220 relative to the first direction and the second direction based on the second signal.

[0342] As described above, in this embodiment, to obtain the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100, the positions of the first antenna array 120 and the second antenna array 220 relative to each other need to be determined. Specifically, the relative coordinates of the second antenna array 220 relative to the first antenna array 120, i.e., the first coordinates, need to be obtained by the first antenna array 120 based on the first signals transmitted by the second antenna array 220. The first coordinates can be used to determine the spatial position of the second antenna array 220.

[0343] In addition, the second antenna array 220 is disposed on the second electronic device 200. When the second electronic device 200 is operated, the second electronic device 200 can freely rotate at the position indicated by the first coordinate to drive and rotate the second antenna array 220. Such rotation affects the phase of the signal received by the second antenna array 220, and the value of the first coordinate in the first direction and the second direction is changed. As a result, the actual pointing position of the second antenna array 220 does not correspond to the position indicated by the first coordinate. Therefore, in this embodiment, the rotation of the second electronic device 200 is taken into account. After the first antenna array 120 obtains, through positioning, the first coordinates of the second antenna array 220 based on the first signal transmitted by the second antenna array 220, the second antenna array 220 can obtain, through positioning, the deflection angles of the second antenna array 220 relative to the first direction X and the second direction Y based on the second signal transmitted by the first antenna array 120. The final second coordinates can be further obtained based on the first coordinates and the deflection angles.

[0344] In some embodiments, when the radiation plane of the first antenna array 120 is parallel to the display interface 160 of the first electronic device 100, the second coordinate is the position of a cursor that can be displayed on the first electronic device 100 through an operation on the second electronic device 200. In some other embodiments, when the radiation plane of the first antenna array 120 is not parallel to the display interface 160 of the first electronic device, the second coordinate needs to be further transformed based on the physical positional relationship between the first antenna array 120 and the display interface 160 to obtain the position of the cursor that is displayed on the display interface 160 after the transformation.

[0345] 32 . The second modular circuit 230 may also include a control unit 231, a transmitter 233, a receiver 234, a calculation unit 232, etc. The control unit 231 can control the transmitter 233 and the calculation unit 232 to operate. The transmitter 233 is configured to control the second antenna array 220 to transmit a first signal. The receiver 234 is configured to control the second antenna array 220 to receive a second signal from the first antenna array 120. The calculation unit 232 may calculate a phase parameter in the received second signal and feed back the calculation result to the control unit 231. The control unit 231 can further calculate a deflection angle of the second antenna array 220 based on the result fed back by the calculation unit 232.

[0346] The first modular circuit 130 or the second modular circuit 230 may be configured to calculate a second coordinate based on the first coordinate and the deflection angle. In one embodiment, after obtaining the deflection angle, the second antenna array 220 may transmit the deflection angle to the first modular circuit 130 via the transmission interface. The first modular circuit 130 may calculate a second coordinate based on the first coordinate and the deflection angle. In another embodiment, after obtaining the deflection angle, the second antenna array 220 may obtain the second coordinate through calculation by using the second modular circuit 230 and then transmit the second coordinate to the first modular circuit 130 via the transmission interface. If the second coordinate is within the size range of the display interface of the first electronic device 100, the second coordinate may be displayed on the first electronic device 100.

[0347] Therefore, according to the system provided in this embodiment of the present application, the first antenna array 120 is disposed on the first electronic device 100, and the second antenna array 220 is disposed on the second electronic device 200, so that long-distance interaction between the first electronic device 100 and the second electronic device 200 can be implemented without needing to rely on a moving plane. Furthermore, the positions of the first antenna array 120 and the second antenna array 220 relative to each other can be determined to obtain the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100. The positioning of the second antenna array 220 becomes more accurate, and the operation experience in spatial pointing operation is improved.

[0348] Optionally, see FIG. 3 . At least three first antenna elements 120 a are arranged, and at least two second antenna elements are arranged. The distance L between any two first antenna elements 120 a having a signal receiving function among the at least three first antenna elements 120 a is equal to or less than the wavelength λ of the first signal. The first antenna array 120 and the second antenna array 220 may have the same arrangement configuration. For example, the first antenna array 120 includes three first antenna elements 120 a, and the second antenna array 220 includes three second antenna elements, and the three first antenna elements 120 a and the three second antenna elements have the same arrangement configuration. Of course, in some other embodiments, the first antenna array 120 and the second antenna array 220 may alternatively have different arrangement configurations. For example, the first antenna array 120 includes three first antenna elements 120a, and the second antenna array 220 includes two second antenna elements, and the three first antenna elements 120a and the two second antenna elements have different arrangement configurations.

[0349] In this embodiment, the configuration of the first antenna array 120 is used as an example for illustration.

[0350] It can be understood that the wavelength can be obtained through calculations based on the wave speed and frequency. In this embodiment, the first antenna array 120 needs to receive a first signal transmitted by the second antenna array 220. The wavelength of the first signal can be obtained through calculations based on the frequency of the first signal and the wave speed of electromagnetic waves. The distance between any two first antenna elements 120a is limited based on the wavelength. Because the shape of the antenna is not absolutely regular, the equivalent center of the antenna can be used as the start or end point of the calculated distance. That is, the distance between any two first antenna elements 120a is the distance between the equivalent centers of the antennas. The distance between any two first antenna elements 120a with signal reception function is guaranteed to be equal to or less than the wavelength of the first signal. As a result, the first antenna elements 120a configured to receive the signal can receive the first signal approximately simultaneously. Each first antenna element 120a can obtain a phase parameter based on the first signal, and the first coordinate can be further obtained through calculations based on the phase parameter.

[0351] Correspondingly, Figure 33 is a diagram illustrating the arrangement of the second antenna array 220 on the second electronic device 200 according to an embodiment of the present application. Please refer to Figure 33. The second antenna elements in the second antenna array 220 can be configured to receive the second signal transmitted by the first antenna array 120. The distance L' between any two second antenna elements is ensured to be equal to or less than the wavelength λ of the second signal, so that the second antenna elements configured to receive the signal can receive the second signal substantially simultaneously, and each second antenna element can obtain a phase parameter based on the second signal and a deflection angle based on the phase parameter.

[0352] That is, in this embodiment, the distance between any two first antenna elements 120a and the distance between any two second antenna elements are both guaranteed to be less than the wavelength of the corresponding received signal, so that the first coordinate and deflection angle can be obtained based on the phase parameters of the received signal. In this way, positioning of the second antenna array 220 in three-dimensional space can be implemented, and the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100 can be obtained. This improves the positioning accuracy and improves the experience of operating the second electronic device 200.

[0353] The first modular circuit 130 includes one or more receivers 134. For example, if there is one receiver 134, the receiver 134 may be electrically connected to the second antenna 122, the third antenna 123, and the first antenna 121 separately using a high-speed switch, so that the signal reception functions of the three first antenna elements 120a can be implemented using the single receiver 134. The three antennas receive signals approximately simultaneously, and a first coordinate can be calculated based on the phase difference between the first antenna elements 120a. In addition, if there are multiple receivers 134, each receiver 134 is connected to a corresponding first antenna element 120a. Synchronization can be performed between the receivers 134 using a synchronization signal to obtain the phase difference between the first antenna elements 120a.

[0354] Correspondingly, the second modular circuit 230 also includes one or more receivers 234, and the arrangement of the receivers 234 and second antenna elements in the second modular circuit 230 may be the same as the arrangement of the receivers 134 and first antenna elements in the first modular circuit 130. For example, if one receiver 234 is present, the one receiver 234 is electrically connected to each second antenna element, and the one receiver 234 can implement the signal reception function of three second antenna elements. If multiple receivers 234 are present, each receiver 234 is connected to a corresponding second antenna element. Synchronization can be performed between the receivers 234 using a synchronization signal, so that the three second antenna elements can receive signals approximately simultaneously, and the deflection angle can be calculated based on the phase difference between the second antenna elements.

[0355] Optionally, if multiple receivers 134 or 234 are present, one of the receivers may be electrically connected to multiple antennas.

[0356] Optionally, see Figures 27 and 28. The at least three first antenna elements 120a may be a first antenna 121, a second antenna 122, and a third antenna 123. The second antenna 122 is located on a side of the first antenna 121 that faces a first direction X. The third antenna 123 is located on a side of the first antenna 121 that faces a second direction Y.

[0357] The first antenna 121 may implement signal transmission or reception, and the origin of the three-dimensional coordinate system may be defined based on the first antenna 121.

[0358] For example, the first antenna 121 may be a single independent antenna integrated with transmission and reception. The first modular circuit 130 includes a transmitter 133 and a selector switch 135. The transmitter 133 is connected to the first antenna 121 via the selector switch 135, and switching between the signal transmission function and the signal reception function may be implemented by using the selector switch 135. In this embodiment, the position of the first antenna 121 is the origin of a three-dimensional coordinate system, which can facilitate coordinate calculations.

[0359] Additionally, in another embodiment, the first antenna 121 may alternatively include one transmitting antenna 121a and one receiving antenna. The transmitting antenna 121a is connected to the transmitter 133 and configured to transmit signals. The receiving antenna is connected to the receiver 134 and configured to receive signals. In this embodiment, the transmitting antenna in the first antenna 121 is the origin of a three-dimensional coordinate system, which can facilitate coordinate calculations.

[0360] Furthermore, in some other embodiments, the origin of the three-dimensional coordinate system may alternatively be defined based on a position other than the first antenna 121. This is not limited in this embodiment.

[0361] For ease of explanation, the following will be described by using an example in which the first antenna 121 is an independent antenna integrated with transmitting and receiving.

[0362] In one embodiment, the first antenna 121 is used as the origin of a three-dimensional coordinate system, with the first direction being the x-axis direction of the three-dimensional coordinate system and the second direction being the y-axis direction of the three-dimensional coordinate system. The second antenna 122 is located on the x-axis, and the third antenna 123 is located on the y-axis. Thus, the first antenna 121, the second antenna 122, and the third antenna 123 are arranged in an "L" shape. Both the distance between the second antenna 122 and the first antenna 121 and the distance between the third antenna 123 and the first antenna 121 are equal to or less than the wavelength of the first signal.

[0363] Based on the structure of the first antenna array 120 provided in this embodiment, the positioning method will be described in detail below with reference to the accompanying drawings.

[0364] When the second electronic device 200 is operated, a distance is usually maintained between the second electronic device 200 and the first electronic device 100, i.e., a distance is maintained between the first antenna array 120 and the second antenna array 220, so that a triangle is formed between the second antenna array 220, the first antenna 121, and the second antenna 122, and a triangle is also formed between the second antenna array 220, the first antenna 121, and the third antenna 123. Therefore, the value of the first coordinate (x, y, z) can be obtained through calculation according to the related principles of triangles and electromagnetic waves.

[0365] Specifically, Figure 34 is a diagram of a model for calculating a first coordinate according to one embodiment of the present application. Please refer to Figure 34. In a triangle including the second antenna array 220, the first antenna 121, and the second antenna 122, for ease of explanation, the distance between the second antenna array 220 and the first antenna 121 may be defined as a first distance r, the second distance between the second antenna array 220 and the second antenna 122 is r', and the third distance between the second antenna 122 and the first antenna 121 is d.

[0366] Figure 35 is a schematic diagram of a one-way ranging method according to an embodiment of the present application. Please refer to Figure 35. For calculating the first distance r, if the clock of the second antenna array 220 is accurately synchronized with the clock of the first antenna 121, the one-way ranging method can be used. The following steps are specifically included:

[0367] Step a1: Detect a first time point t1 at which the second antenna array 220 transmits a first signal.

[0368] Step a2: Detect a second time point t2 at which the first antenna 121 receives the first signal.

[0369] Step a3: Obtain a first distance d based on the first time point, the second time point, and the speed of light.

[0370] t2-t1 is the duration of time that the electromagnetic wave propagates between the second antenna array 220 and the first antenna 121. The propagation speed of the electromagnetic wave is the speed of light c. The first distance r can be obtained by multiplying the duration by the speed of light c, which can be specifically reflected in the following equation: r=(t2-t1)×c

[0371] In addition, Figure 36 is a schematic diagram of a two-way ranging method according to an embodiment of the present application. Please refer to Figure 36. For calculating the first distance r, if the clock of the second antenna array 220 is not synchronized with the clock of the first antenna 121, the two-way ranging method can be used. The following steps are specifically included:

[0372] Step b1: Detect a first time point t3 at which the second antenna array 220 transmits a first signal.

[0373] Step b2: Detect a second time point t4 at which the first antenna 121 receives the first signal.

[0374] Step b3: Detect the duration t' of the delay for the first antenna 121 to process the first signal.

[0375] Step b4: Detect a third time point t5 at which the first antenna 121 transmits the second signal.

[0376] Step b5: Detect a fourth time point t6 at which the second antenna array 220 receives the second signal.

[0377] Step b6: Obtain a straight-line distance based on the first time point, the second time point, the duration of the delay, the third time point, the fourth time point, and the speed of light.

[0378] Because the clock of the second antenna array 220 is not synchronized with the clock of the first antenna 121, the duration t' of the signal delay between reception and transmission of the signal by the first antenna 121 needs to be taken into consideration, where t' = t5 - t4. t4 - t3 is the duration for the electromagnetic wave to propagate from the second antenna array 220 to the first antenna 121. t6 - t5 is the duration for the electromagnetic wave to propagate from the first antenna 121 to the second antenna array 220. The period t4 - t3 and the period t6 - t5 are equal. The first distance r can be specifically calculated by using the following formula:

number

[0379] For the calculation of the second distance r', there is a third distance d between the second antenna 122 and the first antenna 121, resulting in a phase difference p' between the signal received by the second antenna 122 and the signal received by the first antenna 121. The phase difference p' may be a positive or negative value in the coordinate system. The distance difference p between the first distance r and the second distance r' can be calculated based on the phase difference p', the frequency f of the first signal, and the speed of light c. The distance difference p' can be calculated according to the following formula:

number

[0380] When the second antenna array 220 transmits a first signal, the first antenna 121 and the second antenna 122 may receive the first signal separately, and the phase parameters can be obtained separately, so that the phase difference p′ between the first antenna 121 and the second antenna 122 can be obtained. After the distance difference p is obtained, the second distance r′ can be obtained through calculation, i.e., r′=rp.

[0381] See Figure 34. The third distance d can be learned directly when the second antenna 122 and the first antenna 121 are positioned. Thus, the lengths of the three sides of a triangle including the first antenna 121, the second antenna 122, and the second antenna array 220 can be learned. The included angle between the connecting line between the second antenna array 220 and the first antenna 121 and the connecting line between the second antenna 122 and the first antenna 121 may be defined as α, and the first coordinate of the second antenna array 220 in the three-dimensional coordinate system is (x, y, z). This can be learned according to the following equation:

number

number

[0382] In equations (2) and (3), x is a coordinate value corresponding to the x-axis of the three-dimensional coordinate system of the second antenna array 220. z is a coordinate value corresponding to the z-axis of the three-dimensional coordinate system of the second antenna array 220. The value of x in the first coordinate may be obtained according to equations (1) and (2), and the value of z in the first coordinate may be obtained through calculation using equations (1) to (3).

[0383] Correspondingly, the y value of the first coordinate can be obtained through calculation according to the above-mentioned principle of calculating the x value and z value of the first coordinate, the details of which will not be described again in this specification.

[0384] Therefore, all values of the first coordinate (x, y, z) can be obtained by using the above method.

[0385] In another embodiment, Fig. 37 is a diagram of another model for calculating the first coordinate according to an embodiment of the present application. See Fig. 37. The second antenna 122 is on the x-axis of a three-dimensional coordinate system, and the third antenna 123 is located on the side of the first antenna 121 in the y-axis direction, but not on the y-axis, so that the positions of the first antenna 121, the third antenna 123, and the second antenna 122 are distributed in an "isosceles triangle" shape, an acute triangle, an obtuse triangle, etc.

[0386] In this embodiment, for a triangle including the first antenna 121, the second antenna 122, and the second antenna array 220, the second antenna 122 is located on the x-axis, so the x and z values of the first coordinate in this embodiment can still be calculated by the above-mentioned method.

[0387] See FIG. 37. Because the third antenna 123 is not located on the y-axis, calculations cannot be performed directly based on a triangle including the first antenna 121, the third antenna 123, and the second antenna array 220. Instead, a projection point y1 of the third antenna 123 on the y-axis must be determined. A triangle is determined using the projection point y1, the first antenna 121, and the second antenna array 220, and the y value in the first coordinate system is calculated based on the triangle. An included angle β1 exists between the connecting line between the third antenna 123 and the first antenna 121 and the y-axis. Regarding the phase difference between the third antenna 123 and the first antenna 121, the component of the phase difference on the y-axis can be obtained through a transformation based on the included angle β1. The distance from the projection point y1 of the third antenna 123 on the y-axis to the second antenna array 220 can be obtained through a calculation based on the component of the phase difference on the y-axis. The distance from the projection point y1 to the first antenna 121 can be obtained through a conversion based on the distance between the third antenna 123 and the first antenna 121 and the included angle β1. The distance between the second antenna array 220 and the first antenna 121 can still be obtained through calculation based on the one-way ranging method or the two-way ranging method described above. Therefore, the side lengths of each side of the triangle determined by the projection point y1, the first antenna 121, and the second antenna array 220 can be obtained. The value of y in the first coordinate can be obtained through calculation based on the method described above.

[0388] In addition, in some other embodiments, Figure 38 is a diagram of yet another model for calculating the first coordinate according to an embodiment of the present application. See Figure 38. For the x and z values, a triangle can also be determined by using the projection point on the x-axis of the third antenna 123, the first antenna 121, and the second antenna array 220. In this way, the x and z values in the first coordinate are calculated based on the above-mentioned method.

[0389] Specifically, see FIG. 38 . An included angle β2 exists between the connecting line between the third antenna 123 and the first antenna 121 and the x-axis. Regarding the phase difference between the third antenna 123 and the first antenna 121, the component of the phase difference on the x-axis can be obtained through a transformation based on the included angle β2. The distance from the projection point x1 of the third antenna 123 on the x-axis to the second antenna array 220 can be obtained through a calculation based on the component of the phase difference on the x-axis. The distance from the projection point x1 to the first antenna 121 can be obtained through a transformation based on the distance between the third antenna 123 and the first antenna 121 and the included angle β2. The distance between the second antenna array 220 and the first antenna 121 can still be obtained through a calculation based on the one-way ranging method or the two-way ranging method described above. Therefore, the side lengths of each side of the triangle determined by the projection point x1, the first antenna 121, and the second antenna array 220 can be obtained. The x value and z value in the first coordinate can be obtained through calculation based on the above-mentioned method.

[0390] Optionally, the second antenna array 220 includes at least two second antenna elements. When there are two second antenna elements, one acceleration sensor is required to operate together. The acceleration sensor and one of the second antenna elements are distributed in a third direction and a fourth direction, respectively, where the third direction and the fourth direction are perpendicular to each other. The other second antenna element may be located at the intersection of the third direction and the fourth direction and used as the origin of a coordinate system including the third direction and the fourth direction. For example, the second antenna element located on the third direction side of the origin may be configured to acquire a horizontal signal. The acceleration sensor located on the fourth direction side of the origin is configured to acquire a vertical signal and further acquire a deflection angle of the second antenna array based on the horizontal and vertical signals.

[0391] If there are more than three second antenna elements, at least two of the at least three second antenna elements are distributed in the third direction and the fourth direction, respectively.

[0392] Both the third direction and the fourth direction use the second electronic device 200 as a reference frame, and specifically, the third direction and the fourth direction are not separately associated with the first direction X, the second direction Y, and the world coordinate system. The second antenna array 220 may be located at any position on the second electronic device 200. To implement better signal reception and transmission performance, the second antenna array 220 is located at an end of the second electronic device 200, the end being that of the second electronic device 200 in use and facing the first electronic device 100.

[0393] The third direction and the fourth direction are two directions perpendicular to each other with respect to the edge of the second electronic device 200. The second antenna elements are arranged in two mutually perpendicular directions, so that the deflection angles of the second antenna array 220 with respect to the first direction X and the second direction Y can be obtained based on the phase difference between the antennas. In this way, the second coordinates, i.e., the absolute coordinates of the second row of antennas within the size range of the first electronic device 100, can be obtained based on the first coordinates and the deflection angles.

[0394] The second antenna array 220 and the first antenna array 120 may have the same antenna arrangement configuration, and the antennas in the second antenna array 220 and the first antenna array 120 may be arranged in an "L" shape, an "isosceles triangle" shape, a rectangular array, etc., respectively. This facilitates calculation of parameters such as antenna phase difference and deflection angle, and implements highly accurate positioning. Of course, in some other embodiments, as described above, the second antenna array 220 and the first antenna array 120 may alternatively have different arrangement configurations. The details will not be described again herein.

[0395] Optionally, see Figures 32 and 33. The second antenna array 220 includes at least three second antenna elements. The at least three second antenna elements may be a fourth antenna 221, a fifth antenna 222, and a sixth antenna 223. The fifth antenna 222 is located on the side of the fourth antenna 221 in the third direction, and the sixth antenna 223 is located on the side of the fourth antenna 221 in the fourth direction, so that the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 form an "L"-shaped structure. The fourth antenna 221 is an integrated transmitting and receiving antenna, and both the fifth antenna 222 and the sixth antenna 223 are receiving antennas. The distance between any two of the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 is equal to or less than the wavelength of the second signal. See Figure 32. The fourth antenna 221 may be one independent antenna. The independent fourth antenna 221 may be connected to the transmitter via a changeover switch 235, and switching between the signal transmission function and the signal reception function may be implemented by using the changeover switch 235. Of course, in some other embodiments, the fourth antenna 221 may alternatively include one transmitting antenna 221a and one receiving antenna. The transmitting antenna 221a is connected to the transmitter 233 and configured to transmit signals. The receiving antenna is connected to the receiver 234 and configured to receive signals.

[0396] When the first antenna array 120 transmits a second signal, the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 can all receive the second signal, and the phase difference between the fifth antenna 222 and the fourth antenna 221, and the phase difference between the sixth antenna 223 and the fourth antenna 221 can be obtained based on the phase parameters in the second signal. Since the distance between any two of the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 is less than or equal to the wavelength of the second signal, the first deflection angle θ1 of the second antenna array 220 relative to the first direction and the second deflection angle θ2 of the second antenna array 220 relative to the second direction can be correspondingly obtained based on the phase difference, and the final two-dimensional coordinates (x+z×tanθ1, y+z×tanθ2) of the second antenna array 220 projected on the display interface 160 of the first electronic device 100 can be obtained by combining the first coordinates (x, y, z).

[0397] Optionally, a plane including the first direction X and the second direction Y is parallel to a display interface of the first electronic device 100. The equivalent center of each first antenna element 120a in the first antenna array 120 may be located on the plane including the first direction X and the second direction Y. This can facilitate geometric calculation of each coordinate point value in the first coordinate and can improve the accuracy of the first coordinate.

[0398] Of course, in some other embodiments, the equivalent center of each first antenna element 120a in the first antenna array 120 does not have to be located on the display interface 160 of the first electronic device 100, as long as the geometric relationship between each first antenna element 120a and the display interface 160 of the first electronic device 100 can be determined.

[0399] An embodiment of the present application further provides a positioning method. Hereinafter, the positioning method provided in the embodiment of the present application will be described in detail with reference to the accompanying drawings and specific embodiments.

[0400] The positioning method may be applied to a system including a first electronic device 100 and a second electronic device 200. A first antenna array 120 is disposed on the first electronic device 100, and includes a plurality of first antenna elements 120a, at least two of which are distributed in a first direction and a second direction, respectively, and the first direction is perpendicular to the second direction. A second antenna array 220 is disposed on the second electronic device 200, and includes a plurality of second antenna elements.

[0401] Figure 39 is a flowchart of a positioning method according to an embodiment of the present application. Please refer to Figure 39. The method includes the following steps:

[0402] Step S1: Determine the position of a first cursor displayed on the first electronic device 100 based on a first signal transmitted by the second antenna array 220 and a second signal transmitted by the first antenna array 120.

[0403] In the present application, the positions of the first antenna array 120 and the second antenna array 220 relative to each other can be determined to specifically obtain the absolute coordinates of the second antenna array 220 relative to the first electronic device 100. The second antenna array can accurately point to a position specified by the first electronic device 100. Specifically, after the position of the first antenna array 120 on the first electronic device 100 is determined, the first antenna array 120 can establish a three-dimensional coordinate system based on the relative position of the first antenna array 120 on the first electronic device 100. The relative position of the first antenna array 120 with respect to the display interface 160 of the first electronic device 100 is also included in the three-dimensional coordinate system. When the positions of the first antenna array 120 and the second antenna array 220 on the second electronic device 200 relative to each other are determined, if the detected coordinates of the second antenna array 220 do not exceed the range of the display interface 160, the coordinates of the second antenna array 220 can be accurately displayed within the range of the display interface 160 in the form of a first cursor. In this way, the positioning of the second antenna array 220 becomes more accurate and the operating experience in the spatial pointing operation is improved.

[0404] Furthermore, if the coordinates of the second antenna array 220 exceed the size range of the first electronic device 100, the coordinates determined in this case may be defined as the position of the second cursor, and the position of the second cursor will not be displayed on the display interface 160, so that the problem of inaccurate pointing can be avoided.

[0405] Specifically, Figure 40 is a flowchart of a positioning method according to another embodiment of the present application. Please refer to Figure 40. Step S1 specifically includes the following steps:

[0406] Step S11: Based on the first signal, measure the first coordinate of the second antenna array in the three-dimensional coordinate system in which the first antenna array is located. The first coordinate may be obtained by calculation on the first electronic device 100 side. Of course, the first coordinate may alternatively be obtained through calculation on the second electronic device 200 side, and the calculation result may be transmitted to the first electronic device 100 side.

[0407] Step S12: Measure the deflection angle of the second antenna array relative to the first direction and the second direction based on the second signal. The deflection angle may be obtained through calculation by the second electronic device 200 side, or alternatively, may be obtained through calculation by the first electronic device 100 side. This is not limited in this embodiment.

[0408] Step S13: Obtain a second coordinate based on the first coordinate and the deflection angle.

[0409] Step S14: Determine the position of the first cursor based on the second coordinate. As described above, based on different positional relationships between the radiation surface of the first antenna array 120 and the display interface 160 of the first electronic device 100, the second coordinate may be the position of the first cursor, or may be the position of the first cursor obtained through transformation based on the second coordinate. Details will not be described again in this specification.

[0410] During use, the second electronic device 200 can freely rotate at the position indicated by the first coordinate, driving the second antenna array 220 to rotate. Such rotation affects the phase of the signal received by the second antenna array 220, changing the value of the first coordinate in the first direction and the second direction. As a result, the actual pointing position of the second antenna array 220 does not correspond to the position indicated by the first coordinate. Therefore, in this embodiment, the rotation of the second electronic device 200 is taken into consideration. After the first antenna array 120 obtains the first coordinate of the second antenna array 220 based on the first signal transmitted by the second antenna array 220 through positioning, the second antenna array 220 can obtain the deflection angle of the second antenna array 220 with respect to the first direction and the second direction based on the second signal transmitted by the first antenna array 120 through positioning. A final second coordinate may further be obtained based on the first coordinate and the deflection angle.

[0411] According to the positioning method provided in this embodiment of the present application, the first antenna array 120 is disposed on the first electronic device 100, and the second antenna array 220 is disposed on the second electronic device 200, so that long-distance interaction between the first electronic device 100 and the second electronic device 200 can be implemented without relying on a moving plane. Furthermore, the positions of the first antenna array 120 and the second antenna array 220 relative to each other may be determined, taking into account the rotation of the second electronic device 200 during use, and using a method to calculate the deflection angle of the second antenna array 220 relative to the first antenna array 120 in the first direction and the second direction. Therefore, the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100 can be obtained. The positioning of the second antenna array 220 becomes more accurate, and the operation experience in spatial pointing operations is improved.

[0412] In a specific implementation, the first antenna element 120a includes a first antenna 121, a second antenna 122, and a third antenna 123. The second antenna 122 is located on a side of the first antenna 121 in a first direction. The third antenna 123 is located on a side of the first antenna in a second direction. The first signal includes a time parameter and a first phase parameter. Specifically, step S11 specifically includes the following steps:

[0413] Step S111: Obtain a first distance between the first antenna 121 and the second antenna array 220 based on a time parameter. The time parameter is a duration for a signal to travel between a receiving time and a transmitting time, and may further include a duration consumed for signal processing. The first distance may be calculated based on the duration.

[0414] 35 and 36. The first distance r is the straight-line distance between the second antenna array 220 and the first antenna 121. As described above, the first distance r may be calculated using a one-way ranging method or a two-way ranging method. In the two calculation methods, the first distance r may be calculated based on the time at which the signal is transmitted or received, or in combination with the duration of a delay for processing the signal. The details will not be described again in this specification.

[0415] Step S112: Based on the first phase parameter, obtain a first phase difference between the second antenna 122 and the first antenna 121, and a second phase difference between the third antenna 123 and the first antenna 121. The first antenna array 220 can analyze and obtain the phase parameter from the received first signal, and the phase difference can be further obtained based on the phase parameter.

[0416] Step S113: Based on the first distance r, the distance between the second antenna 122 and the first antenna 121, and the first phase difference, obtain the x-axis coordinate value and the z-axis coordinate value in the first coordinate, and based on the first distance r, the distance between the third antenna 123 and the first antenna 121, and the second phase difference, obtain the y-axis coordinate value in the first coordinate.

[0417] See Figure 34. As described above, the distance between the second antenna 122 and the second antenna array 220 may be obtained through calculation based on the first phase difference, and the x value and the z value in the first coordinate may be further obtained through calculation. See Figure 37. The distance between the third antenna 123 and the second antenna array 220 may be obtained through calculation based on the second phase difference, and the y value in the first coordinate may be further obtained through calculation, so that all values in the first coordinate (x, y, z) may be obtained.

[0418] In a specific implementation, the second antenna array 220 includes a fourth antenna 221, a fifth antenna 222, and a sixth antenna 223. The fifth antenna 222 is located on the side of the fourth antenna 221 in the third direction. The sixth antenna 223 is located on the side of the origin antenna in the fourth direction. The second signal includes a second phase parameter. Specifically, step S12 specifically includes the following steps:

[0419] Step S121: Based on the second phase parameter, obtain a third phase difference between the fifth antenna 222 and the fourth antenna 221, and a fourth phase difference between the sixth antenna 223 and the fourth antenna 221.

[0420] Step S122: Based on the third phase difference, obtain a first deflection angle θ1 in the first direction of the second antenna array 220, and based on the fourth phase difference, obtain a second deflection angle θ2 in the second direction of the second antenna array 220.

[0421] Because the distance between any two of the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 is equal to or less than the wavelength of the second signal, a first deflection angle θ1 of the second antenna array 220 relative to the first direction and a second deflection angle θ2 of the second antenna array 220 relative to the second direction can be correspondingly obtained based on the phase difference, and the final two-dimensional coordinates (x+z×tan θ1, y+z×tan θ2) of the second antenna array 220 projected on the display interface of the first electronic device 100 can be obtained by combining the first coordinates (x, y, z). If the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 form a triangle or an "isosceles triangle" shape, and the distance between any two receiving antennas is equal to or less than the wavelength of the second signal, some components of the antennas in the horizontal direction can be used to help determine the unique deflection angles. In addition, when the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 form a rectangular array or a "rectangular" shape, the distance between any two receiving antennas is less than half the wavelength of the second signal, so that the unique deflection angle can be directly determined.

[0422] Therefore, in this embodiment, the effect of the rotation of the second electronic device 200 on the coordinate accuracy may be compensated by calculating a first deflection angle θ1 and a second deflection angle θ2. Generally, a gyroscope may be disposed in the second electronic device 200 based on obtaining the first coordinate of the second antenna array 220. However, the gyroscope can only detect the rotation state of the second electronic device 200 and cannot synchronize with the size of the display interface of the first electronic device 100. For example, if the coordinate of the second electronic device 200 exceeds the size range of the display interface of the first electronic device 100, the gyroscope still detects the rotation of the second electronic device 200 and sends a rotation signal to the first electronic device 100. As a result, the cursor on the display interface of the first electronic device 100 moves randomly, and an accurate pointing direction cannot be obtained. In this embodiment, a method for calculating a deflection angle is used, specifically, a first deflection angle θ1 and a second deflection angle θ2 are calculated to implement angle correction of the second antenna array 220 in a three-dimensional coordinate system. The three-dimensional coordinate system is related to the size of the first electronic device 100, so that the absolute coordinates of the second antenna array 220 within the size range of the display interface of the first electronic device 100 can be accurately obtained. If the coordinates of the second antenna array 220 exceed the size range of the display interface of the first electronic device 100, the coordinates of the second antenna array 220 will not be displayed on the display interface of the first electronic device 100, thereby improving the operating experience.

[0423] Additionally, in some other embodiments, the second antenna array includes a fourth antenna, a fifth antenna, and an acceleration sensor, wherein the fifth antenna is positioned on a side of the fourth antenna in a third direction, the acceleration sensor is positioned on a side of the fourth antenna in a fourth direction, the third direction is perpendicular to the fourth direction, and the second signal includes a second phase parameter.

[0424] Step S12 specifically includes the following steps.

[0425] Step S123: Obtain a third phase difference between the fifth antenna and the fourth antenna based on the second phase parameter.

[0426] Step S124: Obtain a first deflection angle of the second antenna array in the first direction based on the third phase difference, and obtain a second deflection angle of the second antenna array in the second direction based on the second phase parameter by the acceleration sensor.

[0427] The acceleration sensor may replace the sixth antenna in the above-described embodiment, and the acceleration sensor can obtain a second deflection angle and obtain a second coordinate by combining the first deflection angle and the first coordinate, the details of which will not be described again in this specification.

[0428] It should be understood that the solutions in the embodiments of the present application can be used in any appropriate combination, and the explanations or descriptions of terms in the embodiments can be cross-referenced or explained in the embodiments.

[0429] It should be further understood that the sequence numbers of the processes do not imply an execution sequence in various embodiments of the present application. The execution order of the processes should be determined based on the functions and internal logic of the processes, and should not be construed as any limitation on the implementation process of the embodiments of the present application.

[0430] It can be understood that to implement the functions in any one of the above-described embodiments, an electronic device (e.g., a control device or a display device) includes a corresponding hardware structure and / or software module for performing each function. Those skilled in the art should easily recognize that the present application can be implemented in the form of hardware or a combination of hardware and computer software based on the units and algorithm steps in the examples described in the embodiments disclosed herein. Whether the functions are performed by hardware or by hardware driven by computer software depends on the specific application and design constraints of the technical solution. Those skilled in the art may use different methods to implement the described functions for each specific application, but the implementation form should not be considered to exceed the scope of the present application.

[0431] In the embodiments of the present application, an electronic device (e.g., a control device or a display device) may be divided into functional modules. For example, each functional module corresponding to each function may be obtained through division, or two or more functions may be integrated into one processing module. The integrated module may be implemented in the form of hardware or in the form of a software functional module. It should be noted that in the embodiments of the present application, the module division is an example and is merely a logical functional division. In actual implementation, another division method may be used.

[0432] It should be further understood that modules within an electronic device (e.g., a control device or a display device) may be implemented in the form of software and / or hardware. This is not specifically limited. In other words, the electronic device is represented in the form of functional modules. A "module" herein may be an application specific integrated circuit (ASIC), a circuit, a processor executing one or more software or firmware programs and memory, an integrated logic circuit, and / or another component capable of providing the aforementioned functionality.

[0433] In an optional manner, when data transmission is implemented using software, the data transmission may be fully or partially implemented in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded into a computer and executed, the procedures or functions according to the embodiments of the present application are fully or partially implemented. The computer may be a general-purpose computer, a special-purpose computer, a computer network, or another programmable device. The computer instructions may be stored in a computer-readable storage medium or transmitted from a computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions may be transmitted from a website, computer, server, or data center to another website, computer, server, or data center via wired (e.g., coaxial cable, optical fiber, or digital subscriber line (DSL)) or wireless (e.g., infrared, radio, or microwave) transmission. The computer-readable storage medium may be any available medium accessible by a computer, or a data storage device such as a server or data center that integrates one or more available media. The usable media may be magnetic media (e.g., floppy disks, hard disks, or magnetic tapes), optical media (e.g., digital video discs (DVDs)), semiconductor media (e.g., solid state disks (SSDs)), and the like.

[0434] The method or algorithm steps described in connection with the embodiments of the present application may be implemented by hardware or by a processor executing software instructions. The software instructions may include corresponding software modules. The software modules may be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM), registers, a hard disk, a removable hard disk, a compact disc read-only memory (CD-ROM), or any other form of storage medium known in the art. For example, the storage medium may be coupled to the processor such that the processor can read information from and write information to the storage medium. Of course, the storage medium may alternatively be components of the processor. The processor and the storage medium may be located in an application specific integrated circuit (ASIC). In addition, the ASIC may reside in an electronic device (e.g., a control device or display device).Of course, the processor and the storage medium may alternatively reside as discrete components.

[0435] Based on the above description of the implementation, those skilled in the art can clearly understand that the division of the above functional modules is used merely as an example for convenience and concise description. In actual application, the above functions can be allocated to different functional modules for implementation according to requirements, that is, the internal structure of the device is divided into different functional modules to implement all or part of the above functions. The above description is merely an exemplary embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application may have various modifications and variations. Any modifications, equivalent replacements, improvements, etc. made without departing from the spirit and principles of the present application shall fall within the protection scope of the present application. [Explanation of symbols]

[0436] 100 First Electronic Device 110 Power Supply Module 120 First Antenna Array 120a First antenna element 121 First Antenna 121a Transmitting antenna 122 Second Antenna 123 Third Antenna 130 First Modular Circuit 131 Control Unit 132 computing units 133 Transmitter 134 Receiver 135 Switch 140 processors 150 Outbound Interface 160 Display Interface 200 Second Electronic Device 210 Power Supply Module 220 Second Antenna Array 221 Fourth Antenna 221a Transmitting Antenna 222 Fifth Antenna 223 Sixth Antenna 230 Second Modular Circuit 231 Control Unit 232 computing units 233 Transmitter 234 Receiver 235 Switch 240 processors 250 outgoing interface

Claims

1. 1. A device display control method, the method being applied to at least one display device, the at least one display device comprising a first display device, the first display device comprising a first localization module and a first display, the method comprising: receiving, by the first positioning module, first positioning information from a control device; following a first movement trajectory of the control device and displaying a corresponding display object on the first display based on the first positioning information; no longer displaying the corresponding display object on the first display when the pointing position of the first movement trajectory moves outside a first edge region of the first display; A device display control method, comprising:

2. The method comprises: After the pointing position of the first movement trajectory moves out of the first edge region, receiving second positioning information from the control device by the first positioning module; no longer displaying the corresponding display object on the first display when a pointing position of a second movement trajectory exceeds the first edge region; when it is determined that the pointing position of a third movement trajectory has moved into the first edge region, following the third movement trajectory of the control device and displaying the corresponding display object on the first display based on the second positioning information; The method of claim 1 further comprising:

3. The step of following a first movement trajectory of the control device and displaying a corresponding display object on the first display based on the first positioning information includes: following the first movement trajectory of the control device and displaying a display trajectory of the display object that coincides with the first movement trajectory on the first display based on the first positioning information; 3. The method of claim 1 or 2, comprising:

4. The method comprises: determining a corresponding pointing position on the first display based on the first positioning information; If the pointing position is within a preset control hot area, displaying a corresponding interface effect when the display object is displayed; 3. The method of claim 1 or 2, further comprising:

5. The at least one display device further comprises a second display device, an orientation relationship between the second display device and the first display device is a first relationship, the second display device comprises a second positioning module and a second display, and the method includes: receiving, by the second positioning module, third positioning information from the control device after the pointing position of the first movement trajectory moves out of the first edge region of the first display; skipping the step of displaying the corresponding display object on the first display if the pointing position of the second movement trajectory exceeds the first edge region; when it is determined that the pointing position of a fourth movement trajectory has moved into a second edge region of the second display, following the fourth movement trajectory of the control device and displaying the corresponding display object on the second display based on the third positioning information; 3. The method of claim 1 or 2, further comprising:

6. The at least one display device further comprises a second display device, the second display device comprising a second localization module and a second display, and the method further comprises: receiving, by the second positioning module, third positioning information from the control device after the pointing position of the first movement trajectory moves out of the first edge region of the first display; when it is determined that the pointing position of the second movement trajectory has moved into a second edge region of the second display, following a fourth movement trajectory of the control device and displaying the corresponding display object on the second display based on the third positioning information; 3. The method of claim 1 or 2, further comprising:

7. the orientation relationship between the second display device and the first display device is changed from the first relationship to a second relationship, and the method further comprises: no longer displaying the corresponding display object on the second display when the pointing position of the fourth movement trajectory moves outside a third edge region of the second display; no longer displaying the corresponding display object on the second display when a pointing position of a fifth movement trajectory exceeds the third edge region; receiving, by the first positioning module, fourth positioning information from the control device; when it is determined that the pointing position of a sixth movement trajectory has moved into a fourth edge region of the first display, following the sixth movement trajectory of the control device and displaying the corresponding display object on the first display based on the fourth positioning information; 6. The method of claim 5, further comprising:

8. the second display device is an integrated display device, and the method further comprises: receiving fifth positioning information from the control device when the screen resolution of the second display has changed; when the pointing position of the fourth movement trajectory is on the second display, following the fourth movement trajectory of the control device and displaying the corresponding display object on the second display based on the fifth positioning information; 6. The method of claim 5, further comprising:

9. the second display device is a split display device, and the method comprises: receiving fifth positioning information from the control device when a screen resolution and / or focal length corresponding to the second display changes; when the pointing position of the fourth movement trajectory is on the second display, following the fourth movement trajectory of the control device and displaying the corresponding display object on the second display based on the fifth positioning information; 6. The method of claim 5, further comprising:

10. The method comprises: receiving sixth positioning information from the control device when an orientation relationship between the control device and the first display device changes in a process of following the first movement trajectory of the control device and displaying the corresponding display object on the first display based on the first positioning information; following the first movement trajectory of the control device and displaying the corresponding display object on the first display based on the sixth positioning information; 10. The method of any one of claims 1 to 9, further comprising:

11. The method of claim 1 , wherein the first positioning information includes information of one or more of an ultra-wideband UWB radio signal, a millimeter wave radar signal, an electromagnetic signal, and an ultrasonic signal.

12. The method comprises:

12. The method of claim 1, further comprising: determining, by the first positioning module, the pointing position of the first movement trajectory based on first information, wherein the first information includes the first movement trajectory, the first positioning information, and the size of the first display.

13. The method of claim 12 , wherein the first information further includes a historical pointing position of the first movement trajectory and a historical presentation position of the display object.

14. The first positioning module of the first display device is a first antenna array comprising a plurality of first antenna elements, at least two of which are distributed in a first direction and a second direction, respectively, and the first direction is perpendicular to the second direction; and the control device comprises a second antenna array comprising a plurality of second antenna elements; The step of receiving first positioning information from a control device by the first positioning module includes:

14. The method of claim 1, comprising receiving, by the first antenna array, the first positioning information from the second antenna array of the control device.

15. 15. The method of claim 14, wherein the step of displaying a corresponding display object on the first display based on the first positioning information includes determining a position of the display object to be displayed on the first display device based on the first positioning information received from the second antenna array and the second positioning information transmitted by the first antenna array.

16. 16. The positioning method according to claim 14 or 15, wherein at least three first antenna elements are arranged and at least two second antenna elements are arranged.

17. 17. The positioning method according to claim 14, wherein the plurality of first antenna elements are a first antenna, a second antenna, and a third antenna, the first antenna being located at an intersection of the first direction and the second direction, the second antenna being located on a side of the first antenna in the first direction, and the third antenna being located on a side of the first antenna in the second direction.

18. the distance between any two first antenna elements within the plurality of first antenna elements that are capable of receiving a first signal is equal to or less than the wavelength of the first signal; and / or 18. The positioning method according to claim 14, wherein the distance between any two second antenna elements within the plurality of second antenna elements and capable of receiving a second signal is equal to or less than the wavelength of the second signal.

19. 19. The positioning method according to any one of claims 14 to 18, wherein the first antenna is an integrated transmitting and receiving antenna or the first antenna comprises a receiving antenna and a transmitting antenna.

20. 20. The positioning method according to claim 14, wherein the plurality of first antenna elements are distributed in an L-shaped, triangular, or rectangular array.

21. 21. The positioning method according to claim 14, wherein a plane containing the first direction and the second direction is parallel to a display interface of the first display device.

22. 21. The method of claim 14, wherein the first antenna array is positioned above the display device.

23. The method of claim 1 , wherein the display object is a cursor.

24. 24. A display device, the display device comprising a positioning module and a display, the positioning module and the display configured to support the display device in implementing the method of any one of claims 1 to 23.

25. 24. A computer-readable storage medium having stored thereon computer program instructions that, when executed by a processing circuit, implement the method of any one of claims 1 to 23.

26. 24. A computer program product comprising instructions, when said computer program product is run on a computer, which enables said computer to carry out the method of any one of claims 1 to 23.

27. 24. A chip system comprising a processing circuit and a storage medium, the storage medium storing computer program instructions that, when executed by the processing circuit, implement the method of any one of claims 1 to 23.

Images