Device display control method, electronic device and communication system

CN119013577AActive Publication Date: 2024-11-22HUAWEI TECH CO LTD

Patent Information

Application Number
CN202380019141.5
Authority / Receiving Office
CN · China
Patent Type
Applications(China)
Current Assignee / Owner
Priority Date
2023-11-27
Filing Date
2023-12-29
Publication Date
2024-11-22
Estimated Expiration
2043-12-29

AI Technical Summary

Technical Problem

In existing technologies, there is a deviation between the initial pose of the control device and the cursor position on the display device, resulting in a poor user experience. Furthermore, the cursor is prone to getting stuck when it is at the edge of the display screen, and the cursor presentation logic between multiple display devices cannot automatically adapt to changes in orientation, which affects the user experience.

Method used

The wireless positioning module between the control device and the display device interacts to determine the pointing position of the control device and displays a cursor on the display device. The cursor is only displayed when the pointing position enters the edge area of ​​the display screen, and the cursor can automatically sense changes in the pointing position between multiple display devices to achieve accurate cursor crossing.

Benefits of technology

It improves user convenience and immersive experience, solves the problem of cursor deviation from the control device's pointing position, avoids frame jamming, and enables smooth cursor movement across multiple display devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN119013577A_ABST
    Figure CN119013577A_ABST
Patent Text Reader

Abstract

The invention discloses a device display control method, an electronic device and a communication system, relates to the technical field of wireless remote control, and can accurately determine the presentation position of a display object (such as a cursor) corresponding to a control device on a display device so as to provide better device control experience for a user. According to the scheme, the presentation position of the display object is determined according to the position where the control equipment points to the display screen, so that very convenient, immersive and accurate equipment control experience can be brought to a user no matter in a single-display-equipment scene or a multi-display-equipment scene.
Need to check novelty before this filing date? Find Prior Art

Description

Device display control method, electronic device, and communication system

[0001] This application claims priority to the Chinese patent applications filed with the State Intellectual Property Office on January 18, 2023, with application number 202310097484.5 and application name “Positioning method, positioning system and electronic device”, filed with the State Intellectual Property Office on July 18, 2023, with application number 202310884005.4 and application name “A remote control cursor display method and device”, and filed with the State Intellectual Property Office on September 8, 2023, with application number 202311164310.2 and application name “Device display control method, electronic device and communication system”, and claims priority to the international patent application filed with the World Intellectual Property Office on November 27, 2023, with application number PCT / CN2023 / 134243 and application name “Positioning method, positioning system and electronic device”, all of the above contents are incorporated by reference into this application. Technical Field

[0002] The present application relates to the field of wireless remote control technology, and in particular to a device display control method, electronic equipment, and communication system. Background Art

[0003] During human-computer interaction, a control device such as a remote control, air mouse, or wearable device is typically used to send control commands to a display device via wired or wireless means to control the display device. Determining the cursor position corresponding to the control device on the display screen is a crucial step in controlling the display device.

[0004] Currently, the relative position change of the cursor is usually determined based on the relative posture change of the control device, and then the cursor position is determined. As shown in Figure 1, the change of the cursor relative to the initial cursor presentation position can be determined based on the posture change of the control device relative to the initial posture, and then the cursor position is determined, where the initial cursor presentation position is mostly a preset default position. Since the initial cursor presentation position is preset and not the actual pointing position of the control device, the subsequent cursor presentation position is not necessarily the actual pointing position of the control device. In other words, there is a deviation between the cursor presentation position on the display device and the actual pointing position of the control device, so the user's control experience during use will be relatively poor.

[0005] Summary of the Invention

[0006] The present application provides a device display control method, which can provide a remote control cursor display solution suitable for any scenario, accurately determine the cursor presentation position corresponding to the control device on the display device, and provide users with a better device control experience.

[0007] To achieve the above objectives, this application adopts the following technical solutions:

[0008] In a first aspect, a device display control method is provided, which is applied to at least one display device, wherein the at least one display device includes a first display device, and the first display device includes a first positioning module and a first display screen. The method includes: the first positioning module receives first positioning information from the control device; the first display device follows the first movement trajectory of the control device, and presents a corresponding display object on the first display screen based on the above-mentioned first positioning information; when the pointing position of the first movement trajectory moves out of the first edge area of ​​the first display screen, the first display device does not continue to present the corresponding display object on the first display screen.

[0009] As an example, the first positioning module can be used to determine the pointing position of the control device by sending and receiving positioning information (such as the first positioning information) with other devices. For example, the first positioning module can include, but is not limited to, one or more of an antenna ultra-wideband radio (UWB) positioning module, a multi-antenna millimeter-wave radar positioning module, a three-dimensional electromagnetic coil positioning module, a three-dimensional ultrasonic positioning module, and the like. The first positioning information can include one or more of the following: UWB signals, millimeter-wave radar signals, electromagnetic signals, and ultrasonic signals.

[0010] As an example, the first edge area of ​​the first display screen can be any edge area of ​​the first display screen, such as the upper edge area, the lower edge area, the left edge area, or the right edge area. In the case where the first display screen is a special shape (such as a circle, an ellipse, etc.), the first edge area of ​​the first display screen can be an edge area of ​​the first display screen close to a predefined boundary. Taking the first display screen as a circle as an example, the first edge area of ​​the first display screen can be a predefined edge area close to the first boundary, where the first boundary is, for example, a boundary corresponding to the range of 315° to 45°, a boundary corresponding to the range of 45° to 135°, a boundary corresponding to the range of 135° to 225°, or a boundary corresponding to the range of 225° to 315° with the center point of the first display screen as the center of the circle.

[0011] As an example, display objects such as icons, cursors, components, virtual images, images, etc. may depend on specific application scenarios and device functions and are not specifically limited.

[0012] The solution provided by the first aspect above is that the display device (such as the first display device) determines the movement trajectory and pointing position of the control device by sending and receiving positioning information with the control device. In this way, when the pointing position of the control device enters the edge area of ​​the display screen, the display device can follow the movement trajectory of the control device to present the cursor on the display screen; when the pointing position of the control device moves out of any edge area of ​​the display screen (such as the upper edge area, the lower edge area, the left edge area or the right edge area), the display device does not continue to present the cursor on the display screen. Therefore, it can bring a very convenient, immersive and precise device control experience to the user. For example, compared with the conventional technology of determining the image presentation position based on the relative posture change of the control device, this solution can not only solve the problem of deviation between the presentation position of the display object and the pointing position of the control device, but also solve the problem of the frame when the display object moves out of the edge of the display screen.

[0013] As a possible implementation, the method further includes: after the pointing position of the first moving track moves out of the first edge area, the first positioning module receives second positioning information from the control device; when the pointing position of the second moving track is outside the first edge area, the first display device does not present the corresponding display object on the first display screen; when it is determined that the pointing position of the third moving track moves into the first edge area, the first display device follows the third moving track of the control device and presents the corresponding display object on the first display screen based on the second positioning information. In this way, when the pointing position of the control device moves out of any edge area of ​​the display screen (such as the upper edge area, the lower edge area, the left edge area or the right edge area), the display device does not continue to present the cursor on the display screen; and when the pointing position of the control device moves back into any edge area of ​​the display screen, the display device can present the cursor on the display screen again. Based on this, the convenience, immersive experience and accuracy of the user in the process of controlling the device display can be greatly enhanced.

[0014] As a possible implementation method, the above-mentioned first display device follows the first movement trajectory of the control device, and presents a corresponding display object on the first display screen based on the first positioning information, including: the first display device follows the first movement trajectory of the control device, and presents a display object display trajectory matching the first movement trajectory on the first display screen based on the first positioning information. For example, in scenarios such as handwriting tablet scenarios and demonstration scenarios, the display device can follow the movement trajectory of the control device and present the display trajectory of display objects such as handwriting on the display screen based on the positioning information. The solution provided by the present application is highly adaptable and does not limit the specific display form of the interface effect presented by the display screen following the movement trajectory of the control device. It can be determined according to the specific application scenario and device function.

[0015] As a possible implementation, the above method also includes: the first display device determines the corresponding pointing position on the first display screen based on the first positioning information; when the pointing position is located in the preset control hot zone, the first display device presents the corresponding interface effect when presenting the display object. For example, in a game scenario, the display device can present pre-set special effects, such as the image of the game protagonist, game special effects (such as bubble effects, fireworks effects, aiming effects, hitting effects, etc.), etc. at the pointing position and / or the display area corresponding to the pointing position (such as the preset control hot zone) when the pointing position of the control device is located in the preset control hot zone. The solution provided by the present application is highly adaptable and does not limit the specific display form of the interface effect presented by the display screen following the movement trajectory of the control device. It can be determined according to the specific application scenario and device function.

[0016] As a possible implementation, the at least one display device further includes a second display device, the second display device having a first orientation relationship with the first display device, the second display device including a second positioning module and a second display screen. The method further includes: after the pointing position of the first movement trajectory moves out of the first edge region of the first display screen, the second positioning module receiving third positioning information from the control device; when the pointing position of the second movement trajectory is outside the first edge region, the first display device does not present the corresponding display object on the first display screen; when the second display device determines that the pointing position of the fourth movement trajectory moves into the second edge region of the second display screen, the second display device follows the fourth movement trajectory of the control device and presents the corresponding display object on the second display screen based on the third positioning information. In this way, even when the first display screen is far from the second display screen, accurate display of the display object can be achieved, providing the user with an immersive and precise cursor control and device manipulation experience. Moreover, compared to conventional technologies that determine the image presentation position based on the relative position change of the control device, this solution does not cause the problem of uneven display object movement when the display object crosses.

[0017] As a possible implementation, the at least one display device further includes a second display device, the second display device includes a second positioning module and a second display screen, and the method further includes: after the pointing position of the first movement trajectory moves out of the first edge area of ​​the first display screen, the second positioning module receives third positioning information from the control device; when it is determined that the pointing position of the second movement trajectory moves into the second edge area of ​​the second display screen, the second display device follows the fourth movement trajectory of the control device and presents the corresponding display object on the second display screen based on the third positioning information. In this way, when the first display screen is close to the second display screen, the display object can also be accurately displayed, giving the user an immersive and precise cursor control and device control experience. Moreover, compared with the conventional technology of presenting display objects at the default position, this solution will not cause the problem of uneven display object crossing when the display object crosses.

[0018] As a possible implementation, the orientation relationship between the second display device and the first display device changes from the first relationship to the second relationship, and the method further includes: when the pointing position of the fourth movement trajectory moves out of the third edge area of ​​the second display screen, the second display device no longer presents the corresponding display object on the second display screen; when the pointing position of the fifth movement trajectory is outside the third edge area, the corresponding display object is no longer presented on the second display screen; the first positioning module receives fourth positioning information from the control device; when it is determined that the pointing position of the sixth movement trajectory moves into the fourth edge area of ​​the first display screen, the first display device follows the sixth movement trajectory of the control device and presents the corresponding display object on the first display screen based on the fourth positioning information. Exemplarily, the orientation relationship between the second display device and the first display device changes from the first relationship to the second relationship, such as by swapping the positions of the second display device and the first display device. In this way, when the positional relationship between the first display screen and the second display screen changes, the display device can sense the change in the orientation relationship by sending and receiving positioning information with the control device, obtain the latest orientation of the control device, and continue to accurately display the display object without the user performing any relevant configuration operations.

[0019] As a possible implementation, the second display device is an integrated display device, and the method further includes: when the screen resolution of the second display changes, the second positioning module receives fifth positioning information from the control device; when the fourth movement trajectory is directed to a position on the second display, the second display device follows the fourth movement trajectory of the control device and presents the corresponding display object on the second display based on the fifth positioning information. In this way, for an integrated display device, when the screen resolution of the display changes, the user does not need to perform any relevant configuration operations; the display device can determine the latest direction of the control device based on the latest screen resolution, thereby continuing to accurately display the display object.

[0020] As a possible implementation, the second display device is a split display device, and the method further includes: when the screen resolution and / or focal length corresponding to the second display screen changes, the second positioning module receives fifth positioning information from the control device; when the pointing position of the fourth movement trajectory is located on the second display screen, the second display device follows the fourth movement trajectory of the control device and presents the corresponding display object on the second display screen based on the fifth positioning information. In this way, for a split display device, when the screen resolution or focal length of the display device changes, the user does not need to perform relevant configuration operations. The display device can determine the latest pointing position of the control device based on the latest screen resolution or focal length, thereby continuing to accurately display the display object.

[0021] As a possible implementation, the method further includes: when the positional relationship between the control device and the first display device changes while following the first movement trajectory of the control device and presenting the corresponding display object on the first display screen based on the first positioning information, the first display device receives sixth positioning information from the control device; the first display device follows the first movement trajectory of the control device and presents the corresponding display object on the first display screen based on the sixth positioning information. In this way, when the distance between the user and the display screen changes, the display device can sense the change and adaptively adjust the display effect by sending and receiving positioning information with the control device, without the user having to perform any configuration operations, thereby continuing to accurately display the display object.

[0022] As one possible implementation, the method further includes: a first positioning module determining a pointing position of the first movement trajectory based on first information, where the first information includes: the first movement trajectory, the first positioning information, and the size of the first display screen. Based on this, the first positioning module can obtain the actual pointing position of the control device, thereby providing the necessary basis for subsequent accurate image presentation.

[0023] As a possible implementation method, the first information further includes: the historical pointing position of the first movement trajectory and the historical presentation position of the display object. In this way, the presentation position of the display object can be calibrated based on the pointing position of the control device, based on the conventional technology of determining the image presentation position based on the relative posture change of the control device. For example, when the image presentation position determined based on the relative posture change of the control device deviates from the pointing direction of the control device by more than a preset range, or after a preset time period has passed, the presentation position of the display object can be calibrated based on the pointing position of the control device. Based on this, the continuous presentation of the display object can be ensured.

[0024] As a possible implementation, the first positioning module of the first display device includes: a first antenna array, the first antenna array includes multiple first antenna units, at least two of the multiple first antenna units are distributed in a first direction and a second direction, respectively, and the first direction is perpendicular to the second direction; the control device includes a second antenna array, the second antenna array includes multiple second antenna units; the first positioning module receives first positioning information from the control device, including: the first antenna array receives the first positioning information from the second antenna array of the control device.

[0025] As a possible implementation method, presenting a corresponding display object on the first display screen based on the first positioning information includes: determining the position of the display object presented on the first display device based on the first positioning information received from the second antenna array and the second positioning information sent by the first antenna array.

[0026] As a possible implementation manner, at least three first antenna units are provided, and at least two second antenna units are provided.

[0027] As a possible implementation method, the multiple first antenna units are respectively a first antenna, a second antenna and a third antenna, the first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on one side of the first antenna in the first direction, and the third antenna is located on one side of the first antenna in the second direction.

[0028] As a possible implementation method, the distance between any two first antenna units among the multiple first antenna units that have the function of receiving the first signal is less than or equal to the wavelength of the first signal; and / or, the distance between any two second antenna units among the multiple second antenna units that have the function of receiving the second signal is less than or equal to the wavelength of the second signal.

[0029] As a possible implementation manner, the first antenna is a transceiver integrated antenna, or the first antenna includes a receiving antenna and a transmitting antenna.

[0030] As a possible implementation manner, the plurality of first antenna units are distributed in an L-shape, a triangle, or a rectangular array.

[0031] As a possible implementation manner, a plane formed by the first direction and the second direction is parallel to a display interface of the first electronic device.

[0032] As a possible implementation manner, the first antenna array is located on the upper side of the display device.

[0033] In a second aspect, the present application provides a positioning method applied to a system including a first electronic device and a second electronic device, wherein the first electronic device is provided with a first antenna array, the first antenna array including a plurality of first antenna units, at least two of the plurality of first antenna units being distributed in a first direction and a second direction, respectively, the first direction being perpendicular to the second direction;

[0034] The second electronic device is provided with a second antenna array, and the second antenna array includes a plurality of second antenna units;

[0035] The method includes determining a position of a first cursor presented on the first electronic device according to a first signal sent by the second antenna array and a second signal sent by the first antenna array.

[0036] The present application can accurately present the position of the first cursor on the first electronic device through the mutual positioning of the first antenna array and the second antenna array, thereby improving the precise positioning of the second antenna array and improving the operating experience in spatial pointing operations.

[0037] In one possible implementation, determining the position of a first cursor presented on the first electronic device according to the first signal sent by the second antenna array and the second signal sent by the first antenna array specifically includes:

[0038] measuring a first coordinate of the second antenna array in the three-dimensional coordinate system where the first antenna array is located according to the first signal;

[0039] measuring a deflection angle of the second antenna array relative to the first direction and the second direction according to the second signal;

[0040] Obtaining a second coordinate according to the first coordinate and the deflection angle;

[0041] The position of the first cursor is determined according to the second coordinates.

[0042] In this case, the first antenna array, based on the first signal sent by the second antenna array, can obtain the relative coordinates of the second antenna array relative to the first antenna array, namely the first coordinates. These first coordinates can be used to locate the position of the second antenna array in space. Based on the second signal sent by the first antenna array, the second antenna array can also locate its own deflection angle relative to the first direction X and the second direction Y. Finally, the final second coordinates can be obtained based on the first coordinates and the deflection angles. Thus, by relative positioning of the first and second antenna arrays, the absolute coordinates of the second antenna array relative to the first electronic device can be obtained. These absolute coordinates can be displayed as a cursor on the first electronic device.

[0043] If the radiating surface of the first antenna array is parallel to the display interface of the first electronic device, the second coordinate is the position of the cursor that can be displayed on the first electronic device by operating the second electronic device. Furthermore, if the radiating surface of the first antenna array is not parallel to the display interface of the first electronic device, the second coordinate needs to be further converted based on the physical positional relationship between the first antenna array and the display interface, and the converted cursor position is obtained.

[0044] In a possible implementation, determining the position of the first cursor according to the second coordinates specifically includes:

[0045] A position of the first cursor displayable on the first electronic device is determined according to the second coordinates and the size of the first electronic device.

[0046] Among them, the second coordinate can be associated with the size of the first electronic device. If the coordinate value corresponding to the second coordinate in the first direction or the second direction is within the size range corresponding to the first electronic device, the first cursor can be displayed on the first electronic device according to the second coordinate. The first cursor can move within the display interface of the first electronic device according to the movement of the second electronic device, has good directionality, and can improve the operating experience.

[0047] In a possible implementation, a third coordinate is obtained according to the first coordinate and the deflection angle, and a position of a second cursor that cannot be displayed on the first electronic device is determined according to the third coordinate and the size of the first electronic device.

[0048] Among them, the third coordinate can be associated with the size of the first electronic device. If the coordinate value of the third coordinate in the first direction X or the second direction Y exceeds the size range corresponding to the first electronic device, it means that the position for displaying the cursor obtained according to the third coordinate cannot fall within the range of the first electronic device. At this time, the cursor position obtained is the second cursor position that cannot be displayed on the first electronic device. Therefore, when the third coordinate exceeds the range of the first electronic device, even if the second electronic device moves, the cursor will not be displayed on the first electronic device, thereby avoiding the problem of inaccurate pointing.

[0049] In one possible implementation, at least three first antenna units are provided, and at least two second antenna units are provided. At least some of the at least three first antenna units have signal receiving and / or signal transmitting functions, and the at least three first antenna units are arranged in a predetermined pattern to facilitate calculation of the first coordinate. At least two second antenna units may also have signal receiving and / or signal transmitting functions, and the at least two second antenna units are also arranged in a predetermined pattern to facilitate calculation of the deflection angle.

[0050] In one possible implementation, the multiple first antenna units are respectively a first antenna, a second antenna and a third antenna, the first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on one side of the first antenna in the first direction, and the third antenna is located on one side of the first antenna in the second direction.

[0051] By positioning the first antenna at the intersection of the first and second directions, a coordinate system can be established, with the first antenna serving as the origin of the coordinate system. Positioning the second and third antennas in the first and second directions relative to the first antenna, respectively, facilitates obtaining the phases in the first and second directions, thereby facilitating calculation of the first coordinates.

[0052] In one possible implementation, the distance between any two of the multiple first antenna units that have the function of receiving the first signal is less than or equal to the wavelength of the first signal; and / or the distance between any two of the multiple second antenna units that have the function of receiving the second signal is less than or equal to the wavelength of the second signal, so that each first antenna unit used to receive the signal can receive the first signal almost at the same time, each second antenna unit can receive the second signal almost at the same time, and each first antenna unit can obtain a phase parameter based on the first signal, and each second antenna unit can obtain a deflection angle based on the second signal.

[0053] In one possible implementation, one second antenna is provided in the first direction, or multiple antennas are provided at intervals, and one third antenna is provided in the second direction, or multiple antennas are provided at intervals. Providing one second antenna and one third antenna facilitates the placement of each antenna and the calculation of the first coordinate. Providing multiple second antennas and multiple third antennas improves the radiation performance of the first antenna array. Alternatively, one second antenna and multiple third antennas may be provided, or multiple second antennas and one third antenna may be provided, thereby enabling flexible placement of the antennas.

[0054] In a possible implementation manner, the first signal includes a time parameter and a first phase parameter;

[0055] The measuring, according to the first signal, a first coordinate of the second antenna array in the three-dimensional coordinate system where the first antenna array is located specifically includes:

[0056] Obtaining a distance between the first antenna array and the second antenna array according to the time parameter;

[0057] The first coordinate is obtained according to the distance and the first phase parameter.

[0058] The distance between the first antenna array and the second antenna array can be accurately obtained according to the time parameter, and the accuracy of the calculation of the first coordinate can be improved by combining the first phase parameter in the first signal.

[0059] In one possible implementation, the first antenna may be capable of transmitting the second signal, and the distance between the first antenna array and the second antenna array may specifically be a first distance between the first antenna and the second antenna array. Obtaining the first coordinate based on the distance and the first phase parameter specifically includes:

[0060] Obtaining a first phase difference between the second antenna and the first antenna, and a second phase difference between the third antenna and the first antenna according to the first phase parameter;

[0061] The x-axis coordinate value and the z-axis coordinate value in the first coordinate are obtained according to the first distance, the distance between the second antenna and the first antenna, and the first phase difference; the y-axis coordinate value in the first coordinate is obtained according to the first distance, the distance between the third antenna and the first antenna, and the second phase difference.

[0062] The first phase parameters obtained by the second antenna and the third antenna are both located in the same signal period, and the first coordinate can be accurately calculated based on the first distance and the first phase difference and the second phase difference obtained based on the first phase parameter.

[0063] In one possible implementation, the second antenna array includes a fourth antenna, a fifth antenna, and a sixth antenna, the fifth antenna being located on one side of the fourth antenna in a third direction, the sixth antenna being located on one side of the fourth antenna in a fourth direction, and the third direction being perpendicular to the fourth direction.

[0064] Among them, the fourth antenna can be located at the intersection of the third direction and the fourth direction. By making the fifth antenna and the sixth antenna respectively located in the third direction and the fourth direction of the fourth antenna, it is convenient to obtain the deflection angle of the second antenna array relative to the first direction and the second direction.

[0065] In a possible implementation manner, the second signal includes a second phase parameter;

[0066] The measuring, according to the second signal, a deflection angle of the second antenna array relative to the first direction and the second direction specifically includes:

[0067] The deflection angle is obtained according to the second phase parameter, thereby improving the accuracy of the deflection angle calculation.

[0068] In a possible implementation manner, obtaining the deflection angle according to the second phase parameter specifically includes:

[0069] obtaining a third phase difference between the fifth antenna and the fourth antenna, and a fourth phase difference between the sixth antenna and the fourth antenna according to the second phase parameter;

[0070] A first deflection angle of the second antenna array in the first direction is obtained according to the third phase difference, and a second deflection angle of the second antenna array in the second direction is obtained according to the fourth phase difference.

[0071] The second phase parameters obtained by the fifth antenna and the sixth antenna are both located in the same signal period, and the deflection angle can be accurately calculated based on the third phase difference and the fourth phase difference obtained according to the second phase parameters.

[0072] In one possible implementation, the second antenna array includes a fourth antenna, a fifth antenna, and an acceleration sensor, the fifth antenna is located on one side of the fourth antenna in a third direction, the acceleration sensor is located on one side of the fourth antenna in a fourth direction, and the third direction is perpendicular to the fourth direction;

[0073] The second signal includes a second phase parameter;

[0074] The measuring, according to the second signal, a deflection angle of the second antenna array relative to the first direction and the second direction specifically includes:

[0075] obtaining a third phase difference between the fifth antenna and the fourth antenna according to the second phase parameter;

[0076] A first deflection angle of the second antenna array in the first direction is obtained according to the third phase difference, and a second deflection angle of the second antenna array in the second direction is obtained by the acceleration sensor according to the second phase parameter.

[0077] Among them, the acceleration sensor can replace the function of the sixth antenna, thereby reducing the layout of one antenna, that is, only the fourth antenna and the fifth antenna need to be arranged on the second electronic device. The acceleration sensor can cooperate with the fifth antenna to obtain the deflection angle of the second antenna array.

[0078] In a possible implementation manner, obtaining the distance between the first antenna array and the second antenna array according to the time parameter specifically includes:

[0079] detecting a first time point at which the second antenna array sends the first signal;

[0080] detecting a second time point at which the first antenna array receives the first signal;

[0081] The distance is obtained according to the first time point, the second time point and a predetermined speed value.

[0082] The distance measurement method is a one-way ranging method. This method requires precise time synchronization between the first and second antenna arrays, enabling distance measurement through a single signal transmission and reception, making operation convenient. For ease of calculation, the predetermined speed value can be the speed of light. Of course, other speed values ​​can also be used in the presence of speed interference or errors. Furthermore, when the first antenna array includes the aforementioned first antenna with a signal transmission function, the distance between the first and second antenna arrays can specifically be the distance between the first and second antenna arrays.

[0083] In a possible implementation manner, obtaining the distance between the first antenna array and the second antenna array according to the time parameter specifically includes:

[0084] detecting a first time point at which the second antenna array sends the first signal;

[0085] detecting a second time point at which the first antenna array receives the first signal;

[0086] detecting a delay duration of the first antenna array processing the first signal;

[0087] detecting a third time point at which the first antenna array sends the second signal;

[0088] detecting a fourth time point at which the second antenna array receives the second signal;

[0089] The distance is obtained according to the first time point, the second time point, the delay duration, the third time point, the fourth time point and a predetermined speed value.

[0090] The distance measurement method is a two-way ranging method. This method can be used if the clocks of the second antenna array and the first antenna array are not synchronized. This method can account for signal processing delays, resulting in more accurate distance measurement. For ease of calculation, the predetermined speed value can be the speed of light or other speeds, which will not be further described here.

[0091] In one possible implementation, the first antenna is a transceiver integrated antenna, that is, the first antenna can have the function of receiving and transmitting signals, and can switch functions by switching switches, thereby reducing the number of antennas, saving space, and facilitating antenna layout.

[0092] In one possible implementation, the first antenna includes a receiving antenna and a transmitting antenna, that is, the first antenna includes two antennas, the transmitting antenna is used to transmit signals, and the receiving antenna is used to receive signals. The first antenna does not need to switch, and the corresponding transmitting and receiving functions can be implemented through each antenna.

[0093] In a possible implementation, the plurality of first antenna units are distributed in an L-shape, a triangle, or a rectangular array, thereby facilitating flexible arrangement of the first antenna units.

[0094] In a possible implementation, the plane formed by the first direction and the second direction is parallel to the display interface of the first electronic device, thereby facilitating geometric calculations of the values ​​of each coordinate point in the first coordinates and improving the accuracy of the first coordinates.

[0095] In a third aspect, the present application further provides a positioning system, which is used to implement the positioning method provided in the first aspect of the present application, and the positioning system includes: a first electronic device and a second electronic device;

[0096] The first electronic device is provided with a first antenna array and a first module circuit, the first antenna array is used to send the second signal and to receive the first signal sent by the second antenna array in the second electronic device; the first module circuit is electrically connected to the first antenna array;

[0097] The second electronic device is provided with the second antenna array and a second module circuit, the second antenna array is used to send the first signal and to receive the second signal; the second module circuit is electrically connected to the second antenna array,

[0098] The first module circuit or the second module circuit is used to determine the position of a first cursor presented on the first electronic device according to the first signal and the second signal.

[0099] Among them, the positioning system can accurately present the position of the first cursor on the first electronic device through the mutual positioning of the first antenna array and the second antenna array, thereby improving the precise positioning of the second antenna array and improving the operating experience in spatial pointing operations.

[0100] In a possible implementation, the first module circuit includes a control unit, a computing unit, a transmitter, and a receiver;

[0101] The transmitter is connected to the first antenna array, and is used to control the first antenna array to transmit the second signal;

[0102] The receiver is connected to the first antenna array, and is used to control the first antenna array to receive the first signal;

[0103] The calculation unit is used to calculate the phase parameter in the first signal;

[0104] The control unit is used to control the operation of the receiver and the transmitter, and is also used to calculate and obtain the first coordinates of the second antenna array according to the calculation result of the calculation unit.

[0105] In one possible implementation, the first antenna array includes a first antenna, a second antenna, and a third antenna, the first antenna being located at the intersection of the first direction and the second direction, the second antenna being located on one side of the first antenna in the first direction, and the third antenna being located on one side of the first antenna in the second direction; the second antenna and the third antenna being electrically connected to the receiver respectively;

[0106] The first antenna is a transceiver integrated antenna; the first module circuit also includes a switching switch, which is electrically connected to the first antenna, the transmitter and the receiver respectively, and the switching switch is used to switch the first antenna to be electrically connected to the transmitter or to the receiver.

[0107] The first antenna may have the functions of receiving and transmitting signals, and the functions may be switched by switching a switch, thereby reducing the number of antennas, saving space, and facilitating antenna arrangement.

[0108] In one possible implementation, the first antenna array includes a first antenna, a second antenna, and a third antenna, the first antenna being located at the intersection of the first direction and the second direction, the second antenna being located on one side of the first antenna in the first direction, and the third antenna being located on one side of the first antenna in the second direction; the second antenna and the third antenna being electrically connected to the receiver respectively;

[0109] The first antenna includes a transmitting antenna and a receiving antenna. The transmitting antenna is electrically connected to the transmitter, and the receiving antenna is electrically connected to the receiver.

[0110] Among them, the first antenna includes two antennas, the transmitting antenna is used to transmit signals, and the receiving antenna is used to receive signals. The first antenna does not need to switch, and the corresponding transmitting and receiving functions can be realized through each antenna.

[0111] In one possible implementation, there is one receiver, electrically connected to a first antenna element in the first antenna array that has a signal receiving function. Thus, a single receiver can receive signals from multiple first antenna elements, enabling them to receive signals nearly simultaneously and calculating the first coordinates based on the phase differences between the first antenna elements. In another possible implementation, there are multiple receivers, each electrically connected to one of the first antenna elements in the first antenna array that has a signal receiving function.

[0112] The receivers may perform synchronization processing with each other through a synchronization signal, thereby obtaining a phase difference between the first antenna units.

[0113] In a possible implementation, the second module circuit includes a control unit, a computing unit, a transmitter, and a receiver;

[0114] The transmitter is connected to the second antenna array, and is used to control the second antenna array to transmit the first signal;

[0115] The receiver is connected to the second antenna array, and is used to control the second antenna array to receive the second signal;

[0116] The calculation unit is used to calculate the phase parameter in the second signal;

[0117] The control unit is used to control the operation of the receiver and the transmitter, and is also used to calculate the deflection angle of the second antenna array according to the calculation result of the calculation unit.

[0118] In a fourth aspect, the present application also provides an electronic device, which is a first electronic device, and the first electronic device is provided with a first antenna array, the first antenna array including multiple first antenna units, at least two of the multiple first antenna units are distributed in a first direction and a second direction, respectively, and the first direction is perpendicular to the second direction; the first antenna array is used to receive a signal sent by a second antenna array on a second electronic device, and determine the position of a first cursor presented on the first electronic device based on the signal.

[0119] The first electronic device provided in the present application can receive signals sent by the second antenna array through the first antenna array, and can also send signals to the second antenna array through the first antenna array. The second antenna array can process the signals it receives, so that mutual positioning can be achieved through the signals exchanged between the first antenna array and the second antenna array, thereby obtaining the absolute coordinates of the second antenna array relative to the first electronic device, and the second antenna array can achieve precise pointing to the specified position of the first electronic device.

[0120] In one possible implementation, the multiple first antenna units are respectively a first antenna, a second antenna and a third antenna, the first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on one side of the first antenna in the first direction, and the third antenna is located on one side of the first antenna in the second direction.

[0121] In one possible implementation, the distance between any two of the plurality of first antenna units that are capable of receiving the first signal is less than or equal to the wavelength of the first signal. This allows each of the first antenna units capable of receiving the signal to receive the first signal nearly simultaneously and obtain a phase parameter based on the first signal.

[0122] In the fifth aspect, a display device includes a positioning module and a display screen; wherein the positioning module is used to send and receive positioning information between the control device; the display screen is used to present interface effects; the positioning module and the display screen are used to support the display device to implement the method described in any one of the first aspect or the second aspect.

[0123] In a sixth aspect, a computer-readable storage medium is provided, on which computer program instructions are stored. When the computer program instructions are executed by a processor, the method in any possible implementation of the first aspect or the second aspect is implemented.

[0124] In a seventh aspect, a computer program product comprising instructions is provided, which, when executed on a computer, enables the computer to implement the method in any possible implementation of the first aspect or the second aspect.

[0125] In an eighth aspect, a chip system is provided, comprising a processing circuit and a storage medium storing computer program instructions; when the computer program instructions are executed by the processor, the method of any possible implementation of the first or second aspect is implemented. The chip system may be composed of a chip alone, or may include a chip and other discrete components. BRIEF DESCRIPTION OF THE DRAWINGS

[0126] FIG1 is a schematic diagram of the presentation process of a remote control cursor in a conventional single-display device scenario;

[0127] FIG2 is a schematic diagram of a remote control cursor presentation process in a conventional multi-display device scenario;

[0128] FIG3 is a schematic diagram of a device remote control system architecture in a single display device scenario provided by an embodiment of the present application;

[0129] FIG4 is a schematic diagram of a remote control cursor presentation process in a single display device scenario provided by an embodiment of the present application;

[0130] FIG5 is a schematic diagram of a device remote control system architecture in a multi-display device scenario provided by an embodiment of the present application;

[0131] FIG6 is a schematic diagram of a remote control cursor presentation process in a multi-display device scenario provided by an embodiment of the present application;

[0132] FIG7 is a flow chart of a device display control method in a single device scenario according to an embodiment of the present application;

[0133] FIG8 is a schematic diagram of a method for determining the coordinate system of a display screen based on a multi-antenna UWB positioning method provided by an embodiment of the present application;

[0134] FIG9 is a flowchart of determining the coordinate system of a display screen based on a multi-antenna UWB positioning method according to an embodiment of the present application;

[0135] FIG10 is a schematic diagram of another method for determining the coordinate system of a display screen based on a multi-antenna UWB positioning method according to an embodiment of the present application;

[0136] FIG11 is a schematic diagram of a process for determining a pointing position of a control device according to an embodiment of the present application;

[0137] FIG12 is an architecture diagram of a three-dimensional electromagnetic coil positioning system provided in an embodiment of the present application;

[0138] FIG13 is a schematic diagram of determining the pointing position of a control device based on a three-dimensional electromagnetic coil positioning method provided by an embodiment of the present application;

[0139] FIG14 is a schematic diagram of determining the position and posture of a control device based on a three-dimensional electromagnetic coil positioning method provided by an embodiment of the present application;

[0140] FIG15 is a second flow chart of a device display control method in a single device scenario provided by an embodiment of the present application;

[0141] FIG16 is a schematic diagram of a cursor presentation effect provided by an embodiment of the present application;

[0142] FIG17 is a flow chart of a device display control method in a multi-device scenario provided by an embodiment of the present application;

[0143] FIG18 is a flowchart of a cursor traversal process in a multi-device scenario according to an embodiment of the present application;

[0144] FIG19 is a first schematic diagram of a cursor crossing process according to an embodiment of the present application;

[0145] FIG20 is a second flow chart of the cursor crossing process in a multi-device scenario provided by an embodiment of the present application;

[0146] FIG21 is a second schematic diagram of a cursor crossing process according to an embodiment of the present application;

[0147] FIG22 is a flowchart of the cursor crossing process in a multi-device scenario according to an embodiment of the present application;

[0148] FIG23 is a schematic diagram showing an update result of a coordinate system where a display carrier is located when the orientation of a projector changes according to an embodiment of the present application;

[0149] FIG24 is a schematic diagram showing an update result of a coordinate system where a display carrier is located when the orientation of another projector changes according to an embodiment of the present application;

[0150] FIG25 is a schematic diagram of a process of a cursor crossing between display devices with different attributes provided by an embodiment of the present application.

[0151] FIG26 is an architecture diagram of a positioning system provided in an embodiment of the present application;

[0152] FIG27 is a schematic structural diagram of a first electronic device provided in an embodiment of the present application;

[0153] FIG28 is a diagram illustrating an arrangement of a first antenna array on a first electronic device according to an embodiment of the present application;

[0154] FIG29 is a schematic diagram of an arrangement of the first antenna unit;

[0155] FIG30 is a schematic diagram of another arrangement of the first antenna unit;

[0156] FIG31 is a schematic diagram of another arrangement of the first antenna unit;

[0157] FIG32 is a schematic structural diagram of a second electronic device provided in an embodiment of the present application;

[0158] FIG33 is a diagram showing an arrangement state of a second antenna array on a second electronic device according to an embodiment of the present application;

[0159] FIG34 is a diagram of a model for calculating a first coordinate provided in an embodiment of the present application;

[0160] FIG35 is a schematic diagram of a one-way ranging method provided in an embodiment of the present application;

[0161] FIG36 is a schematic diagram of a two-way ranging method provided in an embodiment of the present application;

[0162] FIG37 is a diagram of another model for calculating the first coordinate provided in an embodiment of the present application;

[0163] FIG38 is a diagram of another model for calculating the first coordinate provided in an embodiment of the present application;

[0164] FIG39 is a flowchart of a positioning method provided by an embodiment of the present application;

[0165] Figure 40 is a flowchart of a positioning method provided by another embodiment of the present application.

[0166] Reference numerals: 100 - first electronic device; 110 - power module; 120 - first antenna array; 120a - first antenna unit; 121 - first antenna; 121a - transmitting antenna; 122 - second antenna; 123 - third antenna; 130 - first module circuit; 131 - control unit; 132 - computing unit; 133 - transmitter; 134 - receiver; 135 - switch; 140 - processor; 150 - transmission interface; 160 - display interface; 200 - second electronic device; 210 - power module; 220 - second antenna array; 221 - fourth antenna; 221a - transmitting antenna; 222 - fifth antenna; 223 - sixth antenna; 230 - second module circuit; 231 - control unit; 232 - computing unit; 233 - transmitter; 234 - receiver; 235-Switch; 240-Processor; 250-Transmission interface. DETAILED DESCRIPTION

[0167] The technical solutions in the embodiments of the present application will be described below in conjunction with the accompanying drawings in the embodiments of the present application. In the description of the embodiments of the present application, unless otherwise specified, " / " means or, for example, A / B can mean A or B; "and / or" in this article is merely a description of the association relationship of associated objects, indicating that three relationships can exist, for example, A and / or B can mean: A exists alone, A and B exist at the same time, and B exists alone. In addition, in the description of the embodiments of the present application, "multiple" means two or more than two.

[0168] In the following, the terms "first", "second", etc. are only used to distinguish different descriptive objects, and have no limiting effect on the position, order, priority, quantity or content of the described objects. For example, if the described object is a "field", then the ordinal number before the "field" in the "first field" and the "second field" does not limit the position or order between the "fields", and "first" and "second" do not limit whether the "fields" they modify are in the same message, nor do they limit the order of the "first field" and the "second field". For another example, if the described object is a "level", then the ordinal number before the "level" in the "first level" and the "second level" does not limit the priority between the "levels". For another example, the number of described objects is not limited by the ordinal number and can be one or more. Taking the "first display device" as an example, the number of "devices" can be one or more. In addition, the objects modified by different prefixes can be the same or different. For example, if the described object is a "device," then the "first display device" and the "second display device" can be devices of the same type or different types. For another example, if the described object is "information," then the "first information" and the "second information" can be information of the same content or information of different contents. In short, the use of prefixes such as ordinal numbers in the embodiments of this application to distinguish the described objects does not constitute a restriction on the described objects. For the description of the described objects, please refer to the description in the context of the claims or embodiments, and the use of such prefixes should not constitute an unnecessary restriction.

[0169] Furthermore, in the embodiments of the present application, "connection" may be a direct connection or an indirect connection; in addition, it may refer to an electrical connection or a communication connection; for example, the connection between two electrical components A and B may refer to a direct connection between A and B, or may refer to an indirect connection between A and B through other electrical components or connection media, or may refer to an indirect connection between A and B through other communication devices or communication media, as long as communication between A and B can be achieved.

[0170] As described above, currently, when determining the presentation position of a display object such as a cursor, the cursor displacement, and thus the cursor presentation position, is often determined based on the relative positional changes of the control device. For example, the cursor displacement relative to a historical cursor presentation position can be determined based on the positional changes of the control device relative to a historical position, where the historical position includes an initial position, a most recently determined position, and the historical cursor presentation position includes an initial cursor presentation position, a most recently determined cursor presentation position, and the like.

[0171] In the above-mentioned scheme for determining the cursor presentation position based on the relative posture change of the control device, since the initial cursor presentation position corresponding to the initial posture of the control device is usually a preset default position and is not related to the actual posture of the control device, the cursor presentation position is not necessarily the actual pointing position of the control device. In other words, there is a deviation between the cursor presentation position on the display device and the actual pointing position of the control device, so the user's control experience during use will be relatively poor. For example, when the control device is actually pointing outside the display screen, the cursor will still be displayed on the display screen. As shown in Figure 1, when the control device with a posture of A1 is actually pointing to position B1 outside the display screen, the cursor is displayed at cursor presentation position C1 on the display screen shown in Figure 1. For another example, when the control device is actually pointing to a first position on the display screen, the cursor is displayed at a second position on the display screen, where the first position and the second position are different. As shown in Figure 1, when the control device with a posture of A2 is actually pointing to position B2, the cursor is displayed at position C2 on the display screen. As shown in Figure 1, when the control device with a posture of A3 is actually pointing to position B3, the cursor is displayed at position C3 on the display screen.

[0172] In addition, when the solution of determining the cursor presentation position based on the relative posture change of the control device is applied to a single display device scenario, when the actual pointing position of the control device moves out of the display screen, the cursor will usually stay at the edge of the display screen (referred to as the card frame). For example, when the control device with a posture of A4 actually points to the position B4 outside the display screen shown in Figure 1, the cursor will be stuck at the edge position C4 of the display screen shown in Figure 1. Moreover, when the posture of the control device changes from the posture A4 shown in Figure 1 to the posture A5 shown in Figure 1, although the actual pointing position of the control device changes from B4 shown in Figure 1 to B5 shown in Figure 1, the cursor presentation position C5 is determined based on the card frame position shown in Figure 1, that is, the cursor presentation position C4. In this case, the deviation between the cursor presentation position and the actual pointing position of the control device will be aggravated, giving the user a worse control experience.

[0173] Alternatively, when the solution for determining the cursor presentation position based on the relative posture change of the control device is applied to a multi-display device scenario, when the cursor leaves the current device (such as the first display device) and moves to the display device (such as the second display device) in the corresponding orientation, the second display device will continue to present the cursor on the first display device. Since the device where the cursor is currently located does not perceive other display devices around it, it is usually necessary to pre-set the orientation relationship between the multiple display devices. As shown in Figure 2, after the orientation relationship between the first display device, the second display device and the third display device is pre-set, when the cursor leaves the first display device and moves to the second display device located above the first display device, the second display device continues to present the cursor on the first display device; or when the cursor leaves the first display device and moves to the third device located to the right of the first display device, the third device continues to present the cursor on the first display device. However, the premise for implementing this solution is that the orientation relationship between the multiple display devices needs to be determined and set in advance. If the orientation relationship between the multiple display devices shown in Figure 2 changes and the setting is not updated in time, the cursor presentation logic will not automatically adjust according to the change in the orientation between the display devices, which may cause the cursor presentation to not match the real scene, affecting the user experience. Furthermore, this solution only considers the orientation relationship between multiple display devices. It does not perform adaptive cursor presentation adjustments when the types, screen sizes, and screen resolutions of the multiple display devices are different, nor does it perform adaptive cursor presentation adjustments based on the specific distances between the screens of the multiple display devices. For example, when the cursor passes between two display devices that are farther apart as shown in FIG2 , after the cursor moves out of the edge area of ​​the screen of one device, it will directly enter the screen of the other device. The jumps in the visual distance will cause the cursor to pass unevenly, affecting the user's control experience. For another example, when the cursor passes between two display devices with different screen resolutions, the different screen resolutions may cause the presentation positions corresponding to the cursor's real coordinates to be inconsistent on the two screens, resulting in jumps in the visual distance when the cursor passes, causing the cursor to pass unevenly, affecting the user's control experience.

[0174] In addition, in the solution that determines the cursor presentation position based on the relative posture change of the control device, no matter how far the control device is from the display screen, the cursor displacement and the angle change of the control device are in a fixed proportional relationship. This will cause the user to control the cursor at different distances, and the same angle deflection corresponds to the same cursor movement distance. Therefore, the user's control experience when controlling the cursor at different distances varies greatly.

[0175] In order to solve the problems existing in the above-mentioned conventional solutions for determining the cursor presentation position, an embodiment of the present application provides a device display control method, which can determine the cursor presentation position based on the pointing direction of the control device, so as to solve the problem of deviation between the cursor presentation position and the actual pointing position of the control device, the problem of the cursor being stuck when moving out of the edge of the display screen, the inability of the cursor presentation logic to automatically perceive the orientation relationship between the display screens of multiple display devices / the types of multiple display devices / the sizes of the display screens of multiple display devices / the resolutions of the display screens of multiple display devices / the distance between the display screens of multiple display devices, and other problems.

[0176] It should be noted that the cursor described in the embodiments of this application is a cursor in a broad sense. The display form of the cursor can be diverse, including but not limited to icons such as arrows, dots, and editable symbols. In some embodiments, the display form of the cursor can be adaptively displayed based on different interfaces, such as an editable symbol in an editable document or an arrow in a folder interface. This is not specifically limited in the embodiments of this application. The following embodiments use "cursor" as an example.

[0177] Among them, in an embodiment of the present application, the control device and the display device both include a wireless positioning unit, and the wireless positioning unit of the control device and the wireless positioning unit of the display device can locate each other by sending and receiving positioning information. For example, the wireless positioning unit of the control device and the wireless positioning unit of the display device can determine the intersection position of the direction of the control device and the plane where the display screen of the display device is located by sending and receiving positioning information, which is the pointing position of the control device. When the pointing position of the control device is on the display screen, the display device can follow the moving trajectory of the control device to present the corresponding interface effect on the display screen; when the pointing position of the control device is not on the display screen, the display device does not present the corresponding interface effect on the display screen.

[0178] As an example, the interface effects presented on the display screen may include, but are not limited to, presenting a display object (such as an icon, cursor, component, avatar, image, etc.) at the pointing position of the control device, displaying a corresponding viewing angle effect based on the pointing position of the control device, and presenting a pre-set special effect in a corresponding display area (such as a preset control hotspot) based on the pointing position of the display control device. The following embodiments use a cursor as an example to specifically describe the solutions provided in the embodiments of the present application. For display objects in other display forms, reference can also be made to the specific implementation process of cursor presentation.

[0179] For example, in a demonstration scenario, the interface effect presented on the display screen may be such as displaying a cursor at the pointing position of the control device.

[0180] For example, in a game scenario, the interface effects presented on the display screen include displaying the image of the game protagonist at the pointing position of the control device, displaying the image of the game protagonist at a preset perspective at the pointing position of the control device, displaying game equipment at the pointing position of the control device, displaying game special effects (such as bubble effects, fireworks effects, etc.) at the pointing position of the control device, and displaying game special effects (such as aiming effects, hitting effects, etc.) in the corresponding display area according to the pointing position of the display control device.

[0181] For example, in a handwriting tablet scenario, the interface effects presented on the display screen include displaying a stylus image and handwriting at the pointing position of the control device, and displaying handwriting in a corresponding display area (such as the historical trajectory of the stylus image) according to the pointing position of the display control device.

[0182] It should be noted that the interface effects presented on the display screen by the display device following the movement trajectory of the control device are merely examples. In actual applications, the effects may vary depending on the specific application scenario, device functionality, etc. For example, in some embodiments, the display device may follow the movement trajectory of the control device to present both icons and virtual images and special effects at a preset perspective on the display screen. For example, when the pointing position of the control device is within a preset control hotspot, the display device may present the corresponding virtual images and special effects at a preset perspective along with the icons.

[0183] As an example, when positioning each other by sending and receiving positioning information, the control device or display device can determine the direction of the control device, the coordinate system where the display screen of the display device is located, and the position of the display screen of the display device relative to the control device by sending and receiving positioning information, and then determine the intersection position of the direction of the control device and the plane where the display screen of the display device is located, which is the pointing position of the control device, and finally use the pointing position of the control device as the cursor presentation position.

[0184] In some implementations, the display device can determine the coordinate system in which the display screen of the display device is located and send it to the control device. The control device can determine the direction of the control device and the position of the display screen of the display device relative to the control device, and determine the pointing position of the control device based on the above information. The pointing position is then sent to the display device so that the display device can present a cursor at the corresponding position.

[0185] In other implementations, the control device can determine the direction of the control device and send it to the display device, and the display device can determine the coordinate system of the display screen of the display device and the position of the display screen of the display device relative to the control device, and determine the pointing position of the control device based on the above information, and present the cursor at the corresponding position.

[0186] The embodiment of the present application does not specifically limit the execution entity of calculating the pointing position of the control device, and it can be determined according to the actual device function or application scenario.

[0187] In some examples, the control device described in the embodiments of the present application may include, but is not limited to, a remote control, an air mouse, or a portable device. For example, a portable device may include, but is not limited to, a smartphone, a smartwatch, a smart bracelet, a phone watch, a smart ring, smart glasses, an augmented reality (AR) / virtual reality (VR) game controller, etc. Alternatively, the control device may be a wearable device, handheld device, head-mounted device, etc. of other types or structures with remote control functions, which is not limited in the embodiments of the present application.

[0188] In some examples, the display device described in the embodiments of the present application may include, but is not limited to, a netbook, a tablet computer, a handwriting tablet, a car computer, a personal computer (PC), a smart TV, a laser TV, an AR / VR device (such as VR glasses, etc.), a projection device (such as a projector), a somatosensory game console, etc. Alternatively, the display device may be an electronic device with a display function of other types or structures, which is not limited in the embodiments of the present application.

[0189] For example, please refer to Figure 3, which shows a schematic diagram of the device remote control system architecture in a single display device scenario provided by an embodiment of the present application. The device remote control system includes a control device 310 and a first display device 320. The first display device 320 is used to display an interface, and the control device 310 is used to perform display control and / or operation control on the first display device 320.

[0190] As shown in FIG3 , the control device 310 includes a processing unit 310 - 1 , a power management unit (PMU) 310 - 2 , a wireless positioning unit 310 - 3 , and a communication unit 310 - 4 .

[0191] The processing unit 310-1 may be a central processing unit (CPU). In some embodiments, the processing unit 310-1 may include one or more interfaces. The interfaces may include, but are not limited to, an inter-integrated circuit (I2C) interface, an inter-integrated circuit sound (I2S) interface, a pulse code modulation (PCM) interface, a universal asynchronous receiver / transmitter (UART) interface, a mobile industry processor interface (MIPI), a general-purpose input / output (GPIO) interface, and the like.

[0192] Processing unit 310-1 may also be provided with a storage unit for storing instructions and data. In some embodiments, the storage unit in processing unit 310-1 is a cache memory. This storage unit can store instructions or data that have just been used or are being recycled by processing unit 310-1. If processing unit 310-1 needs to use the instruction or data again, it can directly call it from the storage unit. This avoids repeated accesses, reduces the waiting time of processing unit 310-1, and thus improves system efficiency.

[0193] The power management unit 310-2 is used to connect the battery and the processing unit 310-1. The power management unit 310-2 receives input from the battery and supplies power to the processing unit 310-1, the wireless positioning unit 310-3, the communication unit 310-4, etc. For example, the power management unit 310-2 can convert the power level to a level that is suitable for each module such as the processing unit 310-1, the wireless positioning unit 310-3, and the communication unit 310-4 according to their characteristics to provide power to them. The power management module 310-2 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In some other embodiments, the power management unit 310-2 can also be set in the processing unit 310-1.

[0194] The wireless positioning unit 310 - 3 is used to determine the direction of the control device 310 .

[0195] In some embodiments of the present application, the wireless positioning unit 310-3 can also be used to determine the posture of the display screen of the first display device 320 (referred to as the first display screen) relative to the control device 320, and to determine the intersection position of the direction of the control device 310 and the plane where the first display screen is located, that is, the pointing position of the control device 310.

[0196] For example, the wireless positioning unit 310-3 may include, but is not limited to, one or more of a multi-antenna ultra wide band radio (UWB) positioning module, a multi-antenna millimeter wave radar positioning module, a three-dimensional electromagnetic coil positioning module, a three-dimensional ultrasonic positioning module, etc. The wireless positioning unit 310-3 may use one or more of the above modules to send and receive positioning information with the wireless positioning unit 320-3 of the first display device 320 to determine the orientation of the control device 310 and the position of the first display screen relative to the control device 320. The positioning information may include one or more of the following information: UWB signals, millimeter wave radar signals, electromagnetic signals, and ultrasonic signals.

[0197] The communication unit 310-4 is used to process communication matters between the control device and other devices, such as the first display device 320. For example, the communication unit 310-4 may include, but is not limited to, one or more of the following: a communication interface, an antenna, a mobile communication module, a wireless communication module, a modem processor, and a baseband processor.

[0198] The communication interface may include but is not limited to a wired communication interface such as a universal serial bus (USB).

[0199] Antennas are used to transmit and receive electromagnetic wave signals.

[0200] The mobile communication module can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied to the control device 310. The mobile communication module may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module can receive electromagnetic waves through the antenna, filter, amplify and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module can also amplify the signal modulated by the modulation and demodulation processor and convert it into electromagnetic waves for radiation through the antenna. In some embodiments, at least some functional modules of the mobile communication module can be set in the processing unit 310-1. In some embodiments, at least some functional modules of the mobile communication module can be set in the same device as at least some modules of the processing unit 310-1.

[0201] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium- or high-frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. In some embodiments, the modem processor may be a standalone device. In other embodiments, the modem processor may be independent of the processing unit 310-1 and may be located in the same device as the mobile communication module or other functional modules.

[0202] The wireless communication module can provide wireless communication solutions including wireless local area networks (WLAN) (such as WiFi networks), Bluetooth (BT), UWB, global navigation satellite system (GNSS), near field communication (NFC), infrared (IR), etc. applied to the control device 310. The wireless communication module can be one or more devices that integrate at least one communication processing module. The wireless communication module receives electromagnetic waves via an antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processing unit 310-1. The wireless communication module can also receive the signal to be sent from the processing unit 310-1, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0203] In other embodiments of the present application, the control device 310 can receive the first coordinate system where the first display screen is located from the first display device 320 through a wired communication interface or a wireless communication module, and send the pointing position of the control device 310 to the first display device 320.

[0204] In some embodiments of the present application, the control device 310 may send the direction of the control device 310 to the first display device 320 through a wired communication interface or a wireless communication module, so that the first display device 320 can determine the pointing position of the control device 310 based on this.

[0205] In some embodiments of the present application, the control device 310 may send display control instructions, such as opening a file, drawing a line, returning, etc., to the first display device 320 through a wired communication interface or a wireless communication module.

[0206] In some embodiments, as shown in FIG3 , the control device 310 may further include a motion measurement unit 310 - 5 , such as an inertial measurement unit (IMU). The motion posture detection unit 310 - 5 may include, but is not limited to, one or more of an acceleration sensor, a gyroscope sensor, an angular acceleration sensor, and a magnetic sensor, for measuring the motion posture of the control device 310 .

[0207] In an embodiment of the present application, the control device 310 can obtain changes in the position and posture of the control device 310 through the motion measurement unit 310-5 to determine the displacement of the cursor relative to the historical cursor presentation position based on the relative posture change of the control device, and then determine the presentation position of the cursor.

[0208] As shown in FIG3 , the first display device 320 includes a processing unit 320 - 1 , a power management unit 320 - 2 , a wireless positioning unit 320 - 3 , a display unit 320 - 4 , and a communication unit 320 - 5 .

[0209] The processing unit 320-1 may be a CPU. In some embodiments, the processing unit 320-1 may include one or more interfaces. The interfaces may include, but are not limited to, an I2C interface, an I2S interface, a PCM interface, a UART interface, a MIPI interface, a GPIO interface, and the like.

[0210] Processing unit 320-1 may also include a storage unit for storing instructions and data. In some embodiments, the storage unit in processing unit 320-1 is a cache memory. This storage unit can store instructions or data that have just been used or are being recycled by processing unit 320-1. If processing unit 320-1 needs to use the instruction or data again, it can directly access it from the storage unit. This avoids duplicate accesses, reduces the waiting time of processing unit 320-1, and thus improves system efficiency.

[0211] The power management unit 320-2 is used to connect the battery and the processing unit 320-1. The power management unit 320-2 receives input from the battery and supplies power to the processing unit 320-1, the wireless positioning unit 320-3, the communication unit 310-4, etc. For example, the power management unit 310-2 can convert the power level to a level that is suitable for each module such as the processing unit 310-1, the wireless positioning unit 310-3, the display unit 320-4, and the communication unit 320-5 according to their characteristics to provide power to them. The power management module 320-2 can also be used to monitor parameters such as battery capacity, battery cycle count, battery health status (leakage, impedance), etc. In some other embodiments, the power management unit 320-2 can also be set in the processing unit 320-1.

[0212] The wireless positioning unit 320-3 can be used to determine the first coordinate system where the first display screen is located.

[0213] In some embodiments of the present application, the wireless positioning unit 320-3 can also be used to determine the posture of the first display screen relative to the control device 320, and determine the intersection position of the direction of the control device 310 and the plane where the first display screen is located, that is, the pointing position of the control device 310.

[0214] For example, the wireless positioning unit 320-3 may include, but is not limited to, one or more of a UWB positioning module, a multi-antenna millimeter wave radar positioning module, a three-dimensional electromagnetic coil positioning module, a three-dimensional ultrasonic positioning module, etc. The wireless positioning unit 320-3 may use one or more of the above modules to send and receive positioning information with the wireless positioning unit 310-3 of the remote control device 310 to determine the first coordinate system where the first display screen is located or the position of the first display screen relative to the control device 320.

[0215] The display unit 320 - 4 is used to display images, videos, etc. For example, the display unit 320 - 4 may include a display screen.

[0216] In an embodiment of the present application, the display unit 320 - 4 may be used to display content. In some embodiments, the display unit 320 - 4 may also be used to present a cursor at the pointing position of the control device 310 .

[0217] It should be noted that in the embodiment of the present application, the display unit 320-4 can be integrated with other modules such as the processing unit 320-1, the power management unit 320-2, the wireless positioning unit 320-3 and the communication unit 320-5 (i.e., an integrated display device), or it can be independent of other modules such as the processing unit 320-1, the power management unit 320-2, the wireless positioning unit 320-3 and the communication unit 320-5 (i.e., a split display device), and the embodiment of the present application does not make specific limitations.

[0218] The display screen described in the embodiments of the present application is a broad concept. A display screen is a display carrier. For example, when the first display device 320 is an all-in-one display device such as a television or a PC, the display carrier may be a display panel, etc.; when the first display device 320 is a separate display device such as a projector, the display carrier may be a screen, a wall, a ceiling, etc. Furthermore, the display screen described in the embodiments of the present application may be flat or curved, without limitation.

[0219] The communication unit 320-5 is used to handle communication matters between the first display device 320 and other devices, such as the control device 320. For example, the communication unit 320-5 may include, but is not limited to, one or more of the following: a communication interface, an antenna, a mobile communication module, a wireless communication module, a modem processor, and a baseband processor.

[0220] The communication interface may include but is not limited to a wired communication interface such as USB.

[0221] Antennas are used to transmit and receive electromagnetic wave signals.

[0222] The mobile communication module can provide solutions for wireless communications including 2G / 3G / 4G / 5G applied on the first display device 320. The mobile communication module may include at least one filter, a switch, a power amplifier, a low noise amplifier (LNA), etc. The mobile communication module can receive electromagnetic waves from the antenna, filter, amplify and process the received electromagnetic waves, and transmit them to the modulation and demodulation processor for demodulation. The mobile communication module can also amplify the signal modulated by the modulation and demodulation processor, and convert it into electromagnetic waves for radiation through the antenna. In some embodiments, at least some functional modules of the mobile communication module can be set in the processing unit 320-1. In some embodiments, at least some functional modules of the mobile communication module can be set in the same device as at least some modules of the processing unit 320-1.

[0223] The modem processor may include a modulator and a demodulator. The modulator is used to modulate the low-frequency baseband signal to be transmitted into a medium- or high-frequency signal. The demodulator is used to demodulate the received electromagnetic wave signal into a low-frequency baseband signal. The demodulator then transmits the demodulated low-frequency baseband signal to the baseband processor for processing. In some embodiments, the modem processor may be a standalone device. In other embodiments, the modem processor may be independent of the processing unit 320-1 and may be provided in the same device as the mobile communication module or other functional modules.

[0224] The wireless communication module can provide wireless communication solutions including WLAN (such as WiFi network), BT, UWB, GNSS, NFC, IR, etc. applied to the first display device 320. The wireless communication module can be one or more devices that integrate at least one communication processing module. The wireless communication module receives electromagnetic waves via the antenna, frequency modulates and filters the electromagnetic wave signals, and sends the processed signals to the processing unit 320-1. The wireless communication module can also receive the signal to be transmitted from the processing unit 320-1, frequency modulate it, amplify it, and convert it into electromagnetic waves for radiation through the antenna.

[0225] In some embodiments of the present application, the first display device 320 can send the first coordinate system where the first display screen is located to the control device 310 through a wired communication interface or a wireless communication module, and receive the pointing position of the control device 310 from the control device 310.

[0226] In other embodiments of the present application, the first display device 320 may receive the direction of the control device 310 from the control device 310 through a wired communication interface or a wireless communication module.

[0227] In some embodiments of the present application, the first display device 320 can receive control instructions from the control device 310 through a wired communication interface or a wireless communication module, such as opening a file, drawing a line, returning, etc.

[0228] Among them, because the device display control method provided in the embodiment of the application determines the cursor display position based on the pointing position of the control device, the display device does not display the cursor when the pointing position of the control device is not on the display screen of the display device. Only when the pointing position of the control device enters the edge area of ​​the display screen of the display device will the display device display the cursor at the pointing position of the control device. Therefore, this solution can provide users with a very convenient, immersive, and precise cursor control and device operation experience in a single display device scenario.

[0229] For example, please refer to Figure 4, which shows a schematic diagram of the remote control cursor presentation process in a single display device scenario provided by an embodiment of the present application. The single display device scenario shown in Figure 4 includes a control device 310 and a first display device 320. The first display device 320 is used to display an interface, and the control device 310 is used to perform display control and / or operation control on the first display device 320.

[0230] As shown in Figure 4, when the control device 310 in posture A1 points to position B1 outside the display screen, the first display device 320 does not display a cursor because position B1 is not on the first display screen. When the control device 310 in posture A2 points to position B2, since position B2 is on the first display screen, the first display device 320 displays a cursor at position B2, where the control device 310 is pointing. Similarly, when the control device 310 in posture A3 points to position B3, the first display device 320 displays a cursor at position B3, where the control device 310 is pointing. When the control device 310 in posture A4 points to position B4 outside the display screen, since position B4 is not on the first display screen, the first display device 320 does not display a cursor. When the control device 310 changes its posture from posture A4 to A5, since position B5 returns to the first display screen, the first display device 320 displays a cursor at position B5, where the control device 310 is pointing.

[0231] It can be seen that compared to the remote control cursor presentation process in the single-display device scenario shown in FIG1 , in the remote control cursor presentation process in the single-display device scenario shown in FIG4 , since each cursor presentation position of the first display device 320 (i.e., the pointing position of the control device 310) is referenced to the pointing position of the control device 310, the first display device 320 does not present the cursor when the pointing position of the control device 310 is not on the first display screen. Only when the pointing position of the control device 310 enters the edge area of ​​the first display screen will the first display device 320 present the cursor at the pointing position of the control device 310. Furthermore, when the pointing position of the control device 310 moves out of the first display screen, the cursor will not be stuck in the frame. In this way, when the pointing position of the control device 310 enters the edge area of ​​the first display screen, the first display device 320 can follow the movement trajectory of the control device 310 to present the corresponding interface effect (such as presenting a cursor) on the first display screen; when the pointing position of the control device 310 moves out of any edge area of ​​the first display screen (such as the upper edge area, the lower edge area, the left edge area or the right edge area), the first display device 320 does not continue to present the corresponding interface effect (such as not presenting a cursor) on the first display screen. Therefore, this solution can bring users a very convenient, immersive and accurate cursor presentation, cursor control and device control experience in a single display device scenario.

[0232] For another example, please refer to Figure 5, which shows a schematic diagram of the device remote control system architecture in a multi-display device scenario provided by an embodiment of the present application. The device remote control system includes a control device 310, a first display device 320, and a second display device 330. The first display device 320 and the second display device 330 are used to display an interface, and the control device 310 is used to perform display control and / or operation control on the first display device 320 or the second display device 330.

[0233] As shown in FIG5 , the control device 310 includes a processing unit 310 - 1 , a power management unit 310 - 2 , a wireless positioning unit 310 - 3 , and a communication unit 310 - 4 .

[0234] Among them, the wireless positioning unit 310-3 is used to determine the direction of the control device 310.

[0235] In some embodiments of the present application, the wireless positioning unit 310-3 can also be used to determine the posture of the display screen of the first display device 320 (i.e., the first display screen) and the display screen of the second display device 330 (referred to as the second display screen) relative to the control device 320, and based on the above information, determine the intersection position of the direction of the control device 310 and the plane where the first display screen is located, i.e., the pointing position of the control device 310.

[0236] For example, the wireless positioning unit 310-3 can send and receive positioning information with the wireless positioning unit 320-3 of the first display device 320 and the wireless positioning unit 330-3 of the second display device 330 through one or more of a UWB positioning module, a multi-antenna millimeter-wave radar positioning module, a three-dimensional electromagnetic coil positioning module, a three-dimensional ultrasonic positioning module, etc. to determine the direction of the control device 310, the posture of the first display screen relative to the control device 320, and the posture of the second display screen relative to the control device 320.

[0237] The communication unit 310 - 4 is used to process communication matters between the control device and other devices, such as the first display device 320 or the second display device 330 .

[0238] In other embodiments of the present application, the control device 310 can receive a first coordinate system where the first display screen is located from the first display device 320 through a wired communication interface or a wireless communication module, receive a second coordinate system where the second display screen is located from the second display device 330, and send the pointing position of the control device 310 to the first display device 320 or the second display device 330, etc.

[0239] In some embodiments of the present application, the control device 310 may send the direction of the control device 310 to the first display device 320 or the second display device 330 through a wired communication interface or a wireless communication module, so that the first display device 320 can determine the pointing position of the control device 310 based on this.

[0240] In some embodiments of the present application, the control device 310 can send display control instructions, such as opening a file, drawing a line, returning, etc., to the first display device 320 or the second display device 330 through a wired communication interface or a wireless communication module.

[0241] In some embodiments, as shown in FIG5 , the control device 310 may further include a motion measurement unit 310 - 5 , such as an IMU. The motion posture detection unit 310 - 5 may include, but is not limited to, one or more of an accelerometer, a gyroscope, an angular acceleration sensor, and a magnetic sensor, for measuring the motion posture of the control device 310 .

[0242] For a detailed introduction to the processing unit 310-1, the power management unit 310-2, the wireless positioning unit 310-3, the communication unit 310-4 and the motion posture detection unit 310-5, please refer to the introduction to FIG3 above, which will not be repeated here.

[0243] As shown in Figure 3, the first display device 320 includes a processing unit 320-1, a power management unit 320-2, a wireless positioning unit 320-3, a display unit 320-4, and a communication unit 320-5. The second display device 330 includes a processing unit 330-1, a power management unit 330-2, a wireless positioning unit 330-3, a display unit 330-4, and a communication unit 330-5.

[0244] For detailed descriptions of the processing unit 320-1, power management unit 320-2, wireless positioning unit 320-3, display unit 320-4, and communication unit 320-5, please refer to the description of FIG3 above, which will not be repeated here. Furthermore, for detailed descriptions of the processing unit 330-1, power management unit 330-2, wireless positioning unit 330-3, display unit 330-4, and communication unit 330-5, please refer to the descriptions of the processing unit 320-1, power management unit 320-2, wireless positioning unit 320-3, display unit 320-4, and communication unit 320-5 above, which will not be repeated here.

[0245] Among them, the first display device 320 and the second display device 330 can be display devices of the same type, display screen size or display screen resolution, such as the first display device 320 can be TV 1, the second display device 330 can be TV 2, and the display screen size and / or display screen resolution of TV 1 and TV 2 are the same. Alternatively, the first display device 320 and the second display device 330 can also be display devices of different types, display screen sizes or display screen resolutions, for example, the first display device 320 can be a projector, the second display device 330 can be a TV, and the projector and the TV are different in type, display screen size and display screen resolution. Regarding the specific type, display screen size or display screen resolution of multiple display devices in a multi-display device scenario, the embodiments of the present application do not limit them.

[0246] Among them, since the device display control method provided by the embodiment of the present application determines the cursor presentation position based on the pointing position of the control device, the display device does not present the cursor when the pointing position of the control device is not on the display screen of the display device. Only when the pointing position of the control device enters the edge area of ​​the display screen of the display device, the display device will present the cursor at the pointing position of the control device. In addition, this solution does not need to pre-set the orientation relationship between multiple display devices. When the cursor is connected between multiple display devices, it can automatically sense whether the pointing position of the control device is located on the display screen of a certain display device. Therefore, it is not affected by the change of the orientation relationship between multiple display devices, and the cursor can always be accurately crossed. In addition, this solution is not affected by the differences in the types of multiple display devices, display screen sizes, display screen resolutions, distances between multiple display screens, etc. Therefore, this solution can also bring users a very convenient, immersive, and precise cursor control and device manipulation experience in a multi-display device scenario.

[0247] For example, please refer to Figure 6, which shows a schematic diagram of the remote control cursor presentation process in a multi-display device scenario provided by an embodiment of the present application. The multi-display device scenario shown in Figure 6 includes a control device 310, a first display device 320, and a second display device 330. The first display device 320 and the second display device 330 are used to display an interface, and the control device 310 is used to perform display control and / or operation control on the first display device 320 or the second display device 330.

[0248] As shown in Figure 6, when the control device 310 in posture A6 points to position B6 on the first display screen, the first display device 320 displays a cursor at position B6 of the control device 310. When the control device 310 in posture A7 points to position B7 outside the first display screen and is no longer on the second display screen, neither the first display device 320 nor the second display device 330 displays a cursor. When the control device 310 in posture A8 points to position B8 on the second display screen, the second display device 330 displays a cursor at position B8 of the control device 310.

[0249] It can be seen that compared with the presentation process of the remote control cursor in the conventional multi-display device scenario shown in Figure 2, in the presentation process of the remote control cursor in the multi-display device scenario shown in Figure 6, since the position of the cursor presented by the first display device 320 (that is, the pointing position of the control device 310) refers to the pointing position of the control device 310, when the pointing position of the control device 310 is not on the display screen of any display device, multiple display devices do not present the cursor; only when the pointing position of the control device 310 enters the edge area of ​​the display screen of a certain display device (such as the first display device 320 or the second display device 330), the display device will present the cursor at the pointing position of the control device 310. In this way, when the pointing position of the control device 310 enters the edge area of ​​the first display screen, the first display device 320 can follow the movement trajectory of the control device 310 to present a corresponding interface effect (such as presenting a cursor) on the first display screen; when the pointing position of the control device 310 passes from the first display device 320 to the second display device 330, when the pointing position of the control device 310 moves out of any edge area of ​​the first display screen (such as the upper edge area, the lower edge area, the left edge area, or the right edge area) and does not enter the edge area of ​​the second display screen, the first display device 320 does not continue to present the corresponding interface effect (such as not presenting a cursor) on the first display screen; when the pointing position of the control device 310 enters the edge area of ​​the second display screen, the second display device 330 can follow the movement trajectory of the control device 310 to present a corresponding interface effect (such as presenting a cursor) on the second display screen. In particular, when presenting the cursor, the display device (such as the first display device 320 or the second display device 330) can follow the movement trajectory of the control device 310 and present a cursor presentation trajectory that matches the movement trajectory on the display screen.

[0250] Among them, in the embodiment of the present application, the pointing position of the control device entering the edge area of ​​the display screen means that the pointing position of the control device steps into the edge area of ​​the display screen from outside the display screen, and the pointing position of the control device moving out of any edge area of ​​the display screen means that the pointing position of the control device steps out of any edge area of ​​the display screen from the display screen.

[0251] Furthermore, even when the orientation relationship between the first display device 320 and the second display device 330 shown in FIG6 changes, the accurate cursor movement during cursor transitions will not be affected. Furthermore, regardless of whether the first display device 320 and the second display device 330 shown in FIG6 are of the same type, display screen size, display screen resolution, etc., or the distance between the displays of the first display device 320 and the second display device 330, the accurate cursor display will not be affected. For example, assuming the orientation relationship between the first display device 320 and the second display device 330 changes from a first relationship to a second relationship, when determining the pointing position of the control device 310, the pointing position of the control device 310 can be determined based on the latest second relationship. If the pointing position of the control device 310 does not enter the edge area of ​​either display screen, the first display device 320 and the second display device 330 will not display the corresponding display object. Only when the pointing position of the control device 310 enters the edge area of ​​the first display screen or the second display screen will the cursor be displayed on the corresponding display screen, following the movement trajectory of the control device.

[0252] Furthermore, when the orientation relationship between the first display device 320 or the second display device 330 and the remote control device 310 shown in FIG6 changes, or when the screen resolution and / or focal length corresponding to the first display device 320 or the second display device 330 changes, the accurate crossing of the cursor during the cursor connection will not be affected. For example, when the screen resolution and / or focal length corresponding to the display device (such as the first display device 320 or the second display device 330) changes, when determining the pointing position of the control device 310, the pointing position of the control device 310 can be determined based on the latest screen resolution and / or focal length. When the pointing position of the control device 310 does not enter the edge area of ​​any display screen, the first display device 320 and the second display device 330 will not present the corresponding display object. Only when the pointing position of the control device 310 enters the edge area of ​​the first display screen or the second display screen will the cursor be presented on the corresponding display screen following the movement trajectory of the control device. For another example, when the orientation relationship between the display device (such as the first display device 320 or the second display device 330) and the remote control device 310 changes, when determining the pointing position of the control device 310, the pointing position of the control device 310 can be determined based on the latest orientation relationship. When the pointing position of the control device 310 does not enter the edge area of ​​any display screen, the first display device 320 and the second display device 330 do not present the corresponding display object. Only when the pointing position of the control device 310 enters the edge area of ​​the first display screen or the second display screen, will the cursor be presented on the corresponding display screen following the movement trajectory of the control device.

[0253] In summary, the solution provided by the embodiments of the present application can also provide users with a very convenient, immersive, and precise cursor control and device manipulation experience in a multi-display device scenario.

[0254] It should be understood that the structure illustrated in FIG. 3 of the present application does not constitute a specific limitation on the control device 310 and the first display device 320, and the structure illustrated in FIG. 5 does not constitute a specific limitation on the control device 310, the first display device 320, and the second display device 330. In other embodiments of the present application, the control device 310, the first display device 320, or the second display device 330 may include more or fewer components than shown, or may combine or separate certain components, or arrange the components differently. The illustrated components may be implemented in hardware, software, or a combination of software and hardware.

[0255] For example, the control device 310, the first display device 320, or the second display device 330 may further include one or more of a memory (including an external memory interface and an internal memory), a charging management unit, an audio module, a speaker, a receiver, a microphone, a headphone jack, buttons, a camera, etc. For another example, the control device 310, the first display device 320, or the second display device 330 may further include one or more sensors such as a touch sensor, a pressure sensor, an air pressure sensor, a distance sensor, a proximity light sensor, a fingerprint sensor, a temperature sensor, an ambient light sensor, a bone conduction sensor, etc.

[0256] It should be noted that the embodiments of the present application do not limit the number of display screens included in the display device (such as the first display device and the second display device). In some embodiments, the display device may include multiple display screens and a wireless positioning unit, and the wireless positioning unit may be used to determine the coordinates of the multiple display screens. Alternatively, in some embodiments, the display device may include multiple display screens and multiple wireless positioning units, and the multiple wireless positioning units are respectively used to determine the coordinates of the multiple display screens.

[0257] The following will specifically introduce a device display control method provided in an embodiment of the present application in combination with scenario 1 and scenario 2.

[0258] Scenario 1: Single display device scenario

[0259] The single display device scenario includes a control device 310 and a first display device 320 . The first display device 320 is used for interface display, and the control device 310 is used for display control and / or operation control of the first display device 320 .

[0260] In some examples, when the first display device 320 displays a cursor according to the direction of the control device 310, the first display device 320 can determine a first coordinate system where its own display screen (e.g., the first display screen) is located by sending and receiving positioning information with the control device 310, and send the first coordinate system to the control device 310. The control device 310 can determine its own direction, the first pose of the first display screen relative to the control device 320, and the intersection of the direction of the control device 310 and the plane where the first display screen is located (i.e., the pointing position of the control device 310) by sending and receiving positioning information with the first display device 320. When the pointing position of the control device 310 is on the first display screen, the pointing position of the control device 310 is sent to the first display device 320, so that the first display device 320 displays a cursor at the pointing position of the control device 310. The first display device 320 and the control device 310 can send and receive positioning information between each other via their respective wireless positioning units.

[0261] For example, please refer to Figure 7, which shows a flow chart of a device display control method provided by an embodiment of the present application. As shown in Figure 7, the device display control method provided by an embodiment of the present application may include the following S701-S707:

[0262] S701 : The control device 310 establishes a communication connection with the first display device 320 .

[0263] The communication connection established between the control device 310 and the first display device 320 may include, but is not limited to, a wired communication connection and a wireless communication connection. The wireless communication connection may include, but is not limited to, a Bluetooth connection, a WiFi P2P connection, and the like.

[0264] S702: The first display device 320 determines a first coordinate system where its own display screen (ie, the first display screen) is located.

[0265] As a possible implementation, as shown in FIG7 , the first display device 320 may determine the first coordinate system where the first display screen is located by sending and receiving positioning information with the control device 310 .

[0266] As a possible implementation method, the first display device 320 can determine the first coordinate system where the first display screen is located based on one or more of the following methods: multi-antenna UWB positioning method, multi-antenna millimeter wave radar positioning method, three-dimensional electromagnetic coil positioning method, and three-dimensional ultrasonic positioning method. Among them, multi-antenna UWB positioning methods include multi-antenna time difference of arrival (TDOA) positioning method, multi-antenna time of flight (TOF) ranging method, multi-antenna angle of arrival (AOA) positioning method, etc. For example, the positioning information may include one or more of the following information: UWB signal, millimeter wave radar signal, electromagnetic signal, ultrasonic signal. The embodiment of the present application does not limit the specific method used by the first display device 320 to determine the first coordinate system, which may depend on the actual device structure, function, application scenario, etc.

[0267] In some embodiments, if the first display device 320 includes M antennas (M ≥ 3), and the plane formed by the equivalent centers of the M antennas coincides with or is parallel to the display screen, a multi-antenna UWB positioning method can be used to determine the first coordinate system in which the first display screen is located. Referring to Figure 8 , Figure 8 illustrates a schematic diagram of a method for determining the coordinate system of a display screen based on a multi-antenna UWB positioning method, provided in an embodiment of the present application, using the example of an integrated display device as the first display device 320.

[0268] As shown in FIG8 , a first antenna (such as a transmitting antenna), a second antenna (such as a receiving antenna), a third antenna (such as a horizontal antenna), and a fourth antenna (such as a vertical antenna) are provided on the first display screen. The first display device 320 can construct a first coordinate system where the first display screen is located through steps S901-S903 shown in FIG9 based on the multi-antenna UWB positioning method. S901 is: the first display device 320 transmits positioning information to the control device 310 to perform multi-antenna arrival time difference measurement; S902 is: the first display device 320 calculates the distance r between the multiple antennas of the control device 310 and the multiple antennas of the first display device 320 based on the multi-antenna arrival time difference measurement result; S903 is: the first display device 320 calculates the horizontal deflection angle and vertical pitch angle between the multiple antennas of the control device 310 and the multiple antennas of the first display device 320 based on the multi-antenna arrival time difference measurement result, and calculates the position of the equivalent center of the multiple antennas of the first display device 320 in combination with the above distance r, thereby constructing the first coordinate system where the first display screen is located. Furthermore, the first display device 320 can determine the plane in which the M antennas are located based on the positions of the multiple equivalent centers. Since the distance between the first display screen and the M antennas is known, the first display device 320 can further determine the positional relationship of the first display screen relative to the plane in which the M antennas are located, and further determine the first plane in which the first display screen is located based on this.

[0269] For example, if the distance between the multiple equivalent centers and the first display screen is 0, then the first plane where the first display screen is located is the plane where the multiple equivalent centers are located. If the distance between the multiple equivalent centers and the first display screen is not 0 (e.g., d, where d is a vector value), then the first plane where the first display screen is located is a plane parallel to the plane where the multiple equivalent centers are located and a distance d from the plane where the multiple equivalent centers are located. FIG8 only uses the example of a distance of 0 between the multiple equivalent centers and the first display screen.

[0270] It can be understood that after the first coordinate system where the first display screen is located is determined, since the size information of the first display screen and the positional relationship between the first display screen and the M antennas are known, the first display device 320 can construct the first coordinate system where the first display screen is located based on this.

[0271] As shown in FIG8 , the first coordinate system can be a first coordinate system in which the coordinate origin O1 is located at the geometric center of the M antennas, the X1O1Y1 plane coincides with the first plane where the first display screen is located, and the Z1 axis conforms to the right-hand spiral criterion with the X1 axis and the Y1 axis. Of course, the first coordinate system shown in FIG8 is only an example, and this application does not specifically limit the construction principle of the first coordinate system. For example, the coordinate origin O1 can also be set at the center of a certain edge of the first display screen (such as the center of the left edge) or other positions on the first plane.

[0272] It should be noted that FIG8 only uses the example of an integrated first display device 320 to illustrate the specific process of determining display screen coordinates based on the multi-antenna UWB positioning method. For a split-type display device, such as a projector as shown in FIG10 and a screen as shown in FIG10 , the principle of determining display screen coordinates is the same as the example shown in FIG8 . For example, if the projection host of the projector (i.e., the first display device 320) is equipped with M antennas, the projector can also determine the positions of the equivalent centers of the M antennas based on the multi-antenna UWB positioning method through steps S901-S903 shown in FIG9 . Furthermore, the projector can determine the planes on which the M antennas are located based on the positions of the multiple equivalent centers. Furthermore, since the size information of the screen (i.e., the first display screen) and the positional relationship between the screen and the M antennas are known, the projector can further determine the positional relationship of the first display screen relative to the plane on which the M antennas are located, and thereby construct a first coordinate system for the screen based on this information.

[0273] In the case where the first display device 320 is a projector and the first display screen is a screen, the first display device 320 can determine the positional relationship between the screen and the M antennas, as well as the screen size information, based on one or more of the following data: a focal length parameter of the projection host, a projection distance of the projection host, and a projection skew angle of the projection host. For example, the focal length parameter of the projection host can be manually set or default; the projection distance of the projection host or the projection skew angle of the projection host can be measured using a method such as a multi-point TOF ranging method.

[0274] S703: The first display device 320 sends first information to the control device 310. The first information includes a first coordinate system where the display screen of the first display device 320 (ie, the first display screen) is located and the size of the first display screen.

[0275] S704 : The control device 310 determines the orientation of the control device 310 and the first posture of the first display screen relative to the control device 310 .

[0276] As a possible implementation, the first display device 320 may determine the direction of the control device 310 and the first position of the first display screen relative to the control device 310 by sending and receiving positioning information with the control device 310 .

[0277] As a possible implementation, the control device 310 can determine the orientation of the control device 310 and the first position of the first display screen relative to the control device 310 based on one or more of the following methods: multi-antenna UWB positioning method, multi-antenna millimeter wave radar positioning method, three-dimensional electromagnetic coil positioning method, and three-dimensional ultrasonic positioning method. For example, the positioning information may include one or more of the following information: UWB signal, millimeter wave radar signal, electromagnetic signal, and ultrasonic signal. Among them, multi-antenna UWB positioning methods include TDOA positioning method, TOF ranging method, AOA positioning method, etc. The embodiments of the present application do not limit the specific method adopted by the control device 310, which may depend on the actual device structure, function, and application scenario.

[0278] In some embodiments, if the control device 310 includes N antennas (N≥3), and the plane formed by the equivalent centers of the N antennas is perpendicular to the axis of the control device 310, a multi-antenna UWB positioning method can be used to determine the direction of the control device 310.

[0279] As shown in FIG8 , the control device 310 is provided with a fifth antenna (e.g., an origin antenna), a sixth antenna (e.g., a horizontal antenna), and a seventh antenna (e.g., a vertical antenna). The control device 310 can determine the positions of the equivalent centers of the N antennas based on the multi-antenna UWB positioning method through steps S1101-S1103 shown in FIG11 . Furthermore, the control device 310 can determine the planes on which the N antennas are located based on the positions of the multiple equivalent centers. In FIG11 , S1101 is shown as follows: the control device 310 transmits positioning information to the first display device 320 to perform a multi-antenna arrival time difference measurement; S1102 is shown as follows: the control device 310 calculates the distance r between the multiple antennas of the first display device 320 and the multiple antennas of the control device 310 based on the multi-antenna arrival time difference measurement results; and S1103 is shown as follows: the control device 310 calculates the horizontal deflection angle and vertical pitch angle between the multiple antennas of the first display device 320 and the multiple antennas of the control device 310 based on the multi-antenna arrival time difference measurement results, and calculates the position of the equivalent centers of the multiple antennas of the control device 310 in the first coordinate system based on the distance r, thereby determining the orientation of the control device 310. For example, since the plane formed by the equivalent centers of the N antennas is perpendicular to the axial direction of the control device 310, the orientation P of the control device 310 shown in FIG8 can be determined based on the equivalent centers of the N antennas.

[0280] Furthermore, as shown in FIG11 , after calculating the positions of the equivalent centers of the multiple antennas of the control device 310, the control device 310 may also determine the first position of the first display screen relative to the control device 310 through steps S1104-S1105 shown in FIG11 . Specifically, in FIG11 , S1104 is as follows: the control device 310 receives signals transmitted by the first display device 320 via N antennas and calculates the phase difference between the signals received by the N antennas; and in S1105 is as follows: the control device 310 calculates the horizontal deflection angle and vertical pitch angle of the first display screen relative to the control device 310, and determines the first position of the first display screen relative to the control device 310 based on the distance r.

[0281] S705: The control device 310 determines a first position on the plane where the control device 310 is pointing to the first display screen.

[0282] For example, as shown in S1106 in FIG. 11 , the control device 310 may calculate a first position of the control device 310 pointing to a plane where the first display screen is located based on the calculated first posture and the orientation of the control device 310 .

[0283] It should be noted that the above embodiment only uses the multi-antenna UWB positioning method as an example to introduce the specific process of determining the pointing position of the control device 310, but the embodiment of the present application does not limit the specific method and process of determining the pointing direction of the control device 310, determining the posture of the first display device 320 relative to the control device 310, and determining the pointing position of the control device 310. For example, in some embodiments, if the first display device 320 and the control device 330 include a three-axis magnetic field transmitting coil (such as a magnetic sensor including a three-axis magnetic field transmitting coil), a three-dimensional electromagnetic coil positioning method can be used to determine the posture of the control device 310, and then determine the pointing position of the control device 310 based on this.

[0284] The three-dimensional electromagnetic coil is provided with coils wound with wire in three dimensions. When current passes through the coils, a magnetic field is generated. The principle of the three-dimensional electromagnetic coil positioning method is to utilize the effect of the magnetic field and achieve positioning through the electromagnetic induction principle of the magnetic coil. As shown in Figure 12, the transmitting sensor includes a three-axis magnetic field transmitting coil, a driving circuit (i.e., an excitation source), and a processing unit, and the receiving sensor includes a three-axis magnetic field transmitting coil, an amplifying circuit, a sampling and detection unit, and a processing unit. The three-axis magnetic field transmitting coil of the transmitting sensor can transmit electromagnetic signals in response to the driving circuit, wherein the driving circuit is controlled by the processing unit. The receiving sensor can sense the electromagnetic signals from the transmitting sensor through the three-axis magnetic field transmitting coil and obtain the position and posture of the control device 310 after processing by the amplifying circuit, the sampling and detection unit, and the processing unit.

[0285] Please refer to Figure 13. Figure 13 takes the first display device 320 as an integrated display device as an example, and shows a schematic diagram of a method for determining the coordinate system of a display screen based on a three-dimensional electromagnetic coil positioning method provided in an embodiment of the present application.

[0286] As shown in Figure 13, a first three-axis magnetic field transmitting coil is provided on the first display screen, and a second three-axis magnetic field transmitting coil is provided on the control device 310. The first display device 320 can transmit electromagnetic signals via the first three-axis magnetic field transmitting coil. After the control device 310 senses the electromagnetic signals from the first three-axis magnetic field transmitting coil via the second three-axis magnetic field transmitting coil, the position and posture of the control device 310 can be calculated based on the signals.

[0287] For example, the first display device 320 can establish the coordinate system O1-X1Y1Z1 shown in FIG13 based on the first three-axis magnetic field transmitting coil, wherein the coordinate origin of the coordinate system O1-X1Y1Z1 can be the location of the first three-axis magnetic field transmitting coil, the X1O1Z1 plane is the plane where the first display screen is located, and the Z1 axis, the X1 axis, and the Y1 axis conform to the left-hand spiral criterion. The magnetic induction intensity at the location of the first three-axis magnetic field transmitting coil in the coordinate system O1-X1Y1Z1 is shown in FIG14 B x 、B y 、B z The control device 310 can establish the coordinate system O2-X2Y2Z2 shown in FIG13 based on the second three-axis magnetic field transmitting coil. Assume that the control device 310 detects the magnetic induction intensity in the coordinate system as shown in FIG14 through the second three-axis magnetic field transmitting coil. x' 、B y' 、B z' , where the rotation angles of the coordinate system O2-X2Y2Z2 relative to O1-X1Y1Z1 along the three axes are α, β, and γ as shown in Figure 14. Based on this, the following formula can be obtained:

[0288] In the above formula, R is the rotation matrix, and the calculation formula of R is as follows:

[0289] Based on the above formula, the position (x, y, z, α, β, γ) of the control device 310 can be calculated. After obtaining the position of the control device 310, the direction of the control device 310 and the coordinates of the intersection of the direction of the control device 310 and the first display screen (that is, the pointing position of the control device 310) can be calculated based on the trigonometric function relationship.

[0290] S706: If the first position is located on the first display screen, the control device 310 sends second information to the first display device 320, where the second information includes coordinate information of the first position.

[0291] It is understood that when the size of the first display screen and the first coordinate system in which the first display screen is located are known, the first coordinate range of the first display screen in the first coordinate system can be obtained. Furthermore, whether the first position is located on the first display screen can be determined by determining whether the first position is within the first coordinate range.

[0292] Among them, when the first position is on the first display screen, the control device 310 can send the coordinate information of the first position to the first display device 320, so that the first display device 320 can present the cursor at the first position according to the second information; when the first position is not on the first display screen, the control device 310 can do no processing, so the first display device 320 will not present the cursor.

[0293] S707: The first display device 320 presents a cursor at the first position according to the second information.

[0294] In some examples, when the first display device 320 presents a cursor based on the pointing direction of the control device 310, the control device 310 may send its own pointing direction to the first display device 320. The first display device 320 may determine the first coordinate system where its own display screen (i.e., the first display screen) is located and the first pose of the first display screen relative to the control device 320, and based on the above information, determine the intersection of the pointing direction of the control device 310 and the plane where the first display screen is located (i.e., the pointing position of the control device 310), and present the cursor at the pointing position of the control device 310 when the pointing position of the control device 310 is on the first display screen.

[0295] For example, please refer to Figure 15, which shows a flow chart of another device display control method provided by an embodiment of the present application. As shown in Figure 15, a device display control method provided by an embodiment of the present application may include the following S1501-S1506:

[0296] S1501 : The control device 310 establishes a communication connection with the first display device 320 .

[0297] For a detailed introduction to S1501, please refer to the introduction to S701 above, which will not be repeated here.

[0298] S1502 : The control device 310 determines the direction of the control device 310 .

[0299] For a detailed introduction to S1502, please refer to the introduction to S704 above, which will not be repeated here.

[0300] S1503 : The control device 310 sends the direction of the control device 310 to the first display device 320 .

[0301] S1504 : The first display device 320 determines a first coordinate system where its own display screen (ie, the first display screen) is located and a first pose of the first display screen relative to the control device 310 .

[0302] For a detailed introduction to the first display device 320 determining the first coordinate system in which its own display screen (i.e., the first display screen) is located, please refer to the introduction to S702 above. For a detailed introduction to the first display device 320 determining the first position of the first display screen relative to the control device 310, please refer to the process in step S704 above in which the control device 310 determines the first position of the first display screen relative to the control device 310, which will not be repeated here.

[0303] S1505: The first display device 320 determines that the control device 310 is pointing to a first position on the plane where the first display screen is located.

[0304] For a detailed introduction on how the first display device 320 determines that the control device 310 points to the first position on the plane where the first display screen is located, please refer to the process in step S705 above where the control device 310 determines that the control device 310 points to the first position on the plane where the first display screen is located, which will not be repeated here.

[0305] S1506: If the first position is located on the first display screen, the first display device 320 presents a cursor at the first position.

[0306] It can be understood that since the device display control method provided by the embodiment of the present application determines whether the display screen presents a cursor and the specific presentation position of the cursor when it is presented on the display screen based on the position of the control device pointing to the plane where the display screen is located, the display device does not present the cursor when the pointing position of the control device is not on the display screen of the display device. Only when the pointing position of the control device enters the edge area of ​​the display screen of the display device, the display device will present the cursor at the pointing position of the control device (as shown in Figure 4). In this way, when the pointing position of the control device enters the edge area of ​​the display screen, the display device can present the cursor on the display screen following the movement trajectory of the control device; when the pointing position of the control device moves out of any edge area of ​​the display screen (such as the upper edge area, the lower edge area, the left edge area or the right edge area), the display device does not continue to present the cursor on the display screen. Therefore, compared with conventional technologies, it can not only solve the problem of deviation between the cursor presentation position and the pointing position of the control device, but also solve the problem of the cursor being stuck when it moves out of the edge of the display screen.

[0307] Moreover, since the presentation position of the cursor is the pointing position of the control device, the deviation between the presentation position of the cursor and the axial pointing position of the control device 310 in the real posture will be very small. For example, as shown in FIG16 , the presentation position of the cursor will usually be within a preset range S near the axial pointing position of the control device 310 in the real posture. This preset range is usually very small. For example, due to the measurement and / or calculation error of the wireless positioning unit 310-3 of the control device 310, and / or the measurement and / or calculation error of the wireless positioning unit 320-3 of the first display device 320, the deviation between the presentation position of the cursor and the axial pointing position of the control device 310 in the real posture will usually be within 10° (in some embodiments, the deviation may be within 3°, or even within 1°). Therefore, a device display control method provided in an embodiment of the present application can bring a more accurate cursor control experience to the user.

[0308] In summary, the device display control method provided in the embodiments of the present application can bring users a very convenient, immersive and accurate device control experience.

[0309] In some embodiments, to ensure continuous cursor presentation, after ensuring that the cursor enters the edge area of ​​the display screen, the cursor presentation position may be determined based on the relative position change of the control device. When the cursor presentation position determined based on the relative position change of the control device deviates from the direction of the control device by more than a preset range, or after a preset time period has elapsed, the cursor presentation position may be calibrated using the direction of the control device. The preset range of the direction of the control device may be, for example, the overlap range of a cone deflected by an angle φ around the direction of the control device and the display screen.

[0310] For example, in the initial stage, the control device 310 and the first display device 320 can perform relevant measurements and calculations using a wireless positioning unit to determine a first position of the control device 310 pointing to the plane of the first display screen. If the first position is not on the first display screen, subsequent pointing position determinations can be performed as needed at a preset frequency. When the pointing position of the control device 310 enters the edge region of the first display screen, the control device 310 can measure the motion posture of the control device 310 using a motion measurement unit 310-5 (e.g., an IMU) so that the first display device 310 can determine the displacement of the cursor relative to the historical cursor presentation position based on the relative posture change of the control device 310, thereby determining the cursor presentation position. Furthermore, during the process of determining the cursor presentation position based on the relative posture change of the control device 310, the cursor presentation position can be calibrated using the pointing position of the control device at preset time intervals, or when the cursor presentation position deviates from the pointing position of the control device by more than a preset range. Furthermore, after the cursor moves out of the edge region of the first display screen, the wireless positioning unit can be used to perform relevant measurements and calculations to determine the pointing position of the control device 310.

[0311] Based on this, not only can the display deviation of the cursor always be kept within a very small range to ensure the accurate presentation of the cursor, but also the continuous presentation of the cursor on the display screen can be guaranteed.

[0312] In some embodiments, when determining the cursor's presentation position based on the relative posture change of the control device 310, the cursor's displacement relative to the historical cursor's presentation position can also be dynamically adjusted based on the distance between the control device 310 and the first display device 320. For example, when the distance between the control device 310 and the first display device 320 is within the range D1-D2, the cursor's displacement ratio is adjusted based on the result of the relative posture change of the control device 310 * the distance; when the distance between the control device 310 and the first display device 320 is less than D1, the cursor's displacement ratio is adjusted based on the result of the relative posture change of the control device 310 * D1; and when the distance between the control device 310 and the first display device 320 is greater than D2, the cursor's displacement ratio is adjusted based on the result of the relative posture change of the control device 310 * D2. This ensures that when the control device 310 manipulates the cursor at different distances, the cursor's movement distance corresponding to the same posture change can be dynamically adjusted, ensuring a consistent user experience when manipulating the cursor at different distances.

[0313] It should be noted that in the above scenario 1, the display device displays a cursor on the display screen following the movement trajectory of the control device only as an example. In actual applications, the display device may display a cursor according to the specific application scenario, device functions, etc. For example, the interface effects displayed on the display screen may also include, but are not limited to, displaying icons, components, avatars, images, etc. at the location where the control device is pointing, displaying corresponding viewing angle effects according to the location where the control device is pointing, and displaying pre-set special effects in the corresponding display area (such as a preset control hot zone) according to the location where the display control device is pointing.

[0314] For example, in a gaming scenario, the interface effects presented on the display screen may include displaying the image of the game protagonist at a preset perspective at the pointing position of the control device, displaying gaming equipment at the pointing position of the control device, displaying game special effects (such as bubble effects, fireworks effects, etc.) at the pointing position of the control device, and displaying game special effects (such as aiming effects, hitting effects, etc.) in a corresponding display area according to the pointing position of the display control device. For another example, in a handwriting tablet scenario, the interface effects presented on the display screen may include displaying the image of a stylus and handwriting at the pointing position of the control device, and displaying handwriting in a corresponding display area (such as the historical trajectory of the stylus image) according to the pointing position of the display control device. For another example, the display device may also follow the movement trajectory of the control device to present both a cursor and a virtual image and special effects at a preset perspective on the display screen. For example, when the pointing position of the control device is in a preset control hot zone, the display device may present a corresponding virtual image and special effects at a preset perspective when presenting the display object.

[0315] Among them, in the case where the display device follows the movement trajectory of the control device to present interface effects such as components, virtual images, perspective effects, special effects, etc. on the display screen, when the pointing position of the control device moves out of the edge area of ​​the display screen of the display device, the display device may no longer update the above-mentioned interface effects, or may no longer display any interface effects. The embodiments of this application do not make specific limitations, depending on the actual application scenarios and device functions, etc.

[0316] Scenario 2: Multiple display device scenario

[0317] Among them, the multi-display device scenario includes a control device 310, a first display device 320 and a second display device 330. The first display device 320 and the second display device 330 are used for interface display, and the control device 310 is used to perform display control and / or operation control on the first display device 320 or the second display device 330.

[0318] In some examples, during the process of the first display device 320 or the second display device 330 presenting a cursor according to the direction of the control device 310, the first display device 320 can determine the first coordinate system of its own display screen (such as the first display screen) by sending and receiving positioning information with the control device 310, and send the first coordinate system of the first display screen to the control device 310. The second display device 330 can determine the first coordinate system of its own display screen (such as the second display screen) by sending and receiving positioning information with the control device 310, and send the second coordinate system of the second display screen to the control device 310. The control device 310 can determine its own orientation, the first position of the first display screen and the second display screen relative to the control device 320, and the intersection of the orientation of the control device 310 and the plane where the first display screen and the plane where the second display screen are located (i.e., the pointing position of the control device 310) by sending and receiving positioning information with the first display device 320 and the second display device 330. When the pointing position of the control device 310 is on the first display screen, the pointing position of the control device 310 is sent to the first display device 320 so that the first display device 320 can display a cursor at the pointing position of the control device 310. When the pointing position of the control device 310 is on the second display screen, the pointing position of the control device 310 is sent to the second display device 330 so that the second display device 330 can display a cursor at the pointing position of the control device 310. The first display device 320 and the control device 310, or the second display device 330 and the control device 310, can send and receive positioning information via their respective wireless positioning units.

[0319] For example, please refer to Figure 17, which shows a flow chart of a device display control method provided by an embodiment of the present application. As shown in Figure 17, the device display control method provided by an embodiment of the present application may include the following S1701-S1707:

[0320] S1701 : The control device 310 establishes a communication connection with the first display device 320 and the second display device 330 .

[0321] For a detailed introduction on establishing a communication connection between the control device 310 and the first display device 320 and the second display device 330, reference may be made to the process of establishing a communication connection between the control device 310 and the first display device 320 in step S701 above, which will not be repeated here.

[0322] S1702: The first display device 320 determines a first coordinate system where its own display screen (ie, the first display screen) is located.

[0323] For a detailed introduction to S1702, please refer to the above introduction to S702, which will not be repeated here.

[0324] S1703: The first display device 320 sends first information to the control device 310. The first information includes a first coordinate system where the first display screen is located and a size of the first display screen.

[0325] For a detailed introduction to S1703, please refer to the above introduction to S703, which will not be repeated here.

[0326] S1704: The second display device 330 determines a second coordinate system where its own display screen (ie, the second display screen) is located.

[0327] For a detailed description of S1704 , please refer to the process in which the first display device 320 determines the first coordinate system where the first display screen is located in step S702 above, which will not be repeated here.

[0328] S1705: The second display device 330 sends third information to the control device 310. The third information includes a second coordinate system where the second display screen is located and a size of the second display screen.

[0329] For a detailed introduction to S1705 , please refer to the process in which the first display device 320 sends the first information to the control device 310 in step S703 above, which will not be repeated here.

[0330] S1706 : The control device 310 determines the orientation of the control device 310 , a first posture of the first display screen relative to the control device 310 , and a second posture of the second display screen relative to the control device 310 .

[0331] For a detailed introduction to the control device 310 determining the orientation of the control device 310 and the first display screen relative to the control device 310, please refer to the introduction to S704 above. For a detailed introduction to the control device 310 determining the second posture of the second display screen relative to the control device 310, please refer to the process of the control device 310 determining the first posture of the first display screen relative to the control device 310 in step S704 above, which will not be repeated here.

[0332] S1707: The control device 310 determines a first position where the control device 310 points to the plane where the first display screen is located, and a second position where the control device 310 points to the plane where the second display screen is located.

[0333] For a detailed introduction to the control device 310 determining that the control device 310 points to the first position of the plane where the first display screen is located, please refer to the introduction to S705 above. For a detailed introduction to the control device 310 determining that the control device 310 points to the second position of the plane where the second display screen is located, please refer to the process in step S705 above where the control device 310 determines that the control device 310 points to the first position of the plane where the first display screen is located, which will not be repeated here.

[0334] If the first position is on the first display screen, the control device 310 executes S1708-1 and the first display device 320 executes S1709-1; if the second position is on the second display screen, the control device 310 executes S1708-2 and the second display device 330 executes S1709-2.

[0335] S1708 - 1 : The control device 310 sends second information to the first display device 320 , where the second information includes coordinate information of the first position.

[0336] For a detailed introduction to S1708-1, please refer to the introduction to S706 above, which will not be repeated here.

[0337] S1709 - 1 : The first display device 320 presents a cursor at a first position according to the second information.

[0338] For a detailed introduction to S1709-1, please refer to the introduction to S707 above, which will not be repeated here.

[0339] S1708 - 2 : The control device 310 sends fourth information to the second display device 330 , where the fourth information includes coordinate information of the second position.

[0340] For a detailed introduction to S1708 - 2 , please refer to the process of controlling the device 310 to send the second information to the first display device 320 in step S706 above, which will not be repeated here.

[0341] S1709 - 2 : The second display device 330 presents a cursor at a second position according to the fourth information.

[0342] For a detailed introduction to S1709 - 2 , please refer to the process in which the first display device 320 presents the cursor at the first position according to the second information in step S707 above, which will not be repeated here.

[0343] In some embodiments, the first position on the plane where the control device 310 points to the first display screen is on the first display screen, but the second position on the plane where the control device 310 points to the second display screen is not on the second display screen. In this case, the control device 310 does not execute S1708-2 and the second display device 330 does not execute S1709-2.

[0344] In some embodiments, the first position on the plane where the control device 310 points to the first display screen is not on the first display screen, but the second position on the plane where the control device 310 points to the second display screen is on the second display screen. In this case, the control device 310 does not execute S1708-1 and the first display device 320 does not execute S1709-1.

[0345] In some embodiments, the first position of the plane where the control device 310 points to the first display screen is located on the first display screen, and the second position of the plane where the control device 310 points to the second display screen is located on the second display screen. For this case, as an example, the control device 310 executes both S1708-1 and S1708-2, and then the first display device 320 executes S1709-1 and the second display device 330 executes S1709-2; as another example, the control device 310 executes both S1708-1 and S1708-2, and the first display device 320 and the second display device 330 negotiate to determine whether the cursor is presented on the first display screen or the second display screen, and when it is determined that the cursor is presented on the first display screen, the first display device 320 executes S1708-1, or when it is determined that the cursor is presented on the second display screen, the second display device 330 executes S1708-2. 708-2, wherein the factors considered in the negotiation between a display device 320 and a second display device 330 may include but are not limited to one or more of the distance between the display device and the control device, the function of the display device, whether a content interface is displayed on the display device, on which display device the cursor was last presented, etc., and the embodiments of the present application do not make specific limitations; as another example, the control device 310 may determine whether the cursor is presented by the first display screen or the second display screen based on preset rules, and execute S1708-1 after the first display device 320 executes S1709-1 when it is determined that the cursor is presented by the first display screen, or execute S1708-2 after the first display device 320 executes S1709-2 when it is determined that the cursor is presented by the second display screen, wherein the preset rules may include one or more of close distance priority, continuation priority, original display device priority, etc., and the embodiments of the present application do not make specific limitations.

[0346] It should be noted that, in the above embodiment, only the first coordinate system constructed by the first display device 320 and the second coordinate system constructed by the second display device 320 can be constructed based on the actual plane where the display screen itself is located, that is, the first coordinate system and the second coordinate system are different are used as examples. In some embodiments, the first display device 320 and the second display device 320 can also construct a unified coordinate system. In this case, the first display device 320 also sends the coordinate information of the first display screen in the above unified coordinate system to the control device 310. Similarly, the second display device 330 also sends the coordinate information of the second display screen in the above unified coordinate system to the control device 310, so that the control device 310 can perform subsequent first position and second position confirmation based on this.

[0347] It can be understood that since the device display control method provided in the embodiment of the present application determines whether a cursor is displayed on the display screen, and which display device displays the cursor at which position, based on the position of the control device pointing to the plane where the display screen is located, the control device can calculate the specific position pointed by the control device regardless of the orientation relationship between the multiple display devices, without the need to pre-configure the orientation relationship between the multiple display devices. When the pointing position of the control device is not on the screen of any display device, the multiple display devices do not display the cursor. Only when the pointing position of the control device enters the edge area of ​​the screen of a certain display device, the display device will display the cursor at the pointing position of the control device 310. Therefore, this solution can also provide users with a very convenient, immersive, and precise cursor control and device operation experience in a multi-display device scenario.

[0348] For example, taking the case where a cursor changes from being displayed on a first display screen to being displayed on a second display screen, where the first display screen and the second display screen are adjacent to each other, please refer to FIG18 , which shows a flow chart of a cursor crossing process provided by an embodiment of the present application. As shown in FIG18 , a cursor crossing process provided by an embodiment of the present application may include S1801-S1813 (where S1801-S1809 is the first display screen presentation stage, and S1810-S1813 is the second display screen presentation stage):

[0349] S1801 : The control device 310 establishes a communication connection with the first display device 320 and the second display device 330 .

[0350] S1802: The first display device 320 determines a first coordinate system where the first display screen is located.

[0351] S1803: The first display device 320 sends first information to the control device 310. The first information includes a first coordinate system where the first display screen is located and a size of the first display screen.

[0352] S1804: The second display device 330 determines a second coordinate system where the second display screen is located.

[0353] S1805: The second display device 330 sends third information to the control device 310. The third information includes a second coordinate system where the second display screen is located and a size of the second display screen.

[0354] S1806 : The control device 310 determines a first orientation of the control device 310 , a first posture of the first display screen relative to the control device 310 , and a second posture of the second display screen relative to the control device 310 .

[0355] S1807: The control device 310 determines a first position where the control device 310 points to a plane where the first display screen is located, and a second position where the control device 310 points to a plane where the second display screen is located, wherein the first position is located on the first display screen.

[0356] S1808: The control device 310 sends second information to the first display device 320, where the second information includes coordinate information of the first position.

[0357] S1809: The first display device 320 presents a cursor at the first position according to the second information.

[0358] S1810 : The control device 310 determines a second orientation of the control device 310 , a third position of the first display screen relative to the control device 310 , and a fourth position of the second display screen relative to the control device 310 .

[0359] S1811: The control device 310 determines a third position on the plane where the control device 310 is located and a fourth position on the plane where the control device 310 is located, wherein the fourth position is located on the second display screen.

[0360] S1812: The control device 310 sends fifth information to the second display device 330, where the fifth information includes coordinate information of the fourth position.

[0361] S1813: The second display device 330 presents a cursor at the fourth position according to the fifth information.

[0362] For example, please refer to Figure 19, which shows that when a first display screen and a second display screen are located adjacent to each other, the cursor crossing process shown in Figure 18 can be used to achieve the effect shown in Figure 19 of the cursor crossing from the first display screen to the second display screen. The entire process is convenient for users and can provide users with an immersive and precise cursor control and device operation experience.

[0363] For another example, taking the case where a cursor changes from being displayed on a first display screen to being displayed on a second display screen, where the first display screen and the second display screen are relatively far apart, please refer to FIG20 , which shows a flow chart of another cursor traversal process provided by an embodiment of the present application. As shown in FIG20 , the cursor traversal process provided by an embodiment of the present application may include steps S2001-S2015 (where S2001-S2009 are the first display screen presentation stage, S2010-S2011 are the cursor traversal stage, and S2012-S2015 are the second display screen presentation stage):

[0364] S2001 : The control device 310 establishes a communication connection with the first display device 320 and the second display device 330 .

[0365] S2002: The first display device 320 determines a first coordinate system where the first display screen is located.

[0366] S2003: The first display device 320 sends first information to the control device 310. The first information includes a first coordinate system where the first display screen is located and a size of the first display screen.

[0367] S2004: The second display device 330 determines a second coordinate system where the second display screen is located.

[0368] S2005: The second display device 330 sends third information to the control device 310. The third information includes a second coordinate system where the second display screen is located and a size of the second display screen.

[0369] S2006 : The control device 310 determines a first orientation of the control device 310 , a first posture of the first display screen relative to the control device 310 , and a second posture of the second display screen relative to the control device 310 .

[0370] S2007: The control device 310 determines a first position where the control device 310 points to a plane where the first display screen is located, and a second position where the control device 310 points to a plane where the second display screen is located, wherein the first position is located on the first display screen.

[0371] S2008: The control device 310 sends second information to the first display device 320, where the second information includes coordinate information of the first position.

[0372] S2009: The first display device 320 presents a cursor at the first position according to the second information.

[0373] S2010 : The control device 310 determines a third orientation of the control device 310 , a fifth posture of the first display screen relative to the control device 310 , and a sixth posture of the second display screen relative to the control device 310 .

[0374] S2011: The control device 310 determines that the control device 310 points to a fifth position on the plane where the first display screen is located and the control device 310 points to a sixth position on the plane where the second display screen is located, wherein the fifth position is not on the first display screen and the sixth position is not on the second display screen.

[0375] S2012 : The control device 310 determines a second orientation of the control device 310 , a third position of the first display screen relative to the control device 310 , and a fourth position of the second display screen relative to the control device 310 .

[0376] S2013: The control device 310 determines a third position on the plane where the first display screen is located and a fourth position on the plane where the second display screen is located, where the fourth position is located on the second display screen.

[0377] S2014: The control device 310 sends fifth information to the second display device 330, where the fifth information includes coordinate information of the fourth position.

[0378] S2015: The second display device 330 presents a cursor at a fourth position according to the fifth information.

[0379] For example, please refer to Figure 21, which shows that when the first display screen is far away from the second display screen, the cursor crossing process shown in Figure 20 can achieve the effect of the cursor crossing from the first display screen to the second display screen as shown in Figure 21. The whole process is easy to operate for the user and can bring the user an immersive and precise cursor control and device control experience. Moreover, as can be seen from Figures 19 and 21, no matter how far the distance between the display screens of the first display device 320 and the second display device 330 is, it will not affect the accurate display of the cursor.

[0380] In addition, since the device display control method provided in the embodiment of the present application determines whether the display screen presents a cursor and the specific presentation position of the cursor when it appears on the display screen based on the position of the control device pointing to the plane where the display screen is located, when the posture of the display screen of any display device changes, it will still not affect the accurate crossing of the cursor when the cursor is connected.

[0381] For example, taking the change in the position of the display screen of the first display device 320 as an example, please refer to Figure 22, which shows a flow chart of another cursor traversal process provided by an embodiment of the present application. As shown in Figure 22, a cursor traversal process provided by an embodiment of the present application may include S2201-S2215 (where S2201-S2209 is the first display screen presentation stage, S2210-S2211 is the information update stage, and S2212-S2215 is the second display screen presentation stage):

[0382] S2201 : The control device 310 establishes a communication connection with the first display device 320 and the second display device 330 .

[0383] S2202: The first display device 320 determines a first coordinate system where the first display screen is located.

[0384] S2203: The first display device 320 sends first information to the control device 310. The first information includes a first coordinate system where the first display screen is located and a size of the first display screen.

[0385] S2204: The second display device 330 determines a second coordinate system where the second display screen is located.

[0386] S2205: The second display device 330 sends third information to the control device 310. The third information includes a second coordinate system where the second display screen is located and a size of the second display screen.

[0387] S2206 : The control device 310 determines a first orientation of the control device 310 , a first posture of the first display screen relative to the control device 310 , and a second posture of the second display screen relative to the control device 310 .

[0388] S2207: The control device 310 determines a first position where the control device 310 points to a plane where the first display screen is located, and a second position where the control device 310 points to a plane where the second display screen is located, wherein the first position is located on the first display screen.

[0389] S2208: The control device 310 sends second information to the first display device 320, where the second information includes coordinate information of the first position.

[0390] S2209: The first display device 320 presents a cursor at the first position according to the second information.

[0391] S2210: When the position of the first display device 320 changes, the first display device 320 determines a third coordinate system where the first display screen is located.

[0392] S2211: The first display device 320 sends sixth information to the control device 310. The sixth information includes the third coordinate system where the first display screen is located and the size of the first display screen.

[0393] S2212 : The control device 310 determines a fourth orientation of the control device 310 , a seventh posture of the first display screen relative to the control device 310 , and an eighth posture of the second display screen relative to the control device 310 .

[0394] S2213: The control device 310 determines that the control device 310 points to a seventh position on the plane where the first display screen is located, and the control device 310 points to an eighth position on the plane where the second display screen is located, wherein the eighth position is located on the first display screen.

[0395] S2214: The control device 310 sends seventh information to the second display device 330, where the seventh information includes coordinate information of the eighth position.

[0396] S2215: The second display device 330 presents a cursor at an eighth position according to the seventh information.

[0397] For example, taking the first display device 320 as a projector, when the position or angle of the projector shifts, such as when the posture shown in (a) of FIG. 23 changes to the orientation shown in (b) of FIG. 23 , the posture of the display carrier of the projector will change. Since the projector will update the size of its display carrier and the coordinate system of the display carrier to the control device 310 (such as the coordinate origin changes from O1 to O1', the X1 axis changes to the X1' axis, the Y1 axis changes to the Y1' axis, and the Z1 axis changes to the Z1' axis), the control device 310 will also obtain the posture of the display carrier relative to the control device 310 in real time. Therefore, as shown in FIG. 23 , after the posture of the projector changes, the control device 310 can still achieve precise control of the cursor presentation on the new projection interface.

[0398] For another example, taking the first display device 320 as a projector, when the display size parameters of the projector change, the size of the projector's display carrier will change, such as from the size shown in (a) of FIG24 to the size shown in (b) of FIG24. Since the projector will update the size of its display carrier and the coordinate system in which the display carrier is located to the control device 310 (such as the coordinate origin changes from O1 to O1', the X1 axis changes to the X1' axis, the Y1 axis changes to the Y1' axis, and the Z1 axis changes to the Z1' axis), the control device 310 will also obtain the posture of the display carrier relative to the control device 310 in real time. Therefore, as shown in FIG23, after the display size parameters of the projector change, the control device 310 can still achieve precise control of the cursor presentation on the new projection interface.

[0399] Moreover, based on a device display control method provided in an embodiment of the present application, since the cursor is passing between the first display device 320 and the second display device 330, the first display device 320 and the third display device 330 are respectively based on the pointing position of the control device 310, combined with their own specific attributes, such as type, display screen size, display screen resolution, etc. to present the cursor. Therefore, even if the first display device 320 and the second display device 330 have one or more attributes such as type, display screen size, display screen resolution, etc., the cursor can still be passed continuously and smoothly from the first display device 320 to the second display device 330, thereby improving the user's control experience.

[0400] For example, please refer to Figure 25. In Figure 25, the first display device 320 is a projector, and the second display device 330 is a television. For example, a schematic diagram of a process of a cursor crossing between display devices with different attributes provided by an embodiment of the present application is shown. As shown in Figure 25, even if the projector and the television have different attributes such as type, display screen size, and display screen resolution, before the cursor passes from the display carrier of the projector to the television, the projector determines the pointing position of the control device based on the coordinate system where its own display carrier is located, the size of its own display carrier, and the position of its own display carrier relative to the control device, and presents the cursor in combination with its actual attributes; and after the cursor passes from the display carrier of the projector to the television, the television determines the pointing position of the control device based on the coordinate system where its own display screen is located, the size of its own display screen, and the position of its own display screen relative to the control device, and presents the cursor in combination with its actual attributes. Therefore, the entire cursor crossing process is not affected by the different attributes between the devices, and continuous and smooth cursor crossing can be achieved, thereby improving the user's control experience.

[0401] It should be noted that, in addition, the embodiment under the above-mentioned multi-display device scenario only takes the display device sending the coordinate system of its own display screen to the control device 310, and the control device 310 determines its own orientation, the posture of the display screen relative to the control device 320, and the intersection position of the orientation of the control device 310 and the plane where the display screen is located (that is, the orientation position of the control device 310) as an example. In actual applications, the execution entity that determines the orientation position of the control device 310 is not limited. For example, each display device can also determine the intersection position of the orientation of the control device 310 and the plane where its own display screen is located. Regarding this implementation method, you can refer to the implementation process of the relevant embodiment in Scenario 1, which will not be repeated here.

[0402] In addition, the above-mentioned embodiment under the multi-display device scenario only takes the cursor crossing from the first display device to the second display device as an example. In actual application, the actual crossing scenario of the cursor is not limited. For example, the cursor can also cross from the second display device to the first display device.

[0403] Furthermore, the above embodiments of a multi-display scenario use only the first and second display devices as examples. In practical applications, the number of display devices is not limited. For scenarios that also include a third display device, the process of the cursor moving between the first and second display devices can also be referenced. This description will not be repeated here.

[0404] It should be noted that in the above scenario 2, the cursor follows the movement trajectory of the control device between the first and second displays for illustrative purposes only. In actual applications, the specific interface effects displayed may depend on the specific application scenario, device functions, etc. For example, in scenario 2, it is also possible to achieve the effect of components, virtual images, perspective effects, special effects, etc. crossing between the first and second displays; for example, in scenario 2, it is also possible to achieve the effect of the interface effect changing after crossing.

[0405] For example, when the first display screen and the second display screen are in the same game scene, when the pointing position of the control device passes from the first display screen to the second display screen, synchronously, the image of the game protagonist, game equipment, game special effects (such as bubble effects, fireworks effects, aiming effects, hitting effects, etc.) can also pass from the first display screen to the second display screen.

[0406] For example, when the first display screen is in a game scene and the second display screen is in a handwriting board scene, when the pointing position of the control device passes from the first display screen to the second display screen, the interface effect changes synchronously from the image of the game protagonist, game equipment, game special effects (such as bubble effects, fireworks effects, aiming effects, hitting effects, etc.) to the image of a stylus and / or handwriting, etc.

[0407] For example, when the first display screen is in a game scene and the second display screen is in a demonstration scene, when the pointing position of the control device passes from the first display screen to the second display screen, the interface effect changes synchronously from the image of the game protagonist, game equipment, game special effects (such as bubble effects, fireworks effects, aiming effects, hitting effects, etc.) to a cursor.

[0408] Similarly, if the first display screen and the second display screen are in the same handwriting board scene, demonstration scene, etc., the interface effect may not change after crossing; or if the first display screen is in the handwriting board scene and the second display screen is in the game scene, the first display screen is in the demonstration scene and the second display screen is in the game scene, the first display screen is in the demonstration scene and the second display screen is in the handwriting board scene, the first display screen is in the handwriting board scene and the second display screen is in the demonstration scene, etc., the interface effect may also change after crossing, which will not be repeated here.

[0409] Among them, in the above-mentioned scenario 2, the interface effects presented on the first display screen or the second display screen may also include but are not limited to presenting display objects (such as icons, components, virtual images, images, etc.) at the pointing position of the control device, displaying corresponding viewing effects according to the pointing position of the control device, and presenting pre-set special effects in the corresponding display area (such as a preset control hot zone) according to the pointing position of the display control device, etc. The embodiments of this application do not make specific limitations and depend on the actual application scenarios and device functions.

[0410] In addition, in the above scenario 2, when the pointing position of the control device moves out of the edge area of ​​the first display screen and does not enter the edge area of ​​the second display screen, the first display screen may no longer update the above interface effects, or may no longer display any interface effects. This embodiment of the present application does not make specific limitations and depends on the actual application scenario and device functions.

[0411] When describing the positioning process between the control device and the display device, it was mentioned that methods such as multi-antenna UWB or three-dimensional electromagnetic coil positioning can be used to achieve the positioning of the pointing position and the presentation of the cursor. Below, the embodiments of this application further specifically provide a possible implementation method of the positioning system.

[0412] FIG26 is an architectural diagram of a possible positioning system provided in an embodiment of the present application. Referring to FIG26 , the system includes a first electronic device 100 and a second electronic device 200. Specifically, the first electronic device 100 is provided with a first antenna array 120, and the second electronic device 200 is provided with a second antenna array 220. The first antenna array 120 is capable of establishing a three-dimensional coordinate system based on the relative position of the first antenna array 120 on the first electronic device 100. The first antenna array 120 and the second antenna array 220 are capable of relative positioning, so that the coordinates of the second antenna array 220 are accurately displayed on the display interface of the first electronic device 100.

[0413] For example, the first electronic device 100 can be an electronic device with a display interface, such as a television, a computer, or a projector, that is, the first display device 320 or the second display device 320 mentioned above. The second electronic device 200 can be an electronic device with the function of remotely controlling the first electronic device 100, such as a remote control or a mobile phone, that is, the control device 310 mentioned above. This application does not limit the specific form of the first electronic device 100 and the second electronic device 200. In this embodiment, for ease of explanation, the first electronic device 100 is a large screen with a display function, and the second electronic device 200 is a remote control. The remote control can be called a pointing remote control. For example, after the remote control is paired with the television, the first antenna array 120 in the television and the second antenna array 220 in the remote control can be positioned relative to each other so that the coordinates of the remote control are displayed on the television screen. The coordinates can be displayed on the screen in the form of dots, arrows, stars, crosses, hands, etc.

[0414] Figure 27 is a structural diagram of the first electronic device 100 provided in an embodiment of the present application. Referring to Figure 27, the first electronic device 100 may include a processor 140, a transmission interface, a power module 110, a first antenna array 120, a first module circuit 130, etc.

[0415] It will be understood that the structure illustrated in the embodiment of the present invention does not constitute a specific limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may include more or fewer components than shown in the figure, or combine certain components, or split certain components, or arrange the components differently. The illustrated components can be implemented in hardware, software, or a combination of software and hardware. In addition, the interface connection relationship between the modules illustrated in the embodiment of the present invention is only a schematic illustration and does not constitute a structural limitation on the first electronic device 100. In other embodiments of the present application, the first electronic device 100 may also adopt different interface connection methods, or a combination of multiple interface connection methods.

[0416] The processor 140 may include one or more processing units, and different processing units may be independent devices or integrated into one or more processors. For example, the processor 210 is a central processing unit (CPU), an application specific integrated circuit (ASIC), or one or more integrated circuits configured to implement the embodiments of the present application, such as one or more microprocessors (digital signal processors, DSPs) or one or more field programmable gate arrays (FPGAs).

[0417] The transmission interface 150 can be a wired interface such as a Universal Serial Bus (USB) or a standard wireless interface such as one related to Business Transaction Events (BTE). The transmission interface 150 can be used to connect to a charger to charge the first electronic device 100, or to transmit data between the first electronic device 100 and a peripheral device, such as between the first electronic device 100 and a second electronic device 200.

[0418] The power module 110 is used to supply power to components such as the processor 140 of the first electronic device 100 .

[0419] FIG28 is a diagram showing the arrangement of the first antenna array 120 on the first electronic device 100 provided in an embodiment of the present application. Referring to FIG28 , the first antenna array 120 can be set at any position on the first electronic device 100. For example, the first antenna array 120 can be set outside the first electronic device 100, such as on the upper frame of the first electronic device 100, or on an object that is at a certain distance from the first electronic device 100. The "object" can be an independent device, such as a desk, a stand, etc. The first electronic device 100 and the first antenna array 120 can be placed on different stands at a certain distance from each other. Of course, the first antenna array 120 can also be set inside the electronic device in a hidden or semi-hidden manner. This embodiment does not limit this.

[0420] For example, when considering controlling the movement of the cursor on the display through a remote control, it is possible to consider setting an accelerometer and a gyroscope sensor in the remote control to sense the rotational state and translational state of the remote control. Based on the values ​​read by the sensors, the relative displacement of the remote control relative to the display is calculated. This displacement can be reflected as the movement of the cursor on the display, thereby realizing the interaction between the remote control and the display. However, this design can only obtain the relative displacement of the remote control relative to the display. The remote control cannot match the size of the display, resulting in the inability to obtain the absolute displacement of the remote control within the display size range. This will result in the user's actual intention not corresponding to the movement of the cursor on the display when operating the actual pointing and displacement changes of the remote control. For example, when the remote control is pointed to a position outside the display, the cursor will still appear on the display, and the cursor movement can also be controlled when the remote control moves. This results in the inability to perceive the accurate pointing direction and position in the entire remote control recognition.

[0421] To this end, in an embodiment of the present application, another design is considered, namely, a first antenna array 120 is set on the side of the first electronic device 100, and a second antenna array 220 is set on the side of the second electronic device 200. The first antenna array 120 and the second antenna array 220 can both send and receive signals and can achieve mutual positioning, so that the absolute coordinates of the second antenna array 220 relative to the first electronic device 100 can be obtained, and the second antenna array 220 can achieve precise pointing to the specified position of the first electronic device 100. Specifically, after the position of the first antenna array 120 on the first electronic device 100 is determined, the first antenna array 120 can establish a three-dimensional coordinate system based on the relative position of the first antenna array 120 on the first electronic device 100. The three-dimensional coordinate system takes into account the relative position of the first antenna array 120 relative to the display interface 160 of the first electronic device 100. When the first antenna array 120 and the second antenna array 220 of the second electronic device 200 are positioned relative to each other, if the detected coordinates of the second antenna array 220 do not exceed the range of the display interface 160, the coordinates of the second antenna array 220 can be accurately displayed within the range of the display interface 160. When the coordinates of the second antenna array 220 exceed the range of the display interface 160, the coordinates of the second antenna array 220 will not be displayed in the display interface 160, thereby avoiding the problem of inaccurate pointing.

[0422] The first antenna array 120 may specifically include a plurality of first antenna units 120a, which are arranged in a predetermined positional relationship. For example, FIG29 illustrates one arrangement of the first antenna units 120a, where three first antenna units 120a are arranged in an L-shape. FIG30 illustrates another arrangement of the first antenna units 120a, where four first antenna units 120a are arranged in a "U" shape. FIG31 illustrates yet another arrangement of the first antenna units 120a, where three first antenna units 120a are arranged in a "P" shape. In each arrangement of the at least three first antenna units 120a, at least two antennas are respectively distributed in a first direction X and a second direction Y, with the first direction X being perpendicular to the second direction Y. Among them, the first direction X can be used as the horizontal axis of the three-dimensional coordinate system, and the second direction Y can be used as the vertical axis of the three-dimensional coordinate system. The plane formed by the first direction X and the second direction Y can have a set geometric relationship with the display interface of the first electronic device 100, thereby facilitating the calculation of the coordinates of the second antenna array 220.

[0423] The second antenna array 220 can transmit a first signal, and the first antenna array 120 can receive the first signal. Correspondingly, the first antenna array 120 can transmit a second signal, and the second antenna array 220 can receive the second signal. The first antenna array 120 and the second antenna array 220 can operate in an ultra-high frequency (UHF) band, which covers a frequency range of 3 to 30 GHz. For example, possible operating frequencies include 5.8 GHz, 7.9 GHz, and 24 GHz. 7.9 GHz covers the ultra-wide band (UWB) band.

[0424] 27 , the first module circuit 130 may include a control unit 131, a transmitter 133, a receiver 134, and a computing unit 132. The control unit 131 may control the operation of the transmitter 133 and the computing unit 132. The transmitter 133 is configured to control the first antenna array 120 to transmit the second signal, and the receiver 134 is configured to control the first antenna array 120 to receive the first signal from the second antenna array 220. The computing unit 132 may calculate the phase parameters in the received first signal and feed the calculation results back to the control unit 131. The control unit 131 may then further calculate the first coordinates of the second antenna array 220 based on the results fed back by the computing unit 132.

[0425] In addition, Figure 32 is a schematic diagram of the structure of the second electronic device 200 provided in an embodiment of the present application. Referring to Figure 32, the second electronic device 200 may also have the various components described above in the first electronic device 100. Specifically, the second electronic device 200 may include a processor 240, a transmission interface 250, a power module 210, a second antenna array 220, a second module circuit 230, etc. The processor 240, transmission interface 250, and power module 210 in the second electronic device 200 have the same functions as the processor 140, transmission interface 150, and power module 110 in the first electronic device 100, and will not be repeated here.

[0426] The second antenna array 220 is used to send a first signal and receive a second signal. The second module circuit 230 is electrically connected to the second antenna array 220 and is used to measure the deflection angle of the second antenna array 220 relative to the first direction and the second direction according to the second signal.

[0427] As previously described, this embodiment requires that the first antenna array 120 and the second antenna array 220 be positioned relative to each other to obtain the absolute coordinates of the second antenna array 220 within the dimensions of the first electronic device 100. Specifically, the first antenna array 120 needs to obtain the relative coordinates of the second antenna array 220 relative to the first antenna array 120, i.e., the first coordinates, based on the first signal transmitted by the second antenna array 220. These first coordinates can be used to locate the spatial position of the second antenna array 220.

[0428] On the other hand, the second antenna array 220 is disposed on the second electronic device 200. When the second electronic device 200 is operated, the second electronic device 200 itself can rotate freely at the first coordinate position, thereby causing the second antenna array 220 to rotate. This rotation affects the phase of the signal received by the second antenna array 220, thereby changing the value of the first coordinate in the first direction and the second direction, causing the actual pointing position of the second antenna array 220 to not correspond to the first coordinate position. To this end, this embodiment takes into account the situation where the second electronic device 200 itself rotates. After the first antenna array 120 locates the first coordinate of the second antenna array 220 based on the first signal sent by the second antenna array 220, the second antenna array 220 can locate the deflection angle of the second antenna array 220 relative to the first direction X and the second direction Y based on the second signal sent by the first antenna array 120. Further, the final second coordinate can be obtained based on the first coordinate and the deflection angle.

[0429] In some embodiments, if the radiation surface of the first antenna array 120 is parallel to the display interface 160 of the first electronic device 100, the second coordinate is the position of the cursor that can be displayed on the first electronic device 100 by operating the second electronic device 200; in other embodiments, if the radiation surface of the first antenna array 120 is not parallel to the display interface 160 of the first electronic device, the second coordinate needs to be further converted according to the physical position relationship between the first antenna array 120 and the display interface 160, and the cursor position presented on the display interface 160 is obtained after conversion.

[0430] 32 , the second module circuit 230 may also include a control unit 231, a transmitter 233, a receiver 234, and a calculation unit 232. The control unit 231 may control the operation of the transmitter 233 and the calculation unit 232. The transmitter 233 is used to control the second antenna array 220 to transmit the first signal, and the receiver 234 is used to control the second antenna array 220 to receive the second signal from the first antenna array 120. The calculation unit 232 may calculate the phase parameter in the received second signal and feed the calculation result back to the control unit 231. The control unit 231 may further calculate the deflection angle of the second antenna array 220 based on the result fed back by the calculation unit 232.

[0431] In particular, either the first module circuit 130 or the second module circuit 230 can be configured to calculate the second coordinate based on the first coordinate and the deflection angle. In one embodiment, after the second antenna array 220 obtains the deflection angle, it can transmit the calculated deflection angle to the first module circuit 130 via a transmission interface. The first module circuit 130 can then calculate the second coordinate based on the first coordinate and the deflection angle. In another embodiment, after the second antenna array 220 obtains the deflection angle, the second module circuit 230 can calculate the second coordinate, which can then be transmitted to the first module circuit 130 via a transmission interface. If the second coordinate falls within the display interface size range of the first electronic device 100, it can be displayed on the first electronic device 100.

[0432] Therefore, the system provided in the embodiment of the present application, on the one hand, by providing the first antenna array 120 on the first electronic device 100 and the second antenna array 220 on the second electronic device 200, can realize long-distance interaction between the first electronic device 100 and the second electronic device 200 without relying on a moving plane; on the other hand, through the mutual positioning of the first antenna array 120 and the second antenna array 220, the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100 can be obtained, thereby improving the precise positioning of the second antenna array 220 and also improving the operating experience in spatial pointing operations.

[0433] Optionally, referring to FIG3 , at least three first antenna units 120a are provided, and at least two second antenna units are provided, wherein the distance L between any two of the at least three first antenna units 120a that have a signal receiving function is less than or equal to the wavelength λ of the first signal. The first antenna array 120 and the second antenna array 220 may have the same layout. For example, the first antenna array 120 includes three first antenna units 120a, and the second antenna array 220 includes three second antenna units, and the layout of the three first antenna units 120a is the same as the layout of the three second antenna units. Of course, in other embodiments, the first antenna array 120 and the second antenna array 220 may also have different layouts. For example, the first antenna array 120 includes three first antenna units 120a, and the second antenna array 220 includes two second antenna units, and the layout of the three first antenna units 120a is different from the layout of the two second antenna units.

[0434] In this embodiment, the arrangement of the first antenna array 120 is taken as an example for description.

[0435] It is understandable that the wavelength can be calculated based on the wave speed and frequency. In this embodiment, the first antenna array 120 needs to receive the first signal sent by the second antenna array 220. The wavelength of the first signal can be calculated based on the frequency of the first signal and the wave speed of the electromagnetic wave. The distance between any two first antenna units 120a is limited based on the wavelength. Since the shape of the antenna is not an absolutely regular shape, the equivalent center of the antenna can be used as the starting point or end point for measuring the distance, that is, the distance between any two first antenna units 120a is the equivalent center distance of each antenna. By making the distance between any two first antenna units 120a with the function of receiving signals less than or equal to the wavelength of the first signal, each first antenna unit 120a used for receiving signals can receive the first signal almost simultaneously, and each first antenna unit 120a can obtain a phase parameter based on the first signal, and the first coordinate can be further calculated based on the phase parameter.

[0436] Correspondingly, Figure 33 is a diagram of the arrangement status of the second antenna array 220 provided in an embodiment of the present application on the second electronic device 200. Referring to Figure 33, the second antenna unit in the second antenna array 220 can be used to receive the second signal sent by the first antenna array 120. By making the distance L' between any two second antenna units less than or equal to the wavelength λ of the second signal, each second antenna unit used for receiving the signal can receive the second signal almost at the same time, and each second antenna unit can obtain a phase parameter based on the second signal, and the deflection angle can be obtained based on the phase parameter.

[0437] That is to say, this embodiment makes the distance between any two first antenna units 120a and the distance between any two second antenna units less than the wavelength of the corresponding received signal, so that the first coordinates and deflection angles can be obtained according to the phase parameters of the received signal, thereby enabling the second antenna array 220 to be positioned in three-dimensional space, and the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100 can be obtained, thereby improving the positioning accuracy and the control experience of the second electronic device 200.

[0438] The first module circuit 130 includes one or more receivers 134. For example, when there is only one receiver 134, the receiver 134 can be electrically connected to the second antenna 122, the third antenna 123, and the first antenna 121 respectively via a high-speed switch. Thus, a single receiver 134 can receive signals from the three first antenna units 120a, allowing the three antennas to receive signals nearly simultaneously and calculating the first coordinate based on the phase difference between the first antenna units 120a. Furthermore, when there are multiple receivers 134, each receiver 134 is connected to a corresponding first antenna unit 120a. The receivers 134 can synchronize processing via a synchronization signal, thereby also obtaining the phase difference between the first antenna units 120a.

[0439] Accordingly, the second module circuit 230 also includes one or more receivers 234. The arrangement of the receiver 234 and the second antenna unit in the second module circuit 230 can be the same as the arrangement of the receiver 134 and the first antenna unit in the first module circuit 130. For example, when there is only one receiver 234, one receiver 234 is electrically connected to each second antenna unit, and one receiver 234 can perform the signal reception function of three second antenna units. When there are multiple receivers 234, each receiver 234 is connected to a corresponding second antenna unit. The receivers 234 can synchronize processing via synchronization signals, allowing the three second antenna units to receive signals nearly simultaneously, and calculating the deflection angle based on the phase difference between the second antenna units.

[0440] Optionally, when there are multiple receivers 134 or 234 , the number of antennas electrically connected to one receiver may also be multiple.

[0441] 27 and 28 , the at least three first antenna units 120 a may be a first antenna 121, a second antenna 122, and a third antenna 123, respectively, wherein the second antenna 122 is located on one side of the first antenna 121 in the first direction X, and the third antenna 123 is located on one side of the first antenna 121 in the second direction Y.

[0442] The first antenna 121 can transmit or receive signals, and the origin of a three-dimensional coordinate system can be defined through the first antenna 121 .

[0443] Exemplarily, the first antenna 121 may be an independent transceiver antenna. The first module circuit 130 includes a transmitter 133 and a switch 135. The transmitter 133 is connected to the first antenna 121 via the switch 135, and the signal transmission function and the signal reception function can be switched via the switch 135. In this embodiment, the position of the first antenna 121 is the origin of the three-dimensional coordinate system, thereby facilitating coordinate calculation.

[0444] In another embodiment, the first antenna 121 may also include a transmitting antenna 121a and a receiving antenna. The transmitting antenna 121a is connected to the transmitter 133 for transmitting signals, and the receiving antenna is connected to the receiver 134 for receiving signals. In this embodiment, the transmitting antenna in the first antenna 121 is the origin of the three-dimensional coordinate system, thereby facilitating coordinate calculation.

[0445] In addition, in some other embodiments, the origin of the three-dimensional coordinate system may also be defined by a position other than the first antenna 121 , which is not limited in this embodiment.

[0446] For ease of description, the following description will be made by taking the first antenna 121 as an independent transceiver integrated antenna as an example.

[0447] In one embodiment, first antenna 121 serves as the origin of a three-dimensional coordinate system, the first direction is the x-axis direction of the three-dimensional coordinate system, the second direction is the y-axis direction of the three-dimensional coordinate system, second antenna 122 is located on the x-axis, and third antenna 123 is located on the y-axis, so that first antenna 121, second antenna 122, and third antenna 123 are arranged in an "L" shape. The distance between second antenna 122 and first antenna 121, and the distance between third antenna 123 and first antenna 121, are both less than or equal to the wavelength of the first signal.

[0448] Based on the structure of the first antenna array 120 provided in this embodiment, the positioning method will be described in detail below with reference to the accompanying drawings.

[0449] When operating the second electronic device 200, a distance is usually maintained between the second electronic device 200 and the first electronic device 100, that is, a distance is maintained between the first antenna array 120 and the second antenna array 220, so that a triangle is formed between the second antenna array 220, the first antenna 121, and the second antenna 122, and a triangle is also formed between the second antenna array 220, the first antenna 121, and the third antenna 123. Therefore, the value of the first coordinate (x, y, z) can be calculated based on the relevant principles of triangles and electromagnetic waves.

[0450] Specifically, Figure 34 is a model diagram for calculating the first coordinate provided in an embodiment of the present application. Referring to Figure 34, in the triangle formed by the second antenna array 220, the first antenna 121 and the second antenna 122, for the sake of convenience of explanation, the distance between the second antenna array 220 and the first antenna 121 can be defined as the first distance r, the second distance between the second antenna array 220 and the second antenna 122 can be defined as r', and the third distance between the second antenna 122 and the first antenna 121 can be defined as d.

[0451] FIG35 is a schematic diagram of a one-way ranging method provided in an embodiment of the present application. Referring to FIG35 , for calculating the first distance r, if the clocks of the second antenna array 220 and the first antenna 121 are precisely synchronized, the one-way ranging method can be used. Specifically, the steps include:

[0452] Step a1: detecting the first time point t1 at which the second antenna array 220 sends the first signal.

[0453] Step a2: Detecting a second time point t2 at which the first antenna 121 receives the first signal.

[0454] Step a3: Obtain a first distance d according to the first time point, the second time point, and the speed of light.

[0455] Among them, t2-t1 is the time length of the electromagnetic wave propagating between the second antenna array 220 and the first antenna 121. The speed of electromagnetic wave propagation is the speed of light c. The time length multiplied by the speed of light can obtain the first distance r, which can be specifically expressed as the following formula: r=(t2-t1)×c.

[0456] In addition, FIG36 is a schematic diagram of a two-way ranging method provided in an embodiment of the present application. Referring to FIG36 , for calculating the first distance r, if the clocks of the second antenna array 220 and the first antenna 121 are not synchronized, a two-way ranging method can be used, which specifically includes the following steps:

[0457] Step b1: detecting the first time point t3 when the second antenna array 220 sends the first signal.

[0458] Step b2: Detect the second time point t4 when the first antenna 121 receives the first signal.

[0459] Step b3: Detect the delay time t' of the first antenna 121 processing the first signal.

[0460] Step b4: Detecting a third time point t5 at which the first antenna 121 sends the second signal.

[0461] Step b5: detecting a fourth time point t6 at which the second antenna array 220 receives the second signal.

[0462] Step b6: Obtain the straight-line distance based on the first time point, the second time point, the delay duration, the third time point, the fourth time point, and the speed of light.

[0463] Since the clocks of the second antenna array 220 and the first antenna 121 are not synchronized, a signal delay t' needs to be considered between the first antenna 121 transmitting and receiving signals, where t'=t5-t4; t4-t3 is the time it takes for the electromagnetic wave to propagate from the second antenna array 220 to the first antenna 121, and t6-t5 is the time it takes for the electromagnetic wave to propagate from the first antenna 121 to the second antenna array 220. The time lengths t4-t3 and t6-t5 are equal. Specifically, the first distance r can be calculated using the following formula:

[0464] Regarding the calculation of the second distance r', since there is a third distance d between the second antenna 122 and the first antenna 121, there is a phase difference p' between the signals received by the second antenna 122 and the first antenna 121. This phase difference p' can be a positive value or a negative value in the coordinate system. Based on this phase difference p', the frequency f of the first signal, and the speed of light c, the distance difference p between the first distance r and the second distance r' can be calculated. This distance difference p can be calculated according to the following formula:

[0465] When the second antenna array 220 transmits the first signal, the first antenna 121 and the second antenna 122 can respectively receive the first signal and obtain phase parameters, thereby obtaining the phase difference p' between the first antenna 121 and the second antenna 122. After obtaining the distance difference p, the second distance r' can be calculated, that is, r' = rp.

[0466] Referring to Figure 34 , the third distance d can be directly determined after arranging the second antenna 122 and the first antenna 121. Thus, the lengths of the three sides of the triangle formed by the first antenna 121, the second antenna 122, and the second antenna array 220 can be determined. The angle α between the line connecting the second antenna array 220 and the first antenna 121 and the line connecting the second antenna 122 and the first antenna 121 can be defined. The first coordinate of the second antenna array 220 in the three-dimensional coordinate system is (x, y, z), which can be determined using the following formula: r 2 =x 2 +z 2 ; (3)

[0467] Among them, in Formulas (2) and (3), x is the coordinate value corresponding to the second antenna array 220 on the x-axis in the three-dimensional coordinate system, and z is the coordinate value corresponding to the second antenna array 220 on the z-axis in the three-dimensional coordinate system. According to Formulas (1) and (2), the x value in the first coordinate can be obtained, and according to Formulas (1)-(3), the z value in the first coordinate can be calculated.

[0468] Correspondingly, according to the principle of calculating the x value and z value in the first coordinate as described above, the y value in the first coordinate can be calculated, which will not be elaborated here.

[0469] Thus, through the above method, all the numerical values of the first coordinate (x, y, z) can be obtained.

[0470] In another embodiment, FIG. 37 is another model diagram for calculating the first coordinate provided by the embodiment of the present application. Referring to FIG. 37, the second antenna 122 is on the x-axis of the three-dimensional coordinate system, and the third antenna 123 is located on one side of the first antenna 121 in the y-axis direction but not on the y-axis, so that the positional distribution of the first antenna 121, the third antenna 123, and the second antenna 122 is in a "pin" shape, an acute triangle, an obtuse triangle, etc.

[0471] In this embodiment, for the triangle formed by the first antenna 121, the second antenna 122, and the second antenna array 220, since the second antenna 122 is on the x-axis, the calculation of the x value and z value in the first coordinate in this embodiment can still be obtained by the above method.

[0472] Referring to FIG. 37, since the third antenna 123 is not on the y-axis, it cannot be directly calculated according to the triangle formed by the first antenna 121, the third antenna 123, and the second antenna array 220. Instead, it is necessary to determine the projection point y1 of the third antenna 123 on the y-axis, and determine a triangle with this projection point y1, the first antenna 121, and the second antenna array 220, and calculate the y value in the first coordinate according to this triangle. Among them, there is an angle β1 between the connection line of the third antenna 123 and the first antenna 121 and the y-axis. The phase difference between the third antenna 123 and the first antenna 121 can be used to convert the component of this phase difference on the y-axis according to this angle β1. According to the component of this phase difference on the y-axis, the distance from the projection point y1 of the third antenna 123 on the y-axis to the second antenna array 220 can be calculated, and the distance from this projection point y1 to the first antenna 121 can be converted according to the distance between the third antenna 123 and the first antenna 121 and the angle β1. The distance between the second antenna array 220 and the first antenna 121 can still be calculated according to the above single-direction ranging method or two-way ranging method. Thus, the side lengths of the triangle determined by the projection point y1, the first antenna 121, and the second antenna array 220 can be obtained, and the y value of the first coordinate can be calculated according to the above method.

[0473] In addition, in some other embodiments, Figure 38 is another model diagram for calculating the first coordinate provided in an embodiment of the present application. Referring to Figure 38, for the x value and z value, the triangle can also be determined by the projection point of the third antenna 123 on the x-axis, the first antenna 121 and the second antenna array 220, and the x value and z value of the first coordinate can be calculated according to the above method.

[0474] Specifically, referring to Figure 38, there is an angle β2 between the line connecting the third antenna 123 and the first antenna 121 and the x-axis. The phase difference between the third antenna 123 and the first antenna 121 can be converted into the component of the phase difference on the x-axis based on the angle β2. According to the component of the phase difference on the x-axis, the distance from the projection point x1 of the third antenna 123 on the x-axis to the second antenna array 220 can be calculated, and the distance from the projection point x1 to the first antenna 121 can be converted based on the distance between the third antenna 123 and the first antenna 121 and the angle β2. The distance between the second antenna array 220 and the first antenna 121 can still be calculated according to the above-mentioned one-way ranging method or two-way ranging method. In this way, the lengths of each side of the triangle determined by the projection point x1, the first antenna 121 and the second antenna array 220 can be obtained, and the x value and z value of the first coordinate can be calculated according to the above-mentioned method.

[0475] Optionally, the second antenna array 220 includes at least two second antenna units. When there are two second antenna units, they need to work in conjunction with an accelerometer. The accelerometer and one of the second antenna units are respectively distributed in a third direction and a fourth direction, where the third direction and the fourth direction are perpendicular. The other second antenna unit can be located at the intersection of the third and fourth directions, serving as the origin of a coordinate system formed by the third and fourth directions. For example, the second antenna unit located on one side of the origin in the third direction can be used to obtain a horizontal signal, and the accelerometer located on the side of the origin in the fourth direction is used to obtain a vertical signal. The deflection angle of the second antenna array is further determined based on the horizontal and vertical signals.

[0476] When there are three or more second antenna units, at least two of the at least three second antenna units are distributed in the third direction and the fourth direction, respectively.

[0477] The third and fourth directions are both based on the second electronic device 200 itself as a reference system, i.e., the third and fourth directions are independent of the first direction X and the second direction Y, respectively, and the world coordinate system. The second antenna array 220 can be positioned anywhere within the second electronic device 200. To achieve better signal transmission and reception performance, the second antenna array 220 is positioned at an end of the second electronic device 200, which is the end of the second electronic device 200 facing the first electronic device 100 during use.

[0478] Among them, the third direction and the fourth direction are two mutually perpendicular directions relative to the end of the second electronic device 200. The second antenna units are respectively arranged in the two mutually perpendicular directions, so that the deflection angle of the second antenna array 220 relative to the first direction X and the second direction Y can be obtained based on the phase difference between each antenna. Therefore, the second coordinate can be obtained based on the first coordinate and the deflection angle, that is, the absolute coordinate of the second column of antennas within the size range of the first electronic device 100.

[0479] The second antenna array 220 and the first antenna array 120 can have the same antenna layout. Each antenna in each array can be arranged in an L-shape, a T-shape, or a rectangular array, for example. This facilitates calculation of parameters such as antenna phase difference and deflection angle, enabling precise positioning. Of course, in other embodiments, as described above, the second antenna array 220 and the first antenna array 120 can also have different layouts, which will not be further described here.

[0480] Optionally, referring to Figures 32 and 33, the second antenna array 220 includes at least three second antenna units, which may be a fourth antenna 221, a fifth antenna 222, and a sixth antenna 223. The fifth antenna 222 is located on one side of the fourth antenna 221 in the third direction, and the sixth antenna 223 is located on one side of the fourth antenna 221 in the fourth direction, so that the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 form an "L"-shaped structure. The fourth antenna 221 is a transceiver antenna, and the fifth antenna 222 and the sixth antenna 223 are both receiving antennas. The distance between any two of the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 is less than or equal to the wavelength of the second signal. Referring to Figure 32, the fourth antenna 221 may be an independent antenna, which may be connected to a transmitter via a switch 235. The switch 235 enables switching between signal transmission and signal reception. Of course, in some other embodiments, the fourth antenna 221 may also include a transmitting antenna 221a and a receiving antenna, the transmitting antenna 221a is connected to the transmitter 233 for sending signals, and the receiving antenna is connected to the receiver 234 for receiving signals.

[0481] When the first antenna array 120 sends the second signal, the fourth antenna 221, the fifth antenna 222 and the sixth antenna 223 can all receive the second signal and obtain the phase difference between the fifth antenna 222 and the fourth antenna 221, as well as the phase difference between the sixth antenna 223 and the fourth antenna 221 based on the phase parameter in the second signal. Since the distance between any two of the fourth antenna 221, the fifth antenna 222 and the sixth antenna 223 is less than or equal to the wavelength of the second signal, the first deflection angle θ1 of the second antenna array 220 relative to the first direction and the second deflection angle θ2 of the second antenna array 220 relative to the second direction can be obtained based on the phase difference. Combined with the first coordinates (x, y, z), the final two-dimensional coordinates (x+z×tanθ1, y+z×tanθ2) of the second antenna array 220 projected onto the display interface 160 of the first electronic device 100 can be obtained.

[0482] Optionally, the plane formed by the first direction X and the second direction Y is parallel to the display interface of the first electronic device 100. The equivalent center of each first antenna unit 120a in the first antenna array 120 can be located on the plane formed by the first direction X and the second direction Y, thereby facilitating geometric calculations of the values ​​of each coordinate point in the first coordinates, which is beneficial to improving the accuracy of the first coordinates.

[0483] Of course, in some other embodiments, the equivalent center of each first antenna unit 120a in the first antenna array 120 may not be coplanar with the display interface 160 of the first electronic device 100, as long as the geometric relationship between each first antenna unit 120a and the display interface 160 of the first electronic device 100 can be determined.

[0484] The embodiment of the present application further provides a positioning method. The positioning method provided in the embodiment of the present application is described in detail below in conjunction with the accompanying drawings and specific embodiments.

[0485] The positioning method can be applied to a system including a first electronic device 100 and a second electronic device 200. The first electronic device 100 is provided with a first antenna array 120, which includes multiple first antenna units 120a. At least two of the multiple first antenna units 120a are distributed in a first direction and a second direction, respectively, and the first direction is perpendicular to the second direction. The second electronic device 200 is provided with a second antenna array 220, which includes multiple second antenna units.

[0486] FIG39 is a flowchart of a positioning method provided in an embodiment of the present application. Referring to FIG39 , the method includes the following steps:

[0487] Step S1: Determine the position of a first cursor displayed on the first electronic device 100 according to the first signal sent by the second antenna array 220 and the second signal sent by the first antenna array 120.

[0488] The present application can obtain the absolute coordinates of the second antenna array 220 relative to the first electronic device 100 by mutually locating the first antenna array 120 and the second antenna array 220, so that the second antenna array can accurately point to the designated location of the first electronic device 100. Specifically, after the position of the first antenna array 120 on the first electronic device 100 is determined, the first antenna array 120 can establish a three-dimensional coordinate system based on the relative position of the first antenna array 120 on the first electronic device 100. The three-dimensional coordinate system takes into account the relative position of the first antenna array 120 relative to the display interface 160 of the first electronic device 100. When the first antenna array 120 and the second antenna array 220 of the second electronic device 200 are mutually located, if the detected coordinates of the second antenna array 220 do not exceed the range of the display interface 160, the coordinates of the second antenna array 220 can be accurately displayed within the range of the display interface 160 in the form of a first cursor, thereby improving the precise positioning of the second antenna array 220 and improving the operating experience in spatial pointing operations.

[0489] In addition, when the coordinates of the second antenna array 220 exceed the size range of the first electronic device 100, the coordinates determined in this case can be defined as the second cursor position, and the second cursor position will not be displayed in the display interface 160, thereby avoiding the problem of inaccurate pointing.

[0490] Specifically, FIG40 is a flowchart of a positioning method provided by another embodiment of the present application. Referring to FIG40 , step S1 specifically includes:

[0491] Step S11: Measure first coordinates of the second antenna array in the three-dimensional coordinate system where the first antenna array is located based on the first signal. The first coordinates may be calculated by the first electronic device 100 or by the second electronic device 200, and the calculation results are sent to the first electronic device 100.

[0492] Step S12: Measure the deflection angle of the second antenna array relative to the first direction and the second direction based on the second signal. The deflection angle can be calculated by the second electronic device 200 or the first electronic device 100, and this embodiment does not limit this.

[0493] Step S13: Obtain a second coordinate according to the first coordinate and the deflection angle.

[0494] Step S14: Determine the position of the first cursor based on the second coordinates. As previously described, depending on the positional relationship between the radiation surface of the first antenna array 120 and the display interface 160 of the first electronic device 100, the second coordinates may be the position of the first cursor, or may be the position of the first cursor obtained by converting the second coordinates. This will not be further described here.

[0495] In particular, the second electronic device 200 can rotate freely at the first coordinate position during use, and will drive the second antenna array 220 to rotate. This rotation will affect the phase of the signal received by the second antenna array 220, thereby changing the value of the first coordinate in the first direction and the second direction, causing the actual pointing position of the second antenna array 220 to not correspond to the first coordinate position. To this end, this embodiment takes into account the situation where the second electronic device 200 itself rotates. After the first antenna array 120 locates the first coordinate of the second antenna array 220 based on the first signal sent by the second antenna array 220, the second antenna array 220 can locate its own deflection angle relative to the first direction and the second direction based on the second signal sent by the first antenna array 120. Further, the final second coordinate can be obtained by following the first coordinate and the deflection angle.

[0496] The positioning method provided in the embodiments of the present application, on the one hand, by providing a first antenna array 120 on the first electronic device 100 and a second antenna array 220 on the second electronic device 200, can achieve long-distance interaction between the first electronic device 100 and the second electronic device 200 without relying on a moving surface. On the other hand, by mutual positioning of the first antenna array 120 and the second antenna array 220, and taking into account the rotation of the second electronic device 200 during use, the absolute coordinates of the second antenna array 220 within the size range of the first electronic device 100 can be obtained by calculating the deflection angle of the second antenna array 220 relative to the first antenna array 120 in the first direction and the second direction, thereby improving the precise positioning of the second antenna array 220 and also improving the operating experience in spatial pointing operations.

[0497] As a specific implementation, the first antenna unit 120a includes a first antenna 121, a second antenna 122, and a third antenna 123. The second antenna 122 is located on one side of the first antenna 121 in the first direction, and the third antenna 123 is located on one side of the first antenna in the second direction. The first signal includes a time parameter and a first phase parameter. Specifically, step S11 includes:

[0498] Step S111: Obtain a first distance between the first antenna 121 and the second antenna array 220 based on a time parameter. The time parameter is the flight time between the time points of signal transmission and reception, and may also include the time consumed for signal processing. The first distance can be calculated based on the time parameter.

[0499] 35 and 36 , the first distance r is the straight-line distance between the second antenna array 220 and the first antenna 121. As previously described, the first distance r can be calculated using a one-way ranging method or a two-way ranging method. In both measurement methods, the first distance r can be calculated based on the time point when the signal is sent or received, and can also be calculated in combination with the delay time for processing the signal. Details will not be repeated here.

[0500] Step S112: Obtain a first phase difference between the second antenna 122 and the first antenna 121, and a second phase difference between the third antenna 123 and the first antenna 121, based on the first phase parameter. The first antenna array 220 may analyze the received first signal to obtain the phase parameter, and the phase difference may be further obtained based on the phase parameter.

[0501] Step S113, obtain the x-axis coordinate value and the z-axis coordinate value in the first coordinate according to the first distance r, the distance between the second antenna 122 and the first antenna 121, and the first phase difference; obtain the y-axis coordinate value in the first coordinate according to the first distance r, the distance between the third antenna 123 and the first antenna 121, and the second phase difference.

[0502] 34 , as previously described, the distance between the second antenna 122 and the second antenna array 220 can be calculated based on the first phase difference, and the x and z values ​​of the first coordinate can be further calculated. Referring to FIG37 , the distance between the third antenna 123 and the second antenna array 220 can be calculated based on the second phase difference, and the y value of the first coordinate can be further calculated, thereby obtaining the entire value of the first coordinate (x, y, z).

[0503] As a specific implementation, the second antenna array 220 includes a fourth antenna 221, a fifth antenna 222, and a sixth antenna 223. The fifth antenna 222 is located on one side of the fourth antenna 221 in the third direction, and the sixth antenna 223 is located on one side of the origin antenna in the fourth direction. The second signal includes a second phase parameter. Specifically, step S12 includes:

[0504] Step S121 : obtaining a third phase difference between the fifth antenna 222 and the fourth antenna 221 , and a fourth phase difference between the sixth antenna 223 and the fourth antenna 221 according to the second phase parameter.

[0505] Step S122: Obtain the first deflection angle θ1 of the second antenna array 220 in the first direction based on the third phase difference, and obtain the second deflection angle θ2 of the second antenna array 220 in the second direction based on the fourth phase difference.

[0506] Among them, since the distance between any two of the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 is less than or equal to the wavelength of the second signal, the first deflection angle θ1 of the second antenna array 220 relative to the first direction and the second deflection angle θ2 of the second antenna array 220 relative to the second direction can be correspondingly obtained according to the phase difference. Combining with the first coordinates (x, y, z), the two-dimensional coordinates (x + z×tanθ1, y + z×tanθ2) of the second antenna array 220 projected onto the display interface of the first electronic device 100 can be obtained. Among them, for the case where the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 form a triangle or a "pin" shape, the distance between any two receiving antennas is less than or equal to the wavelength of the second signal, and the unique deflection angle can be assisted in determination by the horizontal components of some antennas. In addition, for the case where the fourth antenna 221, the fifth antenna 222, and the sixth antenna 223 form a rectangular array or a "square" shape, the distance between any two receiving antennas is less than or equal to 1 / 2 of the wavelength of the second signal, and thus the unique deflection angle can be directly determined.

[0507] Thus, for the influence of the rotation of the second electronic device 200 on the coordinate accuracy, this embodiment considers realizing correction by measuring the first deflection angle θ1 and the second deflection angle θ2. On the basis of obtaining the first coordinates of the second antenna array 220, generally, a gyroscope is considered to be set in the second electronic device 200. However, the gyroscope can only detect the rotation of the second electronic device 200 itself and cannot be synchronized with the size of the display interface of the first electronic device 100. For example, when the coordinates of the second electronic device 200 exceed the size range of the display interface of the first electronic device 100, the gyroscope will still detect the rotation of the second electronic device 200 and transmit the rotation signal to the first electronic device 100, causing the cursor on the display interface of the first electronic device 100 to move randomly and unable to obtain an accurate pointing. In this embodiment, a method of measuring the deflection angle is adopted, that is, by measuring the first deflection angle θ1 and the second deflection angle θ2, the angle correction of the second antenna array 220 in the three-dimensional coordinate system can be realized, and this three-dimensional coordinate system is associated with the size of the first electronic device 100, so that the absolute coordinates of the second antenna array 220 within the size range of the display interface of the first electronic device 100 can be accurately obtained. When the coordinates of the second antenna array 220 exceed the size range of the display interface of the first electronic device 100, the coordinates of the second antenna array 220 are not displayed on the display interface of the first electronic device 100, thereby improving the control experience.

[0508] In addition, in some other embodiments, the second antenna array includes a fourth antenna, a fifth antenna, and an acceleration sensor, the fifth antenna is located on one side of the fourth antenna in a third direction, the acceleration sensor is located on one side of the fourth antenna in a fourth direction, and the third direction is perpendicular to the fourth direction; the second signal includes a second phase parameter;

[0509] Step S12 specifically includes:

[0510] Step S123: Obtain a third phase difference between the fifth antenna and the fourth antenna according to the second phase parameter.

[0511] Step S124 : obtaining a first deflection angle of the second antenna array in the first direction according to the third phase difference, and obtaining a second deflection angle of the second antenna array in the second direction according to the second phase parameter by the acceleration sensor.

[0512] The acceleration sensor may replace the sixth antenna in the aforementioned embodiment. The acceleration sensor can obtain the second deflection angle, and thus the second coordinate can be obtained by combining the first deflection angle and the first coordinate, which will not be described in detail here.

[0513] It should be understood that the various schemes of the embodiments of the present application can be reasonably combined and used, and the explanations or descriptions of the various terms appearing in the embodiments can be referenced or explained with each other in the various embodiments.

[0514] It should also be understood that in the various embodiments of the present application, the size of the serial numbers of the above-mentioned processes does not mean the order of execution. The execution order of each process should be determined by its function and internal logic, and should not constitute a limitation on the implementation process of the embodiments of the present application.

[0515] It is understandable that, in order to realize the functions of any of the above-mentioned embodiments, the electronic device (such as a control device or a display device) includes a hardware structure and / or software module corresponding to the execution of each function. It should be easily appreciated by those skilled in the art that, in combination with the units and algorithm steps of each example described in the embodiments disclosed herein, the present application can be implemented in the form of hardware or a combination of hardware and computer software. Whether a function is executed in the form of hardware or computer software driving hardware depends on the specific application and design constraints of the technical solution. Professional and technical personnel can use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0516] The embodiments of the present application can divide the electronic device (such as a control device or a display device) into functional modules. For example, each functional module can be divided corresponding to each function, or two or more functions can be integrated into one processing module. The above-mentioned integrated modules can be implemented in the form of hardware or in the form of software functional modules. It should be noted that the division of modules in the embodiments of the present application is schematic and is only a logical function division. There may be other division methods in actual implementation.

[0517] It should also be understood that the various modules in an electronic device (such as a control device or a display device) can be implemented in software and / or hardware, without specific limitation. In other words, the electronic device is presented in the form of functional modules. The "module" here can refer to an application-specific integrated circuit (ASIC), a circuit, a processor and memory that executes one or more software or firmware programs, an integrated logic circuit, and / or other devices that can provide the above-mentioned functions.

[0518] In an optional manner, when data transmission is implemented using software, it can be implemented in whole or in part in the form of a computer program product. The computer program product includes one or more computer instructions. When the computer program instructions are loaded and executed on a computer, the process or function described in the embodiment of the present application is implemented in whole or in part. The computer can be a general-purpose computer, a special-purpose computer, a computer network, or other programmable device. The computer instructions can be stored in a computer-readable storage medium or transmitted from one computer-readable storage medium to another computer-readable storage medium. For example, the computer instructions can be transmitted from one website, computer, server or data center to another website, computer, server or data center via a wired (e.g., coaxial cable, optical fiber, digital subscriber line (DSL)) or wireless (e.g., infrared, wireless, microwave, etc.) method. The computer-readable storage medium can be any available medium that can be accessed by a computer or a data storage device such as a server or data center that includes one or more available media. The available medium can be a magnetic medium (e.g., a floppy disk, a hard disk, a tape), an optical medium (e.g., a digital video disk (DVD)), or a semiconductor medium (e.g., a solid state disk (SSD)).

[0519] The steps of the method or algorithm described in conjunction with the embodiments of the present application can be implemented in hardware or by executing software instructions by a processor. The software instructions can be composed of corresponding software modules, which can be stored in random access memory (RAM), flash memory, read-only memory (ROM), erasable programmable read-only memory (EPROM), electrically erasable programmable read-only memory (EEPROM) memory, registers, hard disks, mobile hard disks, compact disc read-only memory (CD-ROM) or any other form of storage medium known in the art. An exemplary storage medium is coupled to a processor so that the processor can read information from the storage medium and write information to the storage medium. Of course, the storage medium can also be an integral part of the processor. The processor and the storage medium can be located in an application specific integrated circuit (ASIC). In addition, the ASIC can be located in an electronic device (such as a control device or a display device). Of course, the processor and the storage medium can also exist as discrete components.

[0520] Through the description of the above implementation methods, those skilled in the art can clearly understand that for the convenience and simplicity of description, only the division of the above-mentioned functional modules is used as an example. In actual applications, the above-mentioned functions can be distributed and completed by different functional modules as needed, that is, the internal structure of the device can be divided into different functional modules to complete all or part of the functions described above. The above is only an exemplary embodiment of the present application and is not intended to limit the present application. For those skilled in the art, the present application can have various changes and variations. Any modifications, equivalent replacements, improvements, etc. made within the spirit and principles of the present application should be included in the scope of protection of the present application.

Claims

1. A device display control method, It is characterized in that The method is applied to at least one display device, the at least one display device includes a first display device, the first display device includes a first positioning module and a first display screen, and the method includes: The first positioning module receives first positioning information from the control device; Following a first moving track of the control device, and presenting a corresponding display object on the first display screen based on the first positioning information; When the pointing position of the first moving track moves out of the first edge area of ​​the first display screen, the corresponding display object is no longer presented on the first display screen.

2. The method according to claim 1, It is characterized in that The method further comprises: After the pointing position of the first moving track moves out of the first edge area, the first positioning module receives second positioning information from the control device; When the pointing position of the second moving track is outside the first edge area, the corresponding display object is no longer presented on the first display screen; When it is determined that the pointing position of the third movement track moves into the first edge area, the third movement track of the control device is followed, and a corresponding display object is presented on the first display screen based on the second positioning information.

3. The method according to claim 1 or 2, It is characterized in that Following the first moving track of the control device and presenting a corresponding display object on the first display screen based on the first positioning information includes: Following a first movement trajectory of the control device, and presenting a display object display trajectory matching the first movement trajectory on the first display screen based on the first positioning information.

4. The method according to claim 1 or 2, It is characterized in that The method further includes: determining a corresponding pointing position on the first display screen based on the first positioning information; When the pointing position is located in a preset control hot zone, a corresponding interface effect is presented when presenting the display object.

5. The method according to claim 1 or 2, It is characterized in that The at least one display device further includes a second display device, the second display device has a first orientation relationship with the first display device, the second display device includes a second positioning module and a second display screen, and the method further includes: After the pointing position of the first moving track moves out of the first edge area of ​​the first display screen, the second positioning module receives third positioning information from the control device; When the pointing position of the second moving track is outside the first edge area, the corresponding display object is not presented on the first display screen; When it is determined that the pointing position of the fourth movement track moves into the second edge area of ​​the second display screen, the fourth movement track of the control device is followed, and a corresponding display object is presented on the second display screen based on the third positioning information.

6. The method according to claim 1 or 2, It is characterized in that The at least one display device further includes a second display device, the second display device includes a second positioning module and a second display screen, and the method further includes: After the pointing position of the first moving track moves out of the first edge area of ​​the first display screen, the second positioning module receives third positioning information from the control device; When it is determined that the pointing position of the second movement track moves into the second edge area of ​​the second display screen, the corresponding display object is presented on the second display screen based on the third positioning information following the fourth movement track of the control device.

7. The method according to claim 5, It is characterized in that The orientation relationship between the second display device and the first display device changes from the first relationship to a second relationship, and the method further includes: When the pointing position of the fourth moving track moves out of the third edge area of ​​the second display screen, the corresponding display object is no longer presented on the second display screen; When the pointing position of the fifth moving track is outside the third edge area, the corresponding display object is no longer presented on the second display screen; The first positioning module receives fourth positioning information from the control device; When it is determined that the pointing position of the sixth movement track moves into the fourth edge area of ​​the first display screen, the sixth movement track of the control device is followed, and a corresponding display object is presented on the first display screen based on the fourth positioning information.

8. The method according to claim 5, It is characterized in that The second display device is an integrated display device, and the method further includes: When the screen resolution of the second display screen changes, receiving fifth positioning information from the control device; When the pointing position of the fourth movement track is located on the second display screen, the fourth movement track of the control device is followed, and a corresponding display object is presented on the second display screen based on the fifth positioning information.

9. The method according to claim 5, It is characterized in that The second display device is a split display device, and the method further includes: When the screen resolution and / or focal length corresponding to the second display screen changes, receiving fifth positioning information from the control device; When the pointing position of the fourth movement track is located on the second display screen, the fourth movement track of the control device is followed, and a corresponding display object is presented on the second display screen based on the fifth positioning information.

10. The method according to any one of claims 1 to 9, It is characterized in that The method further comprises: In the process of following the first moving track of the control device and presenting the corresponding display object on the first display screen based on the first positioning information, when the orientation relationship between the control device and the first display device changes, receiving sixth positioning information from the control device; Following the first moving track of the control device, and presenting a corresponding display object on the first display screen based on the sixth positioning information.

11. The method according to any one of claims 1 to 10, It is characterized in that The first positioning information includes one or more of the following information: ultra-wideband broadcast UWB signal, millimeter wave radar signal, electromagnetic signal, ultrasonic signal.

12. The method according to any one of claims 1 to 11, It is characterized in that The method further comprises: The first positioning module determines the pointing position of the first moving track according to first information, where the first information includes: the first moving track, the first positioning information, and the size of the first display screen.

13. The method according to claim 12, It is characterized in that The first information also includes: a historical pointing position of the first moving track and a historical presentation position of the display object.

14. The method according to any one of claims 1 to 13, It is characterized in that Features The first positioning module of the first display device includes a first antenna array, the first antenna array comprising a plurality of first antenna units, at least two of the plurality of first antenna units being respectively distributed in a first direction and a second direction, the first direction being perpendicular to the second direction; the control device comprising a second antenna array, the second antenna array comprising a plurality of second antenna units; The first positioning module receives first positioning information from the control device, including: The first antenna array receives first positioning information from the second antenna array of the control device.

15. The method according to claim 14, It is characterized in that Presenting the corresponding display object on the first display screen based on the first positioning information includes: determining the position of the display object presented on the first display device according to the first positioning information received from the second antenna array and the second positioning information sent by the first antenna array.

16. The positioning method according to claim 14 or 15, It is characterized in that At least three of the first antenna units are provided, and at least two of the second antenna units are provided.

17. The positioning method according to any one of claims 14 to 16, It is characterized in that The multiple first antenna units are respectively a first antenna, a second antenna and a third antenna. The first antenna is located at the intersection of the first direction and the second direction, the second antenna is located on one side of the first antenna in the first direction, and the third antenna is located on one side of the first antenna in the second direction.

18. The positioning method according to any one of claims 14 to 17, It is characterized in that A distance between any two first antenna units having a function of receiving the first signal among the plurality of first antenna units is less than or equal to a wavelength of the first signal; and / or, A distance between any two second antenna units having a function of receiving the second signal among the plurality of second antenna units is less than or equal to a wavelength of the second signal.

19. The positioning method according to any one of claims 14 to 18, It is characterized in that The first antenna is a transceiver integrated antenna, or the first antenna includes a receiving antenna and a transmitting antenna.

20. The positioning method according to any one of claims 14 to 19, It is characterized in that The plurality of first antenna units are distributed in an L-shape, a triangle, or a rectangular array.

21. The positioning method according to any one of claims 14 to 20, It is characterized in that A plane formed by the first direction and the second direction is parallel to a display interface of the first electronic device.

22. The positioning method according to any one of claims 14 to 20, It is characterized in that The first antenna array is located on the upper side of the display device.

23. The method according to any one of claims 1 to 12, It is characterized in that The display object is a cursor.

24. A display device, It is characterized in that The display device includes a positioning module and a display screen, and the positioning module and the display screen are used to support the display device to implement the method as described in any one of claims 1-23.

25. A computer-readable storage medium, It is characterized in that The computer-readable storage medium stores computer program instructions, and when the computer program instructions are executed by a processing circuit, the method according to any one of claims 1 to 23 is implemented.

26. A computer program product comprising instructions, It is characterized in that When the computer program product is run on a computer, the computer is caused to perform the method according to any one of claims 1 to 23.

27. A chip system, It is characterized in that The chip system includes a processing circuit and a storage medium, wherein the storage medium stores computer program instructions; when the computer program instructions are executed by the processing circuit, the method as described in any one of claims 1 to 23 is implemented.

Citation Information

Patent Citations

  • Information processing method and electronic equipment

    CN103853476A

  • Utilizing a mobile device as a motion-based controller

    CN107615206A

  • Equipment control method and device, electronic equipment and storage medium

    CN113192312A

  • Interactive display method and device, electronic equipment, system and storage medium

    CN114501119A

  • Input device sharing method, electronic device and system

    CN114579016A

Cited By

  • Remote controller pointing alignment method, device and equipment and storage medium

    CN119672940A

  • Remote control pointing alignment method, device, equipment and storage medium

    CN119672940B

  • Display device and control method therefor

    WO2026194334A1