Display device and calibration method for a pointing remote control

Abstract

The application provides a display device and a calibration method of a pointing remote controller. When a user feels that a direction in which the pointing remote controller points in space is inconsistent with a position at which a cursor is displayed by the display device, the display device can be controlled to start a pointing remote controller calibration function. Through an operation of the user aiming the pointing remote controller at an anchor point, the pointing remote controller accurately captures direction information determined by the pointing remote controller when the user subjectively considers that the direction in which the pointing remote controller points in space is consistent with the position at which the cursor is displayed. Then, based on the direction information and the anchor point position, a correction deviation is calculated. The display device can display the cursor after calibrating direction information sent by the pointing remote controller using the correction deviation, so that the position at which the cursor is displayed by the display device can be consistent with the direction in which the pointing remote controller points in space according to the subjective consideration of the user. In addition, the pointing remote controller calibration function is integrated on the display device, so that the calibration process of the pointing remote controller of different manufacturers can be effectively compatible.

Description

Technical Field

[0001] This application relates to the field of display device technology, and in particular to a calibration method for a display device and a pointing remote control. Background Technology

[0002] Display devices refer to terminal devices capable of outputting specific display images, such as smart TVs, mobile terminals, smart advertising screens, and projectors. Taking smart TVs as an example, smart TVs are television products based on Internet application technologies, possessing open operating systems and chips, and having open application platforms. They enable two-way human-computer interaction and integrate multiple functions such as audio-visual, entertainment, and data to meet diverse and personalized user needs.

[0003] As interactive devices typically paired with display devices, remote controls with spatial pointing functionality (hereinafter referred to as "pointing remote controls") are becoming increasingly common in various display products to enrich user interaction methods. When a display device interacts with a pointing remote control, it needs to exchange signals to enable the pointing remote control to determine the current pointing direction information in space, and then transmit this direction information to the display device, so that the display device can display a cursor at the corresponding position on the screen based on this direction information.

[0004] Because different users have different usage habits, even if the direction information indicated by the pointing remote control is consistent with the actual direction it points in space, and the cursor displayed on the display device is consistent with the direction the pointing remote control is pointing in space, the user may subjectively perceive a discrepancy between the cursor position and the actual direction the pointing remote control is pointing in space. Furthermore, most pointing remote controls are primarily calibrated to address discrepancies between the pointing direction and the displayed cursor position, but cannot calibrate for discrepancies perceived by the user. Moreover, if the display device and the pointing remote control are from different manufacturers, the calibration process will be difficult to achieve effectively. Summary of the Invention

[0005] This application provides a calibration method for a display device and a pointing remote control, which can effectively solve the problem that the direction pointed by the pointing remote control is inconsistent with the position of the cursor displayed on the screen, as perceived by the user.

[0006] In a first aspect, embodiments of this application provide a display device, including: The communication device is configured to communicate with the pointing remote control; The display is configured to display an operation interface, on which a cursor is displayed, the position of which is determined by the position of the pointing remote control in three-dimensional space. The controller is configured as follows: In response to an instruction to activate the remote control calibration function, a calibration mode is determined, and the display is controlled to show a calibration page corresponding to the calibration mode on the operation interface, the calibration page including anchor points; After listening to the confirmation event sent by the pointing remote control, it is determined that the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point; wherein, the confirmation event indicates that the user has controlled the pointing remote control to point to the anchor point; Calculate the coordinate deviation between the first coordinate and the anchor point coordinate on the calibration page; The coordinate deviation is set as a correction deviation, and after the second coordinate is mapped to the operation interface when the remote control is determined to point to the first position, the corrected second coordinate is calculated based on the correction deviation and the second coordinate. The display is controlled to show a cursor on the user interface based on the corrected second coordinates.

[0007] Based on this, when a user perceives a discrepancy between the direction the remote control is pointing in space and the position of the cursor displayed on the screen, the display device can be controlled to activate the remote control calibration function. By instructing the user to align the remote control with an anchor point, the system accurately captures the direction the remote control determines when the user subjectively perceives the direction to match the cursor's position. Based on this direction information and the anchor point position, a correction deviation is calculated. The display device can then use this correction deviation to calibrate the direction information sent by the remote control before displaying the cursor. This ensures the cursor's position matches the user's subjective perception of the remote control's direction in space. Furthermore, integrating the remote control calibration function into the display device effectively ensures compatibility with calibration processes for remote controls from different manufacturers.

[0008] In some embodiments of this application, the controller, in response to an instruction to initiate a remote control calibration function, determines a calibration mode, which is specifically configured as follows: If the instruction indicates a calibration mode, then the calibration mode is determined to be the calibration mode indicated by the first instruction; or... If the instruction does not specify a calibration mode, the calibration mode is determined to be a first calibration mode, a second calibration mode, or a third calibration mode; In the first calibration mode, the calibration page includes one anchor point, allowing the user to perform a calibration operation by pointing the remote control at the anchor point; in the second calibration mode, the calibration page includes two anchor points, allowing the user to sequentially perform a calibration operation by pointing the remote control at each of the two anchor points; and in the third calibration mode, the calibration page includes three anchor points, allowing the user to sequentially perform a calibration operation by pointing the remote control at each of the three anchor points.

[0009] Based on this, the display device offers multiple calibration levels and modes to accommodate different user calibration needs. Furthermore, users can either directly specify the desired calibration mode, or, if unsure which mode to use, leave it as is and let the display device assist in determining the initial calibration mode, thus effectively reducing the user's cognitive load.

[0010] In some embodiments of this application, if the calibration mode is the first calibration mode, the calibration page includes a first anchor point; After receiving an acknowledgment event from the pointing remote control, the controller determines the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point, which is specifically configured as follows: After listening to the first confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the first anchor point, the first coordinates mapped to the calibration page are determined; wherein, the first confirmation event indicates that the user has controlled the pointing remote control to point to the first anchor point; The controller calculates the coordinate deviation between the first coordinate and the anchor point coordinates on the calibration page, and is specifically configured as follows: The first difference between the first coordinate and the first anchor point coordinate on the calibration page is calculated to obtain the coordinate deviation.

[0011] Based on this, in the first calibration mode, the user needs to perform a calibration operation based on the first anchor point. The display device can accurately calculate the correction deviation used to correct the subsequent cursor display position by referring to the first coordinates and the anchor point coordinates of the first anchor point that actually correspond to the remote control in this calibration operation.

[0012] In some embodiments of this application, if the calibration mode is the second calibration mode, the calibration page includes a first anchor point and a second anchor point; After receiving an acknowledgment event from the pointing remote control, the controller determines the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point, which is specifically configured as follows: After listening to the first confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the first anchor point, it maps to the first sub-coordinate on the calibration page; wherein, the first confirmation event indicates that the user has controlled the pointing remote control to point to the first anchor point; And, after listening to the second confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the second anchor point, the second sub-coordinate is mapped to the calibration page; wherein, the second confirmation event indicates that the user has controlled the pointing remote control to point to the second anchor point; The controller calculates the coordinate deviation between the first coordinate and the anchor point coordinates on the calibration page, and is specifically configured as follows: Based on the first sub-coordinate and the first anchor point coordinate of the first anchor point on the calibration page, a first system of equations is constructed; and based on the second sub-coordinate and the second anchor point coordinate of the second anchor point on the calibration page, a second system of equations is constructed. The coordinate deviation is calculated based on the first set of equations and the second set of equations.

[0013] Therefore, in the second calibration mode, the user needs to perform calibration operations based on both the first and second anchor points. The display device can construct a set of equations based on the actual coordinates of the pointing remote control during each calibration operation and the anchor point coordinates. This allows for the accurate calculation of the coordinate deviation used to correct the subsequent cursor display position. Furthermore, compared to coordinate deviations calculated based on a single anchor point, coordinate deviations calculated based on two anchor points are more accurate and can more precisely meet the user's calibration needs.

[0014] In some embodiments of this application, if the calibration mode is the third calibration mode, the calibration page includes a first anchor point, a second anchor point, and a third anchor point; After receiving an acknowledgment event from the pointing remote control, the controller determines the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point, which is specifically configured as follows: After listening to the first confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the first anchor point, it maps to the first sub-coordinate on the calibration page; wherein, the first confirmation event indicates that the user has controlled the pointing remote control to point to the first anchor point; After listening to the second confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the second anchor point, it maps to the second sub-coordinate on the calibration page; wherein, the second confirmation event indicates that the user has controlled the pointing remote control to point to the second anchor point; And, after listening to the third confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the third anchor point, it maps to the third sub-coordinate on the calibration page; wherein, the third confirmation event indicates that the user has controlled the pointing remote control to point to the third anchor point; The controller calculates the coordinate deviation between the first coordinate and the anchor point coordinates on the calibration page, and is specifically configured as follows: Based on the first sub-coordinate and the first anchor point coordinate of the first anchor point on the calibration page, a first set of equations is constructed; based on the second sub-coordinate and the second anchor point coordinate of the second anchor point on the calibration page, a second set of equations is constructed; and based on the third sub-coordinate and the third anchor point coordinate of the third anchor point on the calibration page, a third set of equations is constructed. The coordinate deviation is calculated based on the first set of equations, the second set of equations, and the third set of equations.

[0015] Therefore, in the third calibration mode, users need to perform calibration operations based on the first, second, and third anchor points respectively. The display device can construct corresponding equations based on the actual coordinates of the pointing remote control during each calibration operation and the anchor point coordinates. Thus, based on these equations, the coordinate deviation used to correct the subsequent cursor display position can be accurately calculated. Furthermore, compared to coordinate deviations calculated based on a single or two anchor points, coordinate deviations calculated based on three anchor points are more accurate and can more precisely meet the user's calibration needs.

[0016] In some embodiments of this application, if the calibration mode is determined to be either the first calibration mode or the second calibration mode, the controller, after controlling the display to display the cursor on the operation interface based on the calibrated second coordinates, is further configured to: In response to the instruction to restart the remote control calibration function, the calibration mode is determined to be a higher-level calibration mode, and the display is controlled to show the calibration page corresponding to the higher-level calibration mode on the operation interface. The calibration modes, arranged from lowest to highest, are the first calibration mode, the second calibration mode, and the third calibration mode.

[0017] Therefore, if the user is not satisfied with the calibration results of the display device, the display device can automatically increase the calibration level to ensure that the calibration needs of the user can be met after recalibration.

[0018] In some embodiments of this application, if the calibration mode is determined to be either the first calibration mode or the second calibration mode, the controller, after listening to the confirmation event sent by the remote controller, is further configured to: The display is controlled to show a calibration page of a higher-level calibration mode, which includes newly added anchor points compared to the original anchor points included in the previous calibration page. The controller is also configured to: After setting the coordinate deviation as a correction deviation, the display is controlled to show a cursor on the calibration page of the higher-level calibration mode; wherein the position of the cursor on the calibration page is the position after correction based on the current correction deviation; After listening to the confirmation event sent again by the pointing remote control, it is determined that the cursor coordinates mapped to the calibration page when the pointing remote control points to the new anchor point; wherein, the second confirmation event indicates that the user has controlled the pointing remote control to point to the new anchor point; Based on the first coordinates and the original anchor point's anchor point coordinates on the calibration page, a fourth equation is constructed; and based on the cursor coordinates and the newly added anchor point's anchor point coordinates on the calibration page, a fifth equation is constructed. Based on the fourth and fifth equations, the coordinate deviation is calculated again; The correction deviation is updated to the recalculated coordinate deviation; The calibration modes, arranged from lowest to highest, are the first calibration mode, the second calibration mode, and the third calibration mode.

[0019] Based on this, after the user completes the calibration operation in the calibration mode of a lower calibration level, the display device can directly display the calibration page of a higher calibration level. The user can verify the previous calibration result through the newly added anchor points on the calibration page. In this way, if the user is not satisfied with the previous calibration result, there is no need to repeatedly start the remote control calibration function and alignment operation. The user can directly enter the calibration process of a higher calibration level, which effectively simplifies the user's interaction operation and improves the calibration efficiency.

[0020] In some embodiments of this application, after the controller sets the coordinate deviation as a correction deviation and then controls the display to show the cursor on the calibration page of the higher-level calibration mode, it is further configured to: After listening to the cancel event sent by the remote control, control the display to exit the calibration page of the higher-level calibration mode.

[0021] Therefore, if the user is satisfied with the previous calibration result, they can directly exit the calibration process of the higher calibration level, thereby restoring the normal use of the pointing remote control as soon as possible.

[0022] In some embodiments of this application, the controller controls the display to show a calibration page corresponding to the calibration mode on the operating interface, and is further configured to: The display is controlled to show a prompt message on the calibration page, which prompts the user to operate the remote control to point to the anchor point.

[0023] Based on this, display devices can enhance user interactivity by showing prompts on the calibration page, and ensure that users can effectively perform calibration operations, thereby improving calibration efficiency and effectiveness.

[0024] Secondly, this application also provides a calibration method for a pointing remote control, applied to a display device as described in any of the first aspects, wherein the display device is communicatively connected to the pointing remote control and displays a cursor on an operation interface, the position of the cursor on the operation interface being determined by the position pointed to by the pointing remote control in three-dimensional space; The method includes: In response to an instruction to activate the remote control calibration function, a calibration mode is determined, and a calibration page corresponding to the calibration mode is displayed on the operation interface, the calibration page including anchor points; After listening to the confirmation event sent by the pointing remote control, it is determined that the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point; wherein, the confirmation event indicates that the user has controlled the pointing remote control to point to the anchor point; Calculate the coordinate deviation between the first coordinate and the anchor point coordinate on the calibration page; The coordinate deviation is set as a correction deviation, and after the second coordinate is mapped to the operation interface when the remote control is determined to point to the first position, the corrected second coordinate is calculated based on the correction deviation and the second coordinate. Based on the corrected second coordinates, a cursor is displayed on the operation interface.

[0025] Based on this, when a user perceives a discrepancy between the direction the remote control is pointing in space and the position of the cursor displayed on the screen, the display device can be controlled to activate the remote control calibration function. By instructing the user to align the remote control with an anchor point, the system accurately captures the direction the remote control determines when the user subjectively perceives the direction to match the cursor's position. Based on this direction information and the anchor point position, a correction deviation is calculated. The display device can then use this correction deviation to calibrate the direction information sent by the remote control before displaying the cursor. This ensures the cursor's position matches the user's subjective perception of the remote control's direction in space. Furthermore, integrating the remote control calibration function into the display device effectively ensures compatibility with calibration processes for remote controls from different manufacturers. Attached Figure Description

[0026] To more clearly illustrate the technical solution of this application, the drawings used in the embodiments will be briefly introduced below. Obviously, for those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 This is a schematic diagram illustrating the operation scenario between the display device 200 and the control device 100 in an embodiment of this application; Figure 2 This is a hardware configuration block diagram of the display device 200 in this embodiment of the application; Figure 3 This is a diagram showing the operating system configuration of the display device 200 in this embodiment of the application; Figure 4 This is a flowchart illustrating the calibration of the display device 200 with the remote control 100 in this embodiment of the application. Figure 5A This is a timing diagram of the display device 200 calibrating the pointer to the remote controller 100 in an embodiment of this application; Figure 5B This is another timing diagram for calibrating the display device 200 to point at the remote controller 100 in an embodiment of this application; Figures 6A-6C This is a schematic diagram of the calibration page in an embodiment of this application; Figure 7 This is a flowchart illustrating the calibration of the display device 200 to the remote control 100 in a first calibration mode, as described in this application embodiment. Figure 8 This is a flowchart illustrating the calibration of the display device 200 to the remote control 100 in the second calibration mode, as described in this application embodiment. Figure 9 This is a flowchart illustrating the calibration of the display device 200 to the remote control 100 in a third calibration mode, as described in this application embodiment. Figure 10 This is a flowchart illustrating the further calibration of the display device 200 pointing to the remote controller 100 in this embodiment of the application. Detailed Implementation

[0028] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0029] In this application embodiment, "display device" refers to a device with screen display and data processing capabilities. For example, display devices include, but are not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, and augmented reality devices.

[0030] Figure 1 This is a schematic diagram illustrating an operational scenario between a display device and a control device provided in some embodiments of this application. For example... Figure 1 As shown, users can operate the display device 200 via touch, voice, mobile terminals, and control devices. For example, the control device can be a remote control, stylus, gamepad, etc.

[0031] Among them, the remote control, as an interactive device usually paired with the display device 200, has begun to be gradually popularized in various display products in order to enrich the user's interaction mode and support spatial pointing function, such as the pointing remote control 100 shown in the figure.

[0032] Figure 2 Provided for some embodiments of this application Figure 1 Hardware configuration block diagram of display device 200.

[0033] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a user input interface 280, a memory, and a power supply.

[0034] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 300 according to various communication protocol types. The display device 200 may be equipped with multiple communication devices 220 depending on the supported communication methods. The communication devices 220 can enable the display device 200 to communicate with the external devices or the server 300 via wireless or wired connections.

[0035] In some embodiments, the detector 230 is used to collect signals from the external environment or to interact with the outside world.

[0036] In some embodiments, device interface 240 is used to connect to an external device.

[0037] In some embodiments, the controller 250 is used to control the overall operation of the display device 200. The controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored in memory.

[0038] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0039] In some embodiments, the display 260 is used to receive and display image signals output from the controller 250. The display 260 may include display function components for presenting images and driving components for driving image display.

[0040] In some embodiments, a user can input user commands on a graphical user interface (GUI) displayed on a display 260, and a user input interface 280 can receive user commands through the GUI.

[0041] In some embodiments, the audio output device 270 may be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200.

[0042] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0043] In some embodiments, to enable user interaction, the display device 200 may run an operating system. An operating system is a computer program that manages and controls the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running applications. The operating system also allows users to interact with the display device 200.

[0044] The operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices 200.

[0045] like Figure 3 As shown, Figure 3 The diagram below illustrates the software configuration of a display device according to some embodiments of this application. In some embodiments, the system of the display device 200 can be divided into three layers, from top to bottom: the application layer, the middleware layer, and the hardware layer.

[0046] The application layer primarily comprises the UI module and applications on the TV. These applications are mainly browser-based, such as HTML5 apps, native apps, and third-party applications. Native apps can support online or offline operation, push notifications, or access to local resources. Of course, for applications to function properly, the application layer may also include an application framework. An application framework is a complete program model with all the basic functionalities required by standard application software, such as file access, data exchange, and the interfaces for using these functionalities (toolbars, status bars, menus, dialog boxes).

[0047] The middleware layer includes various television protocols, multimedia protocols, and system components. Middleware can use the basic services (functions) provided by system software to connect different parts of application systems or different applications on the network, achieving resource sharing and function sharing.

[0048] The hardware layer mainly includes the HAL interface, hardware, and Linux device drivers. The HAL interface is a unified interface for all TV chips, with the specific logic implemented by each chip. Drivers mainly include: audio drivers, display drivers, Bluetooth drivers, camera drivers, Wi-Fi drivers, USB drivers, HDMI drivers, sensor drivers (such as fingerprint sensors, temperature sensors, pressure sensors, etc.), and power drivers.

[0049] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0050] When the display device 200 interacts with the pointing remote control 100, it needs to communicate with the pointing remote control 100 via signals to determine its current pointing direction in space. This direction information may include the relative position information and attitude information of the pointing remote control 100 in space, which it has acquired or calculated. Alternatively, it may be the coordinates corresponding to the pointing direction calculated by the pointing remote control 100 based on the relative position and attitude information. The pointing remote control 100 transmits this direction information to the display device 200, which then displays a cursor at the corresponding position on the screen based on the received direction information. This allows the user to control the cursor's movement on the display device 200's interface using the pointing remote control 100.

[0051] In some embodiments, the pointing remote controller 100 can send directional information to the display device 200 in the form of coordinate events.

[0052] Because different users have different usage habits, even if the direction information indicated by the pointing remote control 100 is consistent with its actual direction in space, and the cursor displayed on the display device 200 is consistent with the direction the pointing remote control 100 is pointing in space, the user may subjectively perceive a discrepancy between the cursor's position and the actual direction the pointing remote control 100 is pointing in space. Furthermore, most pointing remote controls 100 are primarily calibrated to address discrepancies between their pointing direction and the cursor's position, and cannot calibrate for discrepancies perceived by the user. Moreover, the calibration capabilities of different pointing remote controls 100 vary significantly, potentially making it difficult to meet user calibration needs. Additionally, if the pointing remote control 100 itself lacks calibration functionality, or if the display device 200 and the pointing remote control 100 are from different manufacturers, the calibration process will be difficult to achieve effectively.

[0053] To solve the above problems, the display device 200 provided in this application embodiment is equipped with a pointing remote control calibration function, that is, the display device 200 calibrates the pointing remote control 100. In this way, even if the pointing remote control 100 itself does not have calibration capability, or has poor calibration capability, or the pointing remote control 100 and the display device 200 belong to different manufacturers, the pointing remote control 100 can still be calibrated.

[0054] like Figure 3As shown, to support the pointing function and calibration function of the pointing remote control 100, an intermediate layer includes a pointing remote control interaction service and a pointing remote control calibration service. This intermediate layer also includes a state machine for recording correction deviations and the currently used calibration mode during the calibration process. Simultaneously, this state machine can also record the coordinates sent by the pointing remote control 100 during each calibration process for calculating coordinate deviations. This state machine can record all of the above-mentioned objects, or different state machines can record different objects separately.

[0055] Figure 4 This is a flowchart illustrating the calibration of the display device 200 with the remote control 100 in this embodiment of the application.

[0056] based on Figure 2 The operating system shown is as follows: Figure 4 As shown, the calibration procedure is as follows: In step S401, in response to the instruction to start the remote control calibration function, the calibration mode is determined and the calibration page corresponding to the calibration mode is displayed on the operation interface. The calibration page includes anchor points.

[0057] When a user perceives a deviation between the direction the remote control 100 is pointing in space and the position of the cursor displayed on the display device 200, the user can input a command through the remote control calibration function entry to control the display device 200 to start the remote control calibration function.

[0058] In one example, when a user points the remote control 100 at control A on the user interface, the user thinks that pointing the remote control 100 is pointing at control A. However, the cursor is not displayed on control A, or control A does not have focus. As a result, the user will perceive that there is a discrepancy between the direction the remote control 100 is pointing at and the position of the cursor.

[0059] In some embodiments, the reason why the user perceives a deviation between the direction pointed to by the remote control 100 and the position displayed by the cursor may be that the process of the remote control 100 exchanging signals with the display device 200 to determine directional information or transmitting directional information to the display device 200 is affected, resulting in an objective deviation between the directional information received by the display device 200 and the direction pointed to by the remote control 100.

[0060] In other embodiments, the reason why the user perceives a deviation between the direction pointed to by the remote control 100 and the position of the cursor may be that the direction information received by the display device 200 is not objectively different from the direction pointed to by the remote control 100, but is simply due to the user's subjective perception that there is a deviation between the two.

[0061] In one example, the reasons that might lead a user to subjectively perceive a discrepancy between the two could include: different user habits; a change in the display device 200 that the user interacts with by pointing at the remote control 100, such as switching from a smaller display device 200 to a larger display device 200; or a change in the placement of the display device 200.

[0062] In some embodiments, the entry point for the remote control calibration function can be set on the remote control 100.

[0063] In one example, the entry point for the remote control calibration function can be a specified physical button on the remote control 100; or a combination of multiple specified physical buttons on the remote control 100; or a specified gesture input on the touch screen of the remote control 100.

[0064] In other embodiments, the entry point for the remote control calibration function may be located on the display device 200.

[0065] In one example, the entry point to the remote control calibration function can be a specified physical button on the display device 200; or, a combination of multiple specified physical buttons on the display device 200; or, a specified control on a specified page / menu, such as a specified control on the home page, or a specified control in the settings menu, etc.

[0066] In some embodiments, the display device 200 may add a calibration process for the remote control 100 during the operation guide presentation to the user after the device leaves the factory or after restoring factory settings, and automatically or with the user's consent activate the remote control calibration function.

[0067] In some embodiments, the display device 200 may automatically or prompt the user to start the pointing remote control calibration function when it detects that the pointing remote control 100 is connected and that the pointing remote control 100 is being connected for the first time, so as to calibrate the pointing remote control 100 before it is used.

[0068] In response to the instruction to activate the remote control calibration function, the display device 200 determines the calibration mode to be activated, displays the corresponding calibration page, and enters the calibration mode.

[0069] Figure 5A This is a timing diagram for calibrating the display device 200 to point to the remote controller 100 in an embodiment of this application.

[0070] Combination Figure 5AAfter receiving the instruction to start the pointing remote control calibration function, the display device 200 starts the pointing remote control calibration service, and the pointing remote control calibration service determines the calibration mode to be started and controls the application layer to display the corresponding calibration page.

[0071] The calibration page includes anchor points, which serve as the reference for calibrating the pointing remote control 100.

[0072] Figures 6A-6C This is a schematic diagram of the calibration page in an embodiment of this application.

[0073] The anchor points on the calibration page can be found here. Figure 6A The first anchor point in the middle is 601. Figure 6B The first anchor point 602 and the second anchor point 603, Figure 6C The first anchor point is 604, the second anchor point is 605, and the third anchor point is 606.

[0074] Step S402: After listening to the confirmation event sent by the remote control, determine the first coordinate on the calibration page when the remote control points to the anchor point.

[0075] After displaying the calibration page on the display device 200, the user performs a calibration operation by pointing the remote control 100 at the anchor point. The user subjectively believes that the remote control 100 is pointing at the anchor point, meaning the direction the remote control 100 is pointing matches the position of the anchor point on the calibration page. The user can then send a confirmation event to the display device 200 via the confirmation button on the remote control 100. This confirmation event indicates that the user has successfully directed the remote control 100 to point at the anchor point.

[0076] Combination Figure 5A After the display device 200 listens to the confirmation event sent by the pointing remote control 100 through the pointing remote control interaction service, it determines the first coordinate mapped to the calibration page when the pointing remote control 100 points to the anchor point, and transmits the first coordinate to the pointing remote control calibration service.

[0077] It is understandable that, at this point, the direction in which the remote control 100 is pointed in space is the direction that the user subjectively believes can be mapped to the anchor point. Correspondingly, the position of the anchor point on the calibration page is the position where the user subjectively believes the cursor should be displayed when the remote control 100 is pointing in the current direction; that is, the position where the cursor should be displayed after calibration. The first coordinate determined by the display device 200 based on the direction information currently received from the remote control 100 is the coordinate that deviates from the position of the anchor point, i.e., the coordinate that needs calibration, i.e., the position where the cursor was displayed before calibration. After receiving the direction information sent by the remote control 100, the display device 200 determines the coordinates mapped to the operation page based on this direction information. The calculation process between the various parameters and coordinates, and the conversion process between the coordinate system of the remote control 100 and the screen coordinate system, are not subject to further restrictions in this application.

[0078] Step S403: Calculate the coordinate deviation between the first coordinate and the anchor point coordinate on the calibration page.

[0079] Combination Figure 5A The display device 200 calculates the coordinate deviation between the first coordinate and the anchor point coordinate through the pointing remote control calibration service. This coordinate deviation is the source of the deviation between the position of the cursor display and the direction pointed by the pointing remote control 100.

[0080] Step S404: Set the coordinate deviation as the correction deviation, and after mapping it to the second coordinate on the operation interface when the remote control is determined to point to the first position, calculate the corrected second coordinate based on the correction deviation and the second coordinate.

[0081] The display device 200 sets the calculated coordinate deviation as the correction deviation, which is used to subsequently correct the position of the cursor display.

[0082] Combination Figure 5A The coordinate deviation calculated by the pointing remote control calibration service is updated to the corresponding state machine to update the correction deviation recorded in the state machine.

[0083] If the remote control 100 sends corresponding directional information (such as first directional information) to the display device 200 when pointing to the first position, the display device 200 will calculate the coordinates (such as second coordinates) mapped onto the operation interface based on the first directional information. The second coordinates are the coordinates before calibration. The display device 200 corrects the second coordinates based on the current correction deviation to obtain the corrected second coordinates.

[0084] In some embodiments, the first position can be the position pointing to the anchor point of the remote controller 100. Of course, the first position can also be the position pointing to by the remote controller 100.

[0085] Combination Figure 5A The display device 200 can determine the second coordinates by pointing to the remote control interaction service, read the currently recorded correction deviation from the state machine, and correct the second coordinates based on the correction deviation to obtain the corrected second coordinates.

[0086] Step S405: Based on the corrected second coordinates, display the cursor on the operation interface.

[0087] Combination Figure 5A After the display device 200 calculates the corrected second coordinates through the remote control interaction service, it throws the corrected second coordinates up to the application layer, and the application layer draws the cursor on the operation interface based on the corrected second coordinates.

[0088] The cursor displayed by the display device 200 based on the calibrated second coordinates allows the user to subjectively perceive that the position of the cursor is consistent with or moves toward the direction pointed by the remote control 100.

[0089] Based on the above embodiments, when a user perceives that the direction the remote control 100 is pointing in space is inconsistent with the position of the cursor displayed on the display device 200, the display device 200 can be controlled to activate the remote control calibration function. By having the user align the remote control 100 with an anchor point, the direction information determined by the remote control 100 when the user subjectively believes that the direction the remote control 100 is pointing in space is consistent with the position of the cursor is displayed is accurately captured. Then, based on this direction information and the anchor point position, a correction deviation is calculated. The display device 200 can use this correction deviation to calibrate the direction information sent by the remote control 100 before displaying the cursor. In this way, the position of the cursor displayed on the display device 200 can conform to the user's subjective perception that it is consistent with the direction the remote control 100 is pointing in space. Furthermore, integrating the remote control calibration function into the display device 200 can effectively ensure compatibility with the calibration processes of remote controls from different manufacturers.

[0090] In some embodiments, the display device 200 may be configured with at least one calibration mode. These at least one calibration mode are arranged in ascending order of calibration level, and include, but are not limited to, a first calibration mode, a second calibration mode, and a third calibration mode. It is understood that as the calibration level increases, the corresponding calibration results will be more accurate.

[0091] In the first calibration mode, the corresponding calibration page includes an anchor point, namely the first anchor point, which can be referenced. Figure 6A In the first calibration mode, the user performs a calibration operation to point the remote control 100 to that anchor point.

[0092] In some embodiments, the anchor point may be set at a fixed position on the calibration page.

[0093] In other embodiments, the anchor point can be determined based on the location of the remote control 100 being mapped to position A on the operation interface when the user initiates the remote control calibration function. For example, the anchor point can be dynamically set on position A or dynamically set to a position close to position A to reduce the amount of operation the user needs to perform the calibration operation.

[0094] In the second calibration mode, the corresponding calibration page includes two anchor points, namely the first anchor point and the second anchor point, which can be referenced. Figure 6B In the second calibration mode, the user sequentially performs a calibration operation to point the remote control 100 to each of the two anchor points.

[0095] In some embodiments, the positional relationship between the two anchor points needs to meet preset relative position requirements so that users can more accurately perform calibration operations to align different anchor points.

[0096] In some embodiments, the two anchor points may be set at fixed positions on the calibration page.

[0097] In other embodiments, one of the two anchor points can be determined based on the mapping of the pointing position of the remote control 100 to position A on the operation interface when the user initiates the pointing remote control calibration function. For example, this anchor point can be dynamically set at position A, or dynamically set at a position close to position A, to reduce the amount of operation required by the user when performing the calibration operation. The other anchor point can be dynamically set based on the positional relationship between the two anchor points.

[0098] In the third calibration mode, the corresponding calibration page includes three anchor points: the first anchor point, the second anchor point, and the third anchor point. (See reference below.) Figure 6C In the third calibration mode, the user sequentially performs a calibration operation to point the remote control 100 to each of the three anchor points.

[0099] In some embodiments, the positional relationship of the three anchor points needs to meet preset relative position requirements so that users can more accurately perform calibration operations to align different anchor points.

[0100] In some embodiments, the three anchor points may be set at fixed positions on the calibration page.

[0101] In other embodiments, one of the three anchor points can be determined based on the mapping of the pointing position of the remote control 100 to position A on the operation interface when the user initiates the pointing remote control calibration function. For example, this anchor point can be dynamically set at position A, or dynamically set at a position close to position A, to reduce the amount of operation required by the user when performing the calibration operation. The other two anchor points can be dynamically set based on the positional relationship of the three anchor points.

[0102] Of course, it is understandable that, in order to meet users' needs for higher calibration accuracy, higher calibration levels can be configured, such as calibration modes including four, five, or more anchor points. This application does not impose any limitations on this. In the embodiments of this application, a specific explanation is given using a display device 200 configured with a first calibration mode, a second calibration mode, and a third calibration mode as an example.

[0103] The following is an explanation of step S401.

[0104] In some embodiments, if the instruction indicates a calibration mode, that is, the user directly indicates the calibration mode to be used, then the calibration mode is determined to be the calibration mode indicated by the first instruction.

[0105] In other embodiments, if the instruction does not specify a calibration mode, that is, the user does not directly specify the calibration mode to be used, the calibration mode is determined to be any one of the first calibration mode, the second calibration mode, or the third calibration mode.

[0106] In one example, if the default logic configured for display device 200 is to ensure that the user performs fewer interactive operations, it can default to entering the first calibration mode first.

[0107] In another example, if the default logic of the display device 200 is configured to ensure calibration accuracy, it can default to entering the third calibration mode first.

[0108] In another example, if the default logic of the display device 200 is to minimize user interaction while ensuring a certain level of calibration accuracy, it can default to entering the second calibration mode first.

[0109] Based on the above embodiments, the display device 200 provides multiple calibration modes with different calibration levels to meet the different calibration needs of users. Furthermore, users can either directly indicate the desired calibration mode, or, if unsure which mode to use, choose not to directly indicate the mode and have the display device 200 assist in determining the initial calibration mode, thereby effectively reducing the user's cognitive load.

[0110] It is important to note that although the calibration pages corresponding to different calibration modes include anchors with the same name, these anchors with the same name are not related unless otherwise specified. That is, the anchors included in different calibration pages are independent of each other.

[0111] In some embodiments, if the first calibration mode is entered, the display device 200 can perform the following... Figure 7 The calibration process shown refers to remote control 100. The specific steps are as follows: Step S701: After listening to the first confirmation event sent by the remote controller, determine the first coordinates mapped to the calibration page when the remote controller points to the first anchor point.

[0112] After the display device 200 displays the calibration page corresponding to the first calibration mode, the user controls the remote control 100 to align with the first anchor point. Once the user subjectively believes that the remote control is aligned with the first anchor point, they send a first confirmation event to the display device 200 by pressing the confirmation button on the remote control 100. This first confirmation event signifies that the user has controlled the remote control to point to the first anchor point on the 100.

[0113] When the display device 200 receives the direction information sent by the pointing remote control 100 when pointing to the first anchor point, it can determine the first coordinate mapped to the calibration page based on the direction information through the pointing remote control interaction service, and then transmit the first coordinate to the pointing remote control calibration service.

[0114] Step S702: Calculate the first difference between the first coordinate and the first anchor point coordinate on the calibration page to obtain the coordinate deviation.

[0115] The display device 200 can calculate the first difference between the first coordinate and the first anchor point coordinate through the pointing remote control calibration service. This first difference is the coordinate deviation.

[0116] In some embodiments, the display device may calculate the first difference based on the following formula: (x', y') = (x+a, y+b); Where (x', y') represents the coordinates of the first anchor point, x and y represent the abscissa and ordinate of the first coordinate, respectively, and a and b represent the coordinate deviation, especially the translation deviation.

[0117] If the correction deviation is updated to the above coordinate deviations a and b, it is also necessary to solve the corrected second coordinate based on the above formula. When correcting the second coordinate, (x', y') represents the corrected second coordinate, and x and y represent the horizontal and vertical coordinates of the second coordinate, respectively.

[0118] In some embodiments, if the second calibration mode is entered, the display device 200 can perform the following: Figure 8The calibration process shown refers to remote control 100. The specific steps are as follows: Step S801: After listening to the first confirmation event sent by the remote controller, determine the first sub-coordinate mapped to the calibration page when the remote controller points to the first anchor point; and after listening to the second confirmation event sent by the remote controller, determine the second sub-coordinate mapped to the calibration page when the remote controller points to the second anchor point.

[0119] After the display device 200 displays the calibration page corresponding to the second calibration mode, the user controls the remote control 100 to align with the first anchor point. Once the user subjectively believes that the remote control is aligned with the first anchor point, they send a first confirmation event to the display device 200 by pressing the confirmation button on the remote control 100. This first confirmation event indicates that the user has controlled the remote control to point to the first anchor point on the 100.

[0120] When the display device 200 receives the direction information sent by the pointing remote control 100 when pointing to the first anchor point, it can determine the first sub-coordinate mapped to the calibration page based on the direction information through the pointing remote control interaction service, and then pass the first sub-coordinate to the pointing remote control calibration service.

[0121] Similarly, the user continues to control the remote control 100 to point at the second anchor point, and after subjectively believing that it has been aligned with the second anchor point, sends a second confirmation event to the display device 200 by pressing the confirmation button on the remote control 100. This second confirmation event indicates that the user has controlled the remote control 100 to point at the second anchor point.

[0122] When the display device 200 receives the direction information sent by the pointing remote control 100 when pointing to the second anchor point, it can determine the second sub-coordinates mapped to the calibration page based on the direction information through the pointing remote control interaction service, and then transmit the second sub-coordinates to the pointing remote control calibration service.

[0123] Of course, this application embodiment does not limit the order in which the user performs the calibration operation to align the first anchor point and the second anchor point.

[0124] Step S802: Based on the first sub-coordinate and the first anchor point coordinate on the calibration page, construct a first set of equations; and based on the second sub-coordinate and the second anchor point coordinate on the calibration page, construct a second set of equations.

[0125] Display device 200 can construct a set of equations for calculating coordinate deviations by pointing to the remote control calibration service.

[0126] In some embodiments, the first and second sets of equations are as follows: x'=s1×(x×cosθ-y×sinθ)+a; y'=s2×(x×sinθ+y×cosθ)+b; Where x' and y' represent the abscissa and ordinate of the anchor point coordinates, respectively; x and y represent the abscissa and ordinate of the sub-coordinates, respectively; s1 and s2 represent the scaling in the abscissa and ordinate directions, respectively; θ represents the rotational deviation in the coordinate deviation; and a and b represent the translational deviation in the abscissa and ordinate directions, respectively.

[0127] Step S803: Calculate the coordinate deviation based on the first equation and the second equation.

[0128] If the correction deviation is updated to the above coordinate deviations s1, s2, θ, a and b, it is also necessary to solve for the corrected second coordinate based on the above system of equations. When correcting the second coordinate, (x', y') represents the corrected second coordinate, and x and y represent the abscissa and ordinate of the second coordinate, respectively.

[0129] In some embodiments, if the third calibration mode is entered, the display device 200 can perform the following: Figure 9 The calibration process shown refers to remote control 100. The specific steps are as follows: Step S901: After listening to the first confirmation event sent by the remote controller, determine the first sub-coordinate mapped to the calibration page when the remote controller points to the first anchor point; after listening to the second confirmation event sent by the remote controller, determine the second sub-coordinate mapped to the calibration page when the remote controller points to the second anchor point; and after listening to the third confirmation event sent by the remote controller, determine the third sub-coordinate mapped to the calibration page when the remote controller points to the third anchor point.

[0130] The process of the display device 200 responding to the user-controlled calibration operation of pointing the remote controller 100 at the first anchor point and the second anchor point can be referred to step S801, which will not be repeated here.

[0131] Similarly, the user continues to control the remote control 100 to point at the third anchor point, and after subjectively believing that it has been aligned with the third anchor point, sends a third confirmation event to the display device 200 by pressing the confirmation button on the remote control 100. This third confirmation event indicates that the user has controlled the remote control 100 to point at the third anchor point.

[0132] When the display device 200 receives the direction information sent by the pointing remote control 100 when pointing to the third anchor point, it can determine the third sub-coordinate mapped to the calibration page based on the direction information through the pointing remote control interaction service, and then transmit the third sub-coordinate to the pointing remote control calibration service.

[0133] Of course, this application embodiment does not limit the order in which the user performs calibration operations to align the first anchor point, the second anchor point, and the third anchor point.

[0134] Step S902: Based on the first sub-coordinate and the first anchor point coordinates on the calibration page, construct a first equation; based on the second sub-coordinate and the second anchor point coordinates on the calibration page, construct a second equation; and based on the third sub-coordinate and the third anchor point coordinates on the calibration page, construct a third equation.

[0135] Display device 200 can construct equations for calculating coordinate deviations by pointing to the remote control calibration service.

[0136] In some embodiments, the first set of equations, the second set of equations, and the third set of equations are as follows: x' = s1×x + c×y + a; y' = s² × y + d × x + b; Where x' and y' represent the abscissa and ordinate of the anchor point coordinates, respectively; x and y represent the abscissa and ordinate of the sub-coordinates, respectively; s1 and s2 represent the scaling in the abscissa and ordinate directions, respectively; c represents the cross interference of y on x; d represents the cross interference of x on y; and a and b represent the translational deviation in the abscissa and ordinate directions, respectively.

[0137] Step S903: Calculate the coordinate deviation based on the first set of equations, the second set of equations, and the third set of equations.

[0138] If the correction deviation is updated to the above coordinate deviations s1, s2, a, b, c, and d, it is also necessary to solve for the corrected second coordinate based on the above system of equations. When correcting the second coordinate, (x', y') represents the corrected second coordinate, and x and y represent the abscissa and ordinate of the second coordinate, respectively.

[0139] In some embodiments, if the user finds that the position of the cursor drawn based on the corrected second coordinates is still deviated from the direction pointed to by the remote control 100, that is, the user subjectively believes that the calibration result is not ideal, the user can control the display device 200 to restart the remote control calibration function and perform calibration again.

[0140] In some embodiments, if the display device 200 determines to directly enter a higher-level calibration mode in response to an instruction to re-start the remote control calibration function, it will restart the remote control calibration service.

[0141] In some embodiments, in response to an instruction to reactivate the pointer remote control calibration function, the display device 200 can read the previous calibration mode recorded in the state machine through the pointer remote control calibration service and determine to enter a calibration mode of a higher level than the previous one.

[0142] In one example, if the previous calibration mode was the first calibration mode, then if the remote control calibration function is activated again, it will directly enter the second or third calibration mode.

[0143] In another example, if the previous calibration mode was the second calibration mode, then if the remote control calibration function is activated again, it will directly enter the third calibration mode.

[0144] In other embodiments, if the determined calibration mode is a lower calibration level, such as the first calibration mode or the second calibration mode, during the execution of step S402, after listening to the confirmation event sent to the remote controller 100, the display device 200 can directly enter a higher calibration level to verify the previous calibration result through the higher calibration level, and to directly perform a higher calibration level if the verification fails.

[0145] Figure 10 This is a flowchart illustrating the further calibration of the display device 200 towards the remote control 100 in this embodiment of the application. The specific steps include: Step S1001: After listening to the confirmation event sent to the remote control, display the calibration page of the higher-level calibration mode.

[0146] The calibration page for this higher-level calibration mode includes new anchors in addition to the existing anchors contained in the previous calibration page.

[0147] In one example, if the calibration mode determined in step S401 (i.e. the previous calibration mode) is the first calibration mode, then the original anchor point contained in the previous calibration page is the first anchor point. If the calibration mode of a higher level is the second calibration mode, then the newly added anchor point in its corresponding calibration page is the second anchor point. If the calibration mode of a higher level is the third calibration mode, then the newly added anchor point in its corresponding calibration page is both the second and third anchor points.

[0148] In another example, if the calibration mode determined in step S401 (i.e., the previous calibration mode) is the second calibration mode, then the original anchor points included in the previous calibration page are the first anchor point and the second anchor point. A higher-level calibration mode is the third calibration mode, and its corresponding calibration page will also include the third anchor point as the newly added anchor point.

[0149] It is important to note that in this case, the calibration page of the higher-level calibration mode is related to the previous calibration page. The position of the original anchor point on the calibration page of the higher-level calibration mode is consistent with the position of the original anchor point on the previous calibration page, and the new anchor point conforms to the relative position relationship with the original anchor point.

[0150] Figure 5BThis is another timing diagram for calibrating the display device 200 to point to the remote controller 100 in an embodiment of this application.

[0151] and Figure 5A Compared to the timing diagram shown, Figure 5B The main difference in the timing diagram shown is that after the display device 200 listens for the confirmation event through the pointing remote control interaction service, it also sends a first notification to the pointing remote control calibration service. After receiving the first notification, the pointing remote control calibration service reads the current calibration mode from the state machine, determines the higher-level calibration mode, and controls the application layer to display the corresponding calibration page.

[0152] In step S1002, after setting the coordinate deviation to the correction deviation, the cursor is displayed on the calibration page of the higher-level calibration mode.

[0153] The cursor's position on the calibration page is the position after correction based on the current calibration deviation. In other words, the display device 200 displays the cursor on a higher-level calibration interface so that the user can verify the previous calibration results based on the cursor's position.

[0154] Combination Figure 5B After the display device 200 sets the coordinate deviation to the correction deviation through the pointing remote control calibration service, that is, after updating the correction deviation in the state machine, it can send a second notification to the pointing remote control interaction service, so that the pointing remote control interaction service reads the correction deviation from the state machine, and after receiving the direction information sent by the pointing remote control 100 (such as when pointing to a new anchor point), it determines the cursor coordinates mapped to the calibration page, corrects the cursor coordinates based on the read correction deviation, and pushes the corrected cursor coordinates up to the application layer, so that the application layer can display the cursor on a higher-level calibration page based on the corrected cursor coordinates.

[0155] Step S1003: After listening to the confirmation event sent again by the remote control, determine the cursor coordinates mapped to the calibration page when the remote control points to the new anchor point.

[0156] Users can control the remote control 100 to point to the newly added anchor point and compare the position of the cursor with that of the newly added anchor point to verify the correction result.

[0157] In some embodiments, if the cursor is not on the newly added anchor point, it indicates that the verification has failed. In this case, the user can control the display device 200 to directly enter a higher-level calibration mode. That is, the user can send a confirmation event to the display device 200 again by pointing to the confirmation button on the remote control 100, indicating that the user has controlled the remote control 100 to point to the newly added anchor point.

[0158] Combination Figure 5BAfter the display device 200 detects the confirmation event sent by the pointing remote control 100 through the pointing remote control interaction service, it determines the cursor coordinates mapped to the calibration page when the pointing remote control 100 points to the new anchor point, and transmits these cursor coordinates to the pointing remote control calibration service. The pointing remote control calibration service then calculates the coordinate deviation based on the first coordinate, the coordinates of the original anchor point, the cursor coordinates, and the coordinates of the new anchor point.

[0159] Step S1004: Based on the first coordinates and the original anchor point coordinates on the calibration page, construct the fourth set of equations; and based on the cursor coordinates and the newly added anchor point coordinates on the calibration page, construct the fifth set of equations.

[0160] In some embodiments, if the higher-level calibration mode is the second calibration mode, the fourth and fifth equation sets can be constructed according to the first and second equation sets shown in step S802.

[0161] In some other embodiments, if the higher-level calibration mode is the third calibration mode, the fourth and fifth equation sets can be constructed according to the first, second, and third equation sets shown in step S902.

[0162] Step S1005: Based on the fourth and fifth equation sets, calculate the coordinate deviation again.

[0163] Step S1005 can be referred to step S803 or step S903, and will not be repeated here.

[0164] Step S1006: Update the correction deviation to the recalculated coordinate deviation.

[0165] Combination Figure 5B The display device 200 can update the correction deviation using the coordinate deviation calculated in step S1005 through the pointing remote control calibration service.

[0166] Based on the above embodiments, after the user completes the calibration operation in the calibration mode of a lower calibration level, the display device 200 can directly display the calibration page of a higher calibration level. The user can verify the previous calibration result through the newly added anchor points on the calibration page. In this way, if the user is not satisfied with the previous calibration result, there is no need to repeatedly start the remote control calibration function and alignment operation. The user can directly enter the calibration process of a higher calibration level, which effectively simplifies the user's interactive operation and improves the calibration efficiency.

[0167] In other embodiments, if the cursor is on the newly added anchor point, it indicates that the verification has passed. At this time, the user can control the display device 200 to directly exit the calibration page of the higher-level calibration mode, thereby exiting the calibration process of the higher-level calibration and restoring normal use of the remote control 100 as soon as possible.

[0168] In some embodiments, when the display device 200 displays the calibration page, it also displays a prompt message on the calibration page, which prompts the user to operate the remote control 100 to point to the anchor point.

[0169] Based on this, the display device 200 can enhance interactivity with the user by displaying prompts on the calibration page, and can ensure that the user can effectively perform calibration operations, thereby improving calibration efficiency and effectiveness.

[0170] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion in some embodiments is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the contents of this disclosure, thereby enabling those skilled in the art to better utilize the embodiments.

Claims

1. A display device, characterized in that, include: The communication device is configured to communicate with the pointing remote control; The display is configured to display an operation interface, on which a cursor is displayed, the position of which is determined by the position of the pointing remote control in three-dimensional space. The controller is configured as follows: In response to an instruction to activate the remote control calibration function, a calibration mode is determined, and the display is controlled to show a calibration page corresponding to the calibration mode on the operation interface, the calibration page including anchor points; After listening to the confirmation event sent by the pointing remote control, it is determined that the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point; wherein, the confirmation event indicates that the user has controlled the pointing remote control to point to the anchor point; Calculate the coordinate deviation between the first coordinate and the anchor point coordinate on the calibration page; The coordinate deviation is set as a correction deviation, and after the second coordinate is mapped to the operation interface when the remote control is determined to point to the first position, the corrected second coordinate is calculated based on the correction deviation and the second coordinate. The display is controlled to show a cursor on the user interface based on the corrected second coordinates.

2. The display device according to claim 1, characterized in that, In response to a command to activate the remote control calibration function, the controller determines the calibration mode, which is specifically configured as follows: If the instruction indicates a calibration mode, then the calibration mode is determined to be the calibration mode indicated by the first instruction; or... If the instruction does not specify a calibration mode, the calibration mode is determined to be a first calibration mode, a second calibration mode, or a third calibration mode; In the first calibration mode, the calibration page includes one anchor point, allowing the user to perform a calibration operation by pointing the remote control at the anchor point; in the second calibration mode, the calibration page includes two anchor points, allowing the user to sequentially perform a calibration operation by pointing the remote control at each of the two anchor points; and in the third calibration mode, the calibration page includes three anchor points, allowing the user to sequentially perform a calibration operation by pointing the remote control at each of the three anchor points.

3. The display device according to claim 2, characterized in that, If the calibration mode is the first calibration mode, the calibration page includes a first anchor point; After receiving an acknowledgment event from the pointing remote control, the controller determines the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point, which is specifically configured as follows: After listening to the first confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the first anchor point, the first coordinates mapped to the calibration page are determined; wherein, the first confirmation event indicates that the user has controlled the pointing remote control to point to the first anchor point; The controller calculates the coordinate deviation between the first coordinate and the anchor point coordinates on the calibration page, and is specifically configured as follows: The first difference between the first coordinate and the first anchor point coordinate on the calibration page is calculated to obtain the coordinate deviation.

4. The display device according to claim 2, characterized in that, If the calibration mode is the second calibration mode, the calibration page includes a first anchor point and a second anchor point; After receiving an acknowledgment event from the pointing remote control, the controller determines the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point, which is specifically configured as follows: After listening to the first confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the first anchor point, it maps to the first sub-coordinate on the calibration page; wherein, the first confirmation event indicates that the user has controlled the pointing remote control to point to the first anchor point; And, after listening to the second confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the second anchor point, the second sub-coordinate is mapped to the calibration page; wherein, the second confirmation event indicates that the user has controlled the pointing remote control to point to the second anchor point; The controller calculates the coordinate deviation between the first coordinate and the anchor point coordinates on the calibration page, and is specifically configured as follows: Based on the first sub-coordinate and the first anchor point coordinate of the first anchor point on the calibration page, a first system of equations is constructed; and based on the second sub-coordinate and the second anchor point coordinate of the second anchor point on the calibration page, a second system of equations is constructed. The coordinate deviation is calculated based on the first set of equations and the second set of equations.

5. The display device according to claim 2, characterized in that, If the calibration mode is the third calibration mode, the calibration page includes a first anchor point, a second anchor point, and a third anchor point; After receiving an acknowledgment event from the pointing remote control, the controller determines the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point, which is specifically configured as follows: After listening to the first confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the first anchor point, it maps to the first sub-coordinate on the calibration page; wherein, the first confirmation event indicates that the user has controlled the pointing remote control to point to the first anchor point; After listening to the second confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the second anchor point, it maps to the second sub-coordinate on the calibration page; wherein, the second confirmation event indicates that the user has controlled the pointing remote control to point to the second anchor point; And, after listening to the third confirmation event sent by the pointing remote control, it is determined that when the pointing remote control points to the third anchor point, it maps to the third sub-coordinate on the calibration page; wherein, the third confirmation event indicates that the user has controlled the pointing remote control to point to the third anchor point; The controller calculates the coordinate deviation between the first coordinate and the anchor point coordinates on the calibration page, and is specifically configured as follows: Based on the first sub-coordinate and the first anchor point coordinate of the first anchor point on the calibration page, a first set of equations is constructed; based on the second sub-coordinate and the second anchor point coordinate of the second anchor point on the calibration page, a second set of equations is constructed; and based on the third sub-coordinate and the third anchor point coordinate of the third anchor point on the calibration page, a third set of equations is constructed. The coordinate deviation is calculated based on the first set of equations, the second set of equations, and the third set of equations.

6. The display device according to claim 2, characterized in that, If the calibration mode is determined to be either the first calibration mode or the second calibration mode, the controller controls the display to display the cursor on the operation interface based on the calibrated second coordinates, and is further configured to: In response to the instruction to restart the remote control calibration function, the calibration mode is determined to be a higher-level calibration mode, and the display is controlled to show the calibration page corresponding to the higher-level calibration mode on the operation interface. The calibration modes, arranged from lowest to highest, are the first calibration mode, the second calibration mode, and the third calibration mode.

7. The display device according to claim 4 or 5, characterized in that, If the calibration mode is determined to be either the first calibration mode or the second calibration mode, the controller, after listening to the confirmation event sent by the remote control, is further configured to: The display is controlled to show a calibration page of a higher-level calibration mode, which includes newly added anchor points compared to the original anchor points included in the previous calibration page. The controller is also configured to: After setting the coordinate deviation as a correction deviation, the display is controlled to show a cursor on the calibration page of the higher-level calibration mode; wherein the position of the cursor on the calibration page is the position after correction based on the current correction deviation; After listening to the confirmation event sent again by the pointing remote control, it is determined that the cursor coordinates mapped to the calibration page when the pointing remote control points to the new anchor point; wherein, the second confirmation event indicates that the user has controlled the pointing remote control to point to the new anchor point; Based on the first coordinates and the original anchor point's anchor point coordinates on the calibration page, a fourth set of equations is constructed; and based on the cursor coordinates and the newly added anchor point's anchor point coordinates on the calibration page, a fifth set of equations is constructed. Based on the fourth and fifth sets of equations, the coordinate deviation is calculated again; The correction deviation is updated to the recalculated coordinate deviation; The calibration modes, arranged from lowest to highest, are the first calibration mode, the second calibration mode, and the third calibration mode.

8. The display device according to claim 7, characterized in that, After setting the coordinate deviation as a correction deviation, the controller, after controlling the display to show the cursor on the calibration page of the higher-level calibration mode, is further configured to: After listening to the cancel event sent by the remote control, control the display to exit the calibration page of the higher-level calibration mode.

9. The display device according to claim 1, characterized in that, The controller controls the display to show the calibration page corresponding to the calibration mode on the operation interface, and is also configured to: The display is controlled to show a prompt message on the calibration page, which prompts the user to operate the remote control to point to the anchor point.

10. A calibration method for pointing a remote control, characterized in that, The device is applied to a display device, which is communicatively connected to the pointing remote control and displays a cursor on the operation interface. The position of the cursor on the operation interface is determined by the position pointed to by the pointing remote control in three-dimensional space. The method includes: In response to an instruction to activate the remote control calibration function, a calibration mode is determined, and a calibration page corresponding to the calibration mode is displayed on the operation interface, the calibration page including anchor points; After listening to the confirmation event sent by the pointing remote control, it is determined that the first coordinate mapped to the calibration page when the pointing remote control points to the anchor point; wherein, the confirmation event indicates that the user has controlled the pointing remote control to point to the anchor point; Calculate the coordinate deviation between the first coordinate and the anchor point coordinate on the calibration page; The coordinate deviation is set as a correction deviation, and after the second coordinate is mapped to the operation interface when the remote control is determined to point to the first position, the corrected second coordinate is calculated based on the correction deviation and the second coordinate. Based on the corrected second coordinates, a cursor is displayed on the operation interface.

Images