Display device and focus management method

Abstract

The invention provides a display device and a focus management method. Under the condition that the display equipment can display a key focus and a cursor at the same time, focus management can be carried out on the key focus and the cursor, and when key code data sent by a remote controller is received, a control triggering a hovering event or a focus event last time responds to an event corresponding to the key code data, so that the hovering event or the focus event is triggered. Namely, the user operates the key focus or the control indicated by the cursor last time to respond to the event corresponding to the key code data, so that the control which the user wants to control responds to the event corresponding to the key code data, and the actual requirements of the user are better met.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a focus management method. Background Art

[0002] A display device refers to a terminal device capable of outputting a specific display image. These devices can include smart TVs, mobile terminals, smart advertising screens, projectors, and other terminal devices. Taking smart TVs as an example, they are based on Internet application technology, feature an open operating system and chip, and possess an open application platform. They enable two-way human-computer interaction and integrate multiple functions, including audio, video, entertainment, and data, to meet the diverse and personalized needs of users.

[0003] When paired with a remote control, the display device can move the key focus on the user interface based on the key code data sent by the remote control's directional keys. If the remote control has a pointing function, the display device can also display a cursor at the corresponding location on the user interface based on the coordinate data sent by the remote control when pointing to a specific location in three-dimensional space. When the display device receives key code data from the remote control, such as the key code data for the confirmation key or the directional keys, the control that has the focus will respond to the events corresponding to these key code data.

[0004] The control indicated by the key focus and the control indicated by the cursor are both focused controls. When the key focus and the cursor indicate different controls, respectively, to avoid conflicts in responding to events corresponding to key code data, the display device can be configured to fix the control indicated by the cursor or the control indicated by the key focus to respond to events corresponding to the key code data. However, the control indicated by the cursor or the control indicated by the key focus may not be the control the user wants to control. Therefore, fixing the control indicated by the cursor or the control indicated by the key focus to respond to events corresponding to key code data may not accurately meet the user's actual needs. Summary of the Invention

[0005] The present application provides a display device and a focus management method. When the display device can display the key focus and the cursor at the same time, the key focus and the cursor can be managed by the control that last triggered the hover event or the focus event to respond to the event corresponding to the key code data, that is, the control indicated by the key focus or cursor that the user most recently manipulated responds to the event corresponding to the key code data, thereby ensuring that the control that the user wants to control responds to the event corresponding to the key code data, which is more in line with the user's actual needs.

[0006] In a first aspect, the present application provides a display device, comprising:

[0007] The display is configured to: display an operation interface, wherein the operation interface has a cursor and a key focus, the position of the cursor on the operation interface is determined by the position pointed to by the remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by the key code data of the direction key sent by the remote control; the Bluetooth module is configured to: receive first coordinate data sent when the remote control points to a first position in three-dimensional space, and receive key code data of the first direction key sent by the remote control; the controller is configured to: based on the first coordinate data, monitor a hover event triggered by a first control in the operation interface; and based on the key code data of the first direction key, monitor a focus event triggered by a second control in the operation interface; when monitoring a confirmation key event sent by the remote control, the control that last triggered a hover event or a focus event among the first control and the second control responds to the confirmation key event.

[0008] Based on the above embodiment, when the display device monitors a hover event triggered by a first control and a focus event triggered by a second control, that is, when the key focus and the cursor respectively indicate different controls, when a confirmation key event is monitored, it can control the control that last triggered the hover event or focus event to respond to the confirmation key event, that is, the control indicated by the key focus or cursor that the user most recently manipulated responds to the confirmation key event, thereby ensuring that the control that the user wants to control responds to the confirmation key event to meet the actual needs of the user.

[0009] In some embodiments of the present application, the controller is further specifically configured to:

[0010] Based on the first coordinate data, when a hover event is detected by the first control, the latest selected control recorded in the global record is updated to the first control; based on the key code data of the first direction key, when a focus event is detected by the second control, the latest selected control recorded in the global record is updated to the second control.

[0011] Based on the above embodiment, the display device can be configured to record the most recently selected control through a global log. The most recently selected control is the control that the user most recently manipulated with the key focus or cursor. Furthermore, upon monitoring a hover event or focus event triggered by a control, the most recently selected control recorded in the global log can be updated to ensure the accuracy of the recorded most recently selected control.

[0012] In some embodiments of the present application, when the controller monitors a confirmation key event sent by the remote control, the control among the first control and the second control that last triggered a hover event or a focus event responds to the confirmation key event, and is specifically configured as follows: when the confirmation key event is monitored, the latest selected control recorded in the global record is read; and the latest selected control responds to the confirmation key event.

[0013] Based on the above embodiment, when the display device is configured to record the latest selected control through the global record, when a confirmation key event is monitored, the latest selected control can be read from the global record, and the latest selected control can respond to the confirmation key event, so as to realize that the control indicated by the key focus or cursor of the user's most recent operation responds to the confirmation key event.

[0014] In a second aspect, the present application provides a display device, comprising:

[0015] The display is configured to: display an operation interface, wherein the operation interface has a cursor and a key focus, the position of the cursor on the operation interface is determined by the position pointed to by the remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by the key code data of the direction key sent by the remote control; the Bluetooth module is configured to: receive the key code data of the first direction key sent by the remote control; the controller is configured to: upon monitoring a hover event triggered by a first control and a focus event triggered by a second control, monitor a first focus update event based on the key code data of the first direction key, the first focus update event indicating an update of the position of the key focus on the operation interface; determine a third control to be triggered in the first direction for a focus event based on the control of the first and second controls that last triggered a hover event or a focus event as a basis for moving the key focus, the first direction corresponding to the first direction key; upon monitoring the focus event triggered by the third control, control the display to display the key focus update on the third control.

[0016] Based on the above embodiment, when the display device monitors a hover event triggered by a first control and a focus event triggered by a second control, that is, when the button focus and the cursor respectively indicate different controls, if the remote control sends key code data of the first direction key, that is, the user controls to move the button focus, when the display device monitors the first focus update event, it can control to move the button focus based on the control that last triggered the hover event or focus event, that is, to move the button focus based on the control indicated by the user's most recent manipulation of the button focus or the cursor, thereby ensuring that the button focus is moved to the control that the user wants to control, to meet the actual needs of the user.

[0017] In some embodiments of the present application, the controller uses the control that last triggered a hover event or a focus event as a basis for moving the key focus, and determines the third control to trigger a focus event in the first direction. The controller is specifically configured to: read the latest selected control recorded in the global record, and the latest selected control recorded in the global record is used to represent the control that last triggered a hover event or a focus event; use the latest selected control recorded in the global record as a basis for moving the key focus, and determine the third control to trigger a focus event in the first direction; the controller is further configured to: when monitoring the focus event triggered by the third control, update the latest selected control recorded in the global record to the third control.

[0018] Based on the above embodiment, the display device can be configured to record the latest selected control through a global record. When the display device monitors the first focus update event, it reads the latest selected control from the global record and moves the key focus based on the latest selected control. The latest selected control is the control that the user most recently manipulated the key focus or the control indicated by the cursor. In this way, it is possible to move the key focus based on the control that the user most recently manipulated the key focus or the control indicated by the cursor. In addition, after the key is moved to the third control, the latest selected control recorded in the global record is updated to the third control to ensure the accuracy of the latest selected control recorded in the global record.

[0019] In some embodiments of the present application, the Bluetooth module is further configured to: receive first coordinate data and a page start instruction sent by the remote control when pointing to a first position in three-dimensional space; the controller is further configured to: in response to the page start instruction, control the display to display the first page in the operation page, and after displaying the first page, based on the configuration information of the default control in the first page, monitor the focus event triggered by the control in the first page, the default control is the control that triggers the focus event by default in the first page; based on the first coordinate data, monitor the hover event triggered by the control in the first page; based on the first monitoring result of monitoring the focus event and the first monitoring result of monitoring the hover event Second, the monitoring result updates the latest selected control recorded in the global record; based on the key code data of the second direction key sent by the remote control, a second focus update event is monitored, and the second focus update event indicates an update of the position of the key focus in the first page; the latest selected control recorded in the global record is read; using the latest selected control recorded in the global record as a basis for moving the key focus, a fourth control in the first page to trigger a focus event in the second direction is determined, the second direction corresponds to the second direction key; when the focus event is monitored to be triggered by the fourth control, the display is controlled to display the key focus update on the fourth control in the first page.

[0020] Based on the above embodiment, after launching the first page, the display device can determine the most recently selected control on the first page based on the configuration information of the default controls on the first page and the position of the remote control in three-dimensional space, and update the global record. At this time, if the second focus update event is detected, the display device will move the key focus based on the most recently selected control recorded in the global record, so as to move the key focus to the control that the user wants to control.

[0021] In some embodiments of the present application, the controller updates the latest selected control recorded in the global record based on a first monitoring result of monitoring focus events and a second monitoring result of monitoring hover events, and is specifically configured to: when the second monitoring result is that the hover event triggered by the control is not monitored, and the first monitoring result is that the focus event triggered by the default control is monitored, update the latest selected control recorded in the global record to the default control; or, when the second monitoring result is that the hover event triggered by the control is not monitored, and the first monitoring result is that the focus event triggered by the control is not monitored, update the latest selected control recorded in the global record to empty; or, when the second monitoring result is that the hover event triggered by the initial control in the first page is monitored, update the latest selected control recorded in the global record to the initial control.

[0022] Based on the above embodiment, after starting the first page, the display device can accurately update the latest selected control recorded in the global record based on whether a default key in the first page obtains key focus and whether the cursor indicates a control in the first page.

[0023] In some embodiments of the present application, after determining the fourth control in the page of the first application that is to trigger a focus event in the second direction, the controller is further configured to: update the latest selected control recorded in the global record to the fourth control; the controller is further configured to: based on the key code data of the third direction key sent by the remote control, monitor a third focus update event, the third focus update event indicating an update of the key focus position in the first page; read the latest selected control recorded in the global record; use the latest selected control recorded in the global record as a basis for moving the key focus, and determine the fifth control in the first page that is to trigger a focus event in the third direction, the third direction corresponding to the third direction key; when monitoring the focus event triggered by the fifth control, control the display to display the key focus update on the fifth control in the first page.

[0024] Based on the above embodiment, after the display device moves the button to the fourth control, it updates the most recently selected control recorded in the global record to the fourth control to ensure the accuracy of the most recently selected control recorded in the global record. At this time, if the display device monitors the third focus update event, it reads the most recently selected control from the global record and moves the button focus based on the most recently selected control, so that when the user's most recent manipulation of the button focus indicates the fourth control, the button focus is moved based on the fourth control. Furthermore, after the button is moved to the fifth control, the most recently selected control recorded in the global record is updated to the fifth control to ensure the accuracy of the most recently selected control recorded in the global record.

[0025] In some embodiments, after determining the fourth control in the first page that is to trigger a focus event in the second direction, the controller is further configured to: update the latest selected control recorded in the global record to the fourth control; the controller is further configured to: determine the sixth control pointed to by the remote control in the first page based on the second coordinate data sent when the remote control points to the second position in three-dimensional space; update the latest selected control recorded in the global record to the sixth control; based on the key code data of the fourth direction key sent by the remote control, listen to the fourth focus update event, the fourth focus update event indicates the update of the key focus position in the first page; read the latest selected control recorded in the global record; use the latest selected control recorded in the global record as the basis for moving the key focus, and determine the seventh control in the first page that is to trigger a focus event in the fourth direction, the fourth direction corresponding to the fourth direction key; when listening to the focus event triggered by the seventh control, control the display to display the key focus update on the seventh control in the first page.

[0026] Based on the above embodiment, after the display device moves the button to the fourth control, the display device updates the latest selected control recorded in the global record to the fourth control to ensure the accuracy of the latest selected control recorded in the global record. At this time, if the remote control is pointed to another location, the display device will update the latest selected control recorded in the global record according to the new location pointed to by the remote control. At this time, if the fourth focus update event is monitored, the latest selected control is read from the global record, and the button focus is moved based on the latest selected control, so that when the user last manipulated the cursor to indicate the sixth control, the button focus is moved based on the sixth control. In addition, after the button is moved to the seventh control, the latest selected control recorded in the global record is updated to the seventh control to ensure the accuracy of the latest selected control recorded in the global record.

[0027] In a third aspect, the present application provides a display device, comprising:

[0028] The display is configured to: display an operation interface, wherein the operation interface has a cursor and a key focus, wherein the position of the cursor on the operation interface is determined by the position pointed to by the remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by the key code data of the direction key sent by the remote control; the Bluetooth module is configured to: receive first coordinate data sent by the remote control when pointing to a first position in three-dimensional space, and receive a page startup instruction sent by the remote control; the controller is configured to: in response to the startup page instruction, control the display to display a first page in the operation interface, and after displaying the first page, based on configuration information of a default control in the first page, monitor focus events triggered by controls in the first page, wherein the default control is a control that triggers focus events by default in the first page; monitor hover events triggered by controls in the first page based on the first coordinate data; update the latest selected control recorded in a global record based on a first monitoring result of monitoring focus events and a second monitoring result of monitoring hover events; and when a confirmation key event sent by the remote control is monitored, have the latest selected control recorded in the global record respond to the confirmation key event.

[0029] Based on the above embodiment, after launching the first page, the display device can determine the most recently selected control on the first page after launching the first page based on the configuration information of the default controls on the first page and the position pointed to by the remote control in three-dimensional space, and update the most recently selected control recorded in the global record. The most recently selected control is the control that the user wants to control on the first page after launching the first page. At this time, if a confirmation key event is monitored, the display device will respond to the confirmation key event with the most recently selected control recorded in the global record, so that the control that the user wants to control responds to the confirmation key event.

[0030] In some embodiments, the controller updates the latest selected control recorded in the global record based on a first monitoring result of monitoring focus events and a second monitoring result of monitoring hover events, and is specifically configured as follows: when the second monitoring result is that the hover event triggered by the control is not monitored, and the first monitoring result is that the focus event triggered by the default control is monitored, the latest selected control recorded in the global record is updated to the default control; or, when the second monitoring result is that the hover event triggered by the control is not monitored, and the first monitoring result is that the focus event triggered by the control is not monitored, the selected control recorded in the global record is updated to empty; or, when the second monitoring result is that the hover event triggered by the initial control in the first page is monitored, the selected control recorded in the global record is updated to the initial control.

[0031] Based on the above embodiment, after starting the first page, the display device can accurately update the latest selected control recorded in the global record based on whether a default key in the first page obtains key focus and whether the cursor indicates a control in the first page.

[0032] In some embodiments, when the controller monitors a confirmation key event sent by the remote control, the latest selected control recorded in the global record responds to the confirmation key event, and is specifically configured as follows: when the latest selected control recorded in the global record is empty, determine the positional relationship between the first position mapped to the cursor position in the operation interface and the first page; if the positional relationship is that the cursor position is within the first page, keep displaying the first page on the display; if the positional relationship is that the cursor position is outside the first page, close the first page in response to the confirmation key event.

[0033] Based on the above embodiment, when no control obtains the key focus and the cursor does not point to a control in the first page, the confirmation key event can be responded to in different situations based on the position between the cursor and the first page.

[0034] In some embodiments, the controller is further configured to: when the latest selected control recorded in the global record is empty, based on the key code data of the first direction key sent by the remote control, monitor the focus event triggered by the first control in the first page; update the latest selected control recorded in the global record to the first control; when monitoring the confirmation key event sent by the remote control, read the latest selected control recorded in the global record; and respond to the confirmation key event by the latest selected control recorded in the global record.

[0035] Based on the above embodiment, when no control has received key focus and the cursor is not pointing to a control on the first page, the display device can, in response to the key code data of the first directional key sent by the remote control, control the first control on the first page to receive key focus by default and update the most recently selected control recorded in the global record. At this time, if a confirmation key event is detected, the first control will respond to the confirmation key event. As a result, the user can use the directional keys on the remote control to manipulate the controls on the first page to obtain key focus, thereby further controlling the controls on the first page.

[0036] In some embodiments of the present application, the controller is further configured to: when the latest selected control recorded in the global record is empty, based on the second coordinate data sent when the remote control points to the second position in three-dimensional space, monitor a hover event triggered by the second control in the first page; update the latest selected control recorded in the global record to the second control; when monitoring a confirmation key event sent by the remote control, read the latest selected control recorded in the global record; and respond to the confirmation key event by the latest selected control recorded in the global record.

[0037] Based on the above embodiment, when no control has received key focus and the cursor is not pointing to a control on the first page, the display device can control the second control on the first page to receive key focus by default based on the new position of the remote control in three-dimensional space, and update the most recently selected control recorded in the global record. At this time, if a confirmation key event is detected, the second control will respond to the confirmation key event. In this way, the user can manipulate the control on the first page by changing the position of the remote control to obtain the cursor, thereby further controlling the control on the first page.

[0038] In a fourth aspect, the present application also provides a focus management method, which is applied to a display device as described in any one of the first aspects, wherein the display device displays an operation interface, and the operation interface has a cursor and a key focus, the position of the cursor on the operation interface is determined by the position pointed to by the remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by the key code data of the direction key sent by the remote control; the method includes: receiving first coordinate data sent by the remote control when pointing to a first position in three-dimensional space, and receiving key code data of the first direction key sent by the remote control; based on the first coordinate data, monitoring a hover event triggered by a first control in the operation interface; and based on the key code data of the first direction key, monitoring a focus event triggered by a second control in the operation interface; when monitoring a confirmation key event sent by the remote control, the control that last triggered a hover event or focus event among the first control and the second control responds to the confirmation key event.

[0039] Based on the above embodiment, when the display device monitors a hover event triggered by a first control and a focus event triggered by a second control, that is, when the key focus and the cursor respectively indicate different controls, when a confirmation key event is monitored, it can control the control that last triggered the hover event or focus event to respond to the confirmation key event, that is, the control indicated by the key focus or cursor that the user most recently manipulated responds to the confirmation key event, thereby ensuring that the control that the user wants to control responds to the confirmation key event to meet the actual needs of the user.

[0040] In a fifth aspect, the present application also provides a focus management method, which is applied to a display device as described in any one of the second aspects, wherein the display device displays an operation interface, and the operation interface has a cursor and a key focus, the position of the cursor on the operation interface is determined by the position pointed to by the remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by the key code data of the direction key sent by the remote control; the method includes: receiving the key code data of the first direction key sent by the remote control; in the case of monitoring a hover event triggered by a first control and a focus event triggered by a second control, based on the key code data of the first direction key, monitoring a first focus update event, the first focus update event indicating an update of the position of the key focus on the operation interface; using the control of the first control and the second control that last triggered a hover event or a focus event as a basis for moving the key focus, determining a third control in the first direction to trigger a focus event, the first direction corresponding to the first direction key; when monitoring the focus event triggered by the third control, controlling the display to display the key focus update on the third control.

[0041] Based on the above embodiment, when the display device monitors a hover event triggered by a first control and a focus event triggered by a second control, that is, when the button focus and the cursor respectively indicate different controls, if the remote control sends key code data of the first direction key, that is, the user controls to move the button focus, when the display device monitors the first focus update event, it can control to move the button focus based on the control that last triggered the hover event or focus event, that is, to move the button focus based on the control indicated by the user's most recent manipulation of the button focus or the cursor, thereby ensuring that the button focus is moved to the control that the user wants to control, to meet the actual needs of the user.

[0042] In a sixth aspect, the present application also provides a focus management method, applied to a display device as described in any one of the third aspects, wherein the display device displays an operation interface, the operation interface having a cursor and a key focus, the position of the cursor on the operation interface being determined by the position pointed to by the remote control in three-dimensional space, and the position of the key focus on the operation interface being determined by the key code data of the direction key sent by the remote control; receiving first coordinate data sent when the remote control points to a first position in three-dimensional space, and receiving a page startup instruction sent by the remote control; in response to the startup page instruction, controlling the display to display a first page in the operation interface, and after displaying the first page, based on the configuration information of the default control in the first page, monitoring a focus event triggered by a control in the first page, the default control being the control that triggers the focus event by default in the first page; monitoring a hover event triggered by a control in the first page based on the first coordinate data; updating the latest selected control recorded in the global record based on a first monitoring result of monitoring the focus event and a second monitoring result of monitoring the hover event; when a confirmation key event sent by the remote control is monitored, the latest selected control recorded in the global record responds to the confirmation key event.

[0043] Based on the above embodiment, after launching the first page, the display device can determine the most recently selected control on the first page after launching the first page based on the configuration information of the default controls on the first page and the position pointed to by the remote control in three-dimensional space, and update the most recently selected control recorded in the global record. The most recently selected control is the control that the user wants to control on the first page after launching the first page. At this time, if a confirmation key event is monitored, the display device will respond to the confirmation key event with the most recently selected control recorded in the global record, so that the control that the user wants to control responds to the confirmation key event. BRIEF DESCRIPTION OF THE DRAWINGS

[0044] In order to more clearly illustrate the technical solution of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without any creative work.

[0045] Figure 1 Schematic diagram of an operation scenario between the display device 200 and the control device in an embodiment of the present application;

[0046] Figure 2 This is a hardware configuration block diagram of the display device 200 in an embodiment of the present application;

[0047] Figure 3 This is a diagram of the operating system configuration of the display device 200 in an embodiment of the present application;

[0048] Figure 4 A timing diagram of a Bluetooth connection between the display device 200 and the remote control 100 provided in an embodiment of the present application;

[0049] Figure 5 A schematic diagram of simultaneously displaying a cursor and a key focus in an operation interface provided by an embodiment of the present application;

[0050] Figure 6 A flowchart of a display device 200 managing focus provided in an embodiment of the present application;

[0051] Figure 7A and Figure 7B A schematic diagram of the control style provided in an embodiment of the present application;

[0052] Figure 8 A timing diagram of a first example of the display device 200 managing focus and responding to a confirmation key event provided by an embodiment of the present application;

[0053] Figure 9 A timing diagram of a second example of the display device 200 managing focus and responding to a confirmation key event provided by an embodiment of the present application;

[0054] Figure 10 A flowchart of another display device 200 managing focus provided in an embodiment of the present application;

[0055] Figure 11 A timing diagram of a first example of the display device 200 managing focus and responding to a focus update event provided by an embodiment of the present application;

[0056] Figure 12 A flowchart of another display device 200 managing focus provided in an embodiment of the present application;

[0057] Figure 13 A timing diagram of the display device 200 provided in an embodiment of the present application displaying key focus after starting the menu;

[0058] Figure 14 A schematic diagram of an interface for moving button focus in a menu provided in an embodiment of the present application;

[0059] Figure 15 Another flow chart of a display device 200 managing focus provided in an embodiment of the present application;

[0060] Figure 16 A timing diagram of a first example of the display device 200 managing focus and responding to a confirmation key event after launching a first page provided by an embodiment of the present application;

[0061] Figure 17 A schematic diagram of the interface showing the focus status after the pop-up window is activated according to an embodiment of the present application;

[0062] Figure 18A and Figure 18B A timing diagram of a second example of the display device 200 managing focus and responding to a confirmation key event after launching a first page provided by an embodiment of the present application;

[0063] Figure 19A and Figure 19B This is a schematic diagram of the interface for obtaining focus after starting a pop-up window provided in an embodiment of the present application. DETAILED DESCRIPTION

[0064] The following embodiments are described in detail, with examples illustrated in the accompanying drawings. When the following description refers to the drawings, identical numbers in different figures represent identical or similar elements unless otherwise indicated. The embodiments described in the following embodiments are not intended to represent all possible implementations consistent with the present application. They are merely examples of systems and methods consistent with certain aspects of the present application, as detailed in the claims.

[0065] It should be noted that the brief descriptions of terms in this application are only for the purpose of facilitating the understanding of the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and usual meanings.

[0066] In the specification and claims of this application and the accompanying drawings, the terms "first," "second," "third," etc. are used to distinguish similar or similar objects or entities, and are not necessarily intended to limit a particular order or sequence, unless otherwise noted. It should be understood that the terms used in this manner are interchangeable under appropriate circumstances.

[0067] The terms "comprise," "include," and "have," and any variations thereof, are intended to cover but not exclude inclusion; for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0068] In the embodiments of the present application, a display device generally refers to a device capable of displaying images and processing data. For example, a display device includes but is not limited to smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0069] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG, the user can operate the display device 200 through touch operation, voice, mobile terminal and control device. For example, the control device can be a remote controller 100, a stylus pen, a handle, etc.

[0070] Figure 2 Some embodiments of this application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0071] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a user input interface 280, a memory, and a power supply.

[0072] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocols. The display device 200 may be provided with multiple communication devices 220, depending on the supported communication methods. The communication device 220 enables the display device 200 to communicate with the control device via wireless or wired connections. For example, the display device 200 may communicate with a remote control via a Bluetooth module in the communication device 220.

[0073] In some embodiments, detector 230 is used to collect signals from the external environment or external interactions. For example, detector 230 may include a light receiver, such as a sensor for collecting ambient light intensity; or an image collector, such as a camera, for collecting external environmental scenes, user attributes, or user interaction gestures; or a sound collector, such as a microphone, for receiving external sounds.

[0074] In some embodiments, the device interface 240 is used to access an external device.

[0075] In some embodiments, the controller 250 is used to control the overall operation of the display device 200. The controller 250 may include at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), a power processor, and first to nth interfaces for input / output. The controller 250 controls the operation of the display device 200 and responds to user operations through various software control programs stored in the memory.

[0076] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0077] In some embodiments, the display 260 is configured to receive and display image signals outputted from the controller 250. The display 260 may include a display functional component for presenting images and a driving component for driving image display.

[0078] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface 280 may receive the user command through the GUI.

[0079] In some embodiments, the audio output device 270 may be a local speaker of the display device 200 or an external audio output device of the display device 200 .

[0080] In some embodiments, the user input interface 280 may be configured to receive instructions from a user.

[0081] To facilitate user interaction, in some embodiments, the display device 200 may run an operating system. An operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface. For example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application program. The operating system also allows the user to interact with the display device 200.

[0082] The operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device 200 .

[0083] The operating system can be divided into different modules or layers according to the functions implemented, e.g. Figure 3 As shown, in some embodiments, the system can be divided into four layers, from top to bottom, namely the application layer (referred to as "application layer"), the application framework layer (referred to as "framework layer"), the system runtime layer and the kernel layer.

[0084] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications.

[0085] The framework layer provides applications with an application programming interface (API) and programming framework. The application framework layer includes predefined functions. The application framework layer acts as a processing center, determining the actions taken by applications in the application layer. Through the API, applications can access system resources and services during execution.

[0086] In some embodiments, the system runtime layer can provide support for the framework layer. When the framework layer is used, the operating system will run the instruction library contained in the system runtime layer, such as the C / C++ instruction library, to implement the functions to be implemented by the framework layer.

[0087] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management.

[0088] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0089] After the display device 200 is paired with the remote controller 100 via Bluetooth, the remote controller 100 can control the display device 200 .

[0090] In some embodiments, the remote control 100 may support both button functions and pointing functions.

[0091] The key function means that the remote control 100 can respond to a user's key press by sending corresponding key code data to the display device 200, so that the display device 200 responds to the corresponding key event based on the key code data. For example, the display device 200 can respond to a focus update event based on the key code data of the direction keys sent by the remote control 100 to control the movement of the key focus. In other words, the position of the key focus on the operation interface is determined by the key code data of the direction keys sent by the remote control 100.

[0092] The pointing function allows the remote control 100 to send corresponding coordinate data to the display device 200 based on the location it is pointing to in three-dimensional space, such as the distance between the remote control 100 and the display device 200, the angle at which the remote control 100 is pointing, etc. The display device 200 then determines the location of the remote control 100 based on the coordinate data, maps it to a location on the user interface, and displays the cursor at that location. In other words, the cursor's location on the user interface is determined by the location the remote control 100 is pointing to in three-dimensional space.

[0093] In some embodiments, as Figure 3 The operating system shown in the figure supports the pointing and key functions provided by the remote control 100. The application layer of the operating system is equipped with a control state processing module, a business logic processing module, and a business data processing module. The framework layer of the operating system is equipped with a UI rendering engine, a UI state management module, and a Bluetooth API. The kernel layer of the operating system is equipped with an input device driver, a hardware control core, and a Bluetooth driver.

[0094] based on Figure 3 The operating system shown, Figure 4 This is a timing diagram of the Bluetooth connection between the display device 200 and the remote control 100 provided in an embodiment of the present application.

[0095] like Figure 4As shown, a user activates display device 200 via remote control 100, for example, by sending a startup command to display device 200 using the infrared function of remote control 100. After startup, display device 200 initializes and activates its Bluetooth function to establish a Bluetooth connection with surrounding Bluetooth devices via the Bluetooth module. In one example, display device 200 can scan for surrounding Bluetooth devices using a Bluetooth driver. Upon detecting that the user has pressed the power button, remote control 100 wakes up and activates its Bluetooth function to send a Bluetooth Low Energy (BLE) broadcast to the surrounding area. This BLE broadcast includes device information about remote control 100. After scanning the BLE broadcast sent by remote control 100 via the Bluetooth driver, display device 200 parses the device information of remote control 100 and passes it to the application layer. Display device 200 can display the device information of remote control 100 via the business logic processing module in the application layer. For example, display device 200 can display the device information of remote control 100 in a pop-up window, and display a prompt message within the pop-up window, which asks the user whether to connect to the Bluetooth device scanned by remote control 100. After the display device 200 chooses to connect to the remote control 100, it sends confirmation information for the Bluetooth connection with the remote control 100 to the Bluetooth driver. The Bluetooth driver of the display device 200 sends a Bluetooth connection request to the remote control 100 based on the confirmation information. After receiving the Bluetooth connection request sent by the display device 200, the remote control 100 processes the pairing information in the connection request and feeds back a response message agreeing to the connection to the display device 200. After the display device 200 receives the response message fed back by the remote control 100 through the Bluetooth driver, it completes the Bluetooth connection with the remote control 100 based on the response message, and after the connection is established, it maintains the connection status of the remote control 100 and performs device management on the remote control 100. The Bluetooth driver of the display device 200 also passes the device information of the connected device, such as the device information of the remote control 100, to the application layer, and the application layer displays the device information of the connected device.

[0096] In some embodiments, as Figure 4 As shown, after establishing a Bluetooth connection with the display device 200, the remote control 100 is initialized. This initialization includes initializing various modules within the remote control 100, such as the module for detecting position coordinates and the module for transmitting coordinate data. After completing the initialization, the remote control 100 can detect its own position in three-dimensional space and generate corresponding coordinate data based on this position. Furthermore, the remote control 100 can transmit the coordinate data and key code data corresponding to each button to the display device 200 via the Bluetooth connection.

[0097] In some embodiments, the remote control 100 encapsulates the coordinate data, key code data, etc. into a data packet with a specific format and transmits it to the display device 200 via a Bluetooth connection. After receiving the data packet sent by the remote control 100, the display device 200 can parse the data packet to obtain the coordinate data, key code data, etc.

[0098] In some embodiments, as Figure 4 As shown, the display device 200 displays the operation interface after startup, and the control state processing module initializes the controls in the operation interface. The initialization may include registering monitoring for the controls in the operation interface to monitor events triggered by the controls. In some embodiments, if the remote control 100 supports both pointing and button functions, the events triggered by the controls monitored by the display device 200 may include hover events and focus events. Among them, the hover event refers to the event in which the cursor is obtained by the control; the focus event refers to the event in which the key focus is obtained by the control. In some embodiments, the display device 200 may also monitor confirmation key events responded by the control, such as click events, etc. After completing the initialization of the control, the display device 200 sends monitoring control information to the UI state management module. The monitoring control information indicates that the control in the operation interface has been registered for monitoring. The UI state management module records the monitoring control information to complete the monitoring registration for the control. In some embodiments, combined with Figure 4 , you can use the control state processing module to listen to the hover events and focus events triggered by the control.

[0099] Among them, the control state processing module can be set to an interface for monitoring hover events, such as OnHoverListener, through which hover events on the view can be monitored. When the position pointed to by the remote control 100 in three-dimensional space is mapped to a position on the operation interface and there is a corresponding control, that is, when the cursor is suspended on the control, the display device 200 will trigger a corresponding hover event by the control, and the hover event can be captured through the OnHoverListener interface. For example, when an event of the cursor entering the control or an event of the cursor moving on the control is monitored, the control state processing module monitors that the control triggers a hover event. When the cursor leaves the control, the control state processing module monitors that the control does not trigger a hover event.

[0100] The control state processing module can monitor key events. When the display device 200 receives the key code data of the direction key sent by the remote control 100, the control state processing module can monitor the corresponding key event, which is a focus update event used to indicate moving the key focus in the corresponding direction.

[0101] In some embodiments, after monitoring a hover event or a focus event triggered by a control, the display device 200 may change the style of the control, for example, by changing the background color, border effect, size, etc. of the control.

[0102] Figure 5 A schematic diagram of simultaneously displaying a cursor and a key focus in an operation interface provided in an embodiment of the present application.

[0103] like Figure 5 As shown, when the remote control 100 points to a certain position P1 in three-dimensional space, if the display device 200 determines that the position P1 is mapped to the control 51 in the operation interface, the display device 200 can monitor the hover event triggered by the control 51 and display the cursor 52 on the control 51. The display device 200 can change the style of the control 51, for example, by bolding the border of the control 51. If the display device 200 monitors the focus event triggered by the control 53, the display device 200 displays the key focus on the control 53, for example, by changing the background color of the control 53 to gray.

[0104] When the display device 200 receives the key code data of the confirmation key sent by the remote control 100, the control state processing module can monitor the corresponding confirmation key event. When a control obtains focus, for example, a control triggers a hover event or a control triggers a focus event, the display device 200 can determine that the confirmation key event is a click event, and the control that obtains focus needs to respond to the confirmation key event. In the case where the key focus and the cursor indicate different controls respectively, that is, when there are two controls that obtain focus, in order to avoid the problem of conflicting responses to the confirmation key event, the display device can be configured to fix the control indicated by the cursor or the control indicated by the key focus to respond to the event corresponding to the key code data. However, the control indicated by the cursor or the control indicated by the key focus may not be the control that the user wants to control. Therefore, fixing the control indicated by the cursor or the control indicated by the key focus to respond to the event corresponding to the key code data may not accurately meet the actual needs of the user.

[0105] In order to solve the above problems, the display device 200 provided in the embodiment of the present application is configured to manage the focused controls, so that when the key focus and the cursor indicate different controls respectively, not only can the response conflict to the confirmation key event be avoided, but the control that the user wants to control can also respond to the confirmation key event to meet the actual needs of the user.

[0106] Figure 6 A flowchart of a display device 200 managing focus is provided in an embodiment of the present application, such as Figure 6 The specific steps are as follows:

[0107] Step S601: receiving first coordinate data sent by the remote control when the remote control points to a first position in a three-dimensional space, and receiving key code data of a first direction key sent by the remote control.

[0108] The display device 200 can display an operation interface through the display 260. This operation interface is used to display the page of the application program (hereinafter referred to as "application") running in the foreground. For example, after the display device 200 is started, the application running in the foreground is the home application, and the display device 200 displays the home application in the operation interface. For another example, after the display device 200 opens a media resource application, the application running in the foreground is the media resource application, and the display device 200 displays the page of the media resource application, such as the playback page of a movie, in the operation interface.

[0109] The operation interface has a cursor and a key focus. The user can use the pointing function of the remote control 100 to control the position of the cursor on the operation interface by changing the position of the remote control 100 in three-dimensional space. The user can also use the key function of the remote control 100 to control the position of the key focus on the operation interface by pressing the direction keys of the remote control 100.

[0110] In one example, when the remote control 100 points to a first position in three-dimensional space, it calculates first coordinate data based on the first position. The first coordinate data is used to indicate the position of the cursor on the operating interface. The remote control 100 sends the first coordinate data to the display device 200 via a Bluetooth connection.

[0111] In one example, in response to the user pressing the first direction key, the remote controller 100 sends the key code data of the first direction key to the display device 200 via the Bluetooth connection. The first direction key can be any direction key among the up key, down key, left key, and right key.

[0112] Step S602: Based on the first coordinate data, monitoring a hover event triggered by a first control in the operation interface; and based on the key code data of the first direction key, monitoring a focus event triggered by a second control in the operation interface.

[0113] Based on the first coordinate data, the display device 200 can determine the location indicated by the first coordinate data on the operation interface and further determine the control at the location, such as the first control. Based on this, the display device 200 can determine that the cursor is hovering over the first control and monitor the hover event triggered by the first control.

[0114] Based on the key code data of the first direction key, the display device 200 can determine the control to be given key focus in the first direction indicated by the first direction key, such as the second control. Based on this, the display device 200 can determine to move the key focus to the second control and monitor the focus event triggered by the second control.

[0115] Step S603: When a confirmation key event sent by the remote controller is monitored, the control that last triggered the hover event or the focus event among the first control and the second control responds to the confirmation key event.

[0116] When a user wants to control a control, such as clicking a control, they can press a confirmation key on the remote control 100. In response to the user pressing the confirmation key, the remote control 100 sends the key code data of the confirmation key to the display device 200 via the Bluetooth connection. Based on the key code data of the confirmation key, the display device 200 can monitor the corresponding confirmation key event.

[0117] The display device 200 may be configured such that the control that last triggered the hover event or the focus event among the first control and the second control responds to the confirmation key event.

[0118] In one example, display device 200 first receives the first coordinate data and then receives the key code data for the first directional key. In other words, the user first controls the cursor to the first control by changing the position of remote control 100 in three-dimensional space, and then controls the focus to the second control by pressing the first directional key on remote control 100. Based on this, the control that last triggered the hover event or focus event between the first and second controls is the second control.

[0119] In another example, display device 200 first receives the key code data for the first directional key and then receives the first coordinate data. In other words, the user first presses the first directional key on remote control 100 to control the focus to move to the second control, and then changes the position of remote control 100 in three-dimensional space to control the cursor to move to the first control. Based on this, the control that last triggered the hover event or focus event between the first and second controls is the first control.

[0120] It can be seen from this that the control that last triggered the hover event or focus event among the first and second controls corresponds to the control indicated by the user's most recent cursor manipulation or key focus. The control indicated by the user's most recent cursor manipulation or key focus is usually the control focused by the user, that is, the control the user wants to control. Therefore, the control that last triggered the hover event or focus event among the first and second controls responds to the confirmation key event, that is, the control indicated by the user's most recent key focus or cursor manipulation responds to the confirmation key event, which can ensure that the control the user wants to control responds to the confirmation key event, which meets the user's actual needs.

[0121] In some embodiments, the display device 200 may be configured with a global record that records the most recently selected control. The most recently selected control indicates the control that most recently triggered a hover event or focus event, i.e., the control that the user most recently manipulated with the key focus or cursor. By maintaining the most recently selected control recorded in the global record, the display device 200 can accurately manage the control used to respond to the confirmation key event.

[0122] In some embodiments, the display device 200 may record a global record through a control state processing module, and maintain the latest selected control recorded in the global record.

[0123] In some embodiments, the display device 200 creates a corresponding global record for the application running in the foreground, or the display device 200 maintains the corresponding latest selected control for the application running in the foreground. In other words, the latest selected control recorded in the global record by the display device 200 is the latest selected control in the application running in the foreground.

[0124] In one example, after the display device 200 is started, the application running in the foreground is the homepage application. The display device 200 creates a corresponding global record for the homepage application. The most recently selected control recorded in the global record is the control on the homepage that most recently triggered a hover event or a focus event. If the display device 200 starts a media asset application based on a control on the homepage, the application running in the foreground is the media asset application. The display device 200 creates a corresponding global record for the media asset application. The most recently selected control recorded in the global record is the control on the media asset application page that most recently triggered a hover event or a focus event.

[0125] When the display device 200 manages the control for responding to the confirmation key event by maintaining the latest selected control recorded in the global record, the display device 200 updates the latest selected control recorded in the global record based on the hover event and key event triggered by the control.

[0126] In some embodiments, the display device 200 updates the most recently selected control recorded in the global record to the first control when a hover event is detected by the first control based on the first coordinate data. The display device 200 updates the most recently selected control recorded in the global record to the second control when a focus event is detected by the second control based on the key code data of the first direction key.

[0127] In some embodiments, the display device 200 configures a corresponding style for the most recently selected control, so that the user can quickly identify the key used to respond to the confirmation key event based on the style of the control. The style of the most recently selected control may include a specific background color, border effect, size, etc.

[0128] Figure 7A and Figure 7B A schematic diagram of the control style provided in an embodiment of the present application.

[0129] like Figure 7A As shown, a cursor 72 is hovering over control 71, and a hover event is triggered by control 71, and the border of control 71 becomes thicker. A key focus is displayed on control 73, and a focus event is triggered by control 73, and the background color of control 73 changes to gray. If the latest selected control is control 71, the size of control 71 is enlarged. If the latest selected control is control 73, as shown Figure 7B As shown, the size of the control 73 is enlarged.

[0130] In some embodiments, when the display device 200 monitors a confirmation key event, it reads the latest selected control recorded in the global record, and the latest selected control responds to the confirmation key event. In this way, the control indicated by the key focus or cursor that was most recently manipulated by the user can respond to the confirmation key event.

[0131] Different scenarios in which the display device 200 manages focus and responds to confirmation key events are described with reference to the following examples.

[0132] Figure 8 This is a timing diagram of a first example of the display device 200 managing focus and responding to a confirmation key event provided by an embodiment of the present application.

[0133] In the first example, the user changes the position pointed by the remote control 100 in the three-dimensional space to the first position, and the remote control 100 calculates the first coordinate data based on the changed first position, and sends the first coordinate data to the display device 200 via the Bluetooth connection. The display device 200 receives and parses the first coordinate data through the Bluetooth driver, and passes the first coordinate data to the UI state management module, so that the UI state management module determines the position of the cursor hovering on the operation interface based on the first coordinate data, and determines the control in the operation interface that triggers the hover event based on the hovering position, such as the first control. The UI state management module sends a notification of the hover event triggered by the first control to the control state processing module. The control state processing module listens to the hover event triggered by the first control according to the notification, and after listening to the hover event triggered by the first control, it updates the latest selected control recorded in the global record to the first control, and calls the business logic processing module to perform corresponding business processing. The business logic processing module generates UI data indicating the updated style of the first control, and sends the UI data and a UI update notification to the UI rendering engine. The UI engine re-renders and draws the first control according to the UI update notification to display a cursor on the first control and display the first control as an effect of triggering a hover event.

[0134] When a hover event is triggered by a first control, if the user presses the first direction key of the remote control 100, the remote control 100 sends the key code data of the first direction key to the display device 200 via a Bluetooth connection. The display device 200 receives and parses the key code data of the first direction key through the Bluetooth driver and passes the key code data of the first direction key to the UI state management module. The UI state management module determines the second control that has obtained the key focus based on the key code data of the first direction key and sends a notification to the control state processing module that the second control has obtained the key focus. After monitoring the focus event triggered by the second control based on the notification, the control state processing module updates the most recently selected control recorded in the global record to the second control. The control state processing module calls the business logic processing module to perform corresponding business processing. The business logic processing module generates UI data that indicates the updated style of the second control and sends the UI data and a UI update notification to the UI rendering engine. The UI engine re-renders and draws the second control based on the UI update notification to display the key focus on the second control and display the second control as the effect of triggering the focus event.

[0135] In the case where the second control triggers a focus event, if the user presses the confirmation key of the remote control 100, the remote control 100 sends the key code data of the confirmation key to the display device 200 via the Bluetooth connection, and the display device 200 receives and parses the key code data of the confirmation key through the Bluetooth driver, and passes the key code data of the confirmation key to the UI state management module. The UI state management module generates a confirmation key event based on the key code data of the confirmation key, and sends the confirmation key event to the control state processing module. When the control state processing module monitors the confirmation key event, it reads the latest selected control recorded in the global record (this is the second control), and controls the second control to respond to the confirmation key event. The control state processing module calls the business logic processing module to perform corresponding business processing. For example, if clicking the second control corresponds to opening the page associated with the second control, the business logic processing module controls the startup of the page associated with the second control, and sends the UI data and UI update notification of the page to the UI rendering engine. The UI engine renders and draws the page associated with the second control according to the UI update notification.

[0136] Among them, in the case where the first control triggers a hover event, if the user presses the confirmation key of the remote control 100, the display device 200 responds to the confirmation key event with the latest selected control recorded in the global record (this is the first control) after receiving the key code data of the confirmation key sent by the remote control 100. This process can be referred to Figure 8 The 803 part is not described here.

[0137] Figure 9 This is a timing diagram of a second example of the display device 200 managing focus and responding to a confirmation key event provided by an embodiment of the present application.

[0138] The main difference from the first example is that in the second example, the user first presses the first directional key of the remote control 100 to control the movement of the button focus, and then changes the position pointed to by the remote control 100 in three-dimensional space to the first position. In this case, based on the key code data of the first directional key sent by the remote control 100, the display device 200, after monitoring the triggering of a focus event by the second control and updating the most recently selected control recorded in the global record to the second control, if the key code data of the confirmation key sent by the remote control 100 is received, the control state processing module reads the most recently selected control recorded in the global record, such as the second control, upon monitoring the confirmation key event, and controls the second control to respond to the confirmation key event. Based on the first coordinate data sent by the remote control 100, after monitoring the triggering of a hover event by the first control and updating the most recently selected control recorded in the global record to the first control, if the key code data of the confirmation key sent by the remote control 100 is received, the control state processing module reads the most recently selected control recorded in the global record, such as the first control, upon monitoring the confirmation key event, and controls the first control to respond to the confirmation key event.

[0139] When the display device 200 moves the key focus based on the key code data of the direction key sent by the remote control 100, if the key focus is moved based on the control that currently obtains the key focus, or the key focus is moved based on the control that currently obtains the cursor, the key focus may not be accurately moved to the control that the user wants to control.

[0140] In order to solve the above problems, the display device 200 provided in the embodiment of the present application is configured to manage the focused controls, so that when the key focus and the cursor indicate different controls respectively, one control can be flexibly selected as the basis for moving the key focus, so as to move the key focus to the control that the user wants to control, thereby facilitating the user to quickly control the control that he wants to control.

[0141] Figure 10 Another flow chart of a display device 200 managing focus provided in an embodiment of the present application is as follows: Figure 10 The specific steps are as follows:

[0142] Step S1001: receiving key code data of a first direction key sent by a remote controller.

[0143] When the user wants to move the button focus, taking the user pressing the first direction key on the remote control 100 as an example, the remote control 100 sends the key code data of the first direction key to the display device 200 via the Bluetooth connection. Correspondingly, the display device 200 can receive and parse the key code data of the first direction key through the Bluetooth driver.

[0144] Step S1002: When a hover event is detected by the first control and a focus event is detected by the second control, a first focus update event is detected based on the key code data of the first direction key.

[0145] The display device 200 monitors a hover event triggered by the first control and a focus event triggered by the second control, that is, the first control obtains a cursor and the second control obtains a key focus.

[0146] The display device 200 determines a first focus update event based on the key code data of the first direction key, where the first focus update event indicates updating a position of a key focus on the operation interface.

[0147] Step S1003: using the control that last triggered the hover event or focus event among the first control and the second control as a reference for moving the key focus, a third control to be triggered in the first direction is determined.

[0148] In response to the first focus update event, the display device 200 determines a third control to be triggered in the first direction for a focus event, taking the control of the first and second controls that last triggered a hover event or a focus event as a basis for moving the key focus. The first direction corresponds to the first direction key. For example, the first direction key is the right key, and the first direction is right. The third control to be triggered for a focus event is also the control to be given key focus. The control of the first and second controls that last triggered a hover event or a focus event corresponds to the control indicated by the user's most recent cursor manipulation or key focus, that is, the control focused by the user. By moving the key focus based on the control that last triggered a hover event or a focus event, the key focus can be moved to the control that the user wants to control, so as to meet the actual needs of the user.

[0149] by Figure 5 Taking the operation interface shown as an example, the hover event is triggered by control 51 and the focus event is triggered by control 53. The display device 200 is based on the key code data of the first direction key sent by the remote control 100, such as the key code data of the right key. If the control that last triggered the hover event or the focus event was control 51, the display device 200 can determine that the control to trigger the focus event in the right direction is control 54 based on control 51.

[0150] Step S1004: When a focus event is detected to be triggered by the third control, the key focus is updated and displayed on the third control.

[0151] When the display device 200 monitors that the third control triggers a focus event, it displays the key focus on the third control and displays the third control as the effect of triggering the focus event. Thus, the user determines that the key focus has been moved to the third control based on the display style of the third control.

[0152] In some embodiments, the display device 200 can manage the control that serves as the basis for moving the key focus by maintaining the most recently selected control recorded in the global record. Based on this, when the display device 200 monitors the first focus update event, it reads the most recently selected control recorded in the global record and uses the most recently selected control recorded in the global record as the basis for moving the key focus to determine the third control to trigger the focus event in the first direction.

[0153] In some embodiments, when the display device 200 detects a focus event triggered by a third control, it updates the most recently selected control recorded in the global record to the third control. In this way, the accuracy of the most recently selected control recorded in the global record can be guaranteed. At this time, if the display device 200 detects a confirmation key event, the most recently selected control recorded in the global record (such as the third control) can respond to the confirmation key event; if the display device 200 detects a focus update event again, the key focus can be moved based on the most recently selected control recorded in the global record (such as the third control).

[0154] Different scenarios in which the display device 200 manages focus and responds to focus update events are described with reference to the following examples.

[0155] Figure 11 This is a timing diagram of a first example of the display device 200 managing focus and responding to a focus update event provided by an embodiment of the present application.

[0156] In the first example, the display device 200 first detects a hover event triggered by the first control, and then detects a focus event triggered by the second control. Based on this, the display device 200 records the second control as the most recently selected control in the global record. At this point, upon detecting that the user has pressed the first direction key, the remote control 100 sends the key code data for the first direction key to the display device 200 via a Bluetooth connection. The display device 200 receives and parses the key code data for the first direction key via the Bluetooth driver and passes it to the UI state management module. The UI state management module generates a corresponding first focus update event based on the key code data for the first direction key and passes it to the control state processing module. Upon detecting the first focus update event, the control state processing module reads the most recently selected control recorded in the global record (in this case, the second control) and moves the key focus to the third control in the first direction, based on the second control. Upon detecting a focus event triggered by the third control, the control state processing module updates the most recently selected control recorded in the global record to the third control and calls the business logic processing module to perform the corresponding business processing. The business logic processing module generates UI data for the third control, which indicates the updated style of the third control, and sends the UI data and a notification to update the third control to the UI rendering engine. The UI engine re-renders and draws the third control according to the notification to display the key focus on the third control and display the third control as an effect of triggering a focus event.

[0157] In the second example, the main difference from the first example is that display device 200 first listens for a focus event triggered by the second control, and then listens for a hover event triggered by the first control. Based on this, the most recently selected control recorded in the global record by display device 200 is the first control. When the control state processing module listens for the first focus update event, it reads the most recently selected control recorded in the global record (in this case, the first control) and moves the key focus to the third control in the first direction based on the first control.

[0158] In some embodiments, different default focus rules are configured for different types of pages, and the default focus rules indicate whether a default control is configured for the corresponding page, where the default control is the control that obtains the key focus by default when the page is opened, and when a default control is configured, indicates the control configured as the default control or indicates the determination rule of the default focus.

[0159] In some embodiments, the application configures corresponding default focus rules for the associated page, and the default focus rules are stored in the application's corresponding configuration file. Thus, the application can configure default focus rules in a targeted manner based on design requirements, such as configuring default controls on a specific page. The application can be a native application of the display device 200 or a third-party application.

[0160] In some embodiments, the display device 200 configures default focus rules at the operating system level, which are stored in a system configuration file. Thus, the display device 200 can configure default controls for pages provided by different applications based on the unified default focus rules.

[0161] In some embodiments, when both the application and the display device 200 are configured with default focus rules, the default controls in the page can be determined based on the priority, in accordance with the default focus rule with a higher priority. In one example, the priority of the default focus rule configured by the application is higher than the priority of the default focus rule configured by the display device 200. In another example, the priority of the default focus rule configured by the display device 200 is higher than the priority of the default focus rule configured by the application. In this way, not only can the problem of conflict in determining the default controls be avoided when both the application and the display device 200 are configured with default focus rules, but it can also ensure that when one party does not configure a default focus rule, the default controls can still be configured according to the default focus rule configured by the other party.

[0162] In some embodiments, for pages that are difficult for users to quickly select the desired control, such as pages with rich page content, that is, pages containing many controls, the default focus rule can indicate the configuration of a default control for such pages and indicate the rules for determining the default focus. The default focus determination rule can be: determining the default focus based on one or a combination of conditions such as the recommendation level of the control's associated content, the user's preference for the control, and the distribution of the control.

[0163] In some embodiments, for pages that are not convenient for users to manipulate the cursor to select controls, such as pages with less content, smaller controls, or controls that are distributed more remotely on the page, the default focus rule can indicate that a default control is configured for such pages, and indicates a rule for determining the default focus. The rule for determining the default focus can be: determining the default focus based on one or a combination of conditions such as the default first position on the page (such as the upper left corner of the page), the recommendation level of the control (such as a control with a higher recommendation level in a pop-up window for confirming information), and the like.

[0164] In some embodiments, for some floating pages, such as pop-up windows, menus, etc., if the display device 200 is configured to close the current floating page in response to a confirmation key event when no focus event triggered by a control and no hover event triggered by a control are monitored, that is, no control obtains key focus and no control obtains a cursor, the default focus rule may indicate that a default control is not configured for this type of page.

[0165] Figure 12Another flow chart of a display device 200 managing focus provided in an embodiment of the present application is as follows: Figure 12 The specific steps are as follows:

[0166] Step S1201: receiving first coordinate data and a page start instruction sent by the remote control when the remote control points to a first position in a three-dimensional space.

[0167] When the remote control points to any position (such as the first position) in three-dimensional space, the user can send a page start instruction to the display device 200 based on a button (such as the setting button) on the remote control 100 to instruct the display device 200 to open the corresponding page.

[0168] Step S1202 : In response to the page start instruction, display the first page in the operation page, and after displaying the first page, monitor the focus event triggered by the control in the first page based on the configuration information of the default control in the first page.

[0169] The display device 200 displays a corresponding page, such as the first page, in response to the page start instruction.

[0170] In some embodiments, the first page can be a page of an application (such as the home page of the application displayed after starting the application, the page jumped to by clicking the control in the application page, etc.), a menu (such as a setting menu, shortcut menu, etc. displayed based on the menu key, setting key, etc. on the remote control 100), a pop-up window, a sidebar, etc., and this application does not impose any restrictions on them.

[0171] After displaying the first page, the display device 200 determines a default focus rule corresponding to the first page, and determines a default control in the first page based on the default focus rule, and obtains configuration information of the default control in the first page.

[0172] In some embodiments, when it is determined that a default control is configured in the first page based on the default focus rule, the configuration information of the default control includes the control configured as the default control. Based on the configuration information of the default control, the default control in the first page can be determined, and the focus event triggered by the default control can be monitored, that is, the default control obtains the key focus.

[0173] In some embodiments, when it is determined based on the default focus rule that the first page does not include a default control, the configuration information of the default control includes no default control. Based on the configuration information of the default control, it can be determined that there is no default control in the first page, and the focus event triggered by the default control will not be monitored. In other words, no control in the first page obtains key focus.

[0174] Step S1203: Based on the first coordinate data, monitor a hover event triggered by a control on the first page.

[0175] The display device 200 may determine, based on the first coordinate data, the position (also referred to as the initial position) at which the cursor is first displayed in the operation interface after the first page is opened.

[0176] In some embodiments, when the first page includes a control located at the initial position, the display device 200 may monitor a hover event triggered by the control in the first page, that is, obtain a cursor from the control in the first page.

[0177] In some embodiments, when the first page does not include a control located at the initial position, the display device 200 will not monitor the hover event triggered by the control in the first page, that is, no control in the first page obtains the cursor.

[0178] Step S1204: Based on the first monitoring result of monitoring the focus event and the second monitoring result of monitoring the hover event, the latest selected control recorded in the global record is updated.

[0179] In some embodiments, when the second monitoring result is that no hover event triggered by the control is monitored, and the first monitoring result is that a focus event triggered by the default control is monitored, that is, when no control obtains the cursor in the first page and the default control obtains the key focus, the latest selected control recorded in the global record is updated to the default control.

[0180] In some embodiments, when the second monitoring result is that no hover event triggered by the control is monitored, and the first monitoring result is that no focus event triggered by the control is monitored, that is, no control obtains the cursor in the first page, and no control obtains the key focus, the latest selected control recorded in the global record is updated to empty.

[0181] In some embodiments, when the second monitoring result is a hover event triggered by an initial control on the first page, that is, when a control on the first page receives the cursor, the most recently selected control recorded in the global record is updated to the initial control. The initial control is the control at the initial position on the first page. The default control may receive the key focus, or no control may receive the key focus.

[0182] Therefore, after starting the first page, the display device 200 can accurately update the latest selected control recorded in the global record based on whether a default key in the first page obtains key focus and whether the cursor indicates a control in the first page.

[0183] Step S1205: monitoring a second focus update event based on the key code data of the second direction key sent by the remote controller.

[0184] The second focus update event indicates updating the position of the button focus in the first page.

[0185] Step S1206: Read the latest selected control recorded in the global record.

[0186] Step S1207 : Using the latest selected control recorded in the global record as a basis for moving the key focus, a fourth control in the first page to trigger a focus event in the second direction is determined.

[0187] The second direction corresponds to the second direction key.

[0188] Step S1208: When a focus event is detected to be triggered by the fourth control, the key focus is updated and displayed on the fourth control in the first page.

[0189] Steps S1205 to S1208 are similar to steps S1002 to S1004 and are not described in detail here.

[0190] In the case where the most recently selected control is the default control, the key focus is moved in the second direction based on the default control. In the case where the most recently selected control is the initial control, the key focus is moved in the second direction based on the initial control. In the case where the most recently selected control is empty, the control that receives the key focus on the first page can be determined based on the second direction and the focus acquisition rule corresponding to the first page.

[0191] Based on step S1208 , after monitoring the focus event triggered by the fourth control, the display device 200 updates the latest selected control recorded in the global record to the fourth control.

[0192] In this way, after launching the first page, the display device 200 can determine the most recently selected control on the first page after launching the first page based on the configuration information of the default controls on the first page and the position of the remote control in three-dimensional space, and update the global record. At this time, if the second focus update event is monitored, the display device 200 will move the key focus based on the most recently selected control recorded in the global record, so as to move the key focus to the control that the user wants to control.

[0193] In some embodiments, after the display device 200 moves the button focus to the fourth control, if it receives the key code data of the third direction key sent by the remote control 100, that is, the user wants to continue to move the button focus, the display device 200 can monitor the third focus update event, which indicates the update of the button focus position in the first page. The display device 200 reads the latest selected control recorded in the global record. At this time, the latest selected control is the fourth control, and uses the latest selected control recorded in the global record as the basis for moving the button focus to determine the fifth control in the first page to trigger the focus event in the third direction. The third direction corresponds to the third direction key, that is, the display device 200 moves the button focus based on the fourth control. When the display device 200 monitors the focus event triggered by the fifth control, it updates the button focus to the fifth control in the first page. The above process is similar to steps S1205 to S1208 and will not be repeated here.

[0194] In some embodiments, after the display device 200 moves the key focus to the fourth control, if it receives second coordinate data sent by the remote control 100 when pointing to a second location in three-dimensional space, indicating that the user intends to move the cursor, the display device 200 can determine the sixth control on the first page that the remote control 100 is pointing to based on the second coordinate data and update the most recently selected control recorded in the global record to the sixth control. At this point, if the display device 200 receives key code data for the fourth directional key sent by the remote control 100, indicating that the user intends to move the key focus, the display device 200 can monitor for a fourth focus update event, which indicates an update to the key focus position on the first page. The display device 200 reads the most recently selected control recorded in the global record, which is now the sixth control. Using the most recently selected control recorded in the global record as a basis for moving the key focus, the display device 200 determines the seventh control on the first page that is to trigger a focus event in the fourth direction. The fourth direction corresponds to the fourth directional key. In other words, the display device 200 moves the key focus based on the sixth control. Upon monitoring the focus event triggered by the seventh control, the display device 200 updates the key focus to the seventh control on the first page. The above process is similar to steps S1205 to S1208 and will not be repeated here.

[0195] Figure 13 This is a timing diagram of the display device 200 provided in an embodiment of the present application displaying the key focus after starting the menu. Figure 14 This is a schematic diagram of an interface for moving the button focus in a menu provided by an embodiment of the present application. Figure 13 and Figure 14 , taking the first page as the menu as an example, the above process of moving the key focus is explained exemplarily. Figure 13As shown, when the remote controller 100 points to the position P1 in the three-dimensional space, the user sends a page start instruction to the display device 200 based on the setting key on the remote controller 100, and sends the coordinate data corresponding to the position P1 to the display device 200. The display device 200 responds to the page start instruction by the control state processing module, and controls the display after starting the menu application. Figure 14 The first-level menu 141 in the display device 200 is displayed, and the controls in the first-level menu 141 (such as control A, control B, control C and control D) are initialized. If the default control included in the first-level menu 141 is control A, it can be monitored that control A obtains the key focus. The process in which the display device 200 monitors the hover event triggered by the control based on the coordinate data corresponding to P1 ( Figure 13 (not shown) can refer to Figure 8 Part 801 in the operation interface will not be described in detail here. If there is no control at the initial position mapped to P1 in the operation interface, the control state processing module will not monitor the hover event triggered by the control in the first-level menu 141. The cursor is drawn and displayed by the UI rendering engine at the initial position. The control state processing module updates the latest selected control recorded in the global record to control A. The control state processing module calls the business logic processing module to perform corresponding business processing. The business logic processing module generates UI data, which includes the data of the updated style of control A and the sub-page data associated with control A, and sends the UI data and UI update notification to the UI rendering engine. The UI engine re-renders and draws control A according to the UI update notification to display the key focus on control A, and displays control A as the effect of triggering the focus event, and displays the sub-page associated with control A on the right side of the first-level menu 141. If the user presses the down key of the remote control 100, the display device 200 moves the key focus down to control B based on the key code data of the down key sent by the remote control 100 and the latest selected control (control A at this time) as the reference. Figure 11 The process shown is similar and will not be described here. When control B has an associated sub-page, such as Figure 14 As shown, the subpage associated with control B, namely, the secondary menu 142 (including controls B1 to B8), is displayed on the right side of the primary menu 141. After monitoring the focus event triggered by control B, the display device 200 updates the latest selected control recorded in the global record to control B.

[0196] After the display device 200 moves the key focus to control B, if the user presses the right key of the remote control 100, the display device 200 generates a focus transfer event based on the key code data of the right key sent by the remote control 100. The focus transfer event indicates that the subpage of control B obtains the key focus, and transmits the focus transfer event to the control state processing module. The control state processing module initializes the subpage of control B and determines that the default control configured for the subpage is control B1. After listening to the focus event triggered by control B1, the control state processing module updates the latest selected control recorded in the global record to control B1, and calls the business logic processing module to perform corresponding business processing to display the key focus on control B1. This process is the same as Figure 11 The process shown is similar and will not be repeated here.

[0197] Furthermore, after the display device 200 moves the key focus to the control B1, if the user presses the confirmation key of the remote control 100, the display device 200, through the control state processing module, responds to the confirmation key event by the newly selected control (this time, the control B1). The above process is the same as Figure 8 The process in section 803 is similar and will not be described in detail here. The control state processing module calls the business logic processing module to perform corresponding business processing, such as turning on the switch corresponding to the control B1.

[0198] After the display device 200 moves the button focus to control B, if the user changes the remote control 100 to point to position P2 in the three-dimensional space, the display device 200 updates the latest selected control recorded in the global record to control B5 when the control state processing module monitors the hover event obtained by control B5 based on the coordinate data corresponding to P2. The above process is the same as Figure 8 The process shown in part 801 is similar and will not be repeated here. The control state processing module calls the business logic processing module to perform corresponding business processing to display the cursor M on the control B5 and display the control B5 as the effect of triggering the hover event.

[0199] After the display device 200 moves the cursor to the control B5, if the user presses the confirmation key of the remote control 100, the display device 200 uses the control state processing module to monitor the confirmation key event, and the newly selected control (this time is control B5) responds to the confirmation key event. The above process is the same as Figure 8 The process shown in part 803 is similar and will not be described here in detail. The control state processing module calls the business logic processing module to perform corresponding business processing, such as turning on the switch corresponding to the control B5.

[0200] After the display device 200 moves the cursor to the control B5, if the user presses the down key of the remote control 100, the display device 200, based on the key code data of the down key, moves the key focus downward to the control B6 based on the latest selected control (control B5 in this case) when the control state processing module monitors the focus transfer event. The above process is the same as Figure 11 The process shown is similar and will not be described here. When control B6 has an associated sub-page, such as Figure 14 As shown, the subpage associated with control B6, namely, the third-level menu 143 (including controls B61 to B65), is displayed on the right side of the second-level menu 142. After monitoring the focus event triggered by control B6, the display device 200 updates the latest selected control recorded in the global record to control B6.

[0201] Figure 15 Another flow chart of a display device 200 managing focus is provided in an embodiment of the present application, as shown in FIG. Figure 15 The specific steps are as follows:

[0202] Step S1501: receiving first coordinate data sent by the remote control when the remote control points to a first position in a three-dimensional space, and receiving a page start instruction sent by the remote control.

[0203] Step S1502 : in response to the start page instruction, display the first page in the operation interface, and after displaying the first page, monitor the focus event triggered by the control in the first page based on the configuration information of the default control in the first page.

[0204] Step S1503: Based on the first coordinate data, monitor a hover event triggered by a control on the first page.

[0205] Step S1504: Based on the first monitoring result of monitoring the focus event and the second monitoring result of monitoring the hover event, the latest selected control recorded in the global record is updated.

[0206] Steps S1501 to S1504 are similar to steps S1201 to S1204 and are not described in detail here.

[0207] Step S1505: When a confirmation key event sent by the remote controller is monitored, the latest selected control recorded in the global record responds to the confirmation key event.

[0208] In this way, after launching the first page, the display device 200 can determine the most recently selected control on the first page after launching the first page based on the configuration information of the default controls on the first page and the position pointed to by the remote control in three-dimensional space, and update the most recently selected control recorded in the global record. The most recently selected control is the control that the user wants to control on the first page after launching the first page. At this time, if a confirmation key event is monitored, the display device 200 will respond to the confirmation key event with the most recently selected control recorded in the global record, so that the control that the user wants to control responds to the confirmation key event.

[0209] In some embodiments, when the most recently selected control recorded in the global record is a default control, the default control responds to the confirmation key event.

[0210] In some embodiments, when the most recently selected control recorded in the global record is the initial control, the initial control responds to the confirmation key event.

[0211] In some embodiments, when the most recently selected control recorded in the global record is empty, the positional relationship between the first position mapped to the cursor position in the operation interface and the first page is determined. If the positional relationship is that the cursor position is within the first page, the first page is kept displayed in the operation interface. If the positional relationship is that the cursor position is outside the first page, the first page is closed in response to a confirmation key event. In this way, when no control has obtained key focus and the cursor does not indicate a control in the first page, the confirmation key event can be responded to based on the position between the cursor and the first page.

[0212] In some embodiments, if the most recently selected control in the global record is empty, based on the key code data of the first directional key sent by the remote control, upon detecting a focus event triggered by the first control on the first page, the most recently selected control in the global record is updated to the first control. In other words, the user can first move the key focus to the control on the first page by manipulating the remote control 100. Upon detecting a confirmation key event sent by the remote control 100, the display device 200 reads the most recently selected control in the global record, and the most recently selected control in the global record responds to the confirmation key event. In this way, if no control has key focus and the cursor is not pointing to a control on the first page, the display device 200 can, in response to the key code data of the first directional key sent by the remote control 100, control the first control on the first page to receive key focus by default, and update the most recently selected control in the global record. In this case, if a confirmation key event is detected, the first control will respond to the confirmation key event. Thus, the user can manipulate the control on the first page using the directional keys on the remote control 100 to obtain key focus, thereby further controlling the control on the first page.

[0213] In some embodiments, if the most recently selected control in the global record is empty, based on the second coordinate data sent when the remote control 100 points to a second location in three-dimensional space, a hover event triggered by the second control on the first page is detected, and the most recently selected control in the global record is updated to the second control. In other words, the user can first move the cursor to the control on the first page by manipulating the remote control 100. When the display device 200 detects a confirmation key event sent by the remote control 100, it reads the most recently selected control recorded in the global record, and the most recently selected control in the global record responds to the confirmation key event. In this way, if no control has key focus and the cursor is not pointing to a control on the first page, the display device 200 can control the second control on the first page to receive key focus by default based on the new location pointed to by the remote control in three-dimensional space, and update the most recently selected control in the global record. At this point, if a confirmation key event is detected, the second control will respond to it. Thus, the user can manipulate the control on the first page by changing the location pointed by the remote control 100 to obtain the cursor, thereby further controlling the control on the first page.

[0214] Taking the first page as a floating page (such as a pop-up window) as an example, the following examples illustrate different scenarios in which the display device 200 manages focus and responds to confirmation key events after starting the first page.

[0215] Figure 16 This is a timing diagram of a first example of the display device 200 managing focus and responding to a confirmation key event after starting the first page provided by an embodiment of the present application.

[0216] In the first example, the display device 200 responds to the page start instruction sent when the remote controller 100 points to the position P1 in the three-dimensional space, and the control state processing module controls the display of the following Figure 17 The pop-up window 171 shown in FIG. 171 is displayed, and the focus event and hover event triggered by the control in the pop-up window 171 are monitored. If a default control, such as a cancel control, is configured in the pop-up window 171, and there is no control located at the initial position mapped to the operation interface by P1 in the pop-up window 171, the state processing module updates the latest selected control recorded in the global record to the cancel control after monitoring the focus event triggered by the cancel control, and calls the business logic processing module to update the cancel control to the effect of obtaining the key focus, such as Figure 17 The background color of the cancel control is gray, and the cursor 172 is displayed on the area outside the pop-up window 171. Figure 13The process shown in part 1301 is similar and will not be repeated here. After the display device 200 receives the key code data of the confirmation key sent by the remote control 100, the control state processing module will respond to the confirmation key event by the latest selected control recorded in the global record (this is the cancel control) to call the business logic processing module to execute the corresponding business to exit the pop-up window 171. The above process is the same as Figure 8 The process shown in part 803 is similar and will not be repeated here.

[0217] Figure 18A and Figure 18B This is a timing diagram of a second example of the display device 200 managing focus and responding to a confirmation key event after starting a first page provided by an embodiment of the present application.

[0218] The main difference from the first example is that in the second example, Figure 19A and Figure 19B As shown, if there is no default control in the pop-up window 191, after the display device 200 starts the pop-up window, it monitors that there is no control in the pop-up window 191 that triggers the focus event and no control that triggers the hover event, and updates the latest selected control recorded in the global record to empty. At this time, when the control state processing module monitors the confirmation key event, it detects the position relationship between the cursor 192 and the pop-up window 191. Figure 19A As shown, the cursor 192 is outside the pop-up window 191, and the control state processing module calls the business logic processing module to execute the corresponding business to close the pop-up window 191. Figure 19B As shown, the cursor 192 is located within the pop-up window 191 , and the control state processing module does not respond to the confirmation key event to keep displaying the pop-up window 191 .

[0219] based on Figure 18A The process shown, as Figure 18B As shown, after the display device 200 detects that no control in the pop-up window 191 triggers a focus event and no control triggers a hover event, and updates the latest selected control recorded in the global record to an empty display device 200, the control state processing module can determine the control that obtains the key focus by default in the pop-up window 191, such as the cancel control, based on the focus obtaining rule of the pop-up window 191 when detecting the focus update event. After detecting that the cancel control triggers a focus event, the control state processing module updates the latest selected control recorded in the global record to the cancel control, and calls the business logic processing module to execute the corresponding business to update the cancel control to the effect of obtaining the key focus.

[0220] After the display device 200 moves the key focus to the cancel control, based on the key code data of the confirmation key sent by the remote control 100, the control state processing module monitors the confirmation key event, and the newly selected control (this time the cancel control) responds to the confirmation key event and calls the business logic processing module to execute the corresponding business to close the pop-up window 191. This process is the same as Figure 8 The process shown in part 803 is similar and will not be repeated here.

[0221] In some embodiments, the display device 200 may be configured with a voice control function, such as a far-field voice function. The display device 200 may configure a voice command indicating the selection of a control to have a higher response priority than the most recently selected control in the global record. After the display device 200 receives a voice command indicating the selection of a control from the user, regardless of whether the most recently selected control in the global record is the control indicated by the voice command, the control indicated by the voice command will respond to the click event corresponding to the voice command.

[0222] In the above embodiments, the control is illustrated as being redrawn and rendered after receiving the cursor or key focus, to update the effect of triggering a hover event or focus event. It is understood that the control will also be redrawn and rendered after losing the cursor or key focus, to update the effect of not triggering a hover event or focus event.

[0223] In the above embodiments, the display device 200 maintains a global record as an example to illustrate the process of managing the most recently selected control by the display device 200. It is understood that the method for managing the most recently selected control is not limited to the above method, and other methods for managing the most recently selected control are within the scope of protection claimed in this application.

[0224] For ease of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion of some embodiments is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Based on the above teachings, various modifications and variations can be obtained. The above embodiments are selected and described to better explain the content of this disclosure, thereby enabling those skilled in the art to better use the embodiments.

Claims

1. A display device, characterized in that: include: a display configured to: display an operation interface having a cursor and a key focus, wherein the position of the cursor on the operation interface is determined by the position of the remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by key code data of a direction key sent by the remote control; The Bluetooth module is configured to: receive first coordinate data sent by the remote controller when the remote controller points to a first position in a three-dimensional space, and receive key code data of a first direction key sent by the remote controller; The controller is configured as: Based on the first coordinate data, monitoring a hover event triggered by a first control in the operation interface; and, based on the key code data of the first direction key, monitoring a focus event triggered by a second control in the operation interface; When a confirmation key event sent by the remote controller is monitored, the control that last triggered the hover event or the focus event among the first control and the second control responds to the confirmation key event.

2. The display device according to claim 1, wherein The controller is further specifically configured to: Based on the first coordinate data, when a hover event triggered by the first control is monitored, updating the latest selected control recorded in the global record to the first control; Based on the key code data of the first direction key, when a focus event triggered by the second control is monitored, the latest selected control recorded in the global record is updated to the second control.

3. The display device according to claim 2, wherein When the controller monitors a confirmation key event sent by the remote controller, the control that last triggered the hover event or the focus event among the first control and the second control responds to the confirmation key event, and is specifically configured as follows: When the confirmation key event is monitored, reading the latest selected control recorded in the global record; The newly selected control responds to the confirmation key event.

4. A display device, characterized in that: include: a display configured to: display an operation interface having a cursor and a key focus, wherein the position of the cursor on the operation interface is determined by the position of the remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by key code data of a direction key sent by the remote control; The Bluetooth module is configured to: receive key code data of the first direction key sent by the remote controller; The controller is configured as: In a case where a hover event is monitored to be triggered by the first control and a focus event is monitored to be triggered by the second control, a first focus update event is monitored based on the key code data of the first direction key, where the first focus update event indicates updating the position of the key focus on the operation interface; Determining a third control to trigger a focus event in a first direction based on the control that last triggered a hover event or a focus event among the first and second controls as a reference for moving the key focus, where the first direction corresponds to the first direction key; When the focus event is detected to be triggered by the third control, the display is controlled to update and display the key focus on the third control.

5. The display device according to claim 4, wherein: The controller determines a third control to be triggered with a focus event in a first direction based on the control that last triggered a hover event or a focus event as a basis for moving the key focus, and is specifically configured as follows: Read the latest selected control recorded in the global record, where the latest selected control recorded in the global record is used to represent the control that last triggered a hover event or a focus event; Taking the latest selected control recorded in the global record as a basis for moving the key focus, determining the third control for which a focus event is to be triggered in the first direction; The controller is further configured to: When the focus event is detected to be triggered by the third control, the latest selected control recorded in the global record is updated to the third control.

6. The display device according to claim 5, wherein: The Bluetooth module is further configured to: receive first coordinate data and a page start instruction sent when the remote controller points to a first position in the three-dimensional space; The controller is further configured to: In response to the page start instruction, control the display to display a first page in the operation page, and after displaying the first page, monitor a focus event triggered by a control in the first page based on configuration information of a default control in the first page, where the default control is a control in the first page that triggers a focus event by default; Based on the first coordinate data, monitoring a hover event triggered by a control on the first page; Based on a first monitoring result of monitoring the focus event and a second monitoring result of monitoring the hover event, updating the latest selected control recorded in the global record; monitoring a second focus update event based on the key code data of the second direction key sent by the remote control, where the second focus update event indicates updating a position of the key focus in the first page; Read the latest selected control recorded in the global record; Determining a fourth control on the first page for triggering a focus event in a second direction based on the most recently selected control recorded in the global record as a basis for moving the key focus, where the second direction corresponds to the second direction key; When the focus event is detected to be triggered by the fourth control, the display is controlled to update and display the key focus on the fourth control in the first page.

7. The display device according to claim 6, wherein: The controller updates the latest selected control recorded in the global record based on a first monitoring result of monitoring the focus event and a second monitoring result of monitoring the hover event, and is specifically configured to: If the second monitoring result is that no hover event triggered by the control is monitored, and the first monitoring result is that a focus event is monitored and triggered by the default control, the latest selected control recorded in the global record is updated to the default control; or If the second monitoring result is that no hover event triggered by the control is monitored, and the first monitoring result is that no focus event triggered by the control is monitored, updating the latest selected control recorded in the global record to empty; or, When the second monitoring result is that a hover event is triggered by the initial control in the first page, the latest selected control recorded in the global record is updated to the initial control.

8. The display device according to claim 6 or 7, characterized in that: After determining a fourth control in the page of the first application that is to trigger a focus event in the second direction, the controller is further configured to: Updating the latest selected control recorded in the global record to the fourth control; The controller is further configured to: monitoring a third focus update event based on key code data of a third direction key sent by the remote control, wherein the third focus update event indicates updating a position of the key focus in the first page; Read the latest selected control recorded in the global record; Determining a fifth control on the first page for triggering a focus event in a third direction, using the most recently selected control recorded in the global record as a basis for moving the key focus, where the third direction corresponds to the third direction key; When the focus event is detected to be triggered by the fifth control, the display is controlled to update and display the key focus on the fifth control in the first page.

9. The display device according to claim 6 or 7, characterized in that: After determining the fourth control in the first page that is to trigger a focus event in the second direction, the controller is further configured to: Updating the latest selected control recorded in the global record to the fourth control; The controller is further configured to: determining, based on second coordinate data sent when the remote control points to a second position in three-dimensional space, a sixth control pointed to by the remote control on the first page; Updating the latest selected control recorded in the global record to the sixth control; monitoring a fourth focus update event based on key code data of a fourth direction key sent by the remote control, wherein the fourth focus update event indicates updating a position of the key focus in the first page; Read the latest selected control recorded in the global record; Determining a seventh control on the first page for triggering a focus event in a fourth direction, using the latest selected control recorded in the global record as a basis for moving the key focus, where the fourth direction corresponds to the fourth direction key; When the focus event is detected to be triggered by the seventh control, the display is controlled to update and display the key focus on the seventh control in the first page.

10. A display device, characterized in that: include: a display configured to: display an operation interface having a cursor and a key focus, wherein the position of the cursor on the operation interface is determined by the position of the remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by key code data of a direction key sent by the remote control; a Bluetooth module configured to: receive first coordinate data sent by the remote controller when the remote controller points to a first position in a three-dimensional space, and receive a page start instruction sent by the remote controller; The controller is configured as: In response to the start page instruction, control the display to display a first page in the operation interface, and after displaying the first page, monitor focus events triggered by controls in the first page based on configuration information of default controls in the first page, where the default controls are controls that trigger focus events by default in the first page; Based on the first coordinate data, monitoring a hover event triggered by a control on the first page; Based on the first monitoring result of monitoring the focus event and the second monitoring result of monitoring the hover event, the latest selected control recorded in the global record is updated; When a confirmation key event sent by the remote controller is monitored, the latest selected control recorded in the global record responds to the confirmation key event.

11. The display device according to claim 10, wherein: The controller updates the latest selected control recorded in the global record based on a first monitoring result of monitoring the focus event and a second monitoring result of monitoring the hover event, and is specifically configured as follows: If the second monitoring result is that no hover event triggered by the control is monitored, and the first monitoring result is that a focus event is monitored and triggered by the default control, the latest selected control recorded in the global record is updated to the default control; or If the second monitoring result is that no hover event triggered by the control is monitored, and the first monitoring result is that no focus event triggered by the control is monitored, updating the selected control recorded in the global record to null; or, In a case where the second monitoring result is that a hover event is triggered by the initial control in the first page, the selected control recorded in the global record is updated to the initial control.

12. The display device according to claim 11, wherein When the controller monitors the confirmation key event sent by the remote controller, the controller responds to the confirmation key event by the latest selected control recorded in the global record, and is specifically configured as follows: When the most recently selected control recorded in the global record is empty, determining a positional relationship between the first position mapped to the cursor position in the operation interface and the first page; If the positional relationship is that the cursor is located within the first page, keeping the first page displayed on the display; If the position relationship is that the cursor is located outside the first page, the first page is closed in response to the confirmation key event.

13. The display device according to claim 11 or 12, characterized in that: The controller is further configured to: When the most recently selected control recorded in the global record is empty, monitoring a focus event triggered by the first control in the first page based on the key code data of the first direction key sent by the remote controller; Updating the latest selected control recorded in the global record to the first control; When a confirmation key event sent by the remote controller is monitored, the latest selected control recorded in the global record is read; The latest selected control recorded in the global record responds to the confirmation key event.

14. The display device according to claim 11 or 12, characterized in that The controller is further configured to: When the most recently selected control recorded in the global record is empty, monitoring a hover event triggered by a second control on the first page based on second coordinate data sent when the remote control points to a second position in three-dimensional space; Updating the latest selected control recorded in the global record to the second control; When a confirmation key event sent by the remote controller is monitored, the latest selected control recorded in the global record is read; The latest selected control recorded in the global record responds to the confirmation key event.

15. A focus management method, characterized in that: The display device according to any one of claims 1 to 3 is applied to display an operation interface, wherein the operation interface has a cursor and a key focus, the position of the cursor on the operation interface is determined by the position pointed to by a remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by key code data of a direction key sent by the remote control; The method comprises: receiving first coordinate data sent by the remote controller when the remote controller points to a first position in a three-dimensional space, and receiving key code data of a first direction key sent by the remote controller; Based on the first coordinate data, monitoring a hover event triggered by a first control in the operation interface; and based on the key code data of the first direction key, monitoring a focus event triggered by a second control in the operation interface; When a confirmation key event sent by the remote controller is monitored, the control that last triggered the hover event or the focus event among the first control and the second control responds to the confirmation key event.

16. A focus management method, characterized in that: The display device according to any one of claims 4 to 9 is applied to display an operation interface, wherein the operation interface has a cursor and a key focus, the position of the cursor on the operation interface is determined by the position pointed to by a remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by key code data of a direction key sent by the remote control; The method comprises: receiving key code data of a first direction key sent by the remote controller; In a case where a hover event is monitored to be triggered by the first control and a focus event is monitored to be triggered by the second control, a first focus update event is monitored based on the key code data of the first direction key, where the first focus update event indicates updating the position of the key focus on the operation interface; Determining a third control to trigger a focus event in a first direction based on the control that last triggered a hover event or a focus event among the first and second controls as a reference for moving the key focus, where the first direction corresponds to the first direction key; When the focus event is detected to be triggered by the third control, the display is controlled to update and display the key focus on the third control.

17. A focus management method, characterized in that: The display device according to any one of claims 10 to 14 is applied to display an operation interface, wherein the operation interface has a cursor and a key focus, the position of the cursor on the operation interface is determined by the position pointed to by a remote control in three-dimensional space, and the position of the key focus on the operation interface is determined by key code data of a direction key sent by the remote control; receiving first coordinate data sent by the remote controller when the remote controller points to a first position in a three-dimensional space, and receiving a page start instruction sent by the remote controller; In response to the start page instruction, control the display to display a first page in the operation interface, and after displaying the first page, monitor focus events triggered by controls in the first page based on configuration information of default controls in the first page, where the default controls are controls that trigger focus events by default in the first page; Based on the first coordinate data, monitoring a hover event triggered by a control on the first page; Based on the first monitoring result of monitoring the focus event and the second monitoring result of monitoring the hover event, the latest selected control recorded in the global record is updated; When a confirmation key event sent by the remote controller is monitored, the latest selected control recorded in the global record responds to the confirmation key event.

Images