Display device and control method therefor

Abstract

The present application relates to the technical field of display devices, and discloses a display device and a control method therefor. The method comprises: when a hovering duration of a display object in a preset area in a user interface reaches a first preset duration and the preset area is associated with customized content, controlling a display to present a functional floating window over the user interface, wherein the functional floating window is used for providing an operation entrance for the customized content; and in response to a first operation of a control device on the operation entrance, controlling the display to display a target display interface corresponding to the customized content. The operation process of a user entering a target display interface can be reduced and the operation efficiency of the user is improved.

Description

A display device and its control method

[0001] Cross-references to related applications

[0002] This application claims priority to Chinese Patent Application No. 202510322913.3, filed on March 18, 2025, entitled "A Display Device and a Control Method Thereof", the entire contents of which are incorporated herein by reference; and Chinese Patent Application No. 202510573545.X, filed on April 30, 2025, entitled "A Display Device and a Method for Controlling the Display and Hiding of a Functional Floating Window", the entire contents of which are incorporated herein by reference. Technical Field

[0003] This application relates to the field of display device technology, and in particular to a display device and its control method. Background Technology

[0004] Point-and-click remotes introduce a completely new interaction method, allowing users to operate the TV screen like a smartphone. There's a pointing switch on the left side of the remote; when turned on, it enters pointing mode, allowing users to operate by pointing or swiping. In other technologies, when a user wants to access a specific application or function using a pointing remote, they need to navigate through several steps, such as from the main interface to the application list, then finding and clicking the target application. This method is cumbersome, especially when there are many applications, requiring users to spend a significant amount of time searching for the target application; the process is tedious and inefficient. Summary of the Invention

[0005] This application provides a display device and its control method, which can reduce the operation process for users to enter the target display interface.

[0006] In a first aspect, a display device is provided, comprising:

[0007] The display is configured to display a user interface, which contains display objects. The position of the display objects on the user interface is determined by the position pointed to by the control device in three-dimensional space.

[0008] The controller connected to the display is configured as follows:

[0009] When the hovering time of the displayed object in the preset area of ​​the user interface reaches the first preset time and the preset area is associated with customized content, the control monitor displays a function floating window on the upper layer of the user interface. The function floating window is used to provide an operation entry point for the customized content. In response to the first operation of the control device on the operation entry point, the control monitor displays the target display interface corresponding to the customized content, which can reduce the operation process for the user to enter the target display interface and improve the user's operation efficiency.

[0010] In some embodiments, when the hovering time of the displayed object within a preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, the controller controls the display to display a functional floating window on top of the user interface, configured as follows:

[0011] When the hovering time of the displayed object within a preset area in the user interface reaches a first preset time, a mapping set is obtained. The mapping set includes: the association relationship between any number of preset areas and customized content; the customized content of the preset area is obtained based on the mapping list, and the display is controlled to present a functional floating window on the upper layer of the user interface. By storing the association relationship through the mapping set, the controller can dynamically associate preset areas with customized content without modifying the underlying code. The mapping set can store different types of customized content, thereby supporting diverse functional requirements. In addition, all association relationships between preset areas and customized content are stored in the mapping set, which facilitates unified management and maintenance.

[0012] In some embodiments, when the hovering time of the displayed object within a preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, the controller controls the display to display a functional floating window on top of the user interface, configured as follows:

[0013] When the hovering time of the displayed object in the preset area of ​​the user interface reaches the first preset time, the mode of the display device is obtained; when the mode is the preset mode and the preset area is associated with customized content, the display is controlled to display a function floating window on the upper layer of the user interface. By judging the mode, it can be ensured that the function floating window is only displayed in the appropriate scenario to avoid interfering with the user's current operation.

[0014] In some embodiments, the controller is further configured to:

[0015] When the displayed object is moved out of the function floating window, or when the display object hovers in the function floating window for a duration longer than a preset time threshold, the display is controlled to hide the function floating window. The preset time threshold is greater than the first preset duration, which can avoid too many interface elements interfering with user operation. By setting the preset time threshold, unnecessary operations are avoided due to unintentional user hovering.

[0016] In some embodiments, the display device further includes: a signal source interface for connecting an external device. When the customized content associated with the preset area is the identifier of the signal source interface, the controller responds to the first operation of the control device on the operation entry and controls the display to display the target display interface corresponding to the customized content. It is configured to: respond to the first operation of the control device on the operation entry and generate a channel switching instruction based on the identifier of the signal source interface, so that the content input by the external device can be displayed on the display. The user can quickly switch the signal source interface through simple operation without entering a complex settings menu.

[0017] In some embodiments, when the customized content associated with the preset area is an application, the controller responds to the first operation of the control device on the operation entry and controls the display to show the target display interface corresponding to the customized content. It is configured to: respond to the first operation of the control device on the operation entry, launch the application, and control the display to show the target display interface corresponding to the application. Users can quickly launch the application through simple operations without having to enter a complex menu.

[0018] In some embodiments, the controller is further configured to:

[0019] When no customized content is associated with the preset area, the control display presents a guide window on top of the user interface. The guide window guides the user to the customized interface, which allows the user to configure the association between the preset area and the customized content. By prompting the user to make the configuration through the guide window, the user can quickly understand the function of the preset area and actively participate in the configuration of the customized content, thus enhancing the user's sense of participation and control.

[0020] In some embodiments, when no custom content is associated with the preset area, the controller controls the display to present a guide window on the top layer of the user interface. This is configured such that when no custom content is associated with the preset area and the number of times the displayed object enters the preset area is less than a preset number, the controller controls the display to present a guide window on the top layer of the user interface. This can prevent the guide window from being displayed when the user does not want to configure the custom content, thus improving the user experience.

[0021] In some embodiments, the controller is further configured to:

[0022] In response to a second operation by the control device on the guide window, the control display presents a customized interface, which includes configuration options corresponding to a preset area. In response to a selection operation by the control device on the configuration options, the control display shows a selection list, which includes at least one option for customized content. In response to a selection operation by the control device on a target option in the selection list, an association relationship is established between the preset area and the customized content corresponding to the target option, and the association relationship is stored in a mapping set. Through the guide window and the customized interface, an intuitive configuration experience is provided, and users can customize the association relationship between the preset area and the customized content.

[0023] In some embodiments, the customized interface further includes a screen mapping view of the display, and the controller is further configured to: in response to a selection operation of the control device for the configuration option, control the display to output a first prompt message in the screen mapping view, the first prompt message being used to prompt the configuration of customized content in a preset area, providing an intuitive configuration experience through the visual interface and prompt message.

[0024] In some embodiments, the controller is further configured to:

[0025] When the control device does not perform a second operation on the guide window and the display device is in a preset mode, the number of times the displayed object enters the preset area is not recorded. The preset modes include at least one of the following: startup navigation mode, factory mode, channel search mode, conference mode, senior citizen mode, children's mode, upgrade mode, and game mode. When the control device does not perform a second operation on the guide window and the display device is not in a preset mode, the number of times the displayed object enters the preset area is recorded. This can intelligently determine whether to record the number of times the displayed object enters the preset area, avoiding recording the number of entries in unnecessary scenarios, affecting the output of the guide window, and thus affecting the configuration of the associated customized content of the preset area.

[0026] In some embodiments, the controller is further configured to:

[0027] When the customized content is a customized application, in response to the application uninstallation operation, the association between the preset area and the application is severed; and the display is controlled to output a prompt box in the preset area. The prompt box includes at least one of the following functions: prompting for the customized application to be uninstalled, outputting reconfiguration options, and prompting whether to automatically repair the customized application. The prompt box provides intuitive operation guidance, improves the user experience, supports users to reconfigure the association between the preset area and the customized content, and also supports automatic repair function, providing a more intelligent interactive experience.

[0028] In some embodiments, the controller is configured to: enable the floating window management service when the pointing function of the control device is enabled; trigger the floating window management service to generate a detection floating window in a preset area, the window level of the detection floating window is higher than the window level of the user interface, the detection floating window is used to detect whether the displayed object has entered the preset area, and monitor the position of the displayed object in real time through the detection floating window to provide a fast interactive response.

[0029] In some embodiments, the controller is further configured to disable the floating window management service when the pointing function of the control device is turned off and the off time reaches a second preset duration, thereby avoiding the problem of repeatedly calling the floating window management service due to the repeated activation of the pointing function.

[0030] In some embodiments, the transparency of the detection floating window is greater than a transparency threshold. Setting the transparency of the detection floating window to a high level does not affect user operation.

[0031] In some embodiments, the area of ​​the detection floating window is smaller than the area of ​​the function floating window. By setting the area of ​​the function floating window to be larger, it can be ensured that the user can operate it easily without accidental touches or difficulty in operation due to the small area.

[0032] In some embodiments, the preset area is located at at least one of the upper left corner, upper right corner, lower left corner, lower right corner, left edge, and right edge of the screen, which can reduce the impact on the user's operation of elements in the user interface.

[0033] In some embodiments, the displayed object is a cursor, and the position of the displayed object on the user interface is the screen coordinates of the cursor on the user interface; the hovering duration of the displayed object within a preset area in the user interface is the duration for which the screen coordinates mapped to the pointing position of the control device remain within the preset area; the controller is further configured to: control the function floating window to continue displaying when the screen coordinates mapped to the pointing position of the control device are removed from the function floating window and are not within the user interface of the display; and close the function floating window when the screen coordinates mapped to the pointing position of the control device are removed from the function floating window but are within the user interface. This allows for the display and hiding of the function floating window based on the position of the screen coordinates mapped to the pointing position of the control device, making the display and hiding of the function floating window more consistent with interaction logic and more intelligent, thereby improving the user experience.

[0034] In some embodiments, after the screen coordinates mapped to the pointing position of the control device detach from the function floating window and are no longer within the user interface of the display, the controller is further configured to: continue displaying the function floating window if the screen coordinates mapped to the pointing position of the control device fall into the function floating window within the delayed closing period of the function floating window; and close the function floating window if the screen coordinates mapped to the pointing position of the control device fall into the user interface and are no longer within the function floating window within the delayed closing period. By setting a delayed closing buffer period, if the user regrets the operation within the delayed closing period, they can quickly return to the operation, reducing the cost of accidental operation. By using the delayed closing period as a transition period, the visual jump caused by the sudden disappearance of interface elements is avoided.

[0035] In some embodiments, the controller is further configured to: continue displaying the function floating window if the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration less than the delayed closing duration and no information is obtained to trigger the function floating window; and close the function floating window if the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration equal to the delayed closing duration and no information is obtained to trigger the function floating window. This allows the window to remain within the window for a short period without triggering the closing action, preventing user interruption due to brief distraction. By combining the delayed closing duration with the trigger action, the controller can more accurately distinguish between "hesitation" and "abandonment" behaviors, thus improving the user experience.

[0036] In some embodiments, the controller is configured to display a function floating window in the user interface when the screen coordinates mapped to the pointing position of the control device remain within a preset area for a first preset duration. This includes: when the screen coordinates mapped to the pointing position of the control device fall into the preset area, obtaining a hover entry event and starting a timer to count down; and when the countdown reaches the first preset duration and no hover exit event is obtained, displaying the function floating window in the user interface. The hover exit event is an event obtained when the screen coordinates mapped to the pointing position of the control device leave the preset area. By using a hover entry / exit event notification mechanism to replace continuous coordinate comparison calculation, the CPU load can be reduced.

[0037] In some embodiments, the controller is further configured to: generate a detection floating window in a preset area when it is obtained that the pointing function of the control device is enabled, wherein the detection floating window is used to detect whether the screen coordinates of the pointing position mapping of the control device fall into or leave the preset area. Detecting the screen coordinates of the pointing position mapping of the control device by using the detection floating window can reduce the overhead of continuously polling the screen coordinates of the pointing position mapping of the control device.

[0038] In some embodiments, the controller is further configured to: generate a hover entry event when the screen coordinates mapped to the pointing position of the control device fall into the detection floating window; and generate a hover exit event when the screen coordinates mapped to the pointing position of the control device leave the detection floating window. Through the event generation mechanism, coordinate judgment can be realized, and response speed can be improved.

[0039] In some embodiments, the detection floating window includes a first area within the user interface and a second area outside the user interface, the first area and the second area being connected. By expanding the boundary of the detection floating window, the detection range is expanded, and interaction can be achieved even when the pointing position of the control device is outside the screen.

[0040] In some embodiments, the controller is further configured to: close the detection floating window when the function floating window is displayed; and close the function floating window when the detection floating window is displayed. This avoids visual clutter caused by the overlapping of the detection and function floating windows, improving the simplicity of the interface.

[0041] In some embodiments, the controller is further configured to: when the screen coordinates mapped to the pointing position of the control device are within the user interface, obtain the screen coordinates of the cursor in the user interface based on the screen coordinates mapped to the pointing position of the control device; when the screen coordinates mapped to the pointing position of the control device are outside the user interface, obtain the screen coordinates when the cursor was last in the user interface, and obtain the screen coordinates of the cursor in the user interface based on the screen coordinates when the cursor was last in the user interface, thereby avoiding the user's sense of disorientation when repositioning.

[0042] In a second aspect, a control method for a display device is provided. The method is applied to the display device, which includes a display for displaying a user interface, the user interface having a display object, the position of the display object on the user interface being determined by a position pointed to by a control device in three-dimensional space; and a controller connected to the display. The method includes:

[0043] When the hovering time of the displayed object in the preset area of ​​the user interface reaches the first preset time and the preset area is associated with customized content, a function floating window is presented on the upper layer of the user interface. The function floating window is used to provide an operation entry point for the customized content. The position of the displayed object on the user interface is determined by the position pointed to by the control device in three-dimensional space. In response to the first operation of the control device on the operation entry point, the target display interface corresponding to the customized content is displayed.

[0044] This application provides a control method for a display device. When the hovering time of a display object in a preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, the display is controlled to display a functional floating window on the upper layer of the user interface. The functional floating window is used to provide an operation entry point for the customized content. In response to the first operation of the control device on the operation entry point, the display is controlled to display the target display interface corresponding to the customized content. This can reduce the operation process for the user to enter the target display interface and improve the user's operation efficiency.

[0045] In some embodiments, the display object is a cursor, and the position of the display object on the user interface is the screen coordinates of the cursor on the user interface; the hovering duration of the display object within a preset area in the user interface is the duration for which the screen coordinates mapped to the pointing position of the control device remain within the preset area, and the control method of the display device further includes:

[0046] Even if the screen coordinates mapped to the pointing position of the control device are removed from the function floating window and are no longer within the user interface of the display, the control function floating window continues to be displayed.

[0047] Close the function window if the screen coordinates mapped to the pointing position of the control device are detached from the function window but within the user interface.

[0048] This application provides a control method for a display device, which can control the display and hiding of a functional floating window. The method displays the functional floating window in the operation interface when the screen coordinates mapped to the pointing position of the control device remain within a preset area for a first preset time. The functional floating window provides an entry point for customized content. When the screen coordinates mapped to the pointing position of the control device leave the functional floating window and are no longer within the operation interface of the display, the functional floating window continues to be displayed. When the screen coordinates mapped to the pointing position of the control device leave the functional floating window but are still within the operation interface, the functional floating window is closed. This method controls the display and hiding of the functional floating window based on the position of the screen coordinates mapped to the pointing position of the control device, making the display and hiding of the functional floating window more consistent with interactive logic and more intelligent, thereby improving the user experience. Attached Figure Description

[0049] Figure 1 illustrates an operational scenario between a display device and a control device according to some embodiments;

[0050] Figure 2 shows a hardware configuration block diagram of a control device 100 according to some embodiments;

[0051] Figure 3 shows a hardware configuration block diagram of a display device 200 according to some embodiments;

[0052] Figure 4 illustrates a software configuration diagram of a display device 200 according to some embodiments;

[0053] Figure 5 illustrates a schematic diagram of a user interface according to some embodiments;

[0054] Figure 6 is a schematic diagram of a control scenario for a pointing remote control provided in an embodiment of this application;

[0055] Figure 7 is a flowchart of a control method for a display device provided in an embodiment of this application.

[0056] Figure 8 is a schematic diagram of a scenario provided by an embodiment of this application, in which the remote control is pointed to the upper left corner;

[0057] Figure 9 is a schematic diagram of a functional floating window provided in an embodiment of this application;

[0058] Figure 10 is a schematic diagram of a customized interface provided in an embodiment of this application;

[0059] Figure 11 is a schematic diagram of a customized interface provided in an embodiment of this application;

[0060] Figure 12 is a schematic diagram of another customized interface provided in an embodiment of this application;

[0061] Figure 13 is a schematic diagram of a detection floating window provided in an embodiment of this application. Detailed Implementation

[0062] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.

[0063] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0064] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0065] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0066] In related technologies, when a user wants to access an application or function by pointing a remote control, the user typically needs to start by navigating from the device's main interface, entering the application list or category menu, scrolling through the list to find the target application, and then clicking to enter it. For example, to access a video application, a user wants to watch a video, so they need to go to the application list from the main interface, find the video application, and open it. Similarly, to launch a game application, a user needs to go to the game library from the main interface, find the game, and launch it. As can be seen, the steps involved in accessing applications by pointing a remote control in these technologies are numerous, especially when there are many applications, requiring users to spend a significant amount of time searching for the target application.

[0067] In view of this, embodiments of this application provide a display device and a control method thereof to solve the problem of numerous operation steps.

[0068] The display device provided in this application can have various implementation forms, such as a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. Figures 1 and 2 show a specific implementation of the display device of this application.

[0069] Figure 1 is a schematic diagram of the operation scenario between the display device and the control device according to the embodiment. As shown in Figure 1, the user can operate the display device 200 through the smart device 300 or the control device 100.

[0070] In some embodiments, the control device 100 may be a remote control. Communication between the remote control and the display device includes infrared protocol communication, Bluetooth protocol communication, and other short-range communication methods, controlling the display device 200 wirelessly or via wired means. Users can control the display device 200 by inputting user commands through buttons on the remote control, voice input, control panel input, etc.

[0071] In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) may also be used to control the display device 200. For example, an application running on the smart device may be used to control the display device 200.

[0072] In some embodiments, the display device may receive instructions not through the aforementioned smart devices or control devices, but through touch or gestures.

[0073] In some embodiments, the display device 200 can also be controlled in ways other than the control device 100 and the smart device 300. For example, it can be controlled by directly receiving the user's voice commands through a module configured inside the display device 200 for acquiring voice commands, or it can be controlled by receiving the user's voice commands through a voice control device set outside the display device 200.

[0074] In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.

[0075] Figure 2 illustrates an exemplary configuration block diagram of the control device 100 according to an exemplary embodiment. As shown in Figure 2, the control device 100 includes at least one of a controller 110, a communication interface 130, a user input / output interface 140, a memory, and a power supply. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200.

[0076] In this application, the control device can be a remote control with a specific pointing function. Here, the control device can be called a pointing remote control. The pointing remote control introduces a brand-new interaction method, gets rid of the operation limitations of traditional remote controls, and operates like a laser pointer. It can accurately point to the target control without having to switch icons step by step, which is efficient and convenient.

[0077] In some embodiments, the remote control has a pointing switch on its body. When the pointing switch is turned on, it enters pointing mode, and the user can point, slide, and perform other operations using a displayed object (such as a cursor). When the pointing switch is turned off, the remote control switches from pointing mode to traditional button mode. In traditional button mode, the user can use the up / down / left / right / confirm buttons.

[0078] In some embodiments, after turning on the pointing switch and entering the pointing mode, it can coexist with the traditional button mode. Users can perform pointing, sliding, and clicking operations through the displayed object (such as the cursor), or use the confirmation key and the up / down / left / right / volume keys.

[0079] In some embodiments, the remote control is in a low-power mode in traditional button mode; however, when the pointing switch is turned on and pointing mode is entered, the remote control is no longer in low-power mode. Therefore, in some embodiments, a charging interface, such as a Type-C interface, can be configured for the remote control.

[0080] In some embodiments, the pointing remote control is a remote control device capable of detecting its own position and orientation in three-dimensional space. The pointing remote control has a built-in gyroscope for detecting the remote control's rotation angle and its movement acceleration. Through sensors, the pointing remote control can determine its pointing position in three-dimensional space in real time. The pointing position can include position coordinates and pointing direction, where the position coordinates are the physical position of the remote control relative to the display device (e.g., horizontal distance, vertical height, etc.). The pointing direction is the pointing angle of the remote control (e.g., horizontal and vertical angles relative to the display device).

[0081] In some embodiments, after the remote control obtains its pointing position in three-dimensional space, it can send the pointing position data to the display device. This allows the display device to obtain the pointing position and perform screen coordinate transformation, thus mapping the pointing position of the remote control to the screen coordinate system. At this point, the display device updates the position of the displayed object (e.g., the cursor) based on the calculated screen coordinates. When the user moves the remote control, the remote control's sensors continuously detect changes in position and direction and send the data to the display device. The display device updates the position of the displayed object in real time, and the cursor moves in the direction pointed by the remote control.

[0082] Figure 3 is a schematic diagram of an operation scenario of pointing to a remote control provided in an embodiment of this application. As shown in Figure 3, the user can change the pointing position of the remote control 20, so that the display device can display the display object 30 on the user interface 10 in real time according to the pointing position.

[0083] In some embodiments, the pointing remote control can control the displayed objects on the user interface. The cursor can be moved by pointing the remote control at different areas of the screen for precise selection. The pointing remote control can switch between multiple modes: when the pointing switch is on, the pointing function is enabled, allowing operations such as pointing, swiping, and clicking on the displayed objects; when the pointing switch is off, the pointing function is disabled. When the pointing function is disabled, the pointing remote control can operate in button mode, allowing control of the display device via traditional button operations. The pointing remote control supports various operation methods such as skipping, tapping, circling, swiping, and dragging, making content browsing more convenient.

[0084] In some embodiments, when the pointing function of the pointing remote control is enabled, the OK button among the ordinary buttons on the pointing remote control can be shared during the pointing function. Figure 4 is a schematic diagram of a control scenario of a pointing remote control provided in an embodiment of this application. As shown in Figure 4, if the user wants to perform a confirmation operation, he / she can press the OK button to enable the display device to receive the confirmation operation.

[0085] As shown in Figure 5, the display device 200 includes at least one of the following: a tuner 210, a communicator 220, a detector 230, an external device interface 240, a controller 250, a display 260, an audio output interface 270, a memory, a power supply, and a user interface.

[0086] In some embodiments, the controller includes a processor, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first interface to an nth interface for input / output.

[0087] The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals from the controller output, and a user control UI interface for displaying video content, image content, menu control interface, and user control UI interface.

[0088] The display 260 can be an LCD display, an OLED display, or a projection display, and can also be a projection device and a projection screen.

[0089] The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communicator 220.

[0090] The user interface can be used to receive control signals from the control device 100 (e.g., a remote control pointing at the device). These control signals may include the position information of the control device in three-dimensional space. When the control signal is the position information of the control device in three-dimensional space, the controller can perform coordinate transformation on the position information to obtain position information in two-dimensional space (e.g., screen coordinates), and display the object on the user interface using the position information in two-dimensional space. In some embodiments, the control signal may also include position information in two-dimensional space. When the control signal includes position information in two-dimensional space, the control device has a coordinate transformation function. The control device performs coordinate transformation on the position information it detects in three-dimensional space to obtain position information in two-dimensional space, and sends the position information in two-dimensional space to the display device, thereby enabling the display device to display the object on the user interface using the position information in two-dimensional space (e.g., displaying the cursor at the screen coordinates mapped to the position pointed by the control device).

[0091] Detector 230 is used to collect signals from the external environment or to interact with the external environment. For example, detector 230 includes a light receiver, a sensor for collecting ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to collect external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0092] The external device interface 240 may include, but is not limited to, one or more of the following: High Definition Multimedia Interface (HDMI), analog or high-definition component input interface (component), composite video input interface (CVBS), USB input interface (USB), RGB port, etc. It may also be a composite input / output interface formed by multiple interfaces mentioned above.

[0093] The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals.

[0094] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0095] The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the monitor 260, the controller 250 can execute operations related to the object selected by the user command.

[0096] In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (random access memory), ROM (read-only memory), a first to an nth interface for input / output, a communication bus, etc.

[0097] In this embodiment of the application, the memory is also used to store the connection status of the communication connection between the control device and the display device and the update timestamp corresponding to the connection status.

[0098] Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.

[0099] A "user interface" is the medium through which an application or operating system interacts and exchanges information with the user. It converts information from its internal form to a form that the user can accept. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, view, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.

[0100] In some embodiments, to enable user interaction, the display device 200 may run an operating system. An operating system is a computer program that manages and controls the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running applications. The operating system also allows users to interact with the display device 200.

[0101] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0102] Operating systems can be divided into different modules or layers based on the functions they implement. For example, as shown in Figure 6, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0103] In some embodiments, at least one application runs in the application layer. This application may include: application 1, application 2, application 3, application 4, etc. These applications may be built-in Windows programs, system settings programs, or clock programs; they may also be applications developed by third-party developers. For example, application 1 may be a karaoke application, and application 2 may be a video application. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0104] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0105] As shown in Figure 6, the application framework layer in this embodiment includes managers, content providers, etc., wherein the managers include at least one of the following modules: Activity Manager, used to interact with all activities running in the system; Location Manager, used to provide system services or applications with access to system location services; Package Manager, used to retrieve various information related to application packages currently installed on the device; Notification Manager, used to control the display and clearing of notification messages; and Window Manager, used to manage icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0106] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, shaking the display, distorting the display, etc.).

[0107] In some embodiments, the system runtime library layer provides support for the upper layer, namely the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime library layer to implement the functions that the framework layer needs to perform.

[0108] In some embodiments, the kernel layer is a layer between hardware and software. As shown in Figure 4, the kernel layer includes at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0109] In this embodiment, the display device includes: a display configured to display a user interface, the user interface having a display object, the position of the display object on the user interface being determined by the position pointed to by the control device in three-dimensional space; and a controller connected to the display, configured to: when the hovering time of the display object in a preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, control the display to present a functional floating window on the upper layer of the user interface, wherein the functional floating window is used to provide an operation entry point for the customized content; and in response to the first operation of the control device on the operation entry point, control the display to display the target display interface corresponding to the customized content, thereby reducing the user's operation process to enter the target display interface and improving the user's operation efficiency.

[0110] In some embodiments, the display device may also reduce noise in sensor data and improve the stability of the displayed object by using filtering algorithms (such as Kalman filtering).

[0111] To facilitate a further understanding of the technical solutions in some embodiments of this application, the technical solutions of the display device and the control method of the display device, and how these technical solutions solve the aforementioned technical problems, are described in detail below with reference to some specific embodiments and accompanying drawings. The embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments.

[0112] Figure 7 is a flowchart of a control method for a display device provided in an embodiment of this application. As shown in Figure 7, the controller is configured to perform the following steps:

[0113] Step S701: When the hovering time of the displayed object in the preset area of ​​the user interface reaches the first preset time and the preset area is associated with customized content, the display is controlled to present a function floating window on the upper layer of the user interface, wherein the function floating window is used to provide an operation entry point for the customized content.

[0114] In some embodiments, the preset area is one or more specific areas predefined in the user interface. These areas may be a corner or edge of the screen. For example, the preset area may be located at at least one of the top-left corner, top-right corner, bottom-left corner, bottom-right corner, left edge, and right edge of the screen.

[0115] In some embodiments, the display screen is typically represented using a two-dimensional coordinate system. The origin (0,0) is located at the top left corner of the screen, with the horizontal direction as the X-axis and the positive direction to the right. The vertical direction is the Y-axis, with the positive direction downwards. The screen width is screen_width, and the height is screen_height. The top left, top right, bottom left, bottom right, left edge, and right edge of the screen can be represented by coordinate ranges. The size of the range can be configured; for example, the coordinate range of the top left corner can be represented as (0,0) to (screen_width*0.2, screen_height*0.2), the coordinate range of the top right corner can be represented as (screen_width*0.8, 0) to (screen_width, screen_height*0.2), the coordinate range of the bottom left corner can be represented as (0, screen_height*0.8) to (screen_width*0.2, screen_height), and the coordinate range of the bottom right corner can be represented as (sc... The coordinates of the left edge can be expressed as (0, 0) to (screen_width*0.1, screen_height), and the coordinates of the right edge can be expressed as (screen_width*0.9, 0) to (screen_width, screen_height). Here, 0.2, 0.8, 0.1, and 0.9 are the preset proportions of the area to the screen width or height, which can be adjusted according to actual needs.

[0116] In some embodiments, the coordinate range of the preset area can be stored in a configuration file or a database. Whether a displayed object is within the preset area can be determined by calculating whether the displayed object is within the coordinate range corresponding to the preset area.

[0117] In some embodiments, hover duration refers to the length of time a displayed object remains within a preset area. A first preset duration is a defined threshold time used to determine whether the displayed object has hovered within the preset area for a sufficiently long time. The first preset duration can be set to any duration between 300 milliseconds and 1 second; for example, the first preset duration is 500 milliseconds.

[0118] In some embodiments, the customized content can be any one of the following: an application or a signal source interface identifier. A function floating window is a UI element, such as an icon, window, control, or view, that floats above the user interface and provides an entry point for customizing the content. Function floating windows are typically located at the top of the user interface to avoid being obscured by other UI elements.

[0119] In this embodiment, the window level is used to manage the display order of different types of windows on the screen. The window level of the functional floating window can be the system-type window level. Since the window level of ordinary applications is usually lower than the system-type window level, and the user interface is usually an ordinary application, by setting the window level of the functional floating window to the system-type window level, the functional floating window can be displayed on the user interface. Taking the window level of the functional floating window as the system-type window level as an example, the window level range of ordinary applications is usually 2000 to 2999, so the window level of the functional floating window can be greater than 2999. In this embodiment, the window level of the functional floating window can be lower than the window level of the input method. In some embodiments, the window level of the functional floating window can be the same as the window level of the volume adjustment floating window when adjusting the volume.

[0120] In some embodiments, the window hierarchy of the function floating window can also be applied to the window hierarchy, but the window hierarchy of the function floating window is higher than the window hierarchy of the user interface. For example, if the window hierarchy of the user interface is 2500, then the window hierarchy of the function floating window can be 2501 to 2999.

[0121] In this embodiment, the function floating window includes an operation entry point, which is an interactive element within the function floating window. Users can select and trigger the operation entry point by controlling the device. The operation entry point is typically presented in the form of a button, icon, or text. When the customized content is an application, the operation entry point can be a shortcut icon for the application; when the customized content is an identifier for a signal source interface, the operation entry point corresponds to the entry point of the signal source interface.

[0122] In this embodiment, the controller can monitor the position of the displayed object and determine whether the displayed object is in a hovering state when it enters a preset area. The displacement change of the displayed object within each sampling period can be determined based on its position over multiple first preset duration sampling periods; if the displacement change within a consecutive preset sampling period is less than a preset displacement change threshold, it is determined that the displayed object is in a hovering state.

[0123] In this embodiment, when the displayed object is in a hover state, the controller can continuously detect the hover time of the displayed object within a preset area. If the hover time reaches a first preset duration, it checks whether the preset area is associated with customized content. If customized content is associated, the controller controls the display to show a floating window.

[0124] For example, taking the upper left corner as a preset area, the user can point to the upper left corner with the remote control. Figure 8 is a schematic diagram of a scenario where the user points to the upper left corner with the remote control, as provided in an embodiment of this application. As shown in Figure 8, the display object is displayed in the upper left corner. When the display object hovers in the upper left corner for a first preset duration, a function floating window is displayed. Figure 9 is a schematic diagram of a function floating window provided in an embodiment of this application. As shown in Figure 9, the function floating window is displayed in the upper left corner. The function floating window contains an identifier for High Definition Multimedia Interface 1 / Audio Return Channel (HDMI 1 / ARC), which serves as the operation entry point.

[0125] In step S702, in response to the first operation of the control device on the operation entry, the control display is made to show the target display interface corresponding to the customized content.

[0126] In this embodiment, the first operation refers to the user's triggering action on the operation entry point through the control device. This could be the user pressing the confirmation button on the remote control, thus triggering the first operation on the operation entry point. The target display interface is the interface displayed after the user triggers the operation entry point. If the customized content is an application, the target display interface is the main interface of that application. If the operation entry point is an identifier for a signal source interface, the target display interface is the input screen of an external device (such as a game console or computer).

[0127] Following the example above, this application embodiment provides a target display interface, whereby the user can trigger the operation entry by controlling the device to enter the target display interface corresponding to HDMI 1 / ARC.

[0128] The following example illustrates how a user can quickly access applications on a smart TV using a pointing remote. The user holds the remote and points it at the center of the TV screen; the cursor appears in the center. Moving the remote to the upper right, the cursor enters a preset area in the upper right corner of the screen. The controller starts a timer. When the hover time reaches the first preset duration, it checks if the preset area is associated with customized content. If a music application is associated, a function pop-up window appears on the screen. This pop-up window contains the music application's entry point. The user selects "Music Application" by pointing the remote, launching the music application and displaying its main interface (target display interface).

[0129] The display device provided in this application embodiment, when the hovering time of the displayed object in a preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, controls the display to present a function floating window on the upper layer of the user interface. The function floating window is used to provide an operation entry point for the customized content. In response to the first operation of the control device on the operation entry point, the display is controlled to display the target display interface corresponding to the customized content. Since it is not necessary to navigate to the target application or function step by step, but to directly enter the target display interface through the function floating window, the operation process of the user to enter the target display interface can be reduced, and the user's operation efficiency can be improved.

[0130] In some embodiments, when the hovering time of the displayed object in a preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, the controller controls the display to display a functional floating window on top of the user interface, and is configured to perform the following steps:

[0131] Step S7011: When the hovering time of the displayed object in the preset area of ​​the user interface reaches the first preset time, obtain the mapping set, wherein the mapping set includes: the association relationship between any preset areas and customized content.

[0132] In this embodiment, the mapping set can be a data structure used to store the association between preset regions and customized content. The mapping set can be stored in the form of key-value pairs, where the key can be the identifier of the preset region (e.g., region ID or coordinate range), and the value can be the customized content associated with that region.

[0133] In some embodiments, the mapping set may also be stored as a database table. In some embodiments, the mapping set may also include a functional description of the operation entry point.

[0134] The following example uses a preset region in the mapping set, including the upper left corner, upper right corner, lower right corner, and lower left corner. Table 1 is a schematic table of a mapping set provided in this application. As shown in Table 1,

[0135] Description of the preset area customization operation entry function

[0136] Switch the signal source interface (HDMI 1) in the upper left corner to the HDMI 1 signal source to display the content input from external devices (such as game consoles).

[0137] The application (video player) in the upper right corner launches the video player application and displays the video playback interface.

[0138] The application in the bottom right corner (Weather Forecast) launches the Weather Forecast application, which displays the current weather information and forecast.

[0139] Switch the signal source interface (USB) in the lower left corner to the USB signal source to display the contents of the USB device (such as a storage device).

[0140] In this table, the top left corner is associated with the HDMI 1 signal source. When the user hovers over it and interacts with it, the monitor switches to the HDMI 1 signal source, displaying the content from the connected external device (such as a game console). The top right corner is associated with a video player application. When the user hovers over it and interacts with it, the video player launches and displays its interface. The bottom right corner is associated with a weather forecast application. When the user hovers over it and interacts with it, the weather forecast application launches and displays weather information. The bottom left corner is associated with a USB signal source. When the user hovers over it and interacts with it, the monitor switches to the USB signal source, displaying the content from the USB device.

[0141] In this embodiment of the application, the mapping set can be stored in the memory or storage chip of the display device. When the hovering time of the display object in the preset area of ​​the user interface reaches the first preset time, the mapping set is obtained from the storage area of ​​the display device.

[0142] Step S7012: Based on the mapping set, obtain the customized content of the preset area, and control the display to present the function floating window on the upper layer of the user interface.

[0143] In this embodiment, the controller can find the corresponding customized content from the mapping set based on the identifier of the preset area. For example, if the preset area is the upper left corner, the customized content found through the mapping set is: signal source interface (HDMI 1).

[0144] In this embodiment, the controller can generate a function floating window based on the acquired customized content. The function floating window contains operation entries related to the customized content.

[0145] The display device provided in this application embodiment stores associations through a mapping set, allowing the controller to dynamically associate preset areas with customized content without modifying the underlying code. For example, users can add, delete, or modify the associations between preset areas and content through a configuration interface. The mapping set can store different types of customized content (such as application and signal source interface identifiers), thereby supporting diverse functional requirements. Furthermore, all associations between preset areas and customized content are stored in the mapping set, facilitating unified management and maintenance. The mapping set supports dynamic content updates to support real-time changing scenarios. For example, when a user uninstalls an application, the controller can automatically update the associations in the mapping set.

[0146] In some embodiments, the controller can be configured to perform step S701 as follows:

[0147] Step S7013: If the hovering time of the displayed object in the preset area of ​​the user interface reaches a first preset time, obtain the mode of the display device.

[0148] In this embodiment of the application, scene information stored in the system can be obtained, and the mode of the display device can be determined by the scene information.

[0149] In step S7014, when the mode is the first preset mode and the preset area is associated with customized content, control the display to display a function floating window on the upper layer of the user interface.

[0150] In this embodiment, the first preset mode can be a user-defined mode. For example, the first preset mode can be a home mode, normal usage mode, cinema mode, etc. Only under the first preset mode will the display show a function floating window on top of the user interface; otherwise, the function floating window will not be shown. For example, in game mode, the user does not want to be disturbed by the function floating window. By determining the mode as game mode, the function floating window will not be displayed, ensuring an immersive gaming experience for the user.

[0151] The display device provided in this application embodiment can ensure that the function floating window is only displayed in appropriate scenarios by mode judgment, so as to avoid interfering with the user's current operation.

[0152] In some embodiments, the controller is also configured to perform the following steps:

[0153] Step S703: Move the displayed object out of the function floating window and control the display to hide the function floating window.

[0154] In this embodiment, the pointing position of the control device can be obtained in real time, the coordinates of the displayed object on the screen can be calculated, and the display can be controlled to hide the function floating window if the displayed object moves out of the function floating window.

[0155] The display device provided in this application embodiment features a floating window that is only displayed when needed and automatically hidden when moved out of the window, making the interface more concise and intuitive. Users do not need to manually close the floating window; they only need to move the display object out of the window for it to hide automatically, making the operation more efficient. After hiding the floating window, there is no need to continue rendering its content, which reduces the load on the GPU and CPU, improving device performance.

[0156] In some embodiments, the controller is also configured to perform the following steps:

[0157] Step S704: If the hovering duration of the displayed object within the function floating window exceeds a preset time threshold, control the display to hide the function floating window, wherein the preset time threshold is greater than a first preset duration.

[0158] In this embodiment, the preset time threshold is a defined time value used to determine whether the displayed object stays in the functional floating window for too long. The preset time threshold is usually greater than a first preset duration. For example, the preset time threshold can be 2 seconds.

[0159] In this embodiment, if the displayed object remains within the function floating window, a timer can be started. When the hovering time exceeds a preset time threshold (e.g., 2 seconds), the operation of hiding the function floating window is triggered. Hiding the function floating window can directly remove it. When hiding the function floating window, animation effects can be used.

[0160] The display device provided in this application embodiment controls the display to hide the function floating window when the hovering time of the displayed object in the function floating window exceeds a preset time threshold, so as to avoid too many interface elements interfering with the user's operation. By setting a preset time threshold, unnecessary operations are avoided due to the user's unintentional lingering.

[0161] In some embodiments, the display device further includes a signal source interface for connecting to an external device. When the customized content associated with a preset area is an identifier for the signal source interface, the controller is configured to perform the following steps:

[0162] In step S7023, in response to the first operation of the control device on the operation entry, a channel switching command is generated based on the identifier of the signal source interface so that the content input by the external device can be displayed on the display.

[0163] In this embodiment, the signal source interface may include: HDMI, USB, network interface, etc. HDMI is used to connect game consoles, computers, Blu-ray players, etc., USB is used to connect storage devices, cameras, etc., and network interface is used to connect network streaming media devices.

[0164] In this embodiment, the identifier of the signal source interface can be the name of the signal source interface. The first operation refers to the user's triggering action on the operation entry point through the control device. This can be achieved by pressing the confirmation button on the remote control, causing the display device to receive the first operation from the remote control's control entry point. The channel switching command is a command generated by the controller to switch the input signal of the display device to a specified signal source interface. For example, switching to the "HDMI 1" interface. The target display interface is the content input from an external device, such as game graphics or a computer desktop.

[0165] In this embodiment, the controller can generate and execute channel switching instructions by calling the underlying hardware interface or driver. After switching the signal source, the controller can read the input signal from the specified signal source interface and display it on the display. If the external device is not connected or not turned on, a prompt message can be displayed. After the content input by the external device is displayed on the screen, the function floating window can be hidden.

[0166] The display device provided in this application embodiment allows users to quickly switch signal source interfaces through simple operations without having to navigate through complex settings menus.

[0167] In some embodiments, when the customized content associated with the preset area is an application, the controller, in response to the first operation of the control device on the operation entry, controls the display to show the target display interface corresponding to the customized content. The controller is also configured to perform the following steps:

[0168] Step S7024: In response to the first operation of the control device on the operation entry, the application is started and the display is controlled to show the target display interface corresponding to the application.

[0169] In this embodiment, the application may include: a music player, a video player, a browser, a game application, a video application, etc. These applications may be those pre-installed with the display device at the factory or those installed by the user after purchase. After receiving the first operation from the control device at the operation entry point, the controller can call the application's startup interface or command line to launch the application, and the target display interface shown on the display device is the application's main interface or function interface. After launching the application, the function floating window can be automatically hidden to avoid interfering with user operation.

[0170] The display device provided in this application embodiment allows users to quickly launch applications through simple operations without having to navigate through complex menus.

[0171] In some embodiments, the controller is also configured to perform the following steps:

[0172] In step S705, if no customized content is associated with the preset area, the display is controlled to display a guide window on the upper layer of the user interface. The guide window is used to guide the user to enter the customized interface, which is used to allow the user to configure the association between the preset area and the customized content.

[0173] In this embodiment, the guide window is a UI element, such as an icon, window, control, or view, that floats above the user interface. It prompts the user that the current preset area is not associated with customized content and guides the user to the customization interface for configuration. The guide window is typically located at the top of the user interface and is not obscured by other UI elements. The customization interface is a dedicated configuration interface used to allow the user to configure the association between the preset area and customized content. The customization interface typically includes configuration options for the preset area.

[0174] In this embodiment of the application, the display position of the guide floating window can also be in a preset area.

[0175] The display device provided in this application embodiment prompts the user to configure the device through a floating window. The user can quickly understand the functions of the preset area and actively participate in the configuration of customized content, thereby enhancing the user's sense of participation and control.

[0176] In some embodiments, the controller can execute step S705 by the following steps:

[0177] In step S7051, if no customized content is associated with the preset area and the number of times the display object enters the preset area is less than the preset number, control the display to present a guide floating window on the upper layer of the user interface.

[0178] In this embodiment, the number of times an object enters the preset area refers to the cumulative number of times the displayed object enters the preset area. The controller can record this number using a counter, which records the count each time the displayed object enters the preset area. The preset number is a defined threshold used to determine whether a guide window needs to be displayed. For example, the preset number can be set to 6 times.

[0179] In this embodiment, the number of times can be compared with the preset number of times. If the number of times the displayed object enters the preset area is less than the preset number of times, it means that the user enters less often and may need to configure customized content. Therefore, at this time, the display is controlled to present a guide floating window on the upper layer of the user interface.

[0180] In some embodiments, if the number of times the display object enters the preset area is greater than the preset number of times, it means that the display object has entered the preset area multiple times. If the preset area is not associated with customized content, the user may not want to configure the customized content. In order to avoid affecting the user, if the number of times the display object enters the preset area is greater than the preset number of times, the display will not display the guide floating window.

[0181] In some embodiments, after executing step 705 or step S7051, the controller is further configured to perform the following steps:

[0182] In step S706, in response to the second operation of the control device on the guide floating window, the control display presents a customized interface, which includes configuration options corresponding to the preset area.

[0183] In this embodiment, the user can press the OK button on the control device, thereby enabling the controller to obtain a second operation of the control device on the guide floating window. At this time, the control display presents a customized interface. The customized interface is a dedicated configuration interface used to allow the user to configure the association between the preset area and customized content. Figure 10 is a schematic diagram of a customized interface provided in this embodiment. As shown in Figure 10, the customized interface includes configuration options corresponding to the preset area. In some embodiments, the customized interface also includes a prompt message, for example, the prompt message is: Touch corner function customization, you can use the screen corner as the control corner, and the operation can be quickly started when the cursor is moved to the corner.

[0184] In this embodiment, the configuration option is an interactive element in the customized interface, used to select a preset area. The configuration options corresponding to the preset area can be pre-configured, and the user can click on the configuration option corresponding to the preset area to configure it. For example, referring to Figure 10, the configuration options may include: an option in the upper left corner, an option in the upper right corner, an option in the lower left corner, and an option in the lower right corner. In some embodiments, the configuration options may also include options on the left and right edges.

[0185] In step S707, in response to the control device's selection operation of configuration options, the control display shows a selection list, wherein the selection list includes at least one option with customized content.

[0186] In this embodiment, the selection list is a list containing multiple options. This selection list may include only the application or only the identifier of the signal source interface. In some embodiments, the selection list may also include both the identifier of the signal source interface and the application. When the selection list includes both the signal source interface and the application, it can be obtained by merging the application list and the signal source list. For example, the application list includes options such as "music player" and "video player," and the signal source interface list includes options such as "HDMI 1," "HDMI 2," "HDMI 1," "USB 1," and "USB 2." By merging the application list and the signal source interface list, the selection list can be obtained, which may include options such as "music player," "video player," "HDMI 1," and "USB 2."

[0187] In this embodiment, the user can manipulate the control device to select configuration options, thereby enabling the control device to obtain the selection operation of the configuration options. In response to the selection operation, the control display shows a selection list. Figure 11 is a schematic diagram of another customized interface provided in this embodiment. As shown in Figure 11, the selection list includes: application program and signal source interface.

[0188] Step S708: In response to the control device's selection operation of the target option in the selection list, establish the association between the preset area and the customized content corresponding to the target option, and store the association in the mapping set.

[0189] In this embodiment of the application, the target option is a specific option selected by the user from the selection list, and the association relationship is used to describe the logical connection or binding relationship between the preset area and the customized content corresponding to the target option, so that the preset area can trigger or call the customized content.

[0190] For example, Figure 12 is a schematic diagram of another customized interface provided in an embodiment of this application. The customized content associated with the upper left corner is HDMI1 / ARC, the customized content associated with the upper right corner is Media Center, the customized content associated with the lower left corner is Video Playback Application 1, and the customized content associated with the lower right corner is Video Playback Application 2. The association relationship is usually stored in a mapping set in the form of key-value pairs. The mapping set can be stored on a local device (such as the memory or storage chip of a TV) or a remote server.

[0191] The display device provided in this application embodiment offers an intuitive configuration experience through a guide floating window and a customized interface, supporting users to customize the association between preset areas and customized content.

[0192] In some embodiments, the customized interface further includes: a screen mapping view of the display, and while the controller is executing step S707, the controller is also configured to execute the following steps:

[0193] In step S709, in response to the control device's selection operation for the configuration option, the control display outputs a first prompt message in the screen mapping view. The first prompt message is used to prompt the configuration of customized content for the preset area.

[0194] In this embodiment, the screen mapping view is a visual component in the customized interface, used to display the screen layout of the display and the position of a preset area. The first prompt is a prompt displayed in the screen mapping view, used to guide the user to configure the customized content of the preset area. The first prompt can be a highlighted preset area. For example, if the user selects a configuration option for the preset area in the lower right corner of the screen, then the lower right corner of the screen mapping view will be highlighted. In some embodiments, the first prompt can also be a cursor in the lower right corner of the screen mapping view to prompt the user to configure the customized content in the lower right corner.

[0195] The display device provided in this application provides an intuitive configuration experience through a visual interface and prompts.

[0196] In some embodiments, the controller is also configured to perform the following steps:

[0197] Step S710: Obtain the list of applications and the list of disabled applications in the display device.

[0198] In this embodiment, the application list is a collection of applications installed on the display device and available to the user. The application list typically includes the names of the applications. The disabled application list is a collection of applications that are disabled or hidden on the display device. The disabled application list typically includes the following information: the names of the disabled applications.

[0199] In this embodiment, the application management module can obtain a list of installed and usable applications on the display device, and also a list of disabled or hidden applications on the display device.

[0200] Step S711: Obtain the selection list based on the application list and the disabled application list.

[0201] In this embodiment, an initial application list can be obtained based on an application list and a disabled application list. A selection list is then obtained based on the priority of applications in the initial application list. The disabled application list can be filtered out to obtain the final initial application list.

[0202] In some embodiments, the priority of an application can be determined based on the application type and the user's usage frequency, wherein applications installed by the user have a higher priority than applications in the system, and applications used more frequently by the user have a higher priority than applications used less frequently.

[0203] In some embodiments, priority can also be determined based on installation time, sorting applications by installation time, with newly installed applications having higher priority. Applications can be sorted by priority to obtain a selection list.

[0204] In some embodiments, when the selection list includes the identifier of the signal source interface, the identifier of the signal source interface has a higher priority than all applications; that is, the identifier of the signal source interface is listed first in the selection list.

[0205] The display device provided in this application sorts the customized options in the selection list by priority, so as to provide a selection list that is more in line with user habits.

[0206] In some embodiments, the controller is further configured to: acquire the identifier of the signal source interface of the display device; and add the identifier of the signal source interface to a selection list.

[0207] In this embodiment, the identifiers of all available signal source interfaces in the display device can be obtained through the hardware management module. In some embodiments, the hardware interfaces of the display device can be scanned to obtain the identifiers of the signal source interfaces. In some embodiments, interface information in a system configuration file or database can be read to obtain the identifiers of the signal source interfaces. The controller can add the obtained identifiers of the signal source interfaces to the selection list.

[0208] In some embodiments, the controller is also configured to perform the following steps:

[0209] Step S712: If the control device does not perform a second operation on the guide floating window and the display device is in the second preset mode, the number of times the display object enters the preset area is not recorded. The second preset mode includes at least one of the following: power-on navigation mode, factory mode, channel search mode, conference mode, senior citizen mode, children's mode, upgrade mode, and game mode.

[0210] In this embodiment, the second preset mode is a working state of the display device, typically used for specific scenarios or functions. The mode of the display device can be obtained through the system configuration file. The second preset mode includes at least one of the following: Boot-up Navigation Mode: the navigation interface displayed after the device is powered on; Factory Mode: the device's production and debugging mode; Channel Search Mode: the mode in which the device automatically searches for television signals; Conference Mode: the mode used for conference presentations; Senior Citizen Mode: the mode optimized for elderly users; Children's Mode: the mode optimized for children; Upgrade Mode: the mode in which the device performs system upgrades; Game Mode: the mode optimized for games.

[0211] In this embodiment of the application, if the control device does not perform a second operation on the guide floating window, it means that the user has not clicked to confirm the corresponding floating window.

[0212] Step S713: If the control device does not perform a second operation on the guide floating window and the display device is not in the second preset mode, record the number of times the display object enters the preset area.

[0213] In this embodiment, if the user does not perform a second operation, the controller checks whether the current operating mode of the display device is a second preset mode (e.g., startup navigation mode, factory mode, etc.). If it is in the second preset mode, the entry count is not recorded. If it is not in the second preset mode, the entry count is recorded. The controller can record the number of times the display object enters the preset area using a counter. The counter can increment each time the display object enters the preset area.

[0214] The display device provided in this application embodiment can intelligently determine whether to record the number of times the display object enters the preset area by distinguishing the device's working mode (second preset mode and normal mode) and the user's operation on the guide floating window. This avoids recording the number of times the object enters the preset area in unnecessary scenarios, which would affect the output of the guide floating window and thus affect the configuration of the associated customized content of the preset area.

[0215] In some embodiments, the controller is also configured to perform the following steps:

[0216] In step S714, if the customized content is a customized application, in response to the application uninstallation operation, the association between the preset area and the application is removed.

[0217] In this embodiment, application uninstallation refers to the operation of a user or system removing an application from the display device. After uninstallation, the application will no longer be available. The application management module can detect application uninstallation operations. When an application is detected to be uninstalled, it checks whether the uninstalled application is associated with a preset region. This can be done by checking if a preset region associated with the uninstalled application exists in the mapping set. If it does, the association between the preset region and the application is severed.

[0218] For example, if a user uninstalls a "music player," the system detects that the "music player" has been uninstalled. If the music player is associated with a preset area, the system will then sever the association between that area and the application.

[0219] In some embodiments, the controller is also configured to perform the following steps:

[0220] Step S715: Control the display to output a prompt box in a preset area. The prompt box includes at least one of the following functions: prompting for the customized application to be uninstalled, outputting reconfiguration options, and prompting whether to automatically repair the customized application.

[0221] In this embodiment, the prompt box is a window that floats on top of the user interface and is used to display prompt information or provide operation options to the user.

[0222] Following the example above, when the prompt includes a message to uninstall custom applications, the prompt will display "Music player has been uninstalled".

[0223] The reconfiguration option is an entry point in the prompt box, guiding users to reconfigure the association between preset areas and customized content. Automatic repair refers to the system's attempt to automatically restore uninstalled applications. Automatic repair can include: reinstalling uninstalled applications, restoring application configuration files and data.

[0224] In this embodiment, if the prompt includes a reconfiguration option, the user can select reconfiguration through the control device. When the user's operation is detected (e.g., pressing the confirmation key), the user is redirected to the customization interface, where they can reconfigure the association between the preset area and the customized content. If the prompt is for automatic repair, and the user selects "automatic repair," the controller can automatically restore the uninstalled application (e.g., reinstall the application or restore the configuration file).

[0225] The display device provided in this application embodiment offers intuitive operation guidance through prompt boxes, enhancing the user experience, and allows users to reconfigure the association between preset areas and customized content. It also supports an automatic repair function, providing a more intelligent interactive experience.

[0226] In some embodiments, prior to step S701, the controller is configured to perform the following steps:

[0227] Step S1: With the pointing function of the control device enabled, enable the floating window management service.

[0228] In this embodiment, the pointing function refers to the control device's ability to detect its own pointing position in three-dimensional space and map the detected pointing position onto a display object in the user interface. The user can enable the pointing function using a pointing switch on the control device. The floating window management service is a background service in the display device used to manage and control the display, hiding, and interaction of floating windows. The floating window management service can create and destroy floating windows, set their style and hierarchy, and handle input events. When the pointing function of the control device is detected as enabled, the floating window management service is activated.

[0229] Step S2: Trigger the floating window management service to generate a detection floating window in the preset area. The window level of the detection floating window is higher than the window level of the user interface. The detection floating window is used to detect whether the displayed object has entered the preset area.

[0230] In this embodiment, a detection floating window is a UI element, such as an icon, window, control, or view, that floats above the user interface to detect whether a displayed object has entered a preset area. The detection floating window is located on the top layer of the user interface and will not be obscured by other UI elements. Its transparency is greater than a transparency threshold to avoid affecting user operation, and it is used to monitor the position of the displayed object in real time. A window management framework (such as Android's WindowManager) can be used to set the window's window hierarchy. The detection floating window's window hierarchy is higher than that of a normal application's window hierarchy. The detection floating window's window hierarchy can be a system window type.

[0231] In this embodiment, window hierarchy refers to the display order of elements within a window. The higher the window hierarchy, the higher the element is displayed. Detecting the floating window's window hierarchy is higher than the user interface's window hierarchy to ensure it is not obscured by other interface elements and does not affect the user's operation of other elements on the user interface.

[0232] After the detection window is generated, it monitors the position of the displayed object in real time. When the displayed object enters the preset area, the system triggers the corresponding operation.

[0233] For example, when the control device detects that its pointing function is enabled, it starts a floating window management service. This service generates detection floating windows in preset areas at the top right, bottom right, top left, and bottom left corners of the screen. These windows monitor cursor hover time. The detection floating windows are positioned higher than the user interface windows and have high transparency, making them invisible to the user. When the detection floating windows detect the cursor entering a preset area, they trigger a corresponding operation (e.g., displaying a function floating window).

[0234] The display device provided in this application embodiment monitors the position of the displayed object in real time through a detection floating window, providing a fast interactive response. Furthermore, the transparency of the detection floating window is set to be high, so as not to affect user operation.

[0235] In some embodiments, after step S2, the controller is further configured to perform the following steps:

[0236] Step S3: If the pointing function of the control device is turned off and the turning time reaches the second preset duration, the floating window management service is disabled.

[0237] In this embodiment, the user can turn off the pointing function by controlling a pointing switch on the device. The second preset duration is a defined time value used to determine whether the pointing function is turned off for a sufficiently long period. This is to avoid instability caused by the pointing service flashing on and off due to the user rapidly toggling the pointing switch.

[0238] In this embodiment, the pointing function of the control device can be detected in real time. If the pointing function is off, a timer is started to continuously monitor the off time of the pointing function. If the off time reaches a second preset duration (e.g., 2 minutes), the floating window management service is disabled. Disabling the floating window management service includes the following operations: destroying all detection floating windows.

[0239] In this embodiment, by disabling the floating window management service when the pointing function of the control device is turned off for a second preset duration, the problem of repeatedly calling the floating window management service due to the repeated activation of the pointing function can be avoided. Disabling the floating window management service when the control device is not used for a long time can save system resources.

[0240] In some embodiments, the area of ​​the detection floating window is smaller than the area of ​​the functional floating window.

[0241] In this embodiment, the main function of the detection floating window is to monitor whether the displayed object enters the preset area; it does not need to display a large amount of information or provide complex interactive functions. A smaller area reduces interference with user operations and avoids obscuring important content in the user interface. Functional floating windows need to display more information (such as operation entry points, prompts, etc.) and provide user interaction functions. A larger area ensures that users can clearly see the content and perform operations. Because the detection floating window has a small area, it can be set to a higher transparency, further reducing visual interference for the user. A larger functional floating window can display information more clearly, improving the user's operating experience. A larger functional floating window ensures that users can operate easily without accidental touches or operational difficulties due to a small area.

[0242] For example, a detection floating window is located in a preset area in the upper right corner of the screen. It is small (e.g., 5cm x 5cm) and has high transparency. When the user moves the cursor to this area, the detection floating window detects the cursor's entry and triggers the display of a function floating window. This function floating window is displayed in the upper right corner of the screen, is larger (e.g., 10cm x 10cm), and contains an operation entry point (e.g., "Open Music Player"). The user selects the operation entry point by pointing to the remote control to launch the music player.

[0243] In some embodiments, the customization interface can also be accessed via navigation. For example, you can go to the pointing angle customization interface by clicking the touch angle function customization option in All Settings - Bluetooth - Remote Control.

[0244] Based on the foregoing embodiments, this application further provides a display device. The software architecture of this display device, as described below, includes:

[0245] Pointing Angle Service: Responsible for the pointing remote control service functions, including the touch UI interface (function customization, trial tutorial, first-time on / off guidance interface) and floating window service (log reporting); Unified Persistent Service: Responsible for starting the pointing remote control service upon boot, and starting the floating window service by listening to the dongle plug / unplug and pointing on / off status; Transition: Clicking the pointing angle floating window will trigger the launch of customized applications, signal sources, and settings; Settings: The entry point for pointing angle function customization and trial tutorials; Boot Navigation: The entry point for trial tutorials; Cloud: The pointing remote control service will report logs to the cloud; Platform-Button: The pointing remote control service receives button presses and performs business logic, such as hiding the floating window prompt when the direct key is pressed; Platform Remote Control Service: Remote control processing logic, responsible for providing the application layer with interface statuses such as device insertion, unplugging, and on / off, and the homepage is used to provide the application list. In some embodiments, the software architecture also includes: a TV service module, which is used to provide a list of signal source interfaces, and an Android system module for detecting hover events.

[0246] The following example uses the four corners of the screen as a preset area to describe the implementation scheme of the entire pointing function, starting from the first use of the display device:

[0247] For example, the configuration process for a pointing function provided in this application embodiment is as follows:

[0248] First, the user performs a power-on operation, and the unified resident service starts up. At this time, the unified resident service listens to the remote control status. The unified resident service can obtain the on / off status from the platform remote control service, and the platform remote control service returns the on / off status.

[0249] In this embodiment of the application, if the pointing switch is not turned on, the user can turn on the pointing switch, and the pointing remote control reports the switch status to the platform remote control service. The platform remote control service notifies the unified resident service of the switch status change, and the unified resident service then enables the pointing angle service.

[0250] In this embodiment of the application, if the pointing switch is turned on, the unified resident service will then enable the pointing angle service.

[0251] In this embodiment, after the pointing corner service is enabled, it pops up an initial guidance floating window. When the user points to a corner, the pointing corner service pops up a detection floating window. When the pointing corner service receives a hover event from the Android system module and sends it to the pointing corner service, it displays the guidance floating window if it has not been displayed before. After the user clicks on it, the user enters the customized interface. The pointing corner service can obtain the signal source interface list through the TV service module and can obtain the application list and the disabled list from the home page. A selection list is generated using the application list and the signal source interface list. When the user selects a signal source or application, the selection is saved.

[0252] In this embodiment, if the unified persistent service detects that the pointing switch is off, the floating window service in the pointing angle service is delayed for 2 minutes. Within 2 minutes, if the unified persistent service obtains that the pointing switch is on, the unified persistent service obtains the on / off status of the pointing remote control from the platform remote control service. The platform remote control service returns the on / off status to the unified persistent service. If the switch is already on, the pointing angle service is started.

[0253] In this embodiment, when the switch is turned off, the floating window service needs to be removed, and the switch status monitoring is moved to a unified resident service. To avoid frequent switch operations, the floating window service removal time is delayed by 2 minutes. If the switch is detected to be turned on again within the 2-minute countdown, the submodule - floating window service - is restarted.

[0254] In this embodiment, when a user uses the pointing remote control for the first time, a guidance floating window needs to be displayed and the initial state needs to be remembered. However, the on / off state of the pointing remote control during power-on navigation and factory settings is not remembered. The guidance floating window only provides this prompt once and will not provide it again subsequently. The guidance floating window indicates that the pointing remote control function is enabled, and the user can easily control it using the cursor direction.

[0255] For example, the implementation process of a control method for a display device provided in this application embodiment is as follows: After the floating window service is started, the floating window service will have a transparent detection floating window in each of the four corners of the screen to listen for cursor hover events. When the cursor moves to the four corners and presses the OK button by pointing to the remote control, it checks whether there is customized content. If there is, the floating window service reports the information and enables the function floating window. If the pointing corner service obtains the information of clicking the function floating window, it performs a transition display through a transition, and at this time the customized application is opened.

[0256] In this embodiment, the definition of "cursor first time moving to the four corners" is: when the user has not customized the signal source interface representation or application in the settings, the first time the cursor points to the four corners, the "cursor moving to the four corners of the screen allows for customized one-finger access" function should be displayed, and this should only be displayed once, except in special scenarios. In special scenarios, the first number of times is not remembered, and when the cursor moves to the four corners, no detection floating window is displayed, and the OK button is not responded to. Special scenarios include: boot navigation, factory settings, channel search, conference mode, senior citizen mode, children's mode, and firmware upgrades.

[0257] In this embodiment, when the cursor points to any corner, the corresponding transparent detection floating window at that corner will receive a MotionEvent.ACTION_HOVER_ENTER event, at which point a message with a 500ms delay will be sent. Within 500ms, if the cursor moves out of the detection floating window's range, a MotionEvent.ACTION_HOVER_EXIT event will be received, at which point the delay will be canceled. If the cursor remains within the detection floating window's range for the entire 500ms period, it will be determined after the timeout whether it is a special scenario that cannot be displayed. If it is not a special scenario, the initial guide interface or a customized interface will be displayed, or no content will be displayed, depending on the actual situation.

[0258] The initial guide screen disappears automatically after 5 seconds or when the cursor moves out of the detection floating window. When the guide screen is displayed, it records that this corner has already been displayed. The next time the cursor points to this corner, it determines whether the guide screen needs to be displayed again based on the recorded number of times. Once the guide screen has been displayed, it will not be displayed again. After the pointing corner is customized, pointing to the corresponding corner displays a function floating window, which disappears automatically after 5 seconds of inactivity. It disappears when the cursor moves out of the display area of ​​the function floating window. The function floating window displays the name and icon of the application or signal source interface; customized content can be provided through the customization interface. Clicking the function floating window will directly jump to this application or signal source interface. Both the detection and function floating windows are added to the user interface using WindowManager.addView. The window hierarchy of the detection and function floating windows is the same as that of the volume bar. WindowManager.LayoutParams.FLAG_NOT_FOCUSABLE must be set to ensure it does not steal focus from other applications. When the arrow keys are pressed, focus is still handled normally by the application below it. When the OK button is pressed, the current detection or function floating window responds, and the arrow corner displays customized content. If the customized content is a regular application, it should be checked whether the application has been uninstalled before displaying it. If the application is uninstalled after customization, the arrow corner should not display the customized content.

[0259] In this embodiment, there are two ways to customize the pointing angle: one is to click on the guide interface to jump to the pointing angle customization interface; the other is to click on the touch angle function customization option in All Settings - Bluetooth - Remote Control to jump to the pointing angle customization interface.

[0260] In this embodiment, customization options are displayed in four corners of the customization interface. When the focus is on a customization option, the pointing arrow of the corresponding corner in the screen mapping view is highlighted, indicating that the information of this corner is being customized. Clicking brings up a drop-down selection list, which includes three parts: None, Signal Source (HDMI / Type-C interface), and My Applications. The signal source list is obtained through the platform interface, and the sourceId and name of the signal source can be obtained. The application list (APP list and blacklist list) is obtained from the home application.

[0261] In this embodiment, after obtaining the application list, the applications need to be sorted, with third-party applications ranked higher and system applications ranked after them. Applications downloaded and installed by the user should be those frequently used by the user, ensuring that user-downloaded and installed applications appear at the top of the list.

[0262] In some embodiments, it is also necessary to query the list of disabled applications and exclude the applications from the list of disabled applications obtained from the list of applications.

[0263] After a user configures a specific application, the corresponding angle's customized information is saved for use by the pointing angle. The saved data is in JSON format, and the data definition is as follows:

[0264] {

[0265] "action": Initiate the broadcast action.

[0266] "silo_input_src_id": Startup SourceId,

[0267] "silo_name": The name of the application package to launch.

[0268] }

[0269] Action content is fixed and is executed uniformly by transitions. If the customized content is an identifier of a signal source interface, then silo_input_src_id stores the sourceId of the signal source interface, and silo_name is empty; if the customized content is a normal application, then silo_input_src_id is empty, and silo_name stores the application's package name; if the customization is none, then the saved content is changed to empty.

[0270] When displaying customized content, the pointer determines whether it is the identifier of a signal source interface or a normal application based on the saved data. If silo_input_src_id is not empty, it is a customized signal source interface; if silo_name is not empty, it is a customized normal application.

[0271] If a corner is customized as a regular application, and this application is uninstalled after exiting the customization interface, the corresponding corner's customization information should show as "None" when re-entering the customization interface, because the application is no longer present. In other words, when entering the function floating window, it's necessary to check if the customized application has been uninstalled; if so, it should be cleared and displayed as "None." Each time the user points to this corner, it's necessary to check if it has been customized. If the customized content is a customized application, then it's necessary to verify the application's validity. If the customized content is a signal source interface, then validity verification is not required.

[0272] In some embodiments, after the display device is powered on for the first time, a trial tutorial is also provided. First, the trial tutorial homepage is displayed. If the user clicks "Skip," the process ends. If the user clicks "Trial Tutorial," it is determined whether the indicator switch is turned on. If it is not turned on, a switch guide is displayed, and the guide closes after the user clicks "I understand." If the switch is turned on, the trial tutorial steps begin. After the tutorial is completed, a completion screen is displayed. If the user clicks "Complete," the trial tutorial ends.

[0273] The control method for the display device provided in this application embodiment is designed with a pointing angle function. Users can reduce tedious operations by customizing the one-click access function at the four corners of the screen.

[0274] In practical applications, addressing the issues of cumbersome operation procedures and low efficiency in finding target applications with the pointing remote control, the above embodiments simplify the user's step-by-step navigation from the main interface to the target application or function by optimizing the operation navigation logic. This effectively solves the core pain point of long operation time and low efficiency when there are many applications, and significantly improves the ease of use of the pointing remote control in basic navigation scenarios. Further analysis based on actual application scenarios reveals that the optimization of the above embodiments focuses on simplifying navigation steps, without addressing the design and optimization of the function floating window in pointing mode. This function floating window, as a key carrier for quickly accessing applications and functions with the pointing remote control, suffers from display abnormalities, malfunctions in closing, and insufficiently intelligent display / hiding logic. These issues directly affect the user's operational smoothness, contradicting the convenience goals pursued by the above embodiments, and becoming a bottleneck in further improving the interactive experience of the pointing remote control.

[0275] Therefore, in order to continuously improve the interactive performance of the remote control and make up for the gaps in the optimization of the function floating window in the above embodiments, detailed embodiments and optimization solutions are given for the core problems of abnormal display and hiding of function floating windows and unintelligent logic.

[0276] In this embodiment, the display device can calculate the screen coordinates mapped to the pointing position of the control device. After obtaining the screen coordinates of the pointing position, the display device can display a cursor on the operation interface based on the screen coordinates. When the screen coordinates mapped to the pointing position of the control device are within the operation interface, the display device obtains the screen coordinates of the cursor in the operation interface based on the screen coordinates mapped to the pointing position of the control device. At this time, the cursor moves with the movement direction of the control device. When the screen coordinates mapped to the pointing position of the control device are outside the operation interface, the display device generates a cursor in the operation interface based on the screen coordinates it last had when it was in the operation interface. At this time, the cursor does not move with the control device but is fixed at the screen position of the screen coordinates it last had when it was in the operation interface.

[0277] Specifically, the control method for a display device provided in this application embodiment is implemented through steps S501 to S503, specifically providing a display / hide control function for a floating window. In this embodiment, the display object is a cursor, and the position of the display object on the user interface is the screen coordinates of the cursor on the user interface. The hovering duration of the display object within a preset area in the user interface is the duration for which the screen coordinates mapped to the pointing position of the control device remain within the preset area. Specifically, the controller is configured to execute the following steps:

[0278] Step S501: If the screen coordinates mapped to the pointing position of the control device remain within the preset area for a first preset time, a function floating window is displayed in the user interface. The function floating window is used to provide an operation entry point for customized content.

[0279] In this embodiment, the control device can be a remote control, and the preset area is one or more specific areas predefined in the user interface. These areas can be a corner or edge of the screen. For example, the preset area is located at at least one of the upper left corner, upper right corner, lower left corner, lower right corner, left edge, and right edge of the display. The display screen is typically represented using a two-dimensional coordinate system, with the origin (0,0) located at the upper left corner of the screen. The horizontal direction is the X-axis, with the positive direction to the right. The vertical direction is the Y-axis, with the positive direction downwards. The screen width is screen_width, and the height is screen_height. The upper left corner, upper right corner, lower left corner, lower right corner, left edge, and right edge of the screen can be represented by coordinate ranges. The size of the range can be configured. For example, the coordinate range of the top-left corner can be represented as (0, 0) to (screen_width*0.2, screen_height*0.2), the coordinate range of the top-right corner can be represented as (screen_width*0.8, 0) to (screen_width, screen_height*0.2), the coordinate range of the bottom-left corner can be represented as (0, screen_height*0.8) to (screen_width*0.2, screen_height), and the coordinate range of the bottom-right corner can be represented as (sc The coordinate range of the preset area is (0, 0) to (screen_width*0.1, screen_height) and the coordinate range of the right edge is (screen_width*0.9, 0) to (screen_width, screen_height). Here, 0.2, 0.8, 0.1, and 0.9 are the proportions of the preset area to the screen width or height, which can be adjusted according to actual needs. The coordinate range of the preset area can be stored in a configuration file or database. The preset area mapped to the pointing position of the control device can be determined by calculating whether the screen coordinates mapped to the pointing position of the control device are within the corresponding coordinate range of the preset area. The first preset duration refers to the length of time the screen coordinates mapped to the pointing position of the control device remain within the preset area. The first preset duration can be set to any duration between 300 milliseconds and 1 second; for example, the first preset duration is 500 milliseconds.

[0280] In some embodiments, the customized content can be any one of the following: an application or a signal source interface identifier. A function floating window is an interface element, such as an icon, window, control, or view, that floats above the user interface and provides an entry point for customized content. Function floating windows are typically located at the top of the user interface to avoid being obscured by other interface elements. Window levels manage the display order of different types of windows on the screen. The window level of a function floating window can be the system-type window level. Since the window level of a normal application is usually lower than the system-type window level, and the user interface is usually a normal application, setting the window level of the function floating window to the system-type window level allows the function floating window to appear on the user interface. For example, if the window level of a normal application is the system-type window level, the application window level range is typically 2000 to 2999, then the window level of the function floating window can be greater than 2999. In this embodiment, the function floating window level can be lower than the input method window level. In some embodiments, the function floating window level can be the same as the volume adjustment floating window level when adjusting volume.

[0281] In some embodiments, the window hierarchy of the function floating window can also be applied to the window hierarchy, but the window hierarchy of the function floating window is higher than the window hierarchy of the user interface. For example, if the window hierarchy of the user interface is 2500, then the window hierarchy of the function floating window can be 2501 to 2999.

[0282] In this embodiment, the function floating window includes an operation entry point, which is an interactive element within the function floating window. Users can select and trigger the operation entry point by controlling the device. The operation entry point is typically presented in the form of a button, icon, or text. When the customized content is an application, the operation entry point can be a shortcut icon for the application; when the customized content is an identifier for a signal source interface, the operation entry point corresponds to the entry point of the signal source interface.

[0283] In this embodiment, when a user uses the control device, the control device converts the direction or position information it points to into coordinate values ​​on the display device screen. The remote control has a pointing function; it senses the user's pointing action through built-in sensors (such as a gyroscope or accelerometer), and after algorithm calculation, maps the pointing position to the screen coordinate system, determining a specific point coordinate (x, y) on the screen. This coordinate represents the current position of the control device on the screen. The display device's controller continuously monitors the screen coordinates mapped from the control device's pointing position. The pointing information sent by the control device can be obtained through the communication interface between the controller and the control device (such as Bluetooth, infrared, or radio frequency), and converted into screen coordinates through an internal algorithm.

[0284] In this embodiment, the controller compares the acquired screen coordinates with the boundary coordinates of a preset area to determine whether the coordinates fall within the preset area. If the coordinates are within the preset area, the current state is recorded as "located within the preset area". When the screen coordinates mapped by the pointing position of the control device enter the preset area, a timer is started. During the timer, the system continuously monitors whether the coordinates are still within the preset area. If the coordinates leave the preset area during the timer, the timer is reset to zero, and the system waits for the coordinates to fall back into the preset area before restarting the timer. Only when the coordinates remain within the preset area for a first preset duration will the subsequent operation of the floating window display function be triggered.

[0285] In some embodiments, if the screen coordinates mapped to the pointing position of the control device remain within a preset area for a first preset duration, the controller is further configured to check whether the preset area is associated with customized content. If customized content is associated, the controller controls the display to show a floating window.

[0286] For example, taking the upper left corner as the preset area, the user can point the remote control to the upper left corner, and the screen coordinates mapped by the pointing position of the control device will remain in the upper left corner for a first preset time period, after which a function floating window will be displayed.

[0287] In this embodiment, by continuously pointing the device at the preset area for a first preset duration to display a floating window, a quick way for users to access customized content operation entry points is provided. Users do not need to navigate and operate multiple times through complex menu interfaces; they can simply point the control device at the preset area and hold it for a period of time to quickly open the floating window and perform the required operation, greatly improving the convenience and efficiency of operation.

[0288] In step S502, if the screen coordinates mapped to the pointing position of the control device are removed from the function floating window and are no longer within the user interface of the display, the control function floating window continues to be displayed.

[0289] In this embodiment, the user interface refers to the area on the display device screen where images and interactive content can be displayed normally. Outside the user interface, there may be borders, black borders, or other non-display areas, which cannot display images normally.

[0290] In this embodiment, the controller can continuously monitor the screen coordinates mapped to the position pointed to by the control device and compare them with the boundary coordinates of the functional floating window. When the coordinates move from inside the functional floating window to the outside, it is determined that the coordinates have left the functional floating window. At the same time, the controller will also determine whether the coordinates are within the user interface. If the coordinates are not within the user interface (i.e., located in non-display areas such as screen borders or black borders), the controller will continue to display the functional floating window.

[0291] In this embodiment, when the pointing position of the control device leaves the function floating window and is not within the user interface, the function floating window continues to be displayed, which can prevent the function floating window from being accidentally closed due to user operation errors or pointing outside the screen, thus improving the smoothness and continuity of the interactive experience.

[0292] Step S503: When the screen coordinates mapped to the pointing position of the control device are detached from the function floating window but within the user interface, close the function floating window.

[0293] In this embodiment, when the coordinates move from inside the function floating window to the outside, it is determined that the coordinates have left the function floating window. Simultaneously, it is determined that the coordinates are within the user interface. After the controller detects that the coordinates have left the function floating window and are within the user interface, it closes the function floating window.

[0294] In this embodiment, when the pointing position of the control device leaves the function floating window and is within the user interface, the function floating window is closed in time. This avoids the function floating window from occupying interface space on the screen for a long time, keeps the screen interface simple, reduces visual interference, and allows the user to focus more on the content and other operations on the main interface.

[0295] The display device provided in this application embodiment displays a function floating window in the user interface when the screen coordinates mapped to the pointing position of the control device remain within a preset area for a first preset time. The function floating window provides an entry point for customized content. When the screen coordinates mapped to the pointing position of the control device are removed from the function floating window and are no longer within the user interface of the display, the function floating window continues to be displayed. When the screen coordinates mapped to the pointing position of the control device are removed from the function floating window but are within the user interface, the function floating window is closed. This allows for the display and hiding of the function floating window based on the position of the screen coordinates mapped to the pointing position of the control device, which is more in line with the interaction logic and improves the user experience.

[0296] In some embodiments, after the screen coordinates mapped to the pointing position of the control device are removed from the function floating window and are no longer within the user interface of the display, the controller is further configured to perform the following steps:

[0297] In step S504, if the screen coordinates mapped to the pointing position of the control device fall within the function floating window during the delayed closing time of the function floating window, the function floating window continues to be displayed.

[0298] In this embodiment, the delayed closing duration is a pre-set time threshold, typically measured in seconds or milliseconds. The delayed closing duration is configurable; for example, it can be configured to 5 seconds, and in other embodiments, it can be configured to 3 seconds. When the function floating window meets the closing conditions, it does not close immediately but enters a waiting observation period. The length of this waiting observation period is the delayed closing duration. Within the delayed closing duration, if the conditions for continuing to display the function floating window are met, the function floating window remains open; if the conditions for closing the function floating window are met, the function floating window closes.

[0299] In this embodiment, when the coordinates are detected to have detached from the function floating window and are no longer within the user interface, the controller starts a delayed shutdown timer. The timer records the duration of the delayed shutdown and continuously monitors changes in the coordinates during the timing process. During the delayed shutdown timer's timing, the controller continuously monitors the screen coordinates mapped to the controlled device's pointing position, comparing the current coordinates with the boundary coordinates of the function floating window. If the coordinates move from outside the function floating window to inside, it is determined that the coordinates have fallen into the function floating window. When the coordinates are detected to have fallen into the function floating window, the controller maintains the display state of the function floating window on the screen and does not perform a shutdown operation. Simultaneously, the controller resets the delayed shutdown timer (depending on the design logic if a restart is needed) so that it can subsequently determine whether the function floating window needs to be closed again.

[0300] Step S505: If the screen coordinates mapped to the pointing position of the control device fall within the user interface and are not within the function floating window within the delayed closing time, close the function floating window.

[0301] In this embodiment, when the detected coordinates fall within the user interface but are not within the function floating window, the controller closes the function floating window. The controller also stops the delayed shutdown timer.

[0302] The display device provided in this application embodiment offers users more operational error tolerance by setting a delayed shutdown duration. When a user accidentally points the control device off-screen, causing the function floating window to close, as long as the user pulls the control device back into the function floating window within the delayed shutdown duration, the function floating window will continue to display, allowing the user to continue operating. This avoids interrupting the operation process due to operational errors and improves the flexibility of interaction. Furthermore, in actual operation, users may experience hand tremors or unfamiliarity with the operation, causing the control device to briefly leave the function floating window or user interface. The delayed shutdown duration filters out these brief, unintentional operational changes, reducing the impact of erroneous operations on the display state of the function floating window and making the system more stable and reliable. Through the delayed shutdown mechanism, when a user points the control device off-screen and then wants to quickly return to the function floating window, the function floating window will not close immediately, ensuring the continuity of user operation. Users do not need to re-trigger the display of the function floating window to continue their previous operation, improving the smoothness and continuity of the user experience. If the user does not point the control device back into the function floating window during the delayed closing period, but instead points it to another location within the user interface, the function floating window will close promptly. This prevents the function floating window from occupying screen space for an extended period, keeping the screen interface clean and reducing visual interference. It balances the display requirements of the function floating window with the requirements of interface simplicity.

[0303] In some embodiments, the controller is also configured to perform the following steps:

[0304] Step S506: If the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration less than the delayed closing time and no information is obtained to trigger the function floating window, the function floating window continues to be displayed.

[0305] In this embodiment, the information triggering the function floating window refers to the signal generated and transmitted to the controller of the display device when the user performs a specific operation on the function floating window through the control device. For example, if the user clicks the OK button on the remote control, the signal generated by this operation is the information triggering the function floating window. If the user does not click the OK button on the remote control, the controller does not receive the information triggering the function floating window.

[0306] In this embodiment, the controller monitors in real time whether it receives information to trigger the function floating window. The controller can achieve this by listening to the communication interface with the control device (such as Bluetooth, infrared, etc.). When it receives a signal that conforms to preset rules (such as a specific button press signal, a signal corresponding to a click operation, etc.), it determines that it has received information to trigger the function floating window. During the timing process, if the screen coordinates mapped to the control device's pointing position remain within the function floating window for a duration less than the delayed closing time, and the controller has not received information to trigger the function floating window, the controller will maintain the function floating window's display state on the screen and will not perform a closing operation.

[0307] Step S507: If the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration that reaches the delayed closing time and no information is obtained to trigger the function floating window, then close the function floating window.

[0308] In this embodiment of the application, when the timer records the duration of the delay shutdown and the controller still has not obtained the information to trigger the function floating window, the controller stops displaying the function floating window to close the function floating window.

[0309] In practical use, the display device provided in this application may cause users to briefly pause the control device's pointing position within the function floating window due to unfamiliarity with operation or hand tremors, without actually intending to operate the function floating window. By setting a delayed closing time and requiring the function floating window to close only after no trigger information is obtained within the time limit, the accidental closure of the function floating window due to these unintentional user operations can be effectively avoided, improving the stability and reliability of operation. When the user has not operated the function floating window for a long time, the function floating window will automatically close after the delayed closing time, which can release system resources, prevent the function floating window from occupying screen space and system memory, keep the screen interface simple, reduce visual interference, and improve the system's operating efficiency. In addition, the judgment logic based on coordinate dwell time and trigger information conforms to the user's operating habits and psychological expectations. It not only considers the possible temporary operation pauses of the user, but also closes the function floating window in time when the user clearly no longer needs it, making the entire interaction process more natural and smooth, and enhancing the rationality of the interaction logic.

[0310] In some embodiments, when the controller is configured to display a function floating window in the user interface for a first preset duration when the screen coordinates mapped to the pointing position of the control device remain within a preset area, the following steps can be taken:

[0311] Step S5011: When the screen coordinates mapped to the pointing position of the control device fall into the preset area, a hover entry event is obtained, and a timer is started to start timing.

[0312] In this embodiment, a hover-in event is an event signal generated when the screen coordinates mapped to the pointing position of the control device fall into the preset area from the preset area. The controller of the display device continuously acquires the screen coordinates mapped to the pointing position of the control device. The controller compares the acquired screen coordinates with the boundary coordinates of the preset area. If the coordinates move from outside the preset area to inside the preset area, it is determined that the coordinates have fallen into the preset area, and at this time, the controller generates a hover-in event. At the same time as generating the hover-in event, the controller starts a timer to start counting. The timer records the time from the moment the hover-in event occurs so as to determine whether a first preset duration has been reached.

[0313] Step S1012: When the timeout reaches the first preset duration and no hover exit event is obtained, a function floating window is displayed in the user interface. The hover exit event is an event that occurs when the screen coordinates mapped to the pointing position of the control device leave the preset area.

[0314] In this embodiment of the application, the hover exit event is an event signal generated when the screen coordinates mapped to the pointing position of the control device move out of the preset area, which means that the user no longer points the control device to the preset area and may no longer need related operations.

[0315] In this embodiment, during the timer's operation, the controller monitors the timer's duration in real time. During the timer period, the controller continuously monitors for a hover exit event. Specifically, it continuously compares the screen coordinates mapped to the control device's pointing position with the boundary coordinates of a preset area. If the coordinates move from within the preset area to outside the preset area, a hover exit event is generated. If the timer reaches a first preset duration and no hover exit event is detected during the entire timer process, it indicates that the user has pointed the control device at the preset area and held it there for a period of time, demonstrating a strong intention to operate. At this point, the controller controls the function floating window displayed in the user interface.

[0316] The display device provided in this application avoids accidental triggering of the function floating window due to brief, unintentional pointing actions by the user by setting a first preset duration. Only when the user points the control device to a preset area and holds it for a certain period is the user's intention to operate considered, thus displaying the function floating window, improving the accuracy of operation and the stability of the system. When the user actually has an operation need, by pointing the control device to the preset area and waiting for the first preset duration, the function floating window can be quickly and conveniently brought up to obtain the required operation entry, making the operation process simpler and smoother, and reducing the time spent by the user switching between different interfaces and searching for functions. By setting hover-in and hover-out events, the display device can more accurately perceive the user's operation intention. Users can intuitively move the control device to trigger the corresponding interaction logic, enhancing the intuitiveness and ease of use of the interaction between the user and the display device.

[0317] In some embodiments, prior to step S501, the controller is further configured to perform the following steps:

[0318] Step S1: When the pointing function of the control device is enabled, a detection floating window is generated in a preset area. The detection floating window is used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave the preset area.

[0319] In this embodiment, the pointing function refers to the control device's ability to detect its own pointing position in three-dimensional space and send the detected pointing position to the display device. The display device can then determine the screen coordinates mapped to the pointing position and control the display device based on these coordinates. Users can activate the pointing function using a pointing switch on the control device. When the pointing function is activated, a detection floating window is generated in a preset area.

[0320] The controller can invoke the floating window management service to generate a detection floating window. This service is a background service in the display device used to manage and control the display, hiding, and interaction of floating windows. The floating window management service can create and destroy floating windows, set their style and hierarchy, and handle input events. When the controller's pointing function is enabled, the floating window management service is activated and a detection floating window is generated.

[0321] In this embodiment, the detection floating window is a temporary window displayed on the user interface, superimposed on the main interface. It is primarily used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave a preset area. The detection floating window itself typically does not have obvious interactive functions, serving only as an auxiliary tool for detecting coordinate positions. The detection floating window is located on the top layer of the user interface and will not be obscured by other interface elements. The transparency of the detection floating window is greater than a transparency threshold, so it does not affect user operation and is used for real-time monitoring of the cursor position. A window management framework (such as Android's WindowManager) can be used to set the window's window hierarchy. The window hierarchy of the detection floating window is higher than that of a normal application. The window hierarchy of the detection floating window can be a system window type. Window hierarchy refers to the display order of elements within a window. The higher the window hierarchy, the higher the elements are displayed. The detection floating window's window hierarchy is higher than the user interface's window hierarchy to ensure it is not obscured by other interface elements and does not affect the user's operation of other elements on the user interface.

[0322] In this embodiment, the display device and the control device establish a connection and transmit data via a specific communication protocol (such as Bluetooth, infrared, Wi-Fi Direct, etc.). The control device periodically sends its own status information to the display device, including the on or off status of the pointing function. The controller of the display device receives and parses this status information to determine whether the pointing function of the control device is enabled. The user may enable the pointing function of the control device through specific operations. When it is determined that the pointing function of the control device is enabled, the display device generates a detection floating window at the corresponding position according to the boundary coordinate range of a preset area. A visible rectangular or other shaped area can be drawn on the screen according to the preset floating window style (such as color, transparency, border, etc.), and this area is the detection floating window. The detection floating window can be logically associated with the preset area to ensure that subsequent coordinate detection operations can correctly correspond to the preset area.

[0323] After the detection window is generated, it is used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave the preset area. When the cursor enters the preset area, the corresponding operation is triggered.

[0324] For example, upon detecting that the pointing function of the control device is enabled, the floating window management service is started. The floating window management service generates detection floating windows in preset areas at the upper right, lower right, upper left, and lower left corners of the screen. These detection floating windows are used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave the preset areas. If the detection floating window detects that the screen coordinates mapped to the pointing position of the control device enter the preset areas, a function floating window is displayed.

[0325] The display device provided in this application embodiment monitors the screen coordinates mapped to the pointing position of the control device in real time through a detection floating window, providing a fast interactive response. The detection floating window clearly identifies the range of a preset area, enabling the system to more intuitively and accurately detect whether the screen coordinates mapped to the pointing position of the control device fall within or outside the preset area. This avoids misjudgments caused by coordinate calculation errors or other interference factors, improving the accuracy of the interaction. Furthermore, by observing the detection floating window, users can clearly understand the position and range of the preset area, thereby more accurately operating the control device to ensure its pointing position falls within the preset area to trigger the corresponding function. This intuitive visual feedback enhances the intuitiveness and ease of use of the interaction between the user and the display device, reducing the user's learning cost. By generating a detection floating window within the preset area, the display device can concentrate resources on monitoring coordinate changes within the detection floating window, without needing to perform comprehensive coordinate detection on the entire screen. This reduces the system's computational burden and improves the system's response speed and performance.

[0326] In some embodiments, the controller is also configured to perform the following steps:

[0327] Step S2: When the screen coordinates mapped to the pointing position of the control device fall into the detection floating window, a hover entry event is generated.

[0328] In this embodiment, the display device controller continuously acquires the screen coordinates mapped to the position pointed to by the control device. The controller compares the acquired screen coordinates with the boundary coordinates of the area defined by the detection floating window. The boundary coordinates of the detection floating window are determined and stored in the system memory when the detection floating window is generated. For example, if the detection floating window is a rectangular area, its boundary coordinates are determined by the coordinates of the upper left corner (x1, y1) and the lower right corner (x2, y2). The controller determines whether the x-value of the current screen coordinates is between x1 and x2, and whether the y-value is between y1 and y2. If the coordinates move from outside the detection floating window to inside the detection floating window, i.e., satisfy the above boundary conditions, the controller generates a hover entry event.

[0329] Step S3: When the screen coordinates mapped to the pointing position of the control device are removed from the detection floating window, a hover exit event is generated.

[0330] In this embodiment of the application, if the screen coordinates mapped to the pointing position of the control device move from inside the detection floating window to outside the detection floating window, the controller generates a hover exit event.

[0331] The display device provided in this application, by generating hover-in and hover-out events, can accurately identify the user's intention to point the control device at a specific area (the area defined by the detection floating window) and leave that area. This provides a reliable foundation for subsequent execution of corresponding functions based on the user's intention (such as displaying or hiding function floating windows), improving the accuracy and intelligence of the interaction. Since the display device generates events based on the actual change in the control device's pointing position, rather than simply relying on a one-time user operation (such as a click), it effectively reduces error events caused by user misoperation (such as slight movements due to hand tremors), improving the stability and reliability of the interaction.

[0332] In some embodiments, the detection floating window includes a first area within the user interface and a second area outside the user interface, wherein the first area and the second area are connected.

[0333] In this embodiment of the application, Figure 13 is a schematic diagram of a detection floating window provided by this embodiment. As shown in Figure 13, the first area is 131 and the second area is 132. The first area 131 is the part of the detection floating window located within the user interface, used to directly detect the coordinates of the control device pointing within the normal display range of the screen. It is the detection area most directly encountered by the user during operation. The second area 132 is the part of the detection floating window located outside the user interface. Although it does not directly display content, it is connected to the first area and logically serves as part of the detection floating window. It can assist in determining the operation intention when the control device is pointing near or beyond the edge of the screen. The connection indicates that the first area and the second area are logically a whole, without separation or independence. In operations such as coordinate detection and event generation, these two areas are regarded as a unified detection floating window, and the movement of the control device's pointing position between the two areas is regarded as a continuous trajectory.

[0334] In this embodiment, the first and second regions are considered as a single entity. When the control device points to the screen coordinates mapped to its position, regardless of whether the coordinates are located in the first or second region, it is treated as being within the detection floating window for judgment. For example, when the coordinates move from the first region to the second region, or vice versa, the system considers it a continuous movement trajectory and will not cause interruptions or incorrect judgments due to crossing the user interface boundary. Hover entry and hover exit events are processed uniformly on a per-detection floating window basis. Whenever the coordinates enter or leave the detection floating window (whether in the first or second region), the corresponding event generation logic is triggered. By setting a second region outside the user interface and connecting it to the first region, it is possible to better detect pointing operations of the control device near or even beyond the screen edge. When the user points the control device to the screen edge and continues to move it, their operational intent can be accurately determined, avoiding interaction interruptions or inconsistencies caused by screen boundary limitations, making the interaction process more natural and fluid.

[0335] In some embodiments, the controller is also configured to perform the following steps:

[0336] Step S508: With the function floating window displayed, close the detection floating window.

[0337] In this embodiment, the controller can continuously monitor the display status of the function floating window. The display status of the function floating window can be represented by a Boolean variable (such as isFunctionWindowVisible). When the function floating window is displayed, the value of this variable is true; when the function floating window is hidden, the value of this variable is false. The controller obtains the value of this variable through polling or event listening. Each time the controller detects a change in the state of the function floating window or checks it at certain time intervals, it determines the value of isFunctionWindowVisible. If the value is true, it indicates that the function floating window is being displayed, and the controller performs the operation of closing the detected floating window. Simultaneously, the controller may release resources related to the detected floating window, such as the detected floating window coordinate information stored in memory, event listeners, etc., to save system resources.

[0338] Step 509: With the detection floating window displayed, close the function floating window.

[0339] Similarly, the controller can continuously monitor the display status of the detection window, using a boolean variable (such as isDetectionWindowVisible) to record it. The value of this variable is obtained through polling or event listening. When the controller detects that isDetectionWindowVisible is true, meaning the detection window is currently displayed, it performs the operation to close the feature window.

[0340] In the display device provided in this application embodiment, when a function floating window and a detection floating window are displayed on the screen simultaneously, it may cause interface elements to overlap and obscure each other, affecting the user's visual experience and operational convenience. By closing one floating window while displaying the other, this interface element conflict can be effectively avoided, making the screen interface clearer and cleaner, and allowing users to operate and obtain information more conveniently. Displaying two floating windows simultaneously will consume more system resources, such as memory and processor resources. Closing unnecessary floating windows can release these resources, allowing more resources to be allocated to other important tasks, improving the overall performance and response speed of the display device. By displaying different floating windows in different situations, the current interaction intent and available operation options can be more clearly conveyed to the user. For example, when a detection floating window is displayed, the user knows that they are waiting for its pointed operation; when a function floating window is displayed, the user can focus on selecting the corresponding function option, enhancing the intuitiveness and understandability of the interaction.

[0341] In some embodiments, the controller is also configured to perform the following steps:

[0342] Step S510: If the screen coordinates mapped to the pointing position of the control device are within the user interface, obtain the screen coordinates of the cursor in the user interface based on the screen coordinates mapped to the pointing position of the control device.

[0343] In this embodiment, the cursor is a specific element presented on the user interface. When the screen coordinates mapped to the pointing position of the control device are located on the user interface, the screen coordinates mapped to the pointing position of the control device are the screen coordinates of the cursor in the user interface. Therefore, the controller can control the position of the display at the screen coordinates of the user interface to show the cursor.

[0344] Step S511: When the screen coordinates mapped to the pointing position of the control device are removed from the user interface, obtain the screen coordinates when the device was last located in the user interface, and obtain the screen coordinates of the cursor in the user interface based on the screen coordinates when the device was last located in the user interface.

[0345] In this embodiment, the controller continuously acquires screen coordinates while monitoring whether the coordinates have left the user interface. Simultaneously, the controller records the current screen coordinates whenever they are within the user interface. A variable (such as `lastValidCoordinate`) can be used to store the last screen coordinates when the cursor was within the user interface; this variable is updated each time the coordinates are updated and the cursor is within the user interface. When the controller determines that the current screen coordinates have left the user interface, it no longer uses the current invalid coordinates to generate the cursor, but instead retrieves the last screen coordinates when the cursor was within the user interface from the stored `lastValidCoordinate` variable. The cursor's screen coordinates within the user interface are then obtained based on these last screen coordinates.

[0346] The display device provided in this application can generate a cursor on the user interface regardless of whether the pointing position of the control device is within the user interface. This avoids the interruption of interaction caused by the coordinates leaving the user interface, ensuring continuous response to the user's operational intentions and enhancing the continuity and smoothness of the interaction. By generating the cursor based on the last valid coordinates, even if the pointing position of the control device is unstable or briefly leaves the user interface, the cursor can still be generated in a reasonable position, reducing interface chaos or display errors caused by abnormal coordinates and improving the stability and reliability of the interaction.

[0347] In some embodiments, since the cursor is determined based on the pointing position of the control device in three-dimensional space, and the preset area is usually a corner or edge of the screen, when the screen coordinates mapped to the pointing position of the control device leave the function floating window and are no longer in the user interface of the display, the pointing position of the control device usually moves out of the function floating window and onto the screen. Since the cursor's screen coordinates in the user interface are obtained based on the screen coordinates when it was last in the user interface, and the preset area is a corner or edge of the screen, the cursor will continue to be displayed within the function floating window. Conversely, when the screen coordinates mapped to the pointing position of the control device leave the function floating window but are within the user interface, the pointing position of the control device moves within the screen. Since the cursor follows the pointing position when the pointing position moves within the screen, the cursor will also move out of the function floating window. Therefore, the visibility of the function floating window can be controlled by whether the cursor is within it.

[0348] This application further provides a method for controlling the display of a function floating window in a display device, comprising: displaying a function floating window in the user interface when the cursor remains in a preset area for a first preset time, the function floating window being used to provide an operation entry point for customized content; controlling the function floating window to continue displaying when the cursor is in the function floating window; and closing the function floating window when the cursor moves out of the function floating window.

[0349] The method provided in this application embodiment can determine whether the cursor is within a preset area by using the screen coordinates of the cursor in the user interface, and determine whether the cursor is within a function floating window by using the screen coordinates of the cursor in the user interface, thereby realizing the display and hiding control of the function floating window.

[0350] Based on the foregoing embodiments, this application further provides a processing flow for a method to control the display and hiding of a functional floating window on a display device. This processing flow is implemented through steps S701 to S709. This method is applicable to abnormal scenarios where the device moves off the screen. When the remote control moves to a preset area, the position state of the remote control is determined by a position detection algorithm to control the display and hiding logic of the functional floating window. The following description uses the remote control as the control device and a 5-second delay before closing as an example. The method for controlling the display and hiding of a functional floating window includes:

[0351] Step S701: Expand the range of the detection floating window.

[0352] In this embodiment, the detection floating window is enlarged, and its height and width are set. The detection floating window can be enlarged beyond the screen margins by setting a negative margin value. When a hover exit event occurs, the negative x and y coordinates mapped to the remote control's pointing position can be obtained.

[0353] In step S702, the remote control is quickly moved to the detection floating window. At this time, the detection floating window receives the Hover enter event, displays the function floating window, and uses Handler to start a timer with a delay of 5 seconds.

[0354] Step S703: Check if the remote control moves out of the function floating window within 5 seconds.

[0355] In this embodiment of the application, if the function floating window is removed, step S704 is executed; if the function floating window is not removed, step S705 is executed. At this time, the cursor position is within the function floating window.

[0356] In step S704, the function floating window receives the Hover exit event and obtains the x and y coordinates of the mapping of the pointing position of the remote control.

[0357] Step S706: Determine whether the x and y coordinates are within the screen.

[0358] In this embodiment of the application, the getScreenSize() method can be used to obtain the length and width of the screen, and to determine whether the x and y coordinates are greater than 0 and less than the length and width of the screen.

[0359] In this embodiment of the application, if the person is inside the screen, step S707 is executed; if the person is outside the screen, step S708 is executed.

[0360] In step S707, the Handler sends a message to remove the feature and does not display the feature pop-up window.

[0361] The process ends here.

[0362] Step S708: Do not generate a message to remove the floating window of the sending function.

[0363] After step S708, step S705 is executed.

[0364] Step S705: Determine whether the preset area corresponding to the detection floating window has customized content.

[0365] In this embodiment of the application, if such an interface exists, step S709 is executed. If not, a guide window can be output, wherein the guide window is used to guide the user to enter the customized interface, and the customized interface is used to allow the user to configure the association between the preset area and the customized content.

[0366] Step S709: Display customized content.

[0367] In this embodiment of the application, when the user points to the remote control and clicks "OK", the customized content is displayed.

[0368] In this embodiment of the application, when displaying the function floating window, the function floating window is hidden after 5 seconds of inactivity.

[0369] When a user operates the remote control, the remote may move from off-screen to on-screen. During this process, if a function floating window is displayed at this time, the location of the remote control's movement on the screen is needed to control the window's visibility. This scenario directly impacts the user experience. When the function floating window is displayed, and within less than 5 seconds, the screen coordinates mapped to the remote control's position are detected as having moved off-screen, meaning the user's remote control position is now off-screen. If the user enters the screen from outside the function floating window, the window cannot receive the remote control's position, causing the function floating window to remain displayed even when the user moves the remote control outside of it, negatively affecting the user experience.

[0370] In view of this, this application embodiment further provides a flowchart of a method for controlling the display of a functional floating window on a display device. This method is implemented through steps S801 to S808, and is applicable to abnormal scenarios where the window moves into the screen. The method includes:

[0371] In step S801, when the screen coordinates mapped to the pointing position of the remote control enter the detection floating window and reach the first preset duration for displaying the function floating window, after 5 seconds, the Handler will send a view switching message and a message to hide the function view after a 5-second delay. When the user moves out of the function floating window, the screen coordinates mapped to the pointing position of the remote control are now outside the screen.

[0372] Step S802: When the pointer to the remote control moves into the screen within 5 seconds, obtain the x and y coordinates of the cursor when the pointer to the remote control enters the screen.

[0373] Step S803: Determine whether the coordinates are currently within the function floating window.

[0374] In this embodiment, the current position of the floating window on the screen is obtained by getLocationOnScreen() and the drawn area is obtained by getDrawingRect. The actual boundary Rect of the floating window is calculated, and rect.contains(x,y) is used to determine whether the x and y coordinates are within the floating window.

[0375] In this embodiment, if the location is within the function floating window, step S804 is executed. If the location is not within the function floating window, step S806 is executed.

[0376] Step S804: Continue displaying the function floating window.

[0377] After step S804, the method includes:

[0378] Step S806: Determine whether the function floating window has been removed from the remote control.

[0379] In this embodiment of the application, if no, step S807 is executed; if yes, step S808 is executed.

[0380] Step S807: When the 5-second timer expires, hide the floating window.

[0381] Step S808: Hide the function floating window and remove the timer that delays hiding the function floating window for 5 seconds.

[0382] Step S805: Immediately hide the function floating window and remove the timer that delays hiding the function floating window for 5 seconds.

[0383] In this embodiment of the application, when the function floating window is displayed, it is hidden after 5 seconds of inactivity, and the detection floating window is displayed after the function floating window is hidden.

[0384] In summary, the embodiments of this application enable more intelligent display and hiding of functional floating windows, thereby improving the user experience.

[0385] Based on the foregoing embodiments, this application also provides a computer-readable storage medium storing a computer program. When the computer program is executed by a processor, it implements the steps in the embodiments of the control method for the display device and the display / hide control method for the functional floating window.

[0386] This application provides a computer program product that, when run on a display device, enables the display device to implement the steps described in the control method embodiments.

[0387] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0388] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of the embodiments suitable for specific application considerations.

Claims

A display device, characterized in that, include: The display is configured to display a user interface having display objects, the position of which on the user interface is determined by the position pointed to by the control device in three-dimensional space; The controller connected to the display is configured to: When the hovering time of the displayed object in the preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, the display is controlled to present a function floating window on the upper layer of the user interface, wherein the function floating window is used to provide an operation entry point for the customized content; In response to the first operation of the control device on the operation entry, the display is controlled to show the target display interface corresponding to the customized content. The display device according to claim 1, characterized in that, When the hovering time of the displayed object within a preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, the controller controls the display to display a functional floating window on top of the user interface, configured as follows: When the hovering time of the displayed object in the preset area of ​​the user interface reaches a first preset time, a mapping set is obtained, wherein the mapping set includes: the association relationship between any preset areas and customized content; Based on the mapping set, the customized content of the preset area is obtained, and the display is controlled to present a functional floating window on the upper layer of the user interface. The display device according to claim 1, characterized in that, When the hovering time of the displayed object within a preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, the controller controls the display to display a functional floating window on top of the user interface, configured as follows: When the hovering time of the displayed object in the preset area of ​​the user interface reaches a first preset time, the mode of the display device is obtained; When the mode is the first preset mode and the preset area is associated with customized content, the display is controlled to display a function floating window on the upper layer of the user interface. The display device according to any one of claims 1 to 3 is characterized in that, The controller is also configured to: When the displayed object moves out of the function floating window, or when the hovering time of the displayed object in the function floating window exceeds a preset time threshold, the display is controlled to hide the function floating window, wherein the preset time threshold is greater than the first preset duration. The display device according to any one of claims 1 to 4 is characterized in that, The display device further includes: a signal source interface for connecting to an external device. When the customized content associated with the preset area is an identifier for the signal source interface, the controller, in response to the first operation of the control device on the operation entry, controls the display to show the target display interface corresponding to the customized content, and is configured as follows: In response to the first operation of the control device on the operation entry, a channel switching command is generated based on the identifier of the signal source interface so that the content input by the external device can be displayed on the display. The display device according to any one of claims 1 to 4 is characterized in that, When the customized content associated with the preset area is an application, the controller, in response to the first operation of the control device on the operation entry, controls the display to show the target display interface corresponding to the customized content, and is configured as follows: In response to the first operation of the control device on the operation entry, the application is launched, and the display is controlled to show the target display interface corresponding to the application. The display device according to any one of claims 1 to 4 is characterized in that, The controller is also configured to: If no customized content is associated with the preset area, the display is controlled to display a guide window on top of the user interface. The guide window is used to guide the user to enter the customized interface, which is used to allow the user to configure the association between the preset area and the customized content. The display device according to claim 7, characterized in that, When no customized content is associated with the preset area, the controller controls the display to display a guide floating window on top of the user interface, configured as follows: If no customized content is associated with the preset area, and the number of times the display object enters the preset area is less than a preset number, the display is controlled to present a guide floating window on the upper layer of the user interface. The display device according to claim 7 or 8 is characterized in that, The controller is also configured to: In response to a second operation of the control device on the guide window, the display is controlled to present a customized interface, which includes configuration options corresponding to a preset area; In response to the control device's selection of the configuration options, the display is controlled to show a selection list, wherein the selection list includes at least one option with customized content; In response to the control device's selection operation of a target option in the selection list, an association relationship is established between the preset area and the customized content corresponding to the target option, and the association relationship is stored in a mapping set. The display device according to claim 9, characterized in that, The customized interface also includes: a screen mapping view of the display, and the controller is further configured to: In response to the control device's selection of the configuration option, the display is controlled to output a first prompt message in the screen mapping view. The first prompt message is used to prompt the configuration of customized content for the preset area. The display device according to claim 9, characterized in that, The controller is also configured to: When the control device does not perform a second operation on the guide floating window and the display device is in a second preset mode, the number of times the display object enters the preset area is not recorded. The second preset mode includes at least one of the following: boot navigation mode, factory mode, channel search mode, conference mode, senior mode, children's mode, upgrade mode, and game mode. If the control device does not perform a second operation on the guide window and the display device is not in the second preset mode, record the number of times the display object enters the preset area. The display device according to claim 6, characterized in that, The controller is also configured to: When the customized content is a customized application, in response to the application uninstallation operation, the association between the preset area and the application is severed; and, The display is controlled to output a prompt box in the preset area. The prompt box includes at least one of the following functions: prompting for the uninstallation of the customized application, outputting reconfiguration options, and prompting whether to automatically repair the customized application. The display device according to any one of claims 1 to 12 is characterized in that, The controller is configured to: When the pointing function of the control device is enabled, the floating window management service is activated; The floating window management service is triggered to generate a detection floating window in the preset area. The window level of the detection floating window is higher than the window level of the user interface. The detection floating window is used to detect whether the displayed object has entered the preset area. The display device according to any one of claims 1 to 3 is characterized in that, The preset area is located at at least one of the upper left corner, upper right corner, lower left corner, lower right corner of the display, the left edge of the display screen, and the right edge of the display screen. The display device according to claim 1, characterized in that, include: The display object is a cursor, and the position of the display object on the user interface is the screen coordinate of the cursor on the user interface. The hovering duration of the display object within a preset area in the user interface is the duration during which the screen coordinates mapped from the pointing position of the control device remain within the preset area. The controller is also configured to: If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are not within the user interface of the display, the control device shall continue to display the function floating window. If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are within the user interface, the function floating window is closed. The display device according to claim 15 is characterized in that, After the screen coordinates mapped to the pointing position of the control device are removed from the function floating window and no longer within the user interface of the display, the controller is further configured to: If the screen coordinates mapped to the pointing position of the control device fall within the function floating window during the delayed closing time of the function floating window, the function floating window continues to be displayed; If, during the specified delay period, the screen coordinates mapped to the pointing position of the control device fall within the user interface but not within the function floating window, the function floating window is closed. The display device according to claim 15 or 16 is characterized in that, The controller is also configured to: If the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration shorter than the delayed closing time and no information is obtained to trigger the function floating window, the function floating window continues to be displayed; If the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration that reaches the delayed closing time and no information is obtained to trigger the function floating window, the function floating window shall be closed. The display device according to claim 15 is characterized in that, The controller is configured to display a function floating window in the user interface when the screen coordinates mapped to the pointing position of the control device remain within a preset area for a first preset time, including: When the screen coordinates mapped to the pointing position of the control device fall within the preset area, a hover entry event is obtained, and a timer is started to keep track of the time. If the timeout period reaches the first preset duration and no hover exit event is obtained, a function floating window is displayed in the user interface, wherein the hover exit event is an event that occurs when the screen coordinates mapped to the pointing position of the control device leave the preset area. The display device according to claim 18, characterized in that, The controller is also configured to: When the pointing function of the control device is detected to be enabled, a detection floating window is generated in the preset area. The detection floating window is used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave the preset area. The display device according to claim 19 is characterized in that, The controller is also configured to: When the screen coordinates mapped to the pointing position of the control device fall into the detection floating window, the hover entry event is generated; The hover exit event is generated when the screen coordinates mapped to the pointing position of the control device are removed from the detection floating window. The display device according to claim 19 is characterized in that, The detection floating window includes a first area within the user interface and a second area outside the user interface, wherein the first area and the second area are connected. The display device according to claim 19 is characterized in that, The controller is also configured to: When the function floating window is displayed, close the detection floating window; If the detection pop-up window is displayed, close the function pop-up window. The display device according to claim 15 is characterized in that, The controller is also configured to: When the screen coordinates mapped to the pointing position of the control device are within the user interface, the screen coordinates of the cursor in the user interface are obtained based on the screen coordinates mapped to the pointing position of the control device. When the screen coordinates mapped to the pointing position of the control device are removed from the user interface, the screen coordinates when the device was last located in the user interface are obtained, and the screen coordinates of the cursor in the user interface are obtained based on the screen coordinates when the device was last located in the user interface. A method for controlling a display device, characterized in that, The method is applied to the display device according to any one of claims 1-23, the display device including a display for displaying a user interface, the user interface having a display object, the position of the display object on the user interface being determined by the position pointed to by the control device in three-dimensional space; The method includes: and a controller connected to the display. When the hovering time of the displayed object in the preset area of ​​the user interface reaches a first preset time and the preset area is associated with customized content, a function floating window is presented on the upper layer of the user interface. The function floating window is used to provide an operation entry point for the customized content. The position of the displayed object on the user interface is determined by the position pointed to by the control device in three-dimensional space. In response to the first operation of the control device on the operation entry, the target display interface corresponding to the customized content is displayed. The method according to claim 24, characterized in that, The display object is a cursor, and the position of the display object on the user interface is the screen coordinate of the cursor on the user interface. The method further includes: If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are not within the user interface of the display, the control device shall continue to display the function floating window. If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are within the user interface, the function floating window is closed.

Images