Display device and control method therefor
Patent Information
- Application Number
- PCT/CN2025/141711
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2025-04-30
- Filing Date
- 2025-12-11
- Publication Date
- 2026-09-24
Smart Images

Figure CN2025141711_24092026_PF_FP_ABST
Abstract
Description
Display devices and their control methods
[0001] Cross-references to related applications
[0002] This application claims priority to Chinese Patent Application No. 2025103229133, filed on March 18, 2025; and Chinese Patent Application No. 202510573545X, filed on April 30, 2025; the entire contents of the aforementioned Chinese Patent Applications are incorporated herein by reference. Technical Field
[0003] This application relates to the field of display device technology, and in particular to a display device and its control method. Background Technology
[0004] Point-and-click remotes introduce a completely new interaction method, allowing users to operate the TV screen like a smartphone. There's a pointing switch on the left side of the remote; when turned on, it enters pointing mode, allowing users to operate by pointing or swiping. In other technologies, when a user wants to access a specific application or function using a pointing remote, they need to navigate through several steps, such as from the main interface to the application list, then finding and clicking the target application. This method is cumbersome, especially when there are many applications, requiring users to spend a significant amount of time searching for the target application; the process is tedious and inefficient. Summary of the Invention
[0005] Some embodiments of this application provide a display device, including:
[0006] The display is configured to display a user interface having display objects, the position of which on the user interface is determined by the position pointed to by the control device in three-dimensional space;
[0007] The controller connected to the display is configured to:
[0008] When the hovering time of the displayed object in the preset area of the user interface reaches a preset time, the display is controlled to display a function floating window on the user interface, wherein the function floating window is used to provide an operation entry point for customized content associated with the preset area.
[0009] Some embodiments of this application provide a control method for a display device. The method is applied to the display device, which includes a display for displaying a user interface, the user interface having a display object whose position on the user interface is determined by a position pointed to by a control device in three-dimensional space; and a controller connected to the display. The method includes:
[0010] When the hovering time of the displayed object in the preset area of the user interface reaches the preset time, a function floating window is displayed on the user interface. The function floating window is used to provide an operation entry point for customized content associated with the preset area. The position of the displayed object on the user interface is determined by the position pointed to by the control device in three-dimensional space. Attached Figure Description
[0011] Figure 1 illustrates an operational scenario between a display device and a control device according to some embodiments;
[0012] Figure 2 shows a hardware configuration block diagram of a control device 100 according to some embodiments;
[0013] Figure 3 shows a hardware configuration block diagram of a display device 200 according to some embodiments;
[0014] Figure 4 illustrates a software configuration diagram of a display device 200 according to some embodiments;
[0015] Figure 5 illustrates a schematic diagram of a user interface according to some embodiments;
[0016] Figure 6 is a schematic diagram of a control scenario for a pointing remote control provided in some embodiments of this application;
[0017] Figure 7 is a flowchart of a control method for a display device provided in some embodiments of this application;
[0018] Figure 8 is a schematic diagram of a scenario where a remote control is used to point to the upper left corner, according to some embodiments of this application;
[0019] Figure 9 is a schematic diagram of a functional floating window provided in some embodiments of this application;
[0020] Figure 10 is a schematic diagram of a target display interface provided in some embodiments of this application;
[0021] Figure 11 is a schematic diagram of a customized interface provided in some embodiments of this application;
[0022] Figure 12 is a schematic diagram of a customized interface provided in some embodiments of this application;
[0023] Figure 13 is a schematic diagram of another customized interface provided in some embodiments of this application;
[0024] Figure 14 is a schematic diagram of the software architecture of a display device provided in some embodiments of this application;
[0025] Figure 15 is a schematic diagram of the configuration process of a pointing function provided in some embodiments of this application;
[0026] Figure 16 is a flowchart illustrating the implementation of a control method for a display device according to some embodiments of this application;
[0027] Figure 17 is a flowchart of a method for controlling the display of a functional floating window in a display device according to some embodiments of this application;
[0028] Figure 18 is a schematic diagram of a detection floating window provided in some embodiments of this application;
[0029] Figure 19 is a flowchart illustrating the implementation of another method for controlling the visibility of a functional floating window provided in some embodiments of this application;
[0030] Figure 20 is a flowchart illustrating the implementation of another method for controlling the visibility of a functional floating window provided in some embodiments of this application. Detailed Implementation
[0031] To make the objectives and implementation methods of this application clearer, the exemplary implementation methods of this application will be clearly and completely described below with reference to the accompanying drawings of the exemplary embodiments of this application. Obviously, the exemplary embodiments described are only some embodiments of this application, and not all embodiments.
[0032] In related technologies, when a user wants to access an application or function by pointing a remote control, the user typically needs to start by navigating from the device's main interface, entering the application list or category menu, scrolling through the list to find the target application, and then clicking to enter it. For example, to access a video application, a user wants to watch a video, so they need to go to the application list from the main interface, find the video application, and open it. Similarly, to launch a game application, a user needs to go to the game library from the main interface, find the game, and launch it. As can be seen, the steps involved in accessing applications by pointing a remote control in these technologies are numerous, especially when there are many applications, requiring users to spend a significant amount of time searching for the target application.
[0033] In view of this, some embodiments of this application provide a display device and its control method to solve the problem of numerous operation steps. The display device provided in some embodiments of this application can have various implementation forms, such as a television, smart television, laser projection device, monitor, electronic bulletin board, electronic table, etc. Figures 1 and 2 illustrate some embodiments of the display device of this application. Figure 1 is a schematic diagram of an operation scenario between the display device and the control device according to some embodiments. As shown in Figure 1, a user can operate the display device 200 through a smart device 300 or a control device 100. In some embodiments, the control device 100 can be a remote control, and communication between the remote control and the display device includes infrared protocol communication, satellite communication, or Bluetooth protocol communication, as well as other short-range communication methods, to control the display device 200 wirelessly or via wired means. The user can input user commands through buttons on the remote control, voice input, control panel input, etc., to control the display device 200. In some embodiments, a smart device 300 (such as a mobile terminal, tablet computer, computer, laptop computer, etc.) can also be used to control the display device 200. For example, an application running on the smart device can be used to control the display device 200. In some embodiments, the display device may receive commands not through the aforementioned smart device or control device, but through touch or gestures. In some embodiments, the display device 200 may also be controlled in ways other than the control device 100 and the smart device 300. For example, it may receive user voice commands directly through a module configured within the display device 200, or it may receive user voice commands through an external voice control device. In some embodiments, the display device 200 also communicates with the server 400. The display device 200 may communicate via a local area network (LAN), wireless local area network (WLAN), and other networks. The server 400 may provide various content and interactive features to the display device 200. The server 400 may be a cluster or multiple clusters, and may include one or more types of servers.
[0034] Figure 2 exemplarily illustrates a configuration block diagram of the control device 100 according to some embodiments. As shown in Figure 2, the control device 100 includes at least one of a controller 110, a communication interface 130, a user input / output interface 140, a memory 190, and a power supply 180. The control device 100 can receive user input operation commands and convert the operation commands into commands that the display device 200 can recognize and respond to, thus acting as an intermediary for interaction between the user and the display device 200. In some embodiments of this application, the control device can be a remote control with pointing function. Here, the control device can be called a pointing remote control. The pointing remote control introduces a completely new interaction method, getting rid of the operation limitations of remote controls in related technologies. The operation method is like using a laser pointer, which can accurately point to the target control without the need to switch icons step by step, making it efficient and convenient. In some embodiments, the pointing remote control has a pointing switch on its body. When the pointing switch is turned on, it enters the pointing mode, and the user can point, slide, and perform other operations through the displayed object (such as the cursor). When the pointing switch is turned off, the pointing remote control switches from the pointing mode to the button mode of related technologies. In the button mode of related technologies, the up / down / left / right / confirm buttons can be used for operation. In some embodiments, after the pointing switch is turned on and the pointing mode is entered, it can coexist with the button mode of related technologies. Users can perform operations such as pointing, sliding, and clicking through the displayed object (such as the cursor), or use the confirmation key and the up / down / left / right / volume keys. In some embodiments, in the button mode of related technologies, the remote control is in a low-power mode; however, after the pointing switch is turned on and the pointing mode is entered, the remote control is no longer in a low-power mode. Therefore, in some embodiments, a charging interface, such as a Type-C interface, can be configured for the remote control. In some embodiments, the controller 110 may include RAM 113, ROM 114, processor 112, etc. The communication interface 130 may include at least one of WiFi chip 131, Bluetooth module 132, NFC 133, etc. The user input / output interface 140 may include at least one of microphone 141, touchpad 142, sensor 143, button 144, etc.
[0035] In some embodiments, the pointing remote control is a remote control device capable of detecting its own position and orientation in three-dimensional space. The pointing remote control has a built-in gyroscope for detecting the remote control's rotation angle and its movement acceleration. Through sensors, the pointing remote control can determine its pointing position in three-dimensional space in real time. The pointing position can include position coordinates and pointing direction, where the position coordinates are the physical position of the remote control relative to the display device (e.g., horizontal distance, vertical height, etc.). The pointing direction is the pointing angle of the remote control (e.g., horizontal and vertical angles relative to the display device). In some embodiments, after obtaining its pointing position in three-dimensional space, the pointing remote control can send the pointing position data to the display device, allowing the display device to obtain the pointing position. The display device can then perform screen coordinate transformation based on the pointing position, thus mapping the pointing position of the remote control to the screen coordinate system. At this time, the display device updates the position of the displayed object (e.g., the cursor) according to the calculated screen coordinates. When the user moves the remote control, the remote control's sensors continuously detect changes in position and orientation and send the data to the display device. The display device updates the position of the displayed object in real time, and the cursor moves following the pointing direction of the pointing remote control. The display device can calculate the screen coordinates mapped to the pointing position of the control device. After obtaining the screen coordinates of the pointing position, the display device can display a cursor on the operation interface based on the screen coordinates. When the screen coordinates mapped to the pointing position of the control device are within the operation interface, the display device obtains the cursor's screen coordinates in the operation interface based on the screen coordinates mapped to the pointing position of the control device. At this time, the cursor moves with the direction of movement of the control device. When the screen coordinates mapped to the pointing position of the control device are outside the operation interface, the display device generates a cursor in the operation interface based on the screen coordinates it last had when it was in the operation interface. At this time, the cursor does not move with the control device but is fixed at the screen position of the screen coordinates it last had when it was in the operation interface.
[0036] Figure 3 is a schematic diagram of an operation scenario of a pointing remote control provided in some embodiments of this application. As shown in Figure 3, the user can change the pointing position of the pointing remote control 20, so that the display device displays the display object 30 on the user interface 10 in real time according to the pointing position. In some embodiments, the pointing remote control can control the display object of the user interface. The cursor can be moved by pointing the pointing remote control to different areas on the screen to achieve precise selection. The pointing remote control can switch between multiple modes. When the pointing switch of the pointing remote control is turned on, the pointing function is enabled, and operations such as pointing, sliding, and clicking can be performed on the display object. When the pointing switch of the pointing remote control is turned off, the pointing function is turned off. When the pointing function of the pointing remote control is turned off, the pointing remote control can work in button mode, and the display device can be controlled by button operation of related technologies. The pointing remote control supports multiple operation modes such as skipping, tapping, selecting, sliding, and dragging, making browsing content more convenient. In some embodiments, when the pointing function of the pointing remote control is enabled, the OK button in the ordinary buttons of the pointing remote control can be shared in the pointing function mode. Figure 4 is a schematic diagram of a control scenario for a remote control provided in some embodiments of this application. As shown in Figure 4, if a user wants to perform a confirmation operation, he / she can press the confirmation button to enable the display device to receive the confirmation operation.
[0037] As shown in Figure 5, in some embodiments, the display device 200 includes at least one of a tuner / demodulator 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory 291, a power supply 292, and a user input interface 280. In some embodiments, the controller 250 includes a central processing unit 2501, a video processor 2502, an audio processor 2503, a graphics processor 2504, RAM 2507, ROM 2508, a first interface 2505 for input / output, a second interface 2506, ... to an nth interface 250n. The display 260 includes a display screen assembly for presenting images, a driving assembly for driving image display, a component for receiving image signals output from the controller, and components for displaying video content, image content, and a menu control interface, as well as a user interface. The display 260 may be a liquid crystal display, an OLED display, or a projection display, and may also be a projection device and a projection screen.
[0038] In some embodiments, the communication device 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communication device 220 may include at least one of the following: a Wi-Fi module 2201, a Bluetooth module 2202, an Ethernet module 2203, or other network communication protocol chips or near-field communication protocol chips, as well as an infrared receiver. The display device 200 can establish the transmission and reception of control signals and data signals with the external control device 100 or the server 400 through the communication device 220. The user input interface 280 can be used to receive control signals from the control device 100 (e.g., pointing to a remote control). These control signals may include the position information of the control device in three-dimensional space. When the control signal is the position information of the control device in three-dimensional space, the controller can perform coordinate transformation on the position information to obtain the position information in two-dimensional space or screen coordinates, and display the display object on the user interface using the position information in two-dimensional space or screen coordinates. In some embodiments, the control signal may also include: position information or screen coordinates in two-dimensional space. When the control signal includes position information or screen coordinates in two-dimensional space, the control device has a coordinate transformation function. The control device performs coordinate transformation on the position information or screen coordinates it detects in three-dimensional space to obtain position information or screen coordinates in two-dimensional space, and sends the position information or screen coordinates in two-dimensional space to the display device, thereby enabling the display device to display the display object on the user interface based on the position information or screen coordinates in two-dimensional space.
[0039] In some embodiments, detector 230 is used to acquire signals from the external environment or signals interacting with the external environment. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition unit 2301, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition unit 2302, such as a microphone, for receiving external sound. Device interface 240 may include, but is not limited to, the following: High Definition Multimedia Interface (HDMI) 2401, Analog or Data High Definition Component Input Interface (Component) 2403, Composite Video Input Interface (CVBS) 2402, and USB Input Interface (USB).
[0040] The input / output interface may include one or more interfaces such as 2404 and RGB ports. It may also be a composite input / output interface formed by multiple of the above interfaces. The tuner / demodulator 210 receives broadcast television signals via wired or wireless means, and demodulates audio and video signals, such as EPG data signals, from multiple wireless or wired broadcast television signals. The audio output device 270 may include at least one of a speaker 2701, an external audio output terminal 2702, etc.
[0041] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices; that is, the tuner 210 may also be located in an external device of the main device containing the controller 250, such as an external set-top box. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200. For example, in response to receiving a user command to select a UI object to display on the display 260, the controller 250 can perform operations related to the object selected by the user command. In some embodiments, the controller includes at least one of a central processing unit (CPU), a video processor, an audio processor, a graphics processing unit (GPU), RAM (Random Access Memory), ROM (Read-Only Memory), a first to an nth interface for input / output, a communication bus, etc. In some embodiments of this application, the memory is also used to store the connection status of the communication connection between the control device and the display device and the update timestamps corresponding to the connection status. Users can input commands through a graphical user interface (GUI) displayed on the monitor 260, and the user input interface receives the user input commands through the GUI. Alternatively, users can input commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.
[0042] A "user interface" is the medium through which an application or operating system interacts and exchanges information with a user. It converts information from its internal form to a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be an icon, window, control, view, or other interface element displayed on the screen of an electronic device. Controls can include visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets. In some embodiments, the display device 200 may run an operating system to perform user interaction. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200. In some embodiments, the user interface may also be called an operating interface.
[0043] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system deeply customized for a specific operating platform, or an independent operating system specifically developed for display devices. The operating system can be divided into different modules or layers according to the functions it implements. For example, as shown in Figure 6, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer 6001 (referred to as the "Application Layer"), the Application Framework layer 6002 (referred to as the "Framework Layer"), the System Runtime Library layer 6003, and the Kernel layer 6004.
[0044] In some embodiments, at least one application runs in the application layer. This application may include: Application 1, Application 2, Application 3, Application 4, etc. These applications may be built-in Windows programs, system settings programs, or clock programs, etc., or they may be applications developed by third-party developers. For example, Application 1 may be a karaoke application, and Application 2 may be a video application. In specific implementations, the application packages in the application layer are not limited to the examples above. The framework layer provides the application programming interface (API) and programming framework for the applications. The application framework layer includes some predefined functions. The application framework layer acts as a processing center, determining the actions of the applications in the application layer. Through the API interface, applications can access system resources and obtain system services during execution.
[0045] As shown in Figure 6, in some embodiments of this application, the application framework layer includes managers, content providers, etc., wherein the managers include at least one of the following modules: an Activity Manager for interacting with all activities running in the system; a Location Manager for providing system services or applications with access to system location services; a Package Manager for retrieving various information related to application packages currently installed on the device; a Notification Manager for controlling the display and clearing of notification messages; and a Window Manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.
[0046] In some embodiments, the Activity Manager manages the lifecycle of each application and common navigation and back functions, such as controlling application exit, opening, and navigating. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling display window changes (e.g., shrinking the display window, dithering the display, distorting the display, etc.). In some embodiments, the system runtime layer provides support for the upper layer, i.e., the framework layer. When the framework layer is used, the Android operating system runs the C / C++ libraries contained in the system runtime layer to implement the functions required by the framework layer. In some embodiments, the kernel layer is the layer between hardware and software. As shown in Figure 6, the kernel layer contains at least one of the following drivers: audio driver, display driver, Bluetooth driver, camera driver, Wi-Fi driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.
[0047] In some embodiments of this application, the display device includes: a display configured to display a user interface having a display object, the position of which on the user interface is determined by the position pointed to by a control device in three-dimensional space; and a controller connected to the display, configured to: when the hovering time of the display object within a preset area of the user interface reaches a preset time (also called a first preset time) and the preset area is associated with customized content, control the display to present a functional floating window on top of the user interface, wherein the functional floating window is used to provide an operation entry point for the customized content; and in response to a first operation of the control device on the operation entry point, control the display to display a target display interface corresponding to the customized content, thereby reducing the user's operation steps to enter the target display interface and improving the user's operation efficiency. In some embodiments, the display device may also reduce noise in sensor data and improve the stability of the display object through a filtering algorithm (e.g., Kalman filtering).
[0048] To facilitate a further understanding of the technical solutions in some embodiments of this application, the technical solutions of the display device and the control method of the display device, and how these technical solutions solve the aforementioned technical problems, are described in detail below with reference to some specific embodiments and accompanying drawings. The embodiments can be combined with each other, and the same or similar concepts or processes may not be described again in some embodiments. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments.
[0049] Figure 7 is a flowchart of a control method for a display device according to some embodiments of this application. As shown in Figure 7, the controller is configured to perform the following steps:
[0050] Step S71: When the hovering time of the displayed object in the preset area of the user interface reaches the first preset time and the preset area is associated with customized content, control the display to display a function floating window on the upper layer of the user interface, wherein the function floating window is used to provide an operation entry point for the customized content.
[0051] In some embodiments, a preset region is one or more specific areas predefined in the user interface. These regions can be a corner or edge of the screen. For example, the preset region may be located at at least one of the top-left, top-right, bottom-left, bottom-right corners of the display, the left edge of the screen, and the right edge of the screen. In some embodiments, the display screen is typically represented using a two-dimensional coordinate system, with the origin (0,0) located at the top-left corner of the screen. The horizontal direction is the X-axis, with the positive direction to the right. The vertical direction is the Y-axis, with the positive direction downwards. The screen width is screen_width, and the height is screen_height. The top-left, top-right, bottom-left, bottom-right corners, the left edge of the screen, and the right edge of the screen can be represented by coordinate ranges. The size of the range can be configured. For example, the coordinate range of the top-left corner can be represented as (0, 0) to (screen_width*0.2, screen_height*0.2), the coordinate range of the top-right corner can be represented as (screen_width*0.8, 0) to (screen_width, screen_height*0.2), the coordinate range of the bottom-left corner can be represented as (0, screen_height*0.8) to (screen_width*0.2, screen_height), and the coordinate range of the bottom-right corner can be represented as (sc The coordinate range of the preset area is (0, 0) to (screen_width*0.1, screen_height) and the coordinate range of the right edge is (screen_width*0.9, 0) to (screen_width, screen_height). Here, 0.2, 0.8, 0.1, and 0.9 are the proportions of the preset area to the screen width or height, which can be adjusted according to actual needs. In some embodiments, the coordinate range of the preset area can be stored in a configuration file or database. Whether a displayed object is within the preset area can be determined by calculating whether it is within the coordinate range corresponding to the preset area. In some embodiments, the hover duration refers to the length of time the displayed object stays within the preset area. The first preset duration is a defined threshold time used to determine whether the displayed object has hovered within the preset area for a sufficient amount of time. The first preset duration can be set to any duration between 300 milliseconds and 1 second; for example, the first preset duration is 500 milliseconds.
[0052] In some embodiments, the customized content can be any one of the following: an application or an identifier of a signal source interface. A function floating window is an interface element, such as an icon, window, control, or view, that floats above the user interface and provides an entry point for customized content. Function floating windows are typically located at the top of the user interface to avoid being obscured by other interface elements. In some embodiments of this application, window levels are used to manage the display order of different types of windows on the screen. The window level of a function floating window can be a system-type window level. Since the window level of a normal application is usually lower than the system-type window level, and the user interface is usually a normal application, setting the window level of the function floating window to a system-type window level allows the function floating window to appear on the user interface. For example, if the window level of a normal application is a system-type window level, the application window level range is typically 2000 to 2999, then the window level of the function floating window can be greater than 2999. In some embodiments of this application, the layer of the function floating window can be lower than the window layer of the input method. In some embodiments, the layer of the function floating window can be the same as the window layer of the volume adjustment floating window when adjusting the volume. In some embodiments, the window layer of the function floating window can also apply the window layer, but the window layer of the function floating window is higher than the window layer of the user interface. For example, if the window layer of the user interface is 2500, then the window layer of the function floating window can be 2501 to 2999. In some embodiments of this application, the function floating window includes an operation entry point, which is an interactive element in the function floating window. The user can select and trigger the operation entry point through the control device. The operation entry point is usually presented in the form of a button, icon, or text. When the customized content is an application, the operation entry point can be a shortcut icon of the application; when the customized content is an identifier of a signal source interface, the operation entry point corresponds to the entry point of the signal source interface.
[0053] In some embodiments of this application, the controller can monitor the position of the displayed object and determine whether the displayed object is in a hovering state when it enters a preset area. The displacement change of the displayed object within each sampling period can be determined based on its position over multiple preset duration sampling periods; if the displacement change within a consecutive preset sampling period is less than a preset displacement change threshold, the displayed object is determined to be in a hovering state. In some embodiments of this application, when the displayed object is in a hovering state, the controller can continuously monitor the hovering time of the displayed object within the preset area. If the hovering time reaches a first preset duration, it checks whether the preset area is associated with customized content. If it is associated with customized content, the controller controls the display to show a floating window. For example, taking the upper left corner as the preset area, the user can point to the upper left corner using a remote control. Figure 8 is a schematic diagram of a scenario where the user points to the upper left corner using a remote control, as shown in Figure 8. At this time, the displayed object is displayed in the upper left corner. When the displayed object hovers in the upper left corner for a first preset duration, a function floating window is displayed. Figure 9 is a schematic diagram of a function floating window provided in some embodiments of this application. As shown in Figure 9, the function floating window is displayed in the upper left corner. The function floating window contains an HDMI 1 / ARC identifier, which serves as the operation entry point.
[0054] In step S72, in response to the first operation of the control device on the operation entry, the control display is made to show the target display interface corresponding to the customized content.
[0055] In some embodiments of this application, the first operation refers to the user's triggering action on the operation entry through the control device. This could be the user pressing the confirmation button on the remote control, thus obtaining the first operation of the control device on the operation entry. The target display interface is the interface displayed after the user triggers the operation entry. If the customized content is an application, the target display interface is the main interface of that application. If the operation entry is an identifier of a signal source interface, the target display interface is the input screen of an external device (such as a game console or computer). Continuing with the above example, Figure 10 is a schematic diagram of a target display interface provided in some embodiments of this application. As shown in Figure 10, the user can trigger the operation entry through the control device to enter the target display interface corresponding to HDMI 1 / ARC.
[0056] The following example illustrates how a user can quickly access applications on a smart TV using a pointing remote. The user holds the remote and points it at the center of the TV screen; the cursor appears in the center. Moving the remote to the upper right, the cursor enters a preset area in the upper right corner of the screen. The controller starts a timer. When the hover time reaches the first preset duration, it checks if the preset area is associated with customized content. If a music application is associated, a function pop-up window appears on the screen. This pop-up window contains the music application's entry point. The user selects "Music Application" by pointing the remote, launching the music application and displaying its main interface (target display interface).
[0057] The display device provided in some embodiments of this application, when the hovering time of the displayed object in a preset area of the user interface reaches a first preset time and the preset area is associated with customized content, controls the display to present a functional floating window on the upper layer of the user interface, wherein the functional floating window is used to provide an operation entry point for the customized content; in response to the first operation of the control device on the operation entry point, controls the display to display the target display interface corresponding to the customized content. Since it is not necessary to navigate to the target application or function step by step, but to directly enter the target display interface through the functional floating window, the operation process of the user to enter the target display interface can be reduced, and the user's operation efficiency can be improved. In some embodiments, when the hovering time of the displayed object in a preset area of the user interface reaches a first preset time and the preset area is associated with customized content, the controller controls the display to present a functional floating window on the upper layer of the user interface, and is configured to perform the following steps:
[0058] Step S711: When the hovering time of the displayed object in the preset area of the user interface reaches the first preset time, obtain the mapping set, wherein the mapping set includes: the association relationship between any preset areas and customized content.
[0059] In some embodiments of this application, the mapping set can be a data structure used to store the association between preset regions and customized content. The mapping set can be stored in key-value pairs, where the key can be an identifier of the preset region (e.g., region ID or coordinate range), and the value can be the customized content associated with that region. In some embodiments, the mapping set can also be stored as a database table. In some embodiments, the mapping set further includes a functional description of the operation entry point.
[0060] The following example uses a preset region in the mapping set, including the upper left corner, upper right corner, lower right corner, and lower left corner. Table 1 is a schematic table of a mapping set provided in this application. As shown in Table 1,
[0061] In this table, the top left corner is associated with the HDMI 1 signal source. When the user hovers over it and interacts with it, the display switches to the HDMI 1 signal source to show the content of the connected external device (such as a game console). The top right corner is associated with a video player application. When the user hovers over it and interacts with it, the video player is launched and its interface is displayed. The bottom right corner is associated with a weather forecast application. When the user hovers over it and interacts with it, the weather forecast application is launched and weather information is displayed. The bottom left corner is associated with a USB signal source. When the user hovers over it and interacts with it, the display switches to the USB signal source to show the content of the USB device. In some embodiments of this application, the mapping set can be stored in the memory or storage chip of the display device. When the hovering time of the displayed object in the preset area of the user interface reaches a first preset time, the mapping set is retrieved from the storage area of the display device.
[0062] Step S712: Based on the mapping set, obtain the customized content of the preset area, and control the display to present the function floating window on the upper layer of the user interface.
[0063] In some embodiments of this application, the controller can search for corresponding customized content from a mapping set based on the identifier of a preset area. For example, if the preset area is the upper left corner, the customized content found through the mapping set is the signal source interface (HDMI 1). In some embodiments of this application, the controller can generate a function floating window based on the acquired customized content. The function floating window contains operation entries related to the customized content. The display device provided in some embodiments of this application stores associations through a mapping set, allowing the controller to dynamically associate preset areas with customized content without modifying the underlying code. For example, users can add, delete, or modify the association between preset areas and content through a configuration interface. The mapping set can store different types of customized content (such as applications, identifiers of signal source interfaces, etc.), thereby supporting diverse functional requirements. In addition, all associations between preset areas and customized content are stored in the mapping set, facilitating unified management and maintenance. The mapping set supports dynamic content updates to support real-time changing scenarios. For example, when a user uninstalls an application, the controller can automatically update the associations in the mapping set.
[0064] In some embodiments, the controller can be configured to perform step S71 as follows:
[0065] Step S713: If the hovering time of the displayed object in the preset area of the user interface reaches the first preset time, obtain the mode of the display device.
[0066] In some embodiments of this application, scene information stored in the system can be obtained, and the mode of the display device can be determined by the scene information.
[0067] Step S714: When the mode is the first preset mode and the preset area is associated with customized content, control the display to display a function floating window on the upper layer of the user interface.
[0068] In some embodiments of this application, the first preset mode can be a user-defined mode. For example, the first preset mode can be a home mode, normal usage mode, cinema mode, etc. Only in the first preset mode will the display show a function floating window on top of the user interface; otherwise, the function floating window will not be shown. For example, in game mode, the user does not want to be disturbed by the function floating window. By determining the mode as game mode, the function floating window will not be displayed, ensuring an immersive gaming experience for the user. The display device provided in some embodiments of this application, through mode determination, can ensure that the function floating window is only displayed in appropriate scenarios, avoiding interference with the user's current operation.
[0069] In some embodiments, the controller is also configured to perform the following steps:
[0070] Step S73: Remove the display object from the function floating window and control the display to hide the function floating window.
[0071] In some embodiments of this application, the pointing position of the control device can be obtained in real time, the coordinates of the displayed object on the screen can be calculated, and it can be determined whether the coordinates are within the range of the functional floating window. If the displayed object moves out of the functional floating window, the display is controlled to hide the functional floating window. The display device provided in some embodiments of this application displays the functional floating window only when needed and automatically hides it after it is moved out, which makes the interface more concise and intuitive. Users do not need to manually close the floating window; they only need to move the displayed object out of the floating window for it to hide automatically, making the operation more efficient. After hiding the floating window, there is no need to continue rendering the floating window content, which can reduce the load on the GPU and CPU and improve device performance.
[0072] In some embodiments, the controller is also configured to perform the following steps:
[0073] Step S74: If the hovering duration of the displayed object within the function floating window exceeds a preset time threshold, control the display to hide the function floating window, wherein the preset time threshold is greater than a first preset duration.
[0074] In some embodiments of this application, a preset time threshold is a defined time value used to determine whether the dwell time of the displayed object within the functional floating window is too long. The preset time threshold is typically greater than a first preset duration. For example, the preset time threshold can be 2 seconds. In some embodiments of this application, if the displayed object remains within the functional floating window, a timer can be started. When the dwell time exceeds the preset time threshold (e.g., 2 seconds), the operation of hiding the functional floating window is triggered. Hiding the functional floating window can directly remove the functional floating window. When hiding the functional floating window, an animation effect can be used. The display device provided in some embodiments of this application, by controlling the display to hide the functional floating window when the dwell time of the displayed object within the functional floating window exceeds the preset time threshold, avoids excessive interference from interface elements with user operations. By setting a preset time threshold, unnecessary operations are avoided due to unintentional user dwell.
[0075] In some embodiments, the display device further includes a signal source interface for connecting to an external device. When the customized content associated with a preset area is an identifier for the signal source interface, the controller is configured to perform the following steps:
[0076] Step S723: In response to the first operation of the control device on the operation entry, a channel switching command is generated based on the identifier of the signal source interface so that the content input by the external device can be displayed on the display.
[0077] In some embodiments of this application, the signal source interface may include at least one of HDMI, USB, and network interface. HDMI is used to connect game consoles, computers, Blu-ray players, etc.; USB is used to connect storage devices, cameras, etc.; and the network interface is used to connect network streaming media devices. In some embodiments of this application, the identifier of the signal source interface may be the name of the signal source interface. The first operation refers to the user's triggering action on the operation entry by controlling the device. This can be achieved by pressing the OK button on the remote control, thereby enabling the display device to obtain the first operation on the operation entry of the remote control. The channel switching instruction is an instruction generated by the controller to switch the input signal of the display device to the specified signal source interface. For example, switching to the "HDMI 1" interface. The target display interface is the content input by the external device, such as game screen, computer desktop, etc. In some embodiments of this application, the controller can call the underlying hardware interface or driver to generate and execute the channel switching instruction through the channel switching instruction. After switching the signal source, the controller can read the input signal from the specified signal source interface and display it on the display. If the external device is not connected or not turned on, a prompt message can be displayed. After the content input by the external device is displayed on the display, the function floating window can be hidden. The display devices provided in some embodiments of this application allow users to quickly switch signal source interfaces through simple operations without having to navigate through complex settings menus.
[0078] In some embodiments, when the customized content associated with the preset area is an application, the controller, in response to the first operation of the control device on the operation entry, controls the display to show the target display interface corresponding to the customized content. The controller is also configured to perform the following steps:
[0079] Step S724: In response to the first operation of the control device on the operation entry, the application is launched and the display is controlled to show the target display interface corresponding to the application.
[0080] In some embodiments of this application, the application may include: a music player, a video player, a browser, a game application, a video application, etc. These applications may be those pre-installed with the display device at the factory or those installed by the user after purchase. After receiving the first operation from the control device at the operation entry point, the controller can call the application's startup interface or command line to launch the application, and the target display interface shown on the display device is the application's main interface or function interface. After launching the application, the function floating window can be automatically hidden to avoid interfering with user operation. The display device provided in some embodiments of this application allows users to quickly launch applications through simple operations without navigating complex menus.
[0081] In some embodiments, the controller is also configured to perform the following steps:
[0082] In step S75, if no customized content is associated with the preset area, the display is controlled to display a guide window on the upper layer of the user interface. The guide window is used to guide the user to enter the customized interface, which is used to allow the user to configure the association between the preset area and the customized content.
[0083] In some embodiments of this application, a guide window is an interface element, such as an icon, window, control, or view, that floats above the user interface. It is used to prompt the user that the current preset area is not associated with customized content and guides the user to the customization interface for configuration. The guide window is typically located at the top of the user interface and is not obscured by other interface elements. The customization interface is a dedicated configuration interface used to allow the user to configure the association between the preset area and customized content. The customization interface typically includes configuration options for the preset area. In some embodiments of this application, the guide window may also be displayed within the preset area. The display device provided in some embodiments of this application prompts the user to configure via a guide window, allowing the user to quickly understand the functions of the preset area and actively participate in the configuration of customized content, enhancing the user's sense of participation and control.
[0084] In some embodiments, the controller can execute step S75 by the following steps:
[0085] In step S751, if no customized content is associated with the preset area and the number of times the display object enters the preset area is less than the preset number, control the display to present a guide floating window on the upper layer of the user interface.
[0086] In some embodiments of this application, the number of times a display object enters a preset area refers to the cumulative number of times the display object enters the preset area. The controller can record this number using a counter, which records the number each time the display object enters the preset area. The preset number is a defined threshold used to determine whether a guide window needs to be displayed. For example, the preset number can be set to 6 times. In some embodiments of this application, the number of times the display object enters the preset area can be compared with the preset number. If the number of times the display object enters the preset area is less than the preset number, it indicates that the user has entered less frequently and may need to configure customized content. Therefore, in this case, the display is controlled to display a guide window on top of the user interface. In some embodiments, if the number of times the display object enters the preset area is greater than the preset number, it indicates that the display object has entered multiple times. If the preset area is not associated with customized content, the user may not want to configure customized content. To avoid affecting the user, if the number of times the display object enters the preset area is greater than the preset number, the display is controlled not to display the guide window.
[0087] In some embodiments, after executing step 75 or step S751, the controller is further configured to perform the following steps:
[0088] In step S76, in response to the second operation of the control device on the guide window, the control display presents a customized interface, which includes configuration options corresponding to the preset area.
[0089] In some embodiments of this application, the user can press the OK button on the control device, thereby enabling the controller to obtain a second operation of the control device on the guide floating window. At this time, the control display presents a customized interface. The customized interface is a dedicated configuration interface used to allow the user to configure the association between the preset area and customized content. Figure 11 is a schematic diagram of a customized interface provided in some embodiments of this application. As shown in Figure 11, the customized interface includes configuration options corresponding to the preset area. In some embodiments, the customized interface also includes: prompt information, for example, the prompt information is: Touch corner function customization, you can use the screen corner as the control corner, and the operation can be quickly started when the cursor is moved to the corner. In some embodiments of this application, the configuration option is an interactive element in the customized interface, used to select the preset area. The configuration options corresponding to the preset area can be pre-configured, and the user can click the configuration option corresponding to the preset area to configure the preset area. Exemplarily, continuing to refer to Figure 11, the configuration options may include: the option in the upper left corner, the option in the upper right corner, the option in the lower left corner, and the option in the lower right corner. In some embodiments, the configuration options may also include options on the left edge and the right edge.
[0090] In step S77, in response to the control device's selection of configuration options, the control display shows a selection list, wherein the selection list includes at least one option for customized content.
[0091] In some embodiments of this application, the selection list is a list containing multiple options. This selection list may include only the application or only the identifier of the signal source interface. In some embodiments, the selection list may also include both the identifier of the signal source interface and the application. When the selection list includes both the signal source interface and the application, it can be obtained by merging the application list and the signal source list. For example, the application list includes options such as "music player" and "video player," and the signal source interface list includes options such as "HDMI 1," "HDMI 2," "HDMI 1," "USB 1," and "USB 2." By merging the application list and the signal source interface list, the selection list can be obtained, which may include options such as "music player," "video player," "HDMI 1," and "USB 2." In some embodiments of this application, the user can manipulate the control device to select configuration options, thereby enabling the control device to obtain the selection operation of the configuration options. In response to the selection operation, the control display shows the selection list. Figure 12 is a schematic diagram of another customized interface provided in some embodiments of this application. As shown in Figure 12, the selection list includes both the application and the signal source interface.
[0092] Step S78: In response to the control device's selection operation of the target option in the selection list, establish the association between the preset area and the customized content corresponding to the target option, and store the association in the mapping set.
[0093] In some embodiments of this application, the target option is a specific option selected by the user from a selection list. The association relationship is used to describe the logical connection or binding relationship between the preset area and the customized content corresponding to the target option, so that the preset area can trigger or call the customized content. For example, Figure 13 is a schematic diagram of another customized interface provided in some embodiments of this application. The customized content associated with the upper left corner is HDMI 1 / ARC, the customized content associated with the upper right corner is Media Center, the customized content associated with the lower left corner is Video Playback Application 1, and the customized content associated with the lower right corner is Video Playback Application 2. The association relationship is usually stored in a mapping set in the form of key-value pairs. The mapping set can be stored on a local device (such as the memory or storage chip of a TV) or a remote server. The display device provided in some embodiments of this application provides an intuitive configuration experience through a guide floating window and a customized interface, supporting users to customize the association relationship between the preset area and the customized content.
[0094] In some embodiments, the customized interface further includes: a screen mapping view of the display, and while the controller is executing step S707, the controller is also configured to execute the following steps:
[0095] In step S79, in response to the control device's selection operation for the configuration option, the control display outputs a first prompt message in the screen mapping view. The first prompt message is used to prompt the configuration of customized content for the preset area.
[0096] In some embodiments of this application, the screen mapping view is a visual component in the customized interface, used to display the screen layout of the display and the position of a preset area. The first prompt message is a prompt displayed in the screen mapping view, used to guide the user to configure the customized content of the preset area. The first prompt message can highlight the preset area. For example, if the user selects a configuration option for the preset area in the lower right corner of the screen, then the lower right corner of the screen mapping view will be highlighted. In some embodiments, the first prompt message can also be a cursor in the lower right corner of the screen mapping view to prompt the user to configure the customized content in the lower right corner. The display device provided in some embodiments of this application provides an intuitive configuration experience through a visual interface and prompt messages.
[0097] In some embodiments, the controller is also configured to perform the following steps:
[0098] Step S7100: Obtain the list of applications and the list of disabled applications in the display device.
[0099] In some embodiments of this application, the application list is a collection of applications installed on the display device and available to the user. The application list typically includes the names of the applications. The disabled application list is a collection of applications that are disabled or hidden on the display device. The disabled application list typically includes the following information: the names of the disabled applications. In some embodiments of this application, the list of applications installed on the display device and available to the user, and the list of disabled or hidden applications on the display device, can be obtained through the application management module.
[0100] Step S7110: Obtain the selection list based on the application list and the disabled application list.
[0101] In some embodiments of this application, an initial application list can be obtained based on an application list and a disabled list. A selection list is then obtained based on the priority of applications in the initial application list. The disabled application list can be filtered out to obtain the initial application list. In some embodiments, the priority of applications can be determined based on application type and user usage frequency, wherein user-installed applications have a higher priority than system applications, and applications used more frequently by the user have a higher priority than those used less frequently. In some embodiments, priority can also be determined based on installation time, with newly installed applications having higher priority. Applications can be sorted by priority to obtain the selection list. In some embodiments, when the selection list includes the identifier of a signal source interface, the identifier of the signal source interface has a higher priority than all applications; that is, the identifier of the signal source interface is listed first in the selection list. The display device provided in some embodiments of this application sorts customized options in the selection list by priority, enabling the provision of a selection list that better suits user habits. In some embodiments, the controller is further configured to: obtain the identifier of the signal source interface of the display device; and add the identifier of the signal source interface to the selection list. In some embodiments of this application, the identifiers of all available signal source interfaces in the display device can be obtained through a hardware management module. In some embodiments, the hardware interfaces of the display device can be scanned to obtain the identifier of the signal source interface. In other embodiments, interface information in a system configuration file or database can be read to obtain the identifier of the signal source interface. The controller can add the obtained identifier of the signal source interface to the selection list.
[0102] In some embodiments, the controller is also configured to perform the following steps:
[0103] Step S7120: If the control device does not perform a second operation on the guide floating window and the display device is in the second preset mode, the number of times the display object enters the preset area is not recorded. The second preset mode includes at least one of the following: power-on navigation mode, factory mode, channel search mode, conference mode, senior citizen mode, children's mode, upgrade mode, and game mode.
[0104] In some embodiments of this application, the second preset mode is a working state of the display device, typically used for specific scenarios or functions. The mode of the display device can be obtained through the system configuration file. The second preset mode includes at least one of the following: Boot-up Navigation Mode: the navigation interface displayed after the device is powered on; Factory Mode: the production and debugging mode of the device; Channel Search Mode: the mode in which the device automatically searches for television signals; Conference Mode: the mode in which the device is used for conference presentations; Senior Citizen Mode: the mode optimized for elderly users; Children's Mode: the mode optimized for children; Upgrade Mode: the mode in which the device performs system upgrades; Game Mode: the mode optimized for games. In some embodiments of this application, if the control device does not perform a second operation on the guide floating window, it means that the user has not clicked "OK" on the floating window.
[0105] Step S7130: If the control device does not perform a second operation on the guide floating window and the display device is not in the second preset mode, record the number of times the display object enters the preset area.
[0106] In some embodiments of this application, if the user does not perform a second operation, the controller checks whether the current operating mode of the display device is a second preset mode (e.g., boot navigation mode, factory mode, etc.). If it is in the second preset mode, the entry count is not recorded. If it is not in the second preset mode, the entry count is recorded. The controller can record the number of times the display object enters the preset area using a counter. The counter can increment each time the display object enters the preset area. The display device provided in some embodiments of this application, by distinguishing the device's operating mode (second preset mode and normal mode) and the user's operation on the guide window, can intelligently decide whether to record the number of times the display object enters the preset area, avoiding recording the entry count in unnecessary scenarios, affecting the output of the guide window, and thus affecting the configuration of the associated customized content of the preset area.
[0107] In some embodiments, the controller is also configured to perform the following steps:
[0108] In step S7140, if the customized content is a customized application, in response to the application uninstallation operation, the association between the preset area and the application is removed.
[0109] In some embodiments of this application, application uninstallation refers to the operation of a user or system removing an application from a display device. After uninstallation, the application will no longer be available. The application management module can detect application uninstallation operations. When an application is detected to be uninstalled, it checks whether the uninstalled application is associated with a preset region. This can be done by checking if a preset region associated with the uninstalled application exists in the mapping set. If it does, the association between the preset region and the application is severed. For example, if a user uninstalls "Music Player," the system detects that "Music Player" has been uninstalled. Since the Music Player is associated with a preset region, the association between that region and the application is severed.
[0110] In some embodiments, the controller is also configured to perform the following steps:
[0111] Step S7150: Control the display to output a prompt box in a preset area. The prompt box includes at least one of the following functions: prompting for the customized application to be uninstalled, outputting reconfiguration options, and prompting whether to automatically repair the customized application.
[0112] In some embodiments of this application, the prompt box is a window that floats on top of the user interface, used to display prompt information or provide operation options to the user. Continuing the example above, when the prompt box includes a prompt to uninstall a customized application, it displays "Music player uninstalled." The reconfiguration option is an operation entry point in the prompt box, used to guide the user to reconfigure the association between the preset area and customized content. Automatic repair refers to the system attempting to automatically restore the functionality of the uninstalled application. Automatic repair may include: reinstalling the uninstalled application, restoring the application's configuration files and data. In some embodiments of this application, if the prompt box includes a reconfiguration option, the user can select reconfiguration in the prompt box through the control device. When the user's operation is detected (e.g., pressing the confirmation key), the system jumps to the customization interface, where the user can reconfigure the association between the preset area and customized content. If the prompt box includes automatic repair, if the user selects "automatic repair," the controller can automatically restore the uninstalled application (e.g., reinstall the application or restore the configuration file). The display device provided in some embodiments of this application provides intuitive operation guidance through prompt boxes, improving the user experience and supporting users to reconfigure the association between the preset area and customized content. It also supports automatic repair functionality, providing a more intelligent interactive experience.
[0113] In some embodiments, prior to step S71, the controller is configured to perform the following steps:
[0114] Step S1: With the pointing function of the control device enabled, enable the floating window management service.
[0115] In some embodiments of this application, the pointing function refers to the control device's ability to detect its own pointing position in three-dimensional space and map the detected pointing position onto a display object in the user interface. The user can enable the pointing function using a pointing switch on the control device. The floating window management service is a background service in the display device used to manage and control the display, hiding, and interaction of floating windows. The floating window management service can create and destroy floating windows, set the style and hierarchy of floating windows, and handle input events for floating windows. When it is detected that the pointing function of the control device is enabled, the floating window management service is activated.
[0116] Step S2: Trigger the floating window management service to generate a detection floating window in the preset area. The window level of the detection floating window is higher than the window level of the user interface. The detection floating window is used to detect whether the displayed object has entered the preset area.
[0117] In some embodiments of this application, a detection floating window is an interface element, such as an icon, window, control, or view, that floats above the user interface and is used to detect whether a displayed object has entered a preset area. The detection floating window is located at the top layer of the user interface and is not obscured by other interface elements. Its transparency is greater than a transparency threshold to avoid affecting user operation, and it is used to monitor the position of the displayed object in real time. A window management framework (such as Android's WindowManager) can be used to set the window hierarchy. The window hierarchy of the detection floating window is higher than that of a normal application. The window hierarchy of the detection floating window can be a system window type. In some embodiments of this application, the window hierarchy refers to the display order of elements within a window. The higher the window hierarchy, the higher the element is displayed. The window hierarchy of the detection floating window is higher than that of the user interface to ensure that it is not obscured by other interface elements and does not affect the user's operation of other elements on the user interface. After the detection floating window is generated, it monitors the position of the displayed object in real time. When the displayed object enters the preset area, the system triggers a corresponding operation. For example, the control device detects that its pointing function is enabled and starts the floating window management service. The floating window management service generates detection floating windows in preset areas at the top right, bottom right, top left, and bottom left corners of the screen. These detection floating windows are used to monitor the cursor's hover time. The window hierarchy of the detection floating windows is higher than the user interface window hierarchy, and their transparency is high, so the user cannot see them. When the detection floating window detects the cursor entering the preset area, it triggers a corresponding operation (e.g., displaying a function floating window). Some embodiments of this application provide a display device that uses detection floating windows to monitor the position of the displayed object in real time, providing a fast interactive response, and the high transparency of the detection floating windows does not affect user operation.
[0118] In some embodiments, after step S2, the controller is further configured to perform the following steps:
[0119] Step S3: If the pointing function of the control device is turned off and the turning time reaches another preset duration (which can be called the second preset duration), the floating window management service is disabled.
[0120] In some embodiments of this application, users can disable the pointing function by using a pointing switch on the control device. A second preset duration is a defined time value used to determine whether the pointing function of the control device has been disabled for a sufficiently long time. This is to avoid instability caused by the pointing service flashing on and off due to the user rapidly toggling the pointing switch. In some embodiments of this application, the pointing function of the control device can be detected in real time. If the pointing function is disabled, a timer is started, continuously monitoring the disabled time. If the disabled time reaches the second preset duration (e.g., 2 minutes), the floating window management service is disabled. Disabling the floating window management service includes the following operation: destroying all detection floating windows. In some embodiments of this application, by disabling the floating window management service when the pointing function of the control device is disabled and the disabled time reaches the second preset duration, the problem of repeatedly calling the floating window management service due to repeated enabling of the pointing function can be avoided. Disabling the floating window management service when the control device is not used for a long time can save system resources. In some embodiments, the area of the detection floating window is smaller than the area of the function floating window.
[0121] In some embodiments of this application, the main function of the detection floating window is to monitor whether the displayed object enters a preset area, without needing to display a large amount of information or provide complex interactive functions. A smaller area reduces interference with user operations and avoids obscuring important content in the user interface. Functional floating windows need to display more information (e.g., operation entry points, prompts, etc.) and provide user interaction functions. A larger area ensures that users can clearly see the content and perform operations. Because the detection floating window has a small area, it can be set to higher transparency, further reducing visual interference for the user. A larger functional floating window allows for clearer information display, improving the user's operating experience. A larger functional floating window ensures that users can easily perform operations without accidental touches or operational difficulties due to its small size. For example, the detection floating window is located in a preset area in the upper right corner of the screen, with a small area (e.g., 5cm x 5cm) and high transparency. When the user moves the cursor to this area, the detection floating window detects the cursor's entry and triggers the display of the functional floating window. The functional floating window is displayed in the upper right corner of the screen, with a larger area (e.g., 10cm x 10cm), and contains an operation entry point (e.g., "Open music player"). Users can select an operation entry point by pointing to the remote control to launch the music player. In some embodiments, the customization interface can also be accessed via navigation; for example, users can go to All Settings - Bluetooth - Remote Control, and then click the Touch Angle Function Customization option to jump to the Touch Angle Customization interface.
[0122] Based on the foregoing embodiments, some embodiments of this application further provide a display device. Figure 14 is a schematic diagram of the software architecture of a display device provided by some embodiments of this application. As shown in Figure 14, it includes: a pointing angle service 500: responsible for the function of pointing remote control service, including a touch UI interface 5001 (function customization, trial tutorial, first-time switch guidance interface) and a floating window service 5002 (log reporting); a unified resident service 510: responsible for starting the pointing remote control service upon power-on, and starting the floating window service by listening to the dongle plugging / unplugging and pointing switch status; and a transition service. 520: Clicking the touch corner floating window will trigger the launch of customized applications, signal sources, and settings; Settings 530: Entry point for touch corner function customization and trial tutorials; Boot Navigation 540: Entry point for trial tutorials; Cloud 550: Pointing at the remote control service will log and report to the cloud; Platform - Button 560: Pointing at the remote control service receives button presses and performs business logic, such as hiding the floating window prompt when the direct key is pressed; Platform Remote Control Service 570: Remote control 580 processing logic, responsible for providing the application layer with interface status such as device insertion, removal, and power on / off; Home 590 is used to provide an application list. In some embodiments, the software architecture also includes: a TV service module, which provides a list of signal source interfaces, and an Android system module for detecting hover events.
[0123] The following example uses the four corners of the screen as a preset area to describe the implementation scheme of the entire pointing function, starting from the first use of the display device:
[0124] Figure 15 is a schematic diagram of the configuration process of a pointing function provided in some embodiments of this application. As shown in Figure 15, it includes: First, the user performs a power-on operation, and the unified resident service starts up. At this time, the unified resident service listens to the remote control status. The unified resident service can obtain the switch status from the platform remote control service, and the platform remote control service returns the switch status. In some embodiments of this application, if the pointing switch is not turned on, the user can turn on the pointing switch. The pointing remote control reports the switch status to the platform remote control service, and the platform remote control service notifies the unified resident service of the switch status change. At this time, the unified resident service starts the pointing angle service. In some embodiments of this application, if the pointing switch is turned on, the unified resident service starts the pointing angle service. In some embodiments of this application, after the pointing angle service is started, the pointing angle service pops up an initial guidance floating window. When the user points to a corner, the pointing angle service pops up a detection floating window. When the pointing angle service obtains the hover event received by the Android system module and sends it to the pointing angle service, if the pointing angle service has not displayed a guidance floating window before, it displays the guidance floating window. After the user clicks, the user enters the customized interface. The pointing angle service can obtain the signal source interface list through the TV service module and can obtain the application list and the disabled list from the homepage. A selection list is generated by combining the application list and the signal source interface list. When the user selects a signal source or application, the selection is saved.
[0125] In some embodiments of this application, if the unified resident service detects that the pointing switch is off, the floating window service in the pointing angle service is delayed for 2 minutes. Within 2 minutes, if the unified resident service obtains that the pointing switch is on, it obtains the on / off status of the pointing remote control from the platform remote control service. The platform remote control service returns the on / off status to the unified resident service. If the switch is already on, the pointing angle service is started. In some embodiments of this application, when the pointing switch is off, the floating window service needs to be removed, and the on / off status monitoring is moved to the unified resident service for processing. To avoid frequent on / off operations, the floating window service removal time is delayed by 2 minutes. If the switch is detected to be on again within the 2-minute countdown, the submodule - floating window service - is restarted. In some embodiments of this application, when the user uses the pointing remote control for the first time, a guide floating window needs to be displayed and the initial status needs to be remembered. However, the on / off status of the pointing remote control during startup navigation and factory operations is not remembered. The guide floating window only prompts once and will not prompt again subsequently. The guide floating window shows that the pointing remote control function is enabled, and it can be easily controlled using the cursor direction.
[0126] Figure 16 is a flowchart illustrating the implementation of a control method for a display device according to some embodiments of this application. After the floating window service is started, the floating window service will have a transparent detection floating window at each of the four corners of the screen to listen for cursor hover events. When the cursor moves to one of the four corners and presses the OK button by pointing at the remote control, it checks whether there is customized content. If so, the floating window service reports the information and enables the function floating window. If the pointing corner service obtains the information of clicking the function floating window, it performs a transition display through a transition, at which time the customized application is opened. In some embodiments of this application, the definition of the first time the cursor moves to the four corners is: when the user has not customized the signal source interface representation or application in the settings, the "cursor moving to the four corners of the screen can customize the one-finger direct access function" should be displayed when pointing to the four corners for the first time, and it is only displayed once, except for special scenarios. Special scenarios do not remember the first number, and when the cursor moves to the four corners, the detection floating window is not displayed, and the OK button is not responded to. Special scenarios include: boot navigation, factory, channel search, conference mode, senior mode, children's mode, and upgrade (firmware).
[0127] In some embodiments of this application, when the cursor points to any corner, the transparent detection floating window at that corner receives a MotionEvent.ACTION_HOVER_ENTER event, at which point a message with a 500ms delay is sent. Within 500ms, if the cursor moves out of the detection floating window's range, a MotionEvent.ACTION_HOVER_EXIT event is received, and the delay is canceled. If the cursor remains within the detection floating window's range for 500ms, it is determined after the timeout whether it is a special scenario that cannot be displayed. If it is not a special scenario, the initial guide interface, a customized interface, or no content is displayed, depending on the actual situation. The initial guide interface disappears automatically after 5 seconds or disappears when the cursor moves out of the detection floating window. When the guide interface is displayed, it is recorded that this corner has been displayed. The next time the cursor points to this corner, the number of times it has been displayed is used to determine whether the guide interface needs to be displayed again. Once the guide interface has been displayed, it will not be displayed again. After the pointing corner is customized, when pointing to the corresponding corner, a function floating window is displayed, which disappears automatically after 5 seconds of no operation. The function floating window disappears when the cursor moves out of its display area. The function floating window displays the name and icon of the application or signal source interface. Custom content can be provided through the customization interface. Clicking the function floating window will directly jump to this application or signal source interface. Both the detection and function floating windows are added to the user interface using WindowManager.addView. The window hierarchy of the detection and function floating windows is the same as that of the volume bar. WindowManager.LayoutParams.FLAG_NOT_FOCUSABLE must be set to ensure that they do not steal the focus of other applications. When the arrow keys are pressed, the focus is still handled normally by the application below it. When the OK button is pressed, the current detection or function floating window responds, and the arrow corner displays the customized content. If the customized content is a regular application, it is necessary to check whether the application has been uninstalled before displaying it. If the application is uninstalled after customization, the arrow corner should not display the customized content.
[0128] In some embodiments of this application, there are two ways to customize the pointing angle: one is to click on the guide interface to jump to the pointing angle customization interface; the other is to click on the touch angle function customization option in All Settings - Bluetooth - Remote Control to jump to the pointing angle customization interface. In some embodiments of this application, the customization interface displays customization options for the four corners. When the focus is on a certain customization option, the pointing arrow of the corresponding corner in the screen mapping view is highlighted, indicating that the information of this corner is being customized. Clicking brings up a drop-down selection list, which includes three parts: None, Signal Source (HDMI / Type-C interface), and My Applications. The signal source list is obtained through the platform interface, and the sourceId and name of the signal source can be obtained. The application list (APP list and blacklist list) is obtained from the home page applications. In some embodiments of this application, after obtaining the application list, the applications need to be sorted, with third-party applications ranked first and system applications ranked after third-party applications. The applications downloaded and installed by the user should be those that the user frequently uses, ensuring that the applications downloaded and installed by the user are at the top of the list. In some embodiments, it is also necessary to query the disabled application list and exclude the applications in the disabled application list from the obtained application list. After a user configures a specific application, the corresponding angle's customized information is saved for use by the pointing angle. The saved data is in JSON format, and the data definition is as follows:
[0129] {
[0130] "action": Initiate the broadcast action.
[0131] "silo_input_src_id": Startup SourceId,
[0132] "silo_name": The name of the application package to launch.
[0133] }
[0134] Actions are fixed content, and transitions are executed uniformly. If the customized content is an identifier for a signal source interface, then `silo_input_src_id` stores the sourceId of the signal source interface, and `silo_name` is empty; if the customized content is a regular application, then `silo_input_src_id` is empty, and `silo_name` stores the application's package name; if there is no customization, the saved content is changed to empty. When the pointer corner displays customized content, it determines whether it is an identifier for a signal source interface or a regular application based on the saved data. A non-empty `silo_input_src_id` indicates a customized signal source interface, and a non-empty `silo_name` indicates a customized regular application. If a corner is customized as a regular application, and this application is uninstalled after exiting the customization interface, the corresponding corner's customization information should be displayed as "none" when re-entering the customization interface, because the application is no longer present. That is, when entering the function floating window, it is necessary to check whether the customized application has been uninstalled; if uninstalled, it should be cleared and displayed as "none". Each time the pointer is entered, it is necessary to check whether the corner has been customized; if the customized content is a customized application, it is necessary to determine whether the customized application is valid. If the customized content is a signal source interface, validity checking is not required. In some embodiments, after the display device is powered on for the first time, a trial tutorial is also provided. First, the trial tutorial homepage is displayed. If the user clicks "Skip," the process ends. If the user clicks "Trial Tutorial," it is determined whether the pointing switch is turned on. If it is not turned on, a switch guide is displayed, and the guide is closed after the user clicks "I understand." If the switch is turned on, the trial tutorial steps begin. After the tutorial is completed, a completion screen is displayed. If the user clicks "Complete," the trial tutorial ends. Some embodiments of this application provide a display device control method with a pointing angle function. Users can customize the one-click access function at the four corners of the screen, reducing tedious operations.
[0135] Based on the foregoing embodiments, some embodiments of this application also provide a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the steps in the above-described control method embodiments for a display device. Some embodiments of this application provide a computer program product that, when run on a display device, enables the display device to implement the steps in the above-described control method embodiments.
[0136] Some embodiments of this application provide a display device and a method for controlling the display and hiding of a functional floating window, which makes the display and hiding of the functional floating window more in line with the interaction logic and more intelligent, thereby improving the user experience.
[0137] Figure 17 is a flowchart of a method for controlling the display and hiding of a functional floating window in a display device according to some embodiments of this application. As shown in Figure 17, the controller is configured to perform the following steps:
[0138] Step S501: If the screen coordinates mapped to the pointing position of the control device remain within a preset area for a preset duration, a function floating window is displayed in the operation interface. The function floating window is used to provide an operation entry point for customized content.
[0139] In some embodiments of this application, the control device can be a pointing remote control, and the preset area is one or more specific areas predefined in the operation interface. These areas can be a corner or edge of the screen. For example, the preset area is located at at least one of the upper left corner, upper right corner, lower left corner, lower right corner, left edge, and right edge of the display. The display screen is typically represented using a two-dimensional coordinate system, with the origin (0,0) located at the upper left corner of the screen, the horizontal direction as the X-axis, and the positive direction to the right. The vertical direction is the Y-axis, with the positive direction downwards. The width of the screen is screen_width, and the height is screen_height. The upper left corner, upper right corner, lower left corner, lower right corner, left edge, and right edge of the screen can be represented by coordinate ranges. The size of the range can be configured. For example, the coordinate range of the top-left corner can be represented as (0, 0) to (screen_width*0.2, screen_height*0.2), the coordinate range of the top-right corner can be represented as (screen_width*0.8, 0) to (screen_width, screen_height*0.2), the coordinate range of the bottom-left corner can be represented as (0, screen_height*0.8) to (screen_width*0.2, screen_height), and the coordinate range of the bottom-right corner can be represented as (sc The coordinate range of the preset area is (0, 0) to (screen_width*0.1, screen_height) and the coordinate range of the right edge is (screen_width*0.9, 0) to (screen_width, screen_height). Here, 0.2, 0.8, 0.1, and 0.9 are the proportions of the preset area to the screen width or height, which can be adjusted according to actual needs. The coordinate range of the preset area can be stored in a configuration file or database. The preset area mapped to the pointing position of the control device can be determined by calculating whether the screen coordinates mapped to the pointing position of the control device are within the corresponding coordinate range of the preset area. The preset duration refers to the length of time the screen coordinates mapped to the pointing position of the control device remain within the preset area. The preset duration can be set to any duration between 300 milliseconds and 1 second; for example, the first preset duration is 500 milliseconds.
[0140] In some embodiments, the customized content can be any one of the following: an application or a signal source interface identifier. A function floating window is an interface element, such as an icon, window, control, or view, that floats above the user interface and provides an entry point for customized content. Function floating windows are typically located at the top of the user interface to avoid being obscured by other interface elements. Window level manages the display order of different types of windows on the screen. The window level of a function floating window can be the system-type window level. Since the window level of a normal application is usually lower than the system-type window level, and the user interface is usually a normal application, setting the window level of the function floating window to the system-type window level allows the function floating window to appear on the user interface. For example, if the window level of a normal application is typically between 2000 and 2999, then the window level of the function floating window can be greater than 2999. In some embodiments of this application, the functional floating window may be at a lower level than the input method window. In other embodiments, the functional floating window may be at the same level as the volume adjustment floating window when adjusting the volume.
[0141] In some embodiments, the window hierarchy of the functional floating window can also apply the window hierarchy, but the window hierarchy of the functional floating window is higher than the window hierarchy of the operation interface. For example, if the window hierarchy of the operation interface is 2500, then the window hierarchy of the functional floating window can be 2501 to 2999. In some embodiments of this application, the functional floating window includes an operation entry point, which is an interactive element in the functional floating window. The user can select and trigger the operation entry point through the control device. The operation entry point is usually presented in the form of a button, icon, or text. When the customized content is an application, the operation entry point can be a shortcut icon of the application; when the customized content is an identifier of a signal source interface, the operation entry point corresponds to the entry point of the signal source interface. In some embodiments of this application, when the user uses the control device, the control device converts the direction or position information it points to into coordinate values on the display device screen. The remote control has a pointing function and senses the user's pointing action through built-in sensors (such as gyroscopes, accelerometers, etc.). After algorithm calculation, the pointing position is mapped to the screen coordinate system to determine a specific point coordinate (x, y) on the screen. This coordinate represents the current position of the control device on the screen. The display device's controller continuously monitors the screen coordinates mapped to the position pointed to by the control device. It can obtain the pointing information sent by the control device through a communication interface between the controller and the control device (such as Bluetooth, infrared, or radio frequency), and convert it into screen coordinates using an internal algorithm.
[0142] In some embodiments of this application, the controller compares the obtained screen coordinates with the boundary coordinates of a preset area to determine whether the coordinates fall within the preset area. If the coordinates are within the preset area, the current state is recorded as "located within the preset area". When the screen coordinates mapped by the pointing position of the control device enter the preset area, a timer is started. During the timer, the system continuously monitors whether the coordinates are still within the preset area. If the coordinates leave the preset area during the timer, the timer is reset to zero, and the system waits for the coordinates to fall back into the preset area before restarting the timer. Only when the coordinates remain within the preset area for a preset duration will the subsequent operation of displaying the floating window be triggered. In some embodiments, if the screen coordinates mapped by the pointing position of the control device remain within the preset area for a preset duration, the controller is also configured to check whether the preset area is associated with customized content. If customized content is associated, the controller controls the display to show the floating window. For example, taking the upper left corner as the preset area, the user can point to the upper left corner with the remote control. After the screen coordinates mapped by the pointing position of the control device remain within the upper left corner for a preset duration, the floating window is displayed. In some embodiments of this application, by continuously pointing the device at the preset area for a preset duration to display a floating window, a method is provided for users to quickly access the entry point for customized content operations. Users do not need to navigate and operate multiple times in a complex menu interface; they can simply point the control device at the preset area and hold it for a period of time to quickly open the floating window and perform the required operations, greatly improving the convenience and efficiency of operation.
[0143] Step S502: If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are not within the operation interface of the display, the function floating window is controlled to continue to be displayed.
[0144] In some embodiments of this application, the operating interface refers to the area on the display device screen where images and interactive content can be displayed normally. Outside the operating interface, there may be borders, black borders, or other non-display areas where images cannot be displayed correctly. In some embodiments of this application, the controller can continuously monitor the screen coordinates mapped to the pointing position of the control device and compare them with the boundary coordinates of the functional floating window. When the coordinates move from inside the functional floating window to the outside, it is determined that the coordinates have left the functional floating window. Simultaneously, the controller will also determine whether the coordinates are within the operating interface. If the coordinates are not within the operating interface (i.e., located in non-display areas such as screen borders or black borders), the controller will continue to display the functional floating window. In some embodiments of this application, when the pointing position of the control device leaves the functional floating window and is not within the operating interface, the functional floating window continues to display, which can prevent the functional floating window from accidentally closing due to user operation errors or pointing outside the screen, improving the smoothness and continuity of the interactive experience.
[0145] Step S503: If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are within the operation interface, close the function floating window.
[0146] In some embodiments of this application, when the coordinates move from inside to outside the function floating window, it is determined that the coordinates have left the function floating window. Simultaneously, it is determined that the coordinates are within the operation interface. After the controller detects that the coordinates have left the function floating window and are within the operation interface, it closes the function floating window. In some embodiments of this application, when the pointing position of the control device leaves the function floating window and is within the operation interface, the function floating window is closed promptly, avoiding the function floating window from occupying interface space on the screen for a long time, keeping the screen interface simple, reducing visual interference, and allowing the user to focus more on the content and other operations on the main interface.
[0147] The display device provided in some embodiments of this application displays a function floating window in the operation interface when the screen coordinates mapped to the pointing position of the control device remain within a preset area for a preset time. The function floating window is used to provide an operation entry point for customized content. When the screen coordinates mapped to the pointing position of the control device are removed from the function floating window and are no longer within the operation interface of the display, the function floating window continues to be displayed. When the screen coordinates mapped to the pointing position of the control device are removed from the function floating window but are within the operation interface, the function floating window is closed. This allows for the display and hiding of the function floating window based on the position of the screen coordinates mapped to the pointing position of the control device, which is more in line with the interaction logic and improves the user experience.
[0148] In some embodiments, after the screen coordinates mapped to the pointing position of the control device are removed from the function floating window and no longer within the operation interface of the display, the controller is further configured to perform the following steps:
[0149] Step S504: If the screen coordinates mapped to the pointing position of the control device fall within the function floating window during the delayed closing time of the function floating window, the function floating window continues to be displayed.
[0150] In some embodiments of this application, the delayed closing duration is a preset time threshold, typically in seconds or milliseconds. The delayed closing duration is configurable; for example, it can be configured to 5 seconds, and in other embodiments, it can be configured to 3 seconds. When the functional floating window meets the closing conditions, it does not close immediately but enters a waiting observation period, the length of which is the delayed closing duration. Within the delayed closing duration, if the conditions for continuing to display the functional floating window are met, the functional floating window remains open; if the conditions for closing the functional floating window are met, the functional floating window closes. In some embodiments of this application, when it detects that the coordinates have left the functional floating window and are no longer within the operation interface, the controller starts a delayed closing timer. The timer records the delayed closing duration and continuously monitors the changes in coordinates during the timing process. During the delayed closing timer's timing, the controller continuously monitors the screen coordinates mapped to the control device's pointing position, compares the current coordinates with the boundary coordinates of the functional floating window, and determines that the coordinates have fallen into the functional floating window if the coordinates move from outside the functional floating window to inside. When the coordinates are detected to fall within the function floating window, the controller keeps the function floating window displayed on the screen and does not close it. At the same time, the controller resets the delayed shutdown timer (whether it needs to restart the timer depends on the design logic) so that it can determine whether the function floating window needs to be closed again later.
[0151] Step S505: If the screen coordinates mapped to the pointing position of the control device fall within the operation interface and are not within the function floating window during the delayed closing time, the function floating window is closed.
[0152] In some embodiments of this application, when the detected coordinates fall within the operation interface but are not within the function floating window, the controller closes the function floating window. The controller stops the delayed shutdown timer. The display device provided in some embodiments of this application offers users more operational error tolerance by setting the delayed shutdown duration. When a user accidentally points the control device off-screen, causing the function floating window to close, as long as the control device is pulled back into the function floating window within the delayed shutdown duration, the function floating window can continue to display, allowing the user to continue operating. This avoids interrupting the operation process due to operational errors and improves the flexibility of interaction. Furthermore, in actual operation, users may experience temporary displacement of the control device from the function floating window or operation interface due to hand tremors, unfamiliarity with operation, etc. The delayed shutdown duration filters out these brief, unintentional operational changes, reducing the impact of erroneous operations on the display state of the function floating window and making the system more stable and reliable. Through the delayed shutdown mechanism, when a user points the control device off-screen and then wants to quickly return to the operation function floating window, the function floating window will not close immediately, ensuring the continuity of user operation. Users can continue their previous operations without having to re-trigger the function floating window, improving the smoothness and continuity of the user experience. If, within the delayed closing time, the user does not point the control device back into the function floating window but instead points it to another location within the interface, the function floating window will close promptly. This prevents the function floating window from occupying screen space for an extended period, keeping the screen interface clean and reducing visual distractions, thus balancing the display requirements of the function floating window with the requirements of interface simplicity.
[0153] In some embodiments, the controller is further configured to perform the following steps:
[0154] Step S506: If the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration less than the delayed closing time and no information is obtained to trigger the function floating window, the function floating window continues to be displayed.
[0155] In some embodiments of this application, the information triggering the functional floating window refers to the signal generated and transmitted to the controller of the display device by the user performing a specific operation on the functional floating window through the control device. For example, if the user clicks the "OK" button on the remote control, the signal generated by this operation is the information triggering the functional floating window. If the user does not click the "OK" button on the remote control, the controller does not obtain the information triggering the functional floating window. In some embodiments of this application, the controller monitors in real time whether it obtains the information triggering the functional floating window. The controller can achieve this by listening to the communication interface with the control device (such as Bluetooth, infrared, etc.). When it receives a signal that conforms to preset rules (such as a specific button press signal, a signal corresponding to a click operation, etc.), it determines that it has obtained the information triggering the functional floating window. During the timing process, if the screen coordinates mapped by the pointing position of the control device remain within the functional floating window for a duration less than the delayed closing time, and the controller does not obtain the information triggering the functional floating window, the controller will maintain the display state of the functional floating window on the screen and will not perform a closing operation.
[0156] Step S507: If the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration that reaches the delayed closing duration and no information is obtained to trigger the function floating window, then close the function floating window.
[0157] In some embodiments of this application, when the timer reaches the delayed closing time and the controller has not yet received information to trigger the function floating window, the controller stops displaying the function floating window to close it. In actual use, users may, due to unfamiliarity with operation or hand tremors, cause the control device to briefly hover within the function floating window without actually intending to operate it. By setting a delayed closing time and requiring the function floating window to close only after no trigger information is received within that time, the accidental closure of the function floating window due to these unintentional user actions can be effectively avoided, improving the stability and reliability of operation. When the user has not operated the function floating window for a long time, automatically closing it after the delayed closing time releases system resources, preventing the function floating window from continuously occupying screen space and system memory, keeping the screen interface simple, reducing visual interference, and improving system operating efficiency. Furthermore, the judgment logic based on coordinate hovering time and trigger information aligns with user operating habits and psychological expectations. This design considers potential temporary pauses in user operations and allows for timely closure of the floating window when the user clearly no longer needs it, making the entire interaction process more natural and smooth, and enhancing the rationality of the interaction logic. In some embodiments, the controller is configured to display the floating window in the operation interface when the screen coordinates mapped to the pointing position of the control device remain within a preset area for a preset duration. This can be achieved through the following steps:
[0158] In step S5011, if the screen coordinates mapped to the pointing position of the control device fall into the preset area, a hover entry event is obtained, and a timer is started to keep track of the time.
[0159] In some embodiments of this application, a hover-in event is an event signal generated when the screen coordinates mapped to the pointing position of the control device fall into the preset area from within the preset area. The controller of the display device continuously acquires the screen coordinates mapped to the pointing position of the control device. The controller compares the acquired screen coordinates with the boundary coordinates of the preset area. If the coordinates move from outside the preset area to inside the preset area, it is determined that the coordinates have fallen into the preset area, and at this time, the controller generates a hover-in event. At the same time as generating the hover-in event, the controller starts a timer to start counting. The timer records the time from the moment the hover-in event occurs so as to subsequently determine whether the preset duration has been reached.
[0160] Step S1012: When the timeout reaches the preset duration and no hover exit event is obtained, a function floating window is displayed in the operation interface, wherein the hover exit event is an event that occurs when the screen coordinates mapped to the pointing position of the control device leave the preset area.
[0161] In some embodiments of this application, a hover exit event is an event signal generated when the screen coordinates mapped to the pointing position of the control device move out of the preset area, indicating that the user no longer points the control device at the preset area and may no longer need related operations. In some embodiments of this application, during the timer's operation, the controller monitors the timer's timing in real time. During the timing period, the controller continuously monitors whether a hover exit event is acquired. That is, it continuously compares the screen coordinates mapped to the pointing position of the control device with the boundary coordinates of the preset area. If the coordinates move from within the preset area to outside the preset area, a hover exit event is generated. If the timing period reaches the preset duration and no hover exit event is acquired during the entire timing process, it indicates that the user has pointed the control device at the preset area and held it there for a period of time, indicating a strong intention to operate. At this time, the controller controls the function floating window displayed in the operation interface.
[0162] The display device provided in some embodiments of this application avoids the accidental triggering of function floating windows due to brief, unintentional pointing actions by the user by setting a preset duration. Only when the user points the control device to a preset area and holds it for a certain period is the user's intention to operate considered, thus displaying the function floating window, improving the accuracy of operation and the stability of the system. When the user actually has an operation need, by pointing the control device to the preset area and waiting for the preset duration, the function floating window can be quickly and conveniently brought up to obtain the required operation entry, making the operation process simpler and smoother, and reducing the time spent by the user switching between different interfaces and searching for functions. By setting hover-in and hover-out events, the display device can more accurately perceive the user's operation intention. Users can intuitively move the control device to trigger the corresponding interaction logic, enhancing the intuitiveness and ease of use of the interaction between the user and the display device.
[0163] In some embodiments, prior to step S501, the controller is further configured to perform the following steps:
[0164] Step S1: When it is obtained that the pointing function of the control device is enabled, a detection floating window is generated in the preset area, wherein the detection floating window is used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave the preset area.
[0165] In some embodiments of this application, the pointing function refers to the control device's ability to detect its own pointing position in three-dimensional space and send the detected pointing position to the display device. The display device can then determine the screen coordinates mapped to the pointing position and control the display device based on these coordinates. Users can enable the pointing function using a pointing switch on the control device. When the pointing function is enabled, a detection floating window is generated in a preset area. The controller can call a floating window management service to generate the detection floating window. This service is a background service in the display device used to manage and control the display, hiding, and interaction of floating windows. The floating window management service can create and destroy floating windows, set their style and hierarchy, and handle input events. When the control device's pointing function is detected as enabled, the floating window management service is activated and a detection floating window is generated.
[0166] In some embodiments of this application, a detection floating window is a temporary window displayed on the operating interface. It is superimposed on the main interface and is mainly used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave a preset area. The detection floating window itself usually does not have obvious interactive functions and only serves as an auxiliary tool for detecting coordinate positions. The detection floating window is located at the top layer of the operating interface and will not be obscured by other interface elements. The transparency of the detection floating window is greater than the transparency threshold so as not to affect user operation and is used to monitor the cursor position in real time. The window layer can be set using a window management framework (such as Android's WindowManager). The window layer of the detection floating window is higher than the window layer of a normal application. The window layer of the detection floating window can be a system window type. The window layer refers to the display order of elements in the window. The higher the window layer, the higher the elements are displayed. The window layer of the detection floating window is higher than the window layer of the operating interface to ensure that it will not be obscured by other interface elements and will not affect the user's operation of other elements on the operating interface.
[0167] In some embodiments of this application, the display device and the control device establish a connection and transmit data via a specific communication protocol (such as Bluetooth, infrared, Wi-Fi Direct, etc.). The control device periodically sends its own status information to the display device, including the on or off status of the pointing function. The controller of the display device receives and parses this status information to determine whether the pointing function of the control device is enabled. The user may enable the pointing function of the control device through specific operations. When it is determined that the pointing function of the control device is enabled, the display device generates a detection floating window at the corresponding position according to the boundary coordinate range of a preset area. A visible rectangular or other shaped area can be drawn on the screen according to a preset floating window style (such as color, transparency, border, etc.), and this area is the detection floating window. The detection floating window can be logically associated with the preset area to ensure that subsequent coordinate detection operations can correctly correspond to the preset area.
[0168] After generating the detection floating window, it is used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave the preset area. When the cursor enters the preset area, a corresponding operation is triggered. For example, if the pointing function of the control device is detected to be enabled, the floating window management service is started. The floating window management service generates detection floating windows in preset areas at the upper right, lower right, upper left, and lower left corners of the screen. These detection floating windows are used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave the preset area. If the detection floating window detects that the screen coordinates mapped to the pointing position of the control device have entered the preset area, a function floating window is displayed.
[0169] The display device provided in some embodiments of this application monitors the position of the screen coordinates mapped to the pointing position of the control device in real time through a detection floating window, providing a fast interactive response. The detection floating window clearly identifies the range of a preset area, enabling the system to more intuitively and accurately detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave the preset area. This avoids misjudgments caused by coordinate calculation errors or other interference factors, improving the accuracy of the interaction. Furthermore, by observing the detection floating window, users can clearly understand the position and range of the preset area, thereby more accurately operating the control device to ensure its pointing position falls into the preset area to trigger the corresponding function. This intuitive visual feedback enhances the intuitiveness and ease of use of the interaction between the user and the display device, reducing the user's learning cost. By generating a detection floating window within the preset area, the display device can concentrate resources on monitoring coordinate changes within the detection floating window, without needing to perform comprehensive coordinate detection on the entire screen. This reduces the system's computational burden and improves the system's response speed and performance.
[0170] In some embodiments, the controller is also configured to perform the following steps:
[0171] Step S2: When the screen coordinates mapped to the pointing position of the control device fall into the detection floating window, the hover entry event is generated.
[0172] In some embodiments of this application, the controller of the display device continuously acquires the screen coordinates mapped to the position pointed to by the control device. The controller compares the acquired screen coordinates with the boundary coordinates of the area defined by the detection floating window. The boundary coordinates of the detection floating window are determined and stored in the system memory when the detection floating window is generated. For example, if the detection floating window is a rectangular area, its boundary coordinates are determined by the coordinates of the upper left corner (x1, y1) and the lower right corner (x2, y2). The controller determines whether the x-value of the current screen coordinates is between x1 and x2, and whether the y-value is between y1 and y2. If the coordinates move from outside the detection floating window to inside the detection floating window, i.e., satisfy the above boundary conditions, the controller generates a hover entry event.
[0173] Step S3: When the screen coordinates mapped to the pointing position of the control device are removed from the detection floating window, the hover exit event is generated.
[0174] In some embodiments of this application, if the screen coordinates mapped to the pointing position of the control device move from inside the detection floating window to outside the detection floating window, the controller generates a hover exit event. The display device provided in some embodiments of this application, by generating hover enter and hover exit events, can accurately identify the user's intention to point the control device to a specific area (the area defined by the detection floating window) and leave that area. This provides a reliable basis for subsequently executing corresponding functions (such as displaying or hiding function floating windows) based on the user's intention, improving the accuracy and intelligence of the interaction. Since the display device generates events based on the actual change in the pointing position of the control device, rather than simply relying on a one-time user operation (such as a click), it can effectively reduce error events caused by user misoperation (such as slight movements due to hand tremors), improving the stability and reliability of the interaction. In some embodiments, the detection floating window includes: a first area within the operation interface and a second area outside the operation interface, wherein the first area and the second area are connected.
[0175] In some embodiments of this application, Figure 18 is a schematic diagram of a detection floating window provided in some embodiments of this application. As shown in Figure 18, the first area is 601 and the second area is 602. The first area 601 is the part of the detection floating window located within the operation interface, used to directly detect the coordinates of the control device pointing within the normal display range of the screen. It is the detection area most directly encountered by the user during operation. The second area 602 is the part of the detection floating window located outside the operation interface. Although it does not directly display content, it is connected to the first area and logically serves as part of the detection floating window. It can assist in determining the operation intention when the control device points near or beyond the screen edge. The connection indicates that the first area and the second area are logically a whole, without separation or independence. In operations such as coordinate detection and event generation, these two areas are regarded as a unified detection floating window, and the movement of the control device's pointing position between the two areas is regarded as a continuous trajectory. In some embodiments of this application, the first area and the second area are regarded as a whole. When detecting the screen coordinates mapped to the position of the control device, regardless of whether the coordinates are located in the first area or the second area, they are regarded as being judged within the detection floating window. For example, when coordinates move from the first area to the second area, or vice versa, the system considers it a continuous movement trajectory, without interruption or incorrect judgment due to crossing the boundaries of the user interface. Hover entry and hover exit events are processed uniformly on a per-detection floating window basis. Whenever coordinates enter or leave the detection floating window (whether in the first or second area), the corresponding event generation logic is triggered. By setting a second area outside the user interface and connecting it to the first area, it is possible to better detect pointing operations of the control device near or even beyond the screen edge. When the user points the control device to the screen edge and continues to move it, their operational intent can be accurately determined, avoiding interaction interruptions or inconsistencies caused by screen boundary limitations, making the interaction process more natural and smooth.
[0176] In some embodiments, the controller is further configured to perform the following steps:
[0177] Step S508: When the function floating window is displayed, close the detection floating window.
[0178] In some embodiments of this application, the controller can continuously monitor the display status of the function floating window. The display status of the function floating window can be represented by a Boolean variable (such as isFunctionWindowVisible). When the function floating window is displayed, the value of this variable is true; when the function floating window is hidden, the value of this variable is false. The controller obtains the value of this variable through polling or event listening. Each time the controller detects a change in the state of the function floating window or checks it at certain time intervals, it determines the value of isFunctionWindowVisible. If the value is true, it indicates that the function floating window is being displayed, and the controller performs the operation of closing the detected floating window. Simultaneously, the controller may release resources related to the detected floating window, such as the detected floating window coordinate information stored in memory, event listeners, etc., to save system resources.
[0179] Step 509: While the detection floating window is displayed, close the function floating window.
[0180] Similarly, the controller can continuously monitor the display status of the floating window, using a Boolean variable (such as...).
[0181] The variable `isDetectionWindowVisible` is used to record information. Its value is obtained through polling or event listening. When the controller detects that `isDetectionWindowVisible` is true, indicating that the detection window is being displayed, it closes the functional window. In some embodiments of this application, when the functional and detection windows are displayed simultaneously, interface elements may overlap or obscure each other, affecting the user's visual experience and ease of operation. By closing one window while the other is displayed, this interface element conflict can be effectively avoided, making the screen interface clearer and cleaner, and allowing users to operate and obtain information more conveniently. Displaying two windows simultaneously consumes more system resources, such as memory and processor resources. Closing unnecessary windows releases these resources, allowing more resources to be allocated to other important tasks, improving the overall performance and response speed of the display device. By displaying different windows in different situations, the current interaction intent and available operation options can be more clearly conveyed to the user. For example, when the detection window is displayed, the user knows they are waiting for its pointed operation; when the functional window is displayed, the user can focus on selecting the corresponding function option, enhancing the intuitiveness and understandability of the interaction.
[0182] In some embodiments, the controller is also configured to perform the following steps:
[0183] Step S510: When the screen coordinates mapped to the pointing position of the control device are within the operation interface, the screen coordinates of the cursor in the operation interface are obtained based on the screen coordinates mapped to the pointing position of the control device.
[0184] In some embodiments of this application, the cursor is a specific element presented on the operating interface. When the screen coordinates mapped to the pointing position of the control device are located on the operating interface, the screen coordinates mapped to the pointing position of the control device are the screen coordinates of the cursor in the operating interface. The controller can then control the display to show the cursor at the position of its screen coordinates on the operating interface.
[0185] Step S511: When the screen coordinates mapped to the pointing position of the control device are removed from the operation interface, obtain the screen coordinates when the device was last located on the operation interface, and obtain the screen coordinates of the cursor in the operation interface based on the screen coordinates when the device was last located on the operation interface.
[0186] In some embodiments of this application, the controller continuously acquires screen coordinates while monitoring in real time whether the coordinates have left the operation interface. Simultaneously, the controller records the current screen coordinates whenever they are within the operation interface. A variable (such as `lastValidCoordinate`) can be used to store the last screen coordinates when the cursor was within the operation interface; this variable is updated each time the coordinates are updated and within the operation interface. When the controller determines that the current screen coordinates have left the operation interface, it no longer uses the current invalid coordinates to generate the cursor, but instead retrieves the last screen coordinates when the cursor was within the operation interface from the stored `lastValidCoordinate` variable. Based on the last screen coordinates when the cursor was within the operation interface, the cursor's screen coordinates within the operation interface are obtained. The display device provided in some embodiments of this application can generate a cursor on the operation interface regardless of whether the pointing position of the control device is within the operation interface, avoiding the interruption of interaction due to coordinates leaving the operation interface, ensuring continuous response to the user's operational intentions, and enhancing the continuity and smoothness of the interaction. By generating the cursor based on the last valid coordinates, even when the control device's pointing position is unstable or briefly leaves the operating interface, the cursor can still be generated in a reasonable position. This reduces interface errors or display mistakes caused by abnormal coordinates, improving the stability and reliability of the interaction. In some embodiments, since the cursor is determined based on the control device's pointing position in three-dimensional space, and the preset area is usually a corner or edge of the screen, when the screen coordinates mapped to the control device's pointing position leave the function floating window and are no longer on the display's operating interface, the control device's pointing position typically moves out of the function floating window. Since the cursor's screen coordinates in the operating interface are obtained based on the last screen coordinates it had when it was on the operating interface, and the preset area is a corner or edge of the screen, the cursor will continue to be displayed within the function floating window. Conversely, when the screen coordinates mapped to the control device's pointing position leave the function floating window but are within the operating interface, the control device's pointing position moves within the screen. Since the cursor follows the pointing position when the control device's pointing position moves within the screen, the cursor will also move out of the function floating window. Therefore, the visibility of the function floating window can be controlled by whether the cursor is within it.
[0187] Some embodiments of this application provide a method for controlling the display of a function floating window on a display device, including: displaying a function floating window in the operation interface when the cursor remains in a preset area for a preset time, the function floating window being used to provide an operation entry point for customized content; controlling the function floating window to continue displaying when the cursor is within the function floating window; and closing the function floating window when the cursor moves out of the function floating window.
[0188] The methods provided in some embodiments of this application can determine whether the cursor is within a preset area by using the screen coordinates of the cursor in the operation interface, and determine whether the cursor is within a function floating window by using the screen coordinates of the cursor in the operation interface, thereby realizing the display and hiding control of the function floating window. Based on the foregoing embodiments, some embodiments of this application further provide a flowchart of a display device function floating window display and hiding control method. Figure 19 is a flowchart illustrating the implementation of another function floating window display and hiding control method provided in some embodiments of this application. This method is applicable to abnormal scenarios where the cursor moves off the screen. When the remote control moves to the preset area, the position state of the remote control is determined by a position detection algorithm to control the display and hiding logic of the function floating window. The following description uses the control device as the pointing remote control and a delay closing time of 5 seconds as an example. The function floating window display and hiding control method includes:
[0189] Step S701: Expand the range of the detection floating window.
[0190] In some embodiments of this application, the detection floating window is enlarged, and its height and width are set. The detection floating window can be enlarged beyond the screen margins by setting a negative margin value. When a hover exit event occurs, the negative x and y coordinates of the remote control's pointing position can be obtained.
[0191] In step S702, the remote control is quickly moved to the detection floating window. At this time, the detection floating window receives the Hover enter event, displays the function floating window, and uses Handler to start a timer with a delay of 5 seconds.
[0192] Step S703: Check if the remote control moves out of the function floating window within 5 seconds.
[0193] In some embodiments of this application, if the function floating window is removed, step S704 is executed; if the function floating window is not removed, step S705 is executed, at which point the cursor position is within the function floating window.
[0194] In step S704, the function floating window receives the Hover exit event and obtains the x and y coordinates of the mapping of the pointing position of the remote control.
[0195] Step S706: Determine whether the x and y coordinates are within the screen.
[0196] In some embodiments of this application, the getScreenSize() method can be used to obtain the length and width of the screen, and to determine whether the x and y coordinates are greater than 0 and less than the length and width of the screen.
[0197] In some embodiments of this application, if the person is inside the screen, step S707 is executed; if the person is outside the screen, step S708 is executed.
[0198] In step S707, the Handler sends a message to remove the feature and does not display the feature pop-up window.
[0199] The process ends here.
[0200] Step S708: Do not generate a message to remove the floating window of the sending function.
[0201] After step S708, step S705 is executed.
[0202] Step S705: Determine whether the preset area corresponding to the detection floating window has customized content.
[0203] In some embodiments of this application, if present, step S709 is executed. If not, step S710 can be executed: outputting a guide window, wherein the guide window is used to guide the user to enter a customized interface, and the customized interface is used to allow the user to configure the association between the preset area and the customized content.
[0204] Step S709: Display customized content.
[0205] In some embodiments of this application, customized content is displayed after the user clicks "OK" by pointing at the remote control. In some embodiments of this application, the function floating window is hidden after 5 seconds of inactivity. When the user operates the remote control, the remote control may move from off-screen to on-screen. During this process, if the function floating window is displayed at this time, the display logic needs to be controlled by the position of the remote control entering the screen. This scenario's processing logic directly affects the user experience. When the function floating window is displayed, and within less than 5 seconds, it is detected that the screen coordinates mapped to the pointing position of the remote control have moved off-screen from the function floating window, while the screen coordinates mapped to the user's pointing position of the remote control are off-screen. If the user enters the screen from outside the function floating window, the function floating window cannot receive the position of the remote control, causing the function floating window to remain displayed even when the user moves the remote control outside the function floating window, affecting the user experience.
[0206] In view of this, some embodiments of this application further provide a flowchart of a method for controlling the display and hiding of a functional floating window in a display device. Figure 20 is a schematic flowchart of another method for controlling the display and hiding of a functional floating window provided in some embodiments of this application. This method is applicable to abnormal scenarios where the window moves into the screen, and the method includes:
[0207] In step S801, when the screen coordinates mapped to the pointing position of the remote control enter the detection floating window and reach the preset time, the function floating window is displayed. After 5 seconds, the Handler sends a Message to switch views and a Message to hide the function view after a 5-second delay. When the user moves off the screen from the function floating window, the screen coordinates mapped to the pointing position of the remote control are now off the screen.
[0208] Step S802: When the pointer on the remote control moves into the screen within 5 seconds, obtain the x and y coordinates of the cursor when the pointer on the remote control enters the screen.
[0209] Step S803: Determine whether the coordinates are currently within the function floating window.
[0210] In some embodiments of this application, the current location of the floating window on the screen is obtained using getLocationOnScreen() and the drawn area is obtained using getDrawingRect. The actual boundary Rect of the floating window is calculated, and rect.contains(x,y) is used to determine whether the x and y coordinates are within the floating window.
[0211] In some embodiments of this application, if the location is within a function floating window, step S804 is executed. If the location is not within a function floating window, step S805 is executed.
[0212] Step S804: Continue displaying the function floating window.
[0213] After step S804, the method includes:
[0214] Step S806: Determine whether the function floating window has been removed from the remote control.
[0215] In some embodiments of this application, if not, step S807 is executed; if yes, step S808 is executed.
[0216] Step S807: When the 5-second timer expires, hide the floating window.
[0217] Step S808: Hide the function floating window and remove the timer that delays hiding the function floating window for 5 seconds.
[0218] Step S805: Immediately hide the function floating window and remove the timer that delays hiding the function floating window for 5 seconds.
[0219] In some embodiments of this application, when a functional floating window is displayed, it is hidden after 5 seconds of inactivity, and a detection floating window is displayed after the functional floating window is hidden. Based on the foregoing embodiments, some embodiments of this application also provide a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the steps in the above-described embodiments of the method for controlling the display of a functional floating window on a display device. Some embodiments of this application provide a computer program product that, when run on a display device, enables the display device to implement the steps in the above-described method for controlling the display of a functional floating window.
[0220] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.
Claims
1. A display device, comprising: The display is configured to display a user interface having display objects, the position of which on the user interface is determined by the position pointed to by the control device in three-dimensional space; The controller connected to the display is configured to: When the hovering time of the displayed object in the preset area of the user interface reaches a preset time, the display is controlled to display a function floating window on the user interface, wherein the function floating window is used to provide an operation entry point for customized content associated with the preset area.
2. The display device according to claim 1, wherein, The controller is also configured to: in response to a first operation of the control device on the operation entry, control the display to display the target display interface corresponding to the customized content.
3. The display device according to claim 1 or 2, wherein, The controller is also configured to: When the hovering time of the displayed object in the preset area of the user interface reaches the preset time, a mapping set is obtained, wherein the mapping set includes: the association relationship between any preset area and customized content; Based on the mapping set, the customized content of the preset area is obtained, and the display is controlled to present a functional floating window on the upper layer of the user interface.
4. The display device according to any one of claims 1 to 3, wherein, The controller is also configured to: When the hovering time of the displayed object in the preset area of the user interface reaches a preset time, the mode of the display device is obtained; When the mode is the first preset mode and the preset area is associated with customized content, the display is controlled to display a function floating window on the upper layer of the user interface.
5. The display device according to any one of claims 1 to 4, wherein, The controller is also configured to: If the displayed object moves out of the function floating window, or if the hovering time of the displayed object in the function floating window exceeds a preset time threshold, the display is controlled to hide the function floating window, wherein the preset time threshold is greater than the preset duration.
6. The display device according to any one of claims 1 to 5, further comprising: The controller is further configured to use a signal source interface for connecting external devices, provided that the customized content associated with the preset area is an identifier for the signal source interface: In response to the first operation of the control device on the operation entry, a channel switching command is generated based on the identifier of the signal source interface so that the content input by the external device can be displayed on the display.
7. The display device according to any one of claims 1 to 5, wherein, When the customized content associated with the preset area is an application, the controller is further configured to: In response to the first operation of the control device on the operation entry, the application is launched, and the display is controlled to show the target display interface corresponding to the application.
8. The display device according to any one of claims 1 to 5, wherein, The controller is also configured to: If no customized content is associated with the preset area, the display is controlled to display a guide window on top of the user interface. The guide window is used to guide the user to enter the customized interface, which is used to allow the user to configure the association between the preset area and the customized content.
9. The display device according to claim 8, wherein, The controller is also configured to: If no customized content is associated with the preset area, and the number of times the display object enters the preset area is less than a preset number, the display is controlled to present a guide floating window on the upper layer of the user interface.
10. The display device according to claim 8 or 9, wherein, The controller is also configured to: In response to a second operation of the control device on the guide window, the display is controlled to present a customized interface, which includes configuration options corresponding to a preset area; In response to the control device's selection of the configuration options, the display is controlled to show a selection list, wherein the selection list includes at least one option with customized content; In response to the control device's selection operation of a target option in the selection list, an association relationship is established between the preset area and the customized content corresponding to the target option, and the association relationship is stored in a mapping set.
11. The display device according to claim 10, wherein, The customized interface also includes: a screen mapping view of the display, and the controller is further configured to: In response to the control device's selection of the configuration option, the display is controlled to output a first prompt message in the screen mapping view. The first prompt message is used to prompt the configuration of customized content for the preset area.
12. The display device according to claim 10, wherein, The controller is also configured to: When the control device does not perform a second operation on the guide floating window and the display device is in a second preset mode, the number of times the display object enters the preset area is not recorded. The second preset mode includes at least one of the following: boot navigation mode, factory mode, channel search mode, conference mode, senior mode, children's mode, upgrade mode, and game mode. If the control device does not perform a second operation on the guide window and the display device is not in the second preset mode, record the number of times the display object enters the preset area.
13. The display device according to claim 7, wherein, The controller is also configured to: When the customized content is a customized application, in response to the application uninstallation operation, the association between the preset area and the application is severed; and, The display is controlled to output a prompt box in the preset area. The prompt box includes at least one of the following functions: prompting for the uninstallation of the customized application, outputting reconfiguration options, and prompting whether to automatically repair the customized application.
14. The display device according to any one of claims 1 to 13, wherein, The controller is also configured to: When the pointing function of the control device is enabled, the floating window management service is activated; The floating window management service is triggered to generate a detection floating window in the preset area. The window level of the detection floating window is higher than the window level of the user interface. The detection floating window is used to detect whether the displayed object has entered the preset area.
15. The display device according to any one of claims 1 to 4, wherein, The preset area is located at at least one of the upper left corner, upper right corner, lower left corner, lower right corner of the display, the left edge of the screen, and the right edge of the screen.
16. The display device according to claim 14, wherein, The controller is also configured to disable the floating window management service when the pointing function of the control device is turned off and the turning time reaches another preset duration.
17. The display device according to claim 14, wherein, The transparency of the detection window is greater than the transparency threshold.
18. The display device according to claim 14, wherein, The area of the detection floating window is smaller than the area of the functional floating window.
19. The display device according to claim 1, wherein, The user interface is an operation interface, the display object is a cursor, and the screen coordinates of the cursor on the operation interface are determined by the pointing position of the control device in the three-dimensional space. The controller is also configured to: If the screen coordinates mapped to the pointing position of the control device remain within a preset area for a preset duration, the function floating window is displayed in the operation interface. If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are not within the operation interface of the display, the function floating window shall continue to be displayed. If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are within the operation interface, close the function floating window.
20. The display device according to claim 19, wherein, After the screen coordinates mapped to the pointing position of the control device are removed from the function floating window and no longer within the operation interface of the display, the controller is further configured to: If the screen coordinates mapped to the pointing position of the control device fall within the function floating window during the delayed closing time of the function floating window, the function floating window continues to be displayed; If, during the specified delay period, the screen coordinates mapped to the pointing position of the control device fall within the operation interface but are not within the function floating window, then the function floating window is closed.
21. The display device according to claim 19 or 20, wherein, The controller is also configured to: If the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration shorter than the delayed closing time and no information is obtained to trigger the function floating window, the function floating window continues to be displayed; If the screen coordinates mapped to the pointing position of the control device remain within the function floating window for a duration that reaches the delayed closing time and no information is obtained to trigger the function floating window, the function floating window shall be closed.
22. The display device according to claim 19, wherein, The controller is also configured to: When the screen coordinates mapped to the pointing position of the control device fall within the preset area, a hover entry event is obtained, and a timer is started to keep track of the time. If the timeout period reaches the preset duration and no hover exit event is obtained, a function floating window is displayed in the operation interface. The hover exit event is an event that occurs when the screen coordinates mapped to the pointing position of the control device leave the preset area.
23. The display device according to claim 22, wherein, The controller is also configured to: When the pointing function of the control device is detected to be enabled, a detection floating window is generated in the preset area. The detection floating window is used to detect whether the screen coordinates mapped to the pointing position of the control device fall into or leave the preset area.
24. The display device according to claim 23, wherein, The controller is also configured to: When the screen coordinates mapped to the pointing position of the control device fall into the detection floating window, the hover entry event is generated; The hover exit event is generated when the screen coordinates mapped to the pointing position of the control device are removed from the detection floating window.
25. The display device according to claim 24, wherein, The detection window includes a first area within the operation interface and a second area outside the operation interface, wherein the first area and the second area are connected.
26. The display device according to claim 25, wherein, The controller is also configured to: When the function floating window is displayed, close the detection floating window; If the detection pop-up window is displayed, close the function pop-up window.
27. The display device according to claim 19, wherein, The controller is also configured to: When the screen coordinates mapped to the pointing position of the control device are within the operation interface, the screen coordinates of the cursor in the operation interface are obtained based on the screen coordinates mapped to the pointing position of the control device. When the screen coordinates mapped to the pointing position of the control device are removed from the operation interface, the screen coordinates when the device was last located on the operation interface are obtained, and the screen coordinates of the cursor in the operation interface are obtained based on the screen coordinates when the device was last located on the operation interface.
28. A control method for a display device, applied to the display device including a display for displaying a user interface, the user interface having a display object, the position of the display object on the user interface being determined by a position pointed to by a control device in three-dimensional space; and a controller connected to the display, the method comprising: When the hovering time of the displayed object in the preset area of the user interface reaches the preset time, a function floating window is displayed on the user interface. The function floating window is used to provide an operation entry point for customized content associated with the preset area. The position of the displayed object on the user interface is determined by the position pointed to by the control device in three-dimensional space.
29. The control method according to claim 28 further includes: in response to the first operation of the control device on the operation entry, displaying a target display interface corresponding to the customized content.
30. The control method according to claim 28, wherein, The user interface is an operation interface, the display object is a cursor, and the screen coordinates of the cursor on the operation interface are determined by the pointing position of the control device in three-dimensional space. The method includes: If the screen coordinates mapped to the pointing position of the control device remain within a preset area for a preset duration, the function floating window will be displayed in the operation interface. If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are not within the operation interface of the display, the function floating window shall continue to be displayed. If the screen coordinates mapped to the pointing position of the control device are detached from the function floating window and are within the operation interface, close the function floating window.