Display device and browser control method

Abstract

The invention relates to a display device and a browser control method. The display device includes: a display configured to display a browser interface; the radar assembly is configured to detect state change data of a user; the browser is configured to display contents viewed by a user when the user logs in the target account on a browser interface; logging out the target account and recording display parameters under the condition that the state change data represents that the user leaves the detection area of the radar assembly; under the condition that the state change data represents that the user returns to the detection area, logging in the target account again, and continuing to display the current display content; and the controller is configured to receive and execute the off-screen control strategy and the recovery control strategy. Through the display device and the browser, the off-screen and recovery control strategy is automatically executed, the user privacy is effectively protected, meanwhile, it is avoided that the user misses important content or needs to carry out tedious operation again, and the user experience is improved.

Description

Technical Field

[0001] The present application relates to the technical field of display devices, and in particular to a display device and a browser control method. Background Art

[0002] With the continuous popularization and development of various display devices, display devices such as smart TVs have entered more and more homes. The functions of smart devices are becoming more and more abundant, improving the quality of life of users. For example, users can view web pages, play videos, etc. through the browser of smart TVs.

[0003] In the related art, the experience effect of the TV browser depends on manual settings by the user, and the parameters can only be configured according to a fixed mode when the browser is running. In the web browsing and video playback scenarios of the browser, since the user is generally some distance away from the smart TV, if the user needs to temporarily leave to deal with other things, he often needs to find a control device such as a remote control to operate the currently displayed content so that he can continue processing after returning.

[0004] In this process, there is a problem of complex user operation process, which leads to a poor user interaction experience. Summary of the invention

[0005] The present application provides a display device and a browser control method to solve the problem of poor user interaction experience during user operation.

[0006] In a first aspect, some embodiments provide a display device, including:

[0007] A display configured to display a browser interface;

[0008] A radar component is configured to detect a user state change and send the detected state change data to a browser;

[0009] The browser is configured to:

[0010] Displaying the content viewed by the user logging into the target account on the browser interface;

[0011] In the case where the state change data indicates that the user has left the detection area of ​​the radar component, starting an off-screen control strategy, the off-screen control strategy at least including logging out of the target account and recording display parameters matching the current display content;

[0012] In the case where the state change data indicates that the user has returned to the detection area, starting a recovery control strategy, the recovery control strategy at least comprising logging into the target account again and continuing to display the current display content according to the display parameters;

[0013] A controller configured to receive and execute the off-screen control strategy and the recovery control strategy

[0014] The scheme of the above-mentioned embodiment has the following advantages or beneficial effects: when a user logs in to the target account in the browser to view the content, the radar component automatically detects whether the user leaves or returns to the detection area of ​​the radar component, and the browser automatically executes the off-screen and recovery control strategy, which can provide a seamless experience when the user leaves and returns, avoiding the user from missing important content or needing to redo tedious operations. When executing the off-screen control strategy, the user's privacy can be effectively protected by logging out of the account, preventing others from accessing their personal information when the user leaves. At the same time, by recording the display parameters and resuming playback when executing the reply control strategy, the user does not need to re-search and adjust the playback position and settings, which improves the convenience of use, simplifies user operations, and improves the user's interactive experience.

[0015] In a second aspect, some embodiments further provide a display device, including:

[0016] A display configured to display a browser interface;

[0017] A radar component is configured to detect a user state change and send the detected state change data to a browser;

[0018] The browser is configured to:

[0019] Displaying the content viewed by the user on the browser interface;

[0020] When the state change data indicates that the user has left the detection area of ​​the radar component, starting an off-screen control strategy, wherein the off-screen control strategy at least includes performing performance optimization processing on the browser when the performance index of the browser exceeds an off-screen optimization threshold;

[0021] The off-screen optimization threshold is smaller than a conventional performance optimization threshold of the browser, and the conventional performance optimization threshold is a performance optimization threshold of the browser under continuous use.

[0022] The solutions of the above embodiments have the following advantages or beneficial effects:

[0023] By performing performance optimization when the user leaves the detection area, the browser's performance can be improved without the user's awareness, reducing the frequent freezes and other problems that occur during browser use, providing a better experience for users after they return. By configuring the off-screen optimization threshold to be lower than the regular performance optimization threshold, performance optimization can be performed without the user's awareness, solving the problem of poor experience that may be caused by performance optimization during user use, thereby simplifying user operations and improving user interaction experience.

[0024] In a third aspect, some embodiments further provide a browser control method, including:

[0025] Display the content viewed by the user logging into the target account through the browser, and obtain the status change data obtained by detecting the user status change of the user;

[0026] In the case where the state change data indicates that the user has left the detection area, starting an off-screen control strategy, the off-screen control strategy at least including logging out of the target account in the browser and recording display parameters matching the current display content;

[0027] When the state change data indicates that the user has returned to the detection area, a recovery control strategy is initiated, and the recovery control strategy at least includes logging into the target account again in the browser and continuing to display the current display content in the browser according to the display parameters.

[0028] The solutions of the above embodiments have the following advantages or beneficial effects:

[0029] For the content viewed by the user who logs in to the target account in the browser, by detecting whether the user leaves or returns to the detection area of ​​the radar component, the off-screen and recovery control strategies are automatically executed, which can provide a seamless experience when the user leaves and returns, preventing the user from missing important content or having to redo tedious operations. When executing the off-screen control strategy, the account logout process can effectively protect user privacy and prevent others from accessing their personal information when the user leaves. At the same time, by recording the display parameters and resuming playback when executing the reply control strategy, users do not need to re-find and adjust the playback position and settings, which improves ease of use, simplifies user operations, and improves the user interaction experience.

[0030] In a fourth aspect, some embodiments further provide a browser control method, comprising:

[0031] Acquire status change data obtained by detecting a change in the user status of the user;

[0032] When the state change data indicates that the user has left the detection area of ​​the radar component, starting an off-screen control strategy, wherein the off-screen control strategy at least includes performing performance optimization processing on the browser when the performance index of the browser exceeds an off-screen optimization threshold;

[0033] The off-screen optimization threshold is smaller than a conventional performance optimization threshold of the browser, and the conventional performance optimization threshold is a performance optimization threshold of the browser under continuous use.

[0034] The solutions of the above embodiments have the following advantages or beneficial effects:

[0035] By performing performance optimization when the user leaves the detection area, the browser's performance can be improved without the user's awareness, reducing the frequent freezes and other problems that occur during browser use, providing a better experience for users after they return. By configuring the off-screen optimization threshold to be lower than the regular performance optimization threshold, performance optimization can be performed without the user's awareness, solving the problem of poor experience that may be caused by performance optimization during user use, thereby simplifying user operations and improving user interaction experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0036] In order to more clearly illustrate the embodiments of the present application or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying creative work.

[0037] Figure 1 A schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application;

[0038] Figure 2 A schematic diagram of the hardware configuration of a display device provided in some embodiments of the present application;

[0039] Figure 3 A schematic diagram of the hardware configuration of a control device provided in some embodiments of the present application;

[0040] Figure 4 A schematic diagram of software configuration of a display device provided in some embodiments of the present application;

[0041] Figure 5 A schematic diagram of the structure of a display device provided in some embodiments of the present application;

[0042] Figure 6 A schematic diagram of a browser control process of a display device provided in some embodiments of the present application;

[0043] Figure 7 A flowchart of a browser control process provided in some embodiments of the present application;

[0044] Figure 8 A flowchart of a browser control process provided for some other embodiments of the present application;

[0045] Fig. 9 A schematic diagram of the interaction timing of various parts in a display device provided in some embodiments of the present application;

[0046] Fig.10 A schematic diagram of the system architecture of a display device provided in some embodiments of the present application. DETAILED DESCRIPTION

[0047] The following embodiments are described in detail, and examples thereof are shown in the accompanying drawings. When the following description refers to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The implementations described in the following embodiments do not represent all implementations consistent with the present application. They are only examples of systems and methods consistent with some aspects of the present application as detailed in the claims.

[0048] It should be noted that the brief description of terms in this application is only for the convenience of understanding the embodiments described below, and is not intended to limit the embodiments of this application. Unless otherwise specified, these terms should be understood according to their ordinary and common meanings.

[0049] The terms "first", "second", "third", etc. in the specification and claims of this application and the above drawings are used to distinguish similar or similar objects or entities, and do not necessarily mean to limit a specific order or sequence, unless otherwise noted. It should be understood that the terms used in this way can be interchangeable under appropriate circumstances.

[0050] The terms "comprises," "comprising," and "having," and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device comprising a list of components is not necessarily limited to all the components expressly listed but may include other components not expressly listed or inherent to such product or device.

[0051] The term "module" refers to any known or later developed hardware, software, firmware, artificial intelligence, fuzzy logic or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0052] In the embodiment of the present application, the display device 200 generally refers to a device with image display and data processing capabilities. For example, the display device 200 includes but is not limited to a smart TV, a mobile terminal, a computer, a monitor, an advertising screen, a wearable device, a virtual reality device, an augmented reality device, etc.

[0053] Figure 1 This is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of the present application. Figure 1 As shown in FIG. 1 , the user can operate the display device 200 through touch operation, the mobile terminal 300 and the control device 100. For example, the control device 100 can be a remote controller, a stylus pen, a handle, etc.

[0054] The mobile terminal 300 can be used as a control device to perform human-computer interaction between the user and the display device 200. The mobile terminal 300 can also be used as a communication device to establish a communication connection with the display device 200 for data interaction. In some embodiments, the mobile terminal 300 can install software applications with the display device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The audio and video content displayed on the mobile terminal 300 can also be transmitted to the display device 200 to achieve a synchronous display function.

[0055] like Figure 1 As also shown in FIG. 4 , the display device 200 also communicates data with the server 400 through various communication methods. The display device 200 may be allowed to communicate and connect through a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0056] The display device 200 may provide a broadcast receiving television function, and may also additionally provide an intelligent network television function with a computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), and the like.

[0057] Figure 2 Some embodiments of the present application provide Figure 1 2 is a block diagram of the hardware configuration of the display device 200.

[0058] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface.

[0059] In some embodiments, the detector 230 is used to collect signals of the external environment or external interaction. For example, the detector 230 includes a light receiver, a sensor for collecting the intensity of ambient light; or, the detector 230 includes an image collector, such as a camera, which can be used to collect external environment scenes, user attributes or user interaction gestures; or, the detector 230 includes a sound collector, such as a microphone, etc., for receiving external sounds.

[0060] In some embodiments, the display 260 includes a display function component for presenting a screen, a touch component for receiving a user touch operation, and a drive component for driving an image display. The display 260 is used to receive an image signal output from the controller 250 for display. For example, the display 260 can be used to display video content, image content, and components of a menu control interface and a user control UI interface.

[0061] In some embodiments, the communication device 220 is a component for communicating with an external device or server 400 according to various communication protocol types. The display device 200 may be provided with a plurality of communication devices 220 according to different supported communication modes. For example, when the display device 200 supports wireless network communication, the display device 200 may be provided with a communication device 220 including a WiFi function. When the display device 200 supports Bluetooth connection communication, the display device 200 needs to be provided with a communication device 220 including a Bluetooth function.

[0062] The communication device 220 can enable the display device 200 to communicate with the external device or server 400 by wireless or wired connection. Among them, the wired connection can connect the display device 200 with the external device through components such as data cables and interfaces. The wireless connection can connect the display device 200 with the external device through wireless signals or wireless networks. The display device 200 can establish a connection relationship with the external device directly, or indirectly establish a connection relationship through a gateway, a router, a connection device, etc.

[0063] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first interface to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the display device 200.

[0064] In some embodiments, the controller 250 and the tuner-demodulator 210 may be located in different separate devices, that is, the tuner-demodulator 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0065] In some embodiments, the user may input a user command through a graphical user interface (GUI) displayed on the display 260 , and the user input interface receives the user input command through the graphical user interface (GUI).

[0066] In some embodiments, the audio output device 270 may be a local speaker of the display device 200, or may be an external audio output device of the display device 200. In particular, for the external audio output device of the display device 200, the display device 200 may also be provided with an external audio output terminal, and the audio output device may be connected to the display device 200 through the external audio output terminal to output the sound of the display device 200.

[0067] In some embodiments, the user input interface 280 may be used to receive instructions from a user.

[0068] Figure 3 Some embodiments of the present application provide Figure 1 The hardware configuration diagram of the control device in the figure. Figure 3 As shown, the control device 100 may include: a controller 110, a communication interface 130, a user input / output interface, a memory, and a power supply.

[0069] The control device 100 is configured to control the display device 200 , and can receive user input operation instructions, and convert the operation instructions into instructions that the display device 200 can recognize and respond to, thereby playing the role of an interaction medium between the user and the display device 200 .

[0070] In some embodiments, the control device 100 may be a smart device, for example, the control device 100 may be installed with various applications for controlling the display device 200 according to user needs.

[0071] In some embodiments, Figure 1 As shown, the mobile terminal 300 or other intelligent electronic devices can play a similar function as the control device 100 after installing the application for controlling the display device 200 .

[0072] The controller 110 includes a processor 112, a RAM 113, a ROM 114, a communication interface 130, and a communication bus. The controller 110 is used to control the operation and operation of the control device 100, as well as the communication and cooperation between the internal components and the external and internal data processing functions.

[0073] The communication interface 130 implements communication of control signals and data signals with the display device 200 under the control of the controller 110. The communication interface 130 may include at least one of other near field communication modules such as a WiFi chip 131, a Bluetooth module 132, and an NFC module 133.

[0074] The user input / output interface 140 , wherein the input interface includes at least one of other input interfaces such as a microphone 141 , a touch panel 142 , a sensor 143 , and a button 144 .

[0075] In some embodiments, the control device 100 includes at least one of a communication interface 130 and an input / output interface 140. The control device 100 is configured with a communication interface 130, such as a WiFi, Bluetooth, NFC or other module, and can encode the user input command through the WiFi protocol, Bluetooth protocol, or NFC protocol and send it to the display device 200.

[0076] The memory 190 is used to store various operating programs, data and applications for driving and controlling the control device 100 under the control of the controller. The memory 190 can store various control signal instructions input by the user.

[0077] The power supply 180 is used to provide operating power support for each component of the control device 100 under the control of the controller.

[0078] In order to perform user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program for managing and controlling hardware resources and software resources in the display device 200. The operating system may provide a user interface (control the display device), allow the user to interact with the display device 200, and support the running of various application programs.

[0079] It should be noted that the operating system may be a native operating system based on a specific operating platform, or a third-party operating system deeply customized based on a specific operating platform, or an independent operating system specially developed for the display device.

[0080] The operating system can be divided into different modules or layers according to the functions implemented, such as Figure 4 As shown, in some embodiments, the system is divided into four layers, from top to bottom, namely, the application layer (Applications) layer (referred to as "application layer"), the application framework layer (Application Framework) layer (referred to as "framework layer"), the system library layer and the kernel layer.

[0081] In some embodiments, the application layer is used to provide services and interfaces for applications so that the display device 200 can run applications and interact with users based on the applications. At least one application can be run in the application layer, and these applications can be window programs, system settings programs, clock programs, etc. that come with the operating system; they can also be applications developed by third-party developers. In specific implementations, the application packages in the application layer are not limited to the above examples.

[0082] The framework layer provides application programming interfaces (APIs) and programming frameworks for applications. The application framework layer includes some predefined functions. The application framework layer is equivalent to a processing center that determines the actions that applications in the application layer take. Through the API interface, applications can access system resources and obtain system services during execution.

[0083] like Figure 4 As shown, Figure 4 Some embodiments of the present application provide Figure 1 Schematic diagram of software configuration in the display device. In some embodiments, the system of the display device 200 can be divided into three layers, namely, application layer, middleware layer and hardware layer from top to bottom.

[0084] The application layer mainly includes commonly used applications on TV and application frameworks. Common applications are mainly applications developed based on browsers, such as HTML5 APPs and native APPs.

[0085] The Application Framework is a complete program model that has all the basic functions required by standard application software, such as file access, data exchange, etc., as well as the user interfaces of these functions (toolbars, status bars, menus, dialog boxes).

[0086] Native apps can support online or offline, message push or local resource access.

[0087] The middleware layer includes various TV protocols, multimedia protocols, system components and other middleware. The middleware can use the basic services (functions) provided by the system software to connect various parts of the application system or different applications on the network, and can achieve the purpose of resource sharing and function sharing.

[0088] The hardware layer mainly includes the hardware abstraction layer (HAL) interface, hardware and drivers. The HAL interface is a unified interface for all TV chips to connect, and the specific logic is implemented by each chip. Drivers mainly include: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver.

[0089] It should be noted that the above example is only a simple division of the operating system functions and does not constitute a limitation on the specific operating system form of the display device 200 in the embodiment of the present application. Depending on factors such as the function of the display device and the type of operating system, the number of levels and specific level types contained in the operating system may be expressed in other forms.

[0090] In the prior art, when a TV browser is started, a set of fixed display parameters is set according to a preset mode. The user can only change the setting parameters of the browser through manual operation. When the user approaches or moves away from the TV, moves in front of the TV, or leaves the TV, the browser will not have any changes in the setting parameters. When the user uses the TV browser, if he wants to change the current display parameters, he needs to go through a series of processing, which has the problems of complicated operation process and poor user experience.

[0091] In some embodiments, a display device is provided, such as Figure 5As shown, the display device includes:

[0092] Display 501, configured to display a browser interface;

[0093] Display devices refer to devices that can present images and information, such as televisions and computer monitors, which can be used to display browser interfaces and receive user interactions. The display is one of the core components of display devices and is responsible for presenting images, text and other content to users in a visual form. It can receive signals from browsers or other signal sources and convert them into images that users can intuitively see.

[0094] As the output part of the display device, the monitor is responsible for displaying the content presented by the browser to the user in a visual way. The browser interface can include various elements such as web pages, video playback windows, menu bars, toolbars, etc. Taking smart TV as an example, when a user opens the browser application on the TV, the monitor will show the browser's homepage, which may have popular video recommendations, news information, search bars, etc. If the user logs in to his or her video account, the monitor will display personalized content under the account, such as favorite videos, viewing history, etc. For example, if the user is watching a movie, the monitor will show the movie screen, subtitles, and playback control buttons.

[0095] The radar component 502 is configured to detect changes in user status and send the detected status change data to the browser.

[0096] The radar component is a device that can emit and receive electromagnetic waves and detect changes in user status by analyzing reflected waves. In this solution, it is mainly used to detect whether the user is in its detection area, as well as the user's location, movement direction, speed and other information.

[0097] The radar component uses the reflection principle of electromagnetic waves to detect changes in the user's position, movement direction, speed, and other states. When the user is active near the display device, the radar component will continuously emit electromagnetic waves and receive the reflected signals. By analyzing the changes in these signals, the radar component can determine the user's state and send these state change data to the browser.

[0098] For example, in a family living room, the TV is equipped with a radar component. When the user sits on the sofa and watches TV, the radar component can detect the user's position and distance. If the user gets up from the sofa and walks to the kitchen, the radar component will monitor the user's movement direction and speed in real time and send this information to the browser on the TV. After receiving the data, the browser can determine whether the user has left the radar's detection area. If the user leaves the detection area, the browser will activate the off-screen control strategy.

[0099] In some embodiments, a high-precision radar component can be used to improve the detection accuracy and range. For example, the use of more advanced millimeter-wave radar technology can more accurately detect the user's position and movement changes. Millimeter-wave radar has higher resolution and anti-interference ability, and can accurately identify users in complex environments. At the same time, the number of radar components can be increased to detect from different angles to improve the accuracy of detecting changes in user status. In addition, the radar component can also be used in combination with other sensors, such as infrared sensors, cameras, etc., to achieve more comprehensive user status monitoring. For example, when the radar component detects that the user has left the detection area, the camera can further confirm whether the user has really left the room to avoid misjudgment. In addition, the radar component can also detect different users according to the user's body shape, such as children and adults, fat people and thin people. The radar component can be used in combination with other sensors to further identify different users to determine whether the detected user is the user who has logged into the target account.

[0100] The use of radar components enables the display device to automatically sense changes in the user's status, and the browser can be automatically optimized without manual operation by the user. High-precision detection can accurately determine the user's location and movement, providing the browser with a more accurate basis for decision-making. Increasing the detection range and accuracy can improve the consistency of the user experience. For example, when the user moves in a large room, the display device can also respond in time. Combining other sensors can improve the reliability of the system, reduce the occurrence of misjudgments, and ensure that the browser's control strategy more accurately adapts to the user's actual situation.

[0101] The browser 503 is a software application program used to display web page content, play videos, run various network applications, etc. on a display device. The browser can be responsible for receiving the state change data sent by the radar component and executing the off-screen control strategy and the recovery control strategy according to the data.

[0102] like Figure 6 As shown, the browser 503 is configured to perform the following steps 602 to 606:

[0103] Step 602: Display the content viewed by the user logging into the target account on the browser interface.

[0104] The target account is an account registered by the user on a specific website or application. By logging in to the target account, the user can access personalized content and services. For example, when a user logs in to his or her video account on a TV browser, the browser will display the favorite video list and viewing history under the account. If the user starts watching a movie, the browser will play the movie on the display.

[0105] Step 604, when the state change data indicates that the user has left the detection area of ​​the radar component, start the off-screen control strategy, which at least includes logging out of the target account and recording the display parameters matching the current display content.

[0106] State change data refers to the user state change information detected by the radar component, including data on the user's position change in the detection area, leaving or returning to the detection area, etc. The detection area of ​​the radar component is the range within which the radar component can effectively detect the user's state.

[0107] The off-screen control strategy refers to a series of operations initiated by the browser when the user leaves the detection area of ​​the radar component, which is designed to protect user privacy, save energy and improve user experience. For example, when a user logs in to his or her video account on a TV browser to watch a movie, if the radar component detects that the user has left the detection area, the browser will immediately initiate the off-screen control strategy and log out of the user's target account to protect user privacy. In addition, the browser will record the current movie's playback position, volume setting, screen brightness and other display parameters.

[0108] Step 606: when the state change data indicates that the user has returned to the detection area, a recovery control strategy is initiated, and the recovery control strategy at least includes logging into the target account again and continuing to display the current display content according to the display parameters.

[0109] The recovery control strategy refers to a series of operations initiated by the browser when the user returns to the detection area of ​​the radar component, which is designed to restore the user's previous browsing status so that the user can continue to use the display device seamlessly. Then, it will record the display parameters such as the playback position, volume setting, and screen brightness of the current movie. When a user logs in to his or her video account on the TV browser to watch a movie, and the radar component detects that the user has left halfway, when the radar component detects that the user has returned again, the browser will initiate the recovery control strategy, log in to the user's target account again, and continue to play the movie based on the previously recorded display parameters, such as the current movie's playback position, volume setting, screen brightness, etc., so that the user can continue to watch seamlessly.

[0110] The controller 504 is configured to receive and execute the off-screen control strategy and the recovery control strategy.

[0111] The controller is the control center of the display device, responsible for receiving the off-screen control strategy and recovery control strategy sent by the browser and executing these strategies. The controller can control the various components of the display device through hardware circuits or software programs to ensure that the device can operate according to the predetermined strategy.

[0112] When the browser starts the off-screen control strategy, it sends instructions to the controller, asking the controller to perform relevant operations. After receiving the instructions, the controller will implement these operations through communication with the display, radar components and other related components. For example, the controller can control the display to turn off or reduce the brightness, control the radar component to enter low-power mode, and send the user account logout information to the server. When the user returns to the detection area, the browser starts the recovery control strategy, and the controller receives the instructions again and performs corresponding operations, such as re-logging in to the account, restoring the display brightness and playback parameters, etc.

[0113] In the above embodiments, by automatically executing the off-screen and resume control strategies, the browser can provide a seamless experience when the user leaves and returns, preventing the user from missing important content or having to redo cumbersome operations. Logging out of an account can effectively protect user privacy and prevent others from accessing their personal information when the user is away. Recording display parameters and resuming playback can save users from having to re-find and adjust playback positions and settings, improving ease of use.

[0114] In some other embodiments, in the off-screen control strategy, in addition to logging out of the account and recording display parameters, the video playback can also be automatically paused, the display brightness can be reduced, or the energy-saving mode can be entered to save energy. In the recovery control strategy, a welcome interface or prompt message can be displayed on the browser interface to let the user know that the device has been restored to its previous state. In addition, the browser can also be controlled to interact with other smart devices. For example, when the user leaves the TV, the video being played is automatically pushed to the user's mobile phone or tablet, so that the user can continue to watch it on other devices, which can expand the user's viewing options and improve the flexibility and practicality of the device.

[0115] In some embodiments, the browser is further controlled to:

[0116] When the state change data indicates that the user has changed position within the detection area, determining a first position of the user before the movement and a second position of the user after the movement;

[0117] In the case that the first position and the second position correspond to different position intervals respectively, the display parameters matched by the current display content are adjusted according to the display parameters matched by the position area corresponding to the second position.

[0118] Among them, the position change refers to the situation where the radar component detects the user at one position in the detection area at a first time point, and detects the user at another position in the detection area at a second time point, wherein the first time point is different from the second time point. The first position is the position of the user before the position change occurs. The second position is the position of the user after the position change occurs. The position interval divides the detection area into different range intervals, and each interval corresponds to different display parameters. Display parameters include but are not limited to parameters that affect the display effect and audio effect of the browser interface, such as display content, content arrangement, display resolution, contrast, color gamut, volume, balance, sound field positioning, etc.

[0119] When the browser receives the state change data sent by the radar component indicating that the user's position has changed in the detection area, the browser needs to determine the user's position before the movement (first position) and the position after the movement (second position). This can be achieved by analyzing the position data provided by the radar component to determine the specific coordinate position of the user at different times. Taking a smart TV as an example, suppose that the radar component equipped with the TV can detect the user's position in the living room. The user initially sat on the sofa 3 meters away from the TV, and this position was determined as the first position. Subsequently, the user stood up and walked to a position 2 meters away from the TV, and this new position was the second position. By receiving the position data continuously sent by the radar component, the browser can accurately determine that the user has moved from the first position to the second position.

[0120] In some embodiments, multiple radar components are combined to perform positioning from different angles, or combined with other positioning technologies (such as Bluetooth positioning, WiFi positioning, etc.) to more accurately determine the user's location. At the same time, the detection frequency of position changes can be increased to respond to user position changes more promptly. For example, the user's position is detected multiple times per second to ensure that the new position can be quickly determined after the user moves. Combining multiple positioning technologies can improve the reliability of position determination, reduce position errors caused by the limitations of a single technology, and provide users with more stable services.

[0121] By dividing the detection area into multiple location intervals, different display parameters are set for each location interval. After determining the user's first location and second location, the browser needs to determine whether the two locations correspond to different location intervals. If so, it means that the user's location change has caused the location interval to change, and the display parameters need to be adjusted.

[0122] Exemplarily, the detection area in front of the TV is divided into three position intervals: a close distance interval (1-2 meters from the TV), a medium distance interval (2-4 meters from the TV), and a long distance interval (more than 4 meters from the TV). Each interval corresponds to different display parameters, for example, the close distance interval has a higher resolution and a louder volume, the medium distance interval has a moderate resolution and a moderate volume, and the long distance interval has a lower resolution and a lower volume. If the user moves from a position in the long distance interval (the first position) to a position in the medium distance interval (the second position), the browser will determine that the first position and the second position correspond to different position intervals.

[0123] In some embodiments, the division of the location intervals can be further refined according to different usage scenarios and user needs. For example, different location interval division methods and display parameters can be set for different usage scenarios such as watching movies and browsing web pages. At the same time, users can be allowed to customize the location intervals and display parameters to meet personalized needs. For example, users can set parameters such as resolution and volume for a specific location interval according to their preferences.

[0124] When it is determined that the user's location change has caused the first location and the second location to correspond to different location intervals, the browser needs to adjust the display parameters of the current display content according to the display parameters matched by the location interval corresponding to the second location. For example, the browser will automatically adjust parameters such as resolution and volume according to the user's new location to provide a viewing and listening experience that is more suitable for the user's current location.

[0125] Continuing with the above example, when the user moves from the long distance interval to the medium distance interval, the browser will adjust the resolution and volume of the current display content according to the display parameters corresponding to the medium distance interval. For example, the resolution is adjusted from low to medium, and the volume is adjusted from low to medium. In this way, the user can get a clearer image and a more appropriate volume at the new position, improving the viewing experience.

[0126] In the above embodiments, accurately determining the first position and the second position of the user is the basis for adjusting the display parameters according to the change of the user's position. By judging whether the first position and the second position correspond to different position intervals, it can be determined whether the display parameters need to be adjusted. Automatically adjusting the display parameters according to the change of the user's position can provide the user with a more personalized and comfortable viewing experience.

[0127] In some embodiments, when the browser adjusts the display parameters matched by the current display content according to the display parameters matched by the position area corresponding to the second position, the browser is further controlled to:

[0128] When the currently displayed content is web page content, the section content of the web page content is layout-adjusted according to the section content display conditions matched by the position area corresponding to the second position, so as to display the content in the section content that meets the section content display conditions, and cancel the display of the content in the section content that does not meet the section content display level conditions.

[0129] Among them, the section content is the various components in the web page, such as the news section, the advertising section, the navigation bar, etc. The section content display condition refers to the conditions for screening and adjusting whether different sections in the web page content are displayed or not, which are determined according to the user's location area. The section content display condition can be dynamically adjusted in combination with the user's usage habits and preferences. For example, if a user often browses a specific type of web page content in a certain location area, the browser can optimize the display conditions of the location area according to the user's habits. The layout adjustment can rearrange the layout of the web page content, including adjusting the size, position, display order, etc. of the section. In some embodiments, the browser can dynamically adjust the layout according to the characteristics of the web page content and the user's location changes. For example, for web pages with more pictures, the size and layout of the pictures can be automatically adjusted to improve the viewing effect in different location areas. At the same time, the browser can also provide users with the option of manually adjusting the layout, allowing users to make personalized adjustments based on automatic layout.

[0130] Exemplarily, the browser first determines whether the content currently being displayed is web page content. If it is web page content, the layout is further adjusted according to the section content display conditions matched by the position area corresponding to the user's second position. According to the second position of the user, the corresponding position area is determined. Each position area has specific section content display conditions. These conditions are used to determine whether each section in the web page content should be displayed and how to display it. According to the determined section content display conditions, the layout of each section in the web page content is adjusted. This includes displaying section content that meets the conditions, canceling the display of section content that does not meet the conditions, and adjusting the size, position and display order of the sections.

[0131] For example, when a user browses a web page using a display device, the browser will continuously monitor the type of content currently displayed. Suppose a user opens a news website, and the browser recognizes that the currently displayed content is web content. The radar component will continuously detect the user's status information, determine the user's location movement, and in which position interval the user's location after the movement is located.

[0132] Assume that the space in front of the display device is divided into three position areas: close distance area, medium distance area and long distance area. For the close distance area, the possible display conditions of the section content may be set to highlight the main news content and important navigation links and hide the advertising section; for the medium distance area, some advertising sections and more detailed news classifications may be displayed, and the size of the navigation bar may be adjusted; for the long distance area, the web page layout may be simplified to only display key news headlines and large navigation buttons. When the user moves from one position to another, the browser will determine the corresponding section content display conditions based on the new position.

[0133] When the user is in a close-range area, the browser will adjust the layout of the web page according to the corresponding section content display conditions. The main news article may be enlarged and displayed in the center of the screen, hiding the side advertising section, while highlighting important navigation links such as the home page and hot news. When the user moves to a medium-distance area, the browser will adjust the layout, display some advertising sections, display the news classification in more detail, and adjust the size of the navigation bar to accommodate medium-distance viewing.

[0134] In addition, the browser can be configured to recognize different types of web page content, such as distinguishing between static and dynamic web pages, web pages of different themes, etc. For different types of web pages, more targeted layout adjustment strategies are configured according to their characteristics. At the same time, the browser can provide user customization options, allowing users to choose whether to adjust the layout of specific types of web page content.

[0135] In the above embodiments, the layout of web page content is automatically adjusted according to the change of user's location, providing users with a personalized browsing experience, so that users in different location areas can see the web page layout that best suits their current location, and by filtering and displaying content that meets the content display conditions of the section, unnecessary content is canceled, and the display of important content is highlighted, which meets the key information acquisition methods of users in different locations and improves browsing efficiency. Users can find content that interests them more quickly, saving time and energy.

[0136] In some embodiments, the browser is further controlled to:

[0137] When the state change data indicates that the user has left the detection area of ​​the radar component and has not returned to the detection area after a preset time period, determining that the user has left the detection area;

[0138] When the state change data indicates that the user leaves the detection area and returns to the detection area within a preset time period, it is determined that the position of the user changes within the detection area.

[0139] The preset duration is a pre-set period of time used to determine whether the user has actually left the detection area. Determining that the user has left the detection area refers to the judgment result made by the browser when the user leaves the detection area and does not return after the preset duration. Determining that the user has changed position within the detection area refers to the judgment result made by the browser when the user leaves the detection area but returns within the preset duration, and believes that the user has actually only changed position within the detection area.

[0140] Exemplarily, the browser continuously receives the state change data sent by the radar component. When the data shows that the user has left the detection area, the browser starts timing. If the user does not return to the detection area within a preset time, the browser determines that the user has actually left the detection area. If the user leaves the detection area and re-enters the detection area within a preset time, the browser considers that the user has only changed position within the detection area, rather than actually leaving.

[0141] Taking smart TV as an example, suppose the detection area of ​​the radar component equipped on the TV is a certain range of the living room. When the user gets up and leaves the living room while watching TV, the radar component detects that the user has left the detection area and sends this information to the browser. The browser starts timing, assuming the preset duration is 5 minutes. If the user does not return to the living room within these 5 minutes, that is, does not enter the detection area again, then the browser determines that the user has left the detection area. If the user leaves the living room and returns to the living room within 3 minutes, it means that he has re-entered the detection area of ​​the radar component. In this case, the browser determines that the user has changed position in the detection area, rather than leaving. At this time, the browser can adjust the display parameters according to the user's new position to provide users with a better experience.

[0142] In some other embodiments, the user can adjust the preset duration according to different usage scenarios and user habits. For example, for scenarios where users often leave the home for a short period of time, the preset duration can be appropriately extended; while for display devices in public places, the preset duration can be shortened to improve the response speed. At the same time, other factors can be combined to determine whether the user has actually left, such as whether the user has closed other devices related to the display device (such as synchronization applications on a mobile phone).

[0143] In addition, the browser can also combine the user status data detected by the radar component to further analyze the user's behavior pattern of returning within the preset time, such as the speed and direction of the user's return, so as to more accurately judge the user's intention. If the user returns quickly and faces the display device directly, it may indicate that the user has a strong need to continue using the app, and the display parameters can be adjusted to satisfy the user first. At the same time, historical data can be combined to predict whether the user will return within the preset time. For example, if the user has often returned within a short period of time in the past, the judgment criteria for the preset time can be appropriately shortened.

[0144] In the above embodiments, by setting a preset time to determine whether the user has actually left the detection area, misjudgment can be avoided. In some cases, the user may only leave the detection area for a short time and return soon. If the off-screen control strategy is executed in this case, it will cause unnecessary trouble to the user. By setting a preset time, the user's behavior can be identified more accurately, avoiding misjudging the user's short departure as a real departure. When the user returns within the preset time, it is regarded as a change in position and the display parameters can be quickly adjusted, etc., providing the user with a seamless user experience.

[0145] In some embodiments, the off-screen control strategy further includes: sending a screen-off control signal to the controller so that the controller controls the display device to turn off the screen;

[0146] The recovery control strategy also includes: sending a screen light-up control signal to the controller, so that the controller controls the display device to light up the screen and continues to display the current display content on the browser interface.

[0147] Among them, the screen-off control signal is a signal sent by the browser to the controller, instructing the controller to control the display device to turn off the screen, and the screen-on control signal is also a signal sent by the browser to the controller, instructing the controller to control the display device to turn on the screen. Display device screen-off means that the screen of the display device is turned off and no longer displays any content, but the device is still powered on and can respond to the recovery control strategy at any time. Display device screen-on means that the screen of the display device is turned on and continues to display the content before the user leaves or the content adjusted according to the recovery control strategy.

[0148] Exemplarily, when the browser determines that the user has left the detection area of ​​the radar component, in addition to performing operations such as logging out of the target account and recording display parameters, it will also send a screen-off control signal to the controller. The purpose of this signal is to allow the controller to control the display device to turn off the screen to save energy and reduce unnecessary display interference. When the radar component detects that the user has returned to the detection area again, the browser starts the recovery control strategy. In addition to operations such as logging into the target account again and continuing to display the current content according to the display parameters, the browser will also send a screen-on control signal to the controller. The purpose of this signal is to allow the controller to control the display device to light up the screen and restore it to the state before the user left or to the state adjusted according to the recovery control strategy.

[0149] For example, taking a smart TV as an example, when a user leaves the room while watching TV, the radar component detects that the user has left the detection area, and the browser will start the off-screen control strategy. The browser sends a screen-off control signal to the controller, and after receiving the signal, the controller controls the TV screen to turn off. At this time, the TV enters a low-power state, which not only saves energy, but also avoids unnecessary interference that may be caused by the screen continuing to display when the user is not present, such as light interference or information leakage risks. When the user leaves the room for a period of time and returns, the radar component detects the user's return, and the browser starts the recovery control strategy. The browser sends a screen-on control signal to the controller, and after receiving the signal, the controller controls the TV screen to light up. At this time, the TV screen continues to display the content that the user was watching before leaving, or if there is new information or updates during the user's absence, the browser will adjust the display content according to these situations before lighting up the screen. In this way, users can seamlessly continue their previous viewing or browsing experience without having to search and adjust again.

[0150] In some of the embodiments, the browser can automatically adjust the way and degree of screen extinguishing according to the length of time the user is away and the historical usage habits. For example, if the user is often away for a long time, the display device can be put into a deep sleep state to further reduce power consumption; if the user is only away for a short time, it may only be necessary to reduce the screen brightness without completely turning off the screen. At the same time, the data of other sensors, such as ambient light sensors, can be combined to automatically adjust the screen brightness or completely turn off the screen according to the ambient light when the screen is turned off to achieve the best energy saving effect. In addition, the browser can also display transition effects or prompt information during the process of turning on the screen to allow users to better adapt to the restoration of the screen. For example, the screen brightness can be gradually increased when the screen is turned on to avoid sudden strong light irritating the user's eyes; or a welcome back prompt message can be displayed on the screen to let the user know that the device has returned to normal. At the same time, according to the user's return position and action, the user's needs can be predicted in advance, and the layout of the displayed content can be automatically adjusted or certain important information can be highlighted when the screen is turned on to improve the user's convenience.

[0151] In the above embodiments, energy can be effectively saved by the control strategy of automatically turning off the screen when the user leaves and automatically turning on the screen when returning. This energy-saving effect is more significant especially for display devices that have not been used for a long time. At the same time, automatically controlling the on and off of the screen can reduce the power consumption of the device and extend the service life of the device. When the user leaves and returns, the display device can automatically adjust the screen status, allowing the user to continue the previous browsing or viewing experience without manual operation. This seamless experience can improve the user's convenience and satisfaction and reduce the user's operating burden. Automatically adjusting the screen status according to the user's departure and return reflects the intelligence of the display device. By combining the functions of the radar component and the controller, more accurate user status detection and device control can be achieved, improving the reliability and stability of the system.

[0152] In some embodiments, the display parameter matched by the current display content includes at least one of display brightness and playback volume of the display device;

[0153] The off-screen control strategy further includes: sending an energy-saving mode start instruction to the controller so that the controller performs at least one of reducing display brightness and reducing playback volume;

[0154] The recovery control strategy also includes: sending an energy-saving mode exit instruction to the controller, so that the controller executes to restore the display brightness and the playback volume to the recorded original values ​​respectively.

[0155] Among them, the display parameters matched by the currently displayed content are various parameter settings related to the currently displayed content, which will affect the user's viewing and listening experience. For example, at least one of the display brightness and playback volume of the display device. Display brightness is the intensity of light emitted by the display device screen, and the brightness of the screen can usually be changed by adjusting the brightness value. Playback volume is the loudness of the audio played by the display device, and the volume of the sound can be controlled by adjusting the volume value.

[0156] Energy saving mode is a working mode that reduces the power consumption of display devices, and reduces energy consumption by reducing display brightness and playback volume, etc. Energy saving mode start instruction: an instruction sent by the browser to the controller, instructing the controller to start the energy saving mode and reduce at least one of the display brightness and playback volume. Energy saving mode exit instruction: an instruction sent by the browser to the controller, instructing the controller to exit the energy saving mode and restore the display brightness and playback volume to the recorded original values.

[0157] Exemplarily, when displaying content, the browser determines parameters such as display brightness and playback volume according to the current display requirements and user settings. These parameters will affect the user's viewing and hearing experience of the displayed content. When the browser determines that the user has left the detection area of ​​the radar component, in addition to performing operations such as logging out of the target account and recording display parameters, it will also send an energy-saving mode startup instruction to the controller. The purpose of this instruction is to allow the controller to start the energy-saving mode and reduce at least one of the display brightness and playback volume to achieve the effect of saving energy. When the radar component detects that the user has returned to the detection area again, the browser starts the recovery control strategy. In addition to operations such as logging in to the target account again and continuing to display the current content according to the display parameters, the browser will also send an energy-saving mode exit instruction to the controller. The purpose of this instruction is to allow the controller to exit the energy-saving mode and restore the display brightness and playback volume to the recorded original values ​​to restore the user's previous viewing and hearing experience.

[0158] In some of the embodiments, the browser can also automatically adjust the display brightness and playback volume according to different time, environment and user behavior. For example, the display brightness is automatically increased when the light is strong during the day, and the brightness is automatically reduced at night to reduce eye stimulation; when the user answers a call, the playback volume is automatically reduced to avoid interference. At the same time, users can be allowed to customize the display brightness and playback volume settings in different scenarios to meet personalized needs.

[0159] The browser can also adjust the intensity of the energy-saving mode according to the length of time the user is away and historical usage habits. For example, if the user is often away for a long time, the display brightness and playback volume can be further reduced, and even some unnecessary functional modules can be turned off to achieve better energy-saving effects; if the user is only away for a short time, the brightness and volume can be appropriately reduced, but a certain level of usability can be maintained so that normal use can be quickly resumed when the user returns quickly. At the same time, the data of other sensors, such as ambient light sensors and sound sensors, can be combined to automatically adjust the display brightness and playback volume according to environmental changes in energy-saving mode to achieve the best energy-saving effect.

[0160] In the above embodiments, energy can be effectively saved by starting the energy-saving mode when the user leaves, reducing the display brightness and playback volume, etc. This energy-saving effect is more obvious, especially for display devices that are not used for a long time. This meets the requirements of energy conservation and environmental protection, and also helps to reduce the user's energy costs. When the user leaves and returns, the display device can automatically adjust the display brightness and playback volume, allowing the user to continue the previous viewing and listening experience without manual operation. This seamless experience can improve the user's convenience and satisfaction, and reduce the user's operating burden. The energy-saving mode and display brightness, playback volume and other parameters are automatically adjusted according to the user's departure and return, which reflects the intelligence of the display device. By combining the functions of the radar component and the controller, more accurate user status detection and device control can be achieved.

[0161] In the prior art, current TV browsers monitor performance indicators in real time, such as the browser's memory usage. When the performance indicators exceed the threshold, the browser will perform performance optimization operations. However, the performance optimization process operations often bring negative perceived experience to users. For example, the GC operation of memory recycling will cause freezes, and web page refreshes will interrupt the user's ongoing operations, etc., which will have a negative impact on users.

[0162] To solve the above problems, in some embodiments, a display device is provided, the display device comprising:

[0163] A display configured to display a browser interface;

[0164] A radar component is configured to detect a user state change and send the detected state change data to a browser;

[0165] The browser is configured to:

[0166] Display the content viewed by the user on the browser interface.

[0167] When the state change data indicates that the user has left the detection area of ​​the radar component, an off-screen control strategy is initiated. The off-screen control strategy at least includes performing performance optimization processing on the browser when a performance indicator of the browser exceeds an off-screen optimization threshold.

[0168] The off-screen optimization threshold is smaller than the normal performance optimization threshold of the browser, and the normal performance optimization threshold is the performance optimization threshold of the browser under continuous use.

[0169] Among them, performance indicators are parameters that reflect the performance status of the browser, such as memory usage, CPU usage, etc. The off-screen optimization threshold is the performance indicator threshold at which the browser performs performance optimization when the user leaves the detection area. This threshold is lower than the regular performance optimization threshold so that performance optimization can be performed in advance without the user's awareness. Performance optimization processing refers to a series of operations performed on the browser to improve its performance, such as releasing memory, clearing cache, etc. The regular performance optimization threshold is the threshold at which the browser performs performance optimization under continuous use. When the performance indicator exceeds this threshold, the browser will perform performance optimization to ensure its normal operation.

[0170] Exemplarily, when the user logs in to the target account on the browser, the browser will display the content that the user can view under the account on the display, such as web pages, videos, documents, etc. When the radar component detects that the user has left its detection area, the browser will start the off-screen control strategy. The off-screen control strategy includes performing performance optimization processing on the browser when the browser's performance indicators exceed the off-screen optimization threshold. When the browser's performance indicators exceed the off-screen optimization threshold, performance optimization processing is performed. Among them, the off-screen optimization threshold is less than the conventional performance optimization threshold so that performance optimization can be performed in advance without the user's perception. Performance optimization processing methods may include freeing up memory, clearing cache, optimizing code execution efficiency, etc.

[0171] For example, a user opens a browser on a smart TV and logs in to his or her video account. The browser displays a list of favorite videos and viewing history under the account. The user can choose to watch one of the videos, and the video will be played on the display. When the user leaves the room while watching TV, the radar component detects that the user has left the detection area, and the browser starts the off-screen control strategy. At this time, the browser monitors its own performance indicators, such as memory usage. If the memory usage exceeds the off-screen optimization threshold, the browser will perform performance optimization, such as releasing memory and clearing cache. This can improve the performance of the browser when the user is not present, and avoid problems such as freezes after the user returns. Assume that the browser's regular performance optimization threshold is to perform performance optimization when the memory usage reaches 80%, and the off-screen optimization threshold is to perform performance optimization when the memory usage reaches 60%. When the user leaves the detection area, the browser detects that the memory usage reaches 65%, exceeding the off-screen optimization threshold, and the browser will perform performance optimization. For example, some unnecessary memory usage is released, cache files are cleared, and running script codes are optimized to improve the performance of the browser.

[0172] In addition, the browser can also perform targeted optimization based on different performance indicators and usage scenarios. For example, in the case of high memory usage, the processes that occupy a large amount of memory can be released first; in the case of high CPU usage, the execution efficiency of the code can be optimized to reduce unnecessary calculations. At the same time, performance detection and optimization can be performed regularly. Even if the user does not leave the detection area, lightweight performance optimization can be performed in the background to maintain the browser's good performance status.

[0173] In some of the embodiments, if the user is often away for a long time, the controller can also perform more in-depth performance optimization processing, such as shutting down some unnecessary background processes; if the user is only away for a short time, a relatively lightweight performance optimization processing can be performed, such as cleaning up temporary files. At the same time, the data of other sensors, such as ambient light sensors and temperature sensors, can be combined to make corresponding device adjustments when the user is away. For example, if the ambient light is dim, the brightness of the display can be reduced; if the temperature is high, the cooling fan can be started, etc.

[0174] In the above embodiments, by performing performance optimization processing when the user leaves the detection area, the performance of the browser can be improved, the occurrence of problems such as freezes can be reduced, and a better experience can be provided for the user after returning. By configuring the off-screen optimization threshold to be smaller than the conventional performance optimization threshold, performance optimization can be performed without the user's perception, avoiding the adverse experience that may be caused by performance optimization during user use, such as freezes, page refreshes, etc.

[0175] In some embodiments, when the browser is performing the performance optimization process on the browser, the browser is further controlled to perform at least one of the following processes:

[0176] Perform garbage collection on the browser's memory;

[0177] Refresh the browser page.

[0178] Among them, memory is the space used by the browser to store data and program instructions during operation. Memory usage will affect the performance of the browser. When the memory usage is too high, it may cause the browser to run slowly or freeze. Pages are the web page content displayed in the browser. The loading and display of pages will occupy the browser's resources, including memory, CPU, etc. Garbage collection is a technology that automatically manages memory. It identifies memory space that is no longer used and recycles it to free up memory resources and increase the available space of memory. Page refresh processing is the process of reloading web page content. Page refresh can solve some page display problems, such as page loading errors, incomplete display, etc., and can also update the content of the page.

[0179] Exemplarily, when the browser performs performance optimization processing, garbage collection can be performed on the memory it uses. The purpose of garbage collection processing is to identify and recycle memory spaces that are no longer in use, thereby freeing up memory resources and improving the performance of the browser. Taking the browser on a smart TV as an example, when a user is watching a video, the browser will load the video playback page and related scripts, plug-ins, etc. As the user's operations and pages change, some memory space may no longer be used. For example, when a user closes a web page tab, the memory space occupied by the page corresponding to the tab may no longer be needed. At this point, the browser can start garbage collection processing, identify these no longer used memory spaces and recycle them. This can reduce memory usage and improve the browser's operating speed and responsiveness.

[0180] For example, during the performance optimization process, the browser can refresh the page. Page refresh can solve some page display problems, such as page loading errors, incomplete display, etc., and can also update the content of the page to improve the user experience. Suppose that when a user uses a browser to browse a news website, due to network problems or other reasons, part of the page content is incompletely displayed. At this time, the browser can refresh the page and reload the page content to ensure the integrity and correctness of the page.

[0181] In the above embodiments, the performance of the browser can be effectively improved by performing garbage collection on the browser's memory and refreshing the page. Garbage collection can release memory resources and reduce performance problems caused by excessive memory usage; page refresh can solve page display problems and provide the latest information to improve user experience. When the user is off-screen, timely garbage collection and page refresh can reduce the possibility of browser errors and crashes and enhance the stability of the browser. In particular, for browsers that run for a long time, by performing performance optimization when the user leaves the detection area, performance optimization can be performed without the user's perception, avoiding the bad experience that may be caused by performance optimization during user use.

[0182] In some embodiments, a browser control method is provided, the browser control method comprising:

[0183] Display the content viewed by the user who logs in to the target account through the browser, and obtain the status change data obtained by detecting the user's user status change;

[0184] When the state change data indicates that the user has left the detection area, an off-screen control strategy is initiated, and the off-screen control strategy at least includes logging out of the target account in the browser and recording display parameters that match the current display content;

[0185] When the state change data indicates that the user has returned to the detection area, a recovery control strategy is initiated, and the recovery control strategy at least includes logging in to the target account again in the browser and continuing to display the current display content in the browser according to the display parameters.

[0186] In some embodiments, a browser control method is provided, the browser control method comprising:

[0187] Display the content viewed by the user who logs in to the target account through the browser, and obtain the status change data obtained by detecting the user's user status change;

[0188] When the state change data indicates that the user has left the detection area of ​​the radar component, an off-screen control strategy is initiated, wherein the off-screen control strategy at least includes performing performance optimization processing on the browser when a performance indicator of the browser exceeds an off-screen optimization threshold;

[0189] The off-screen optimization threshold is smaller than the normal performance optimization threshold of the browser, and the normal performance optimization threshold is the performance optimization threshold of the browser under continuous use.

[0190] In the prior art, when a TV browser is started, a set of fixed display parameters and audio and video parameters are set according to a preset mode. Users can only change the browser's setting parameters through manual operation. The browser does not have the ability to automatically sense the user's position and displacement information. When the user approaches or moves away from the TV, moves in front of the TV, or leaves the TV, the browser will not have any changes in setting parameters, and lacks the ability to provide users with intelligent experience perception. In addition, current TV browsers monitor performance indicators in real time, such as the memory usage of the browser. When the performance indicator exceeds the threshold (for example, the memory usage exceeds the threshold), the browser will perform performance optimization operations, but the performance optimization process operations often bring negative perception experiences to users. For example, the GC operation of memory recycling will cause freezes, and web page refreshes will interrupt the user's ongoing operations, etc., which have a negative impact on users.

[0191] In some embodiments, taking a smart TV as an example, a method for controlling a TV browser is provided, specifically including:

[0192] Dynamically set parameters: The millimeter radar is responsible for collecting user location data, and the TV browser, as the receiving end, processes the millimeter radar's feedback data and event notifications in real time. The browser continuously obtains data from the millimeter radar to ensure real-time performance. The browser parses and extracts key information from the millimeter radar data (such as target detection, distance, direction of movement, etc.). The browser dynamically modifies the current display parameters and audio and video parameters based on changes in user location information. The parameter modification is based on multiple user location threshold intervals pre-set by the browser. When the user's location change is mapped to a change in the threshold interval, the browser dynamically modifies the current display parameters and audio and video parameters based on the pre-set parameters of the new threshold interval. If the user manually modifies the setting parameters, the browser will save and update the pre-set parameters of the user's current location threshold interval, and adaptively learn the user's personalized needs at various positions in front of the TV.

[0193] Real-time optimization experience: Figure 7 As shown, the browser maps various positions and displacement information of the user in front of the TV to various threshold intervals. The threshold interval information includes but is not limited to the distance between the user and the TV, the orientation angle of the user in front of the TV, the user's movement direction and movement speed, etc. Each threshold interval is pre-set with display parameters and audio and video parameters for optimizing the user experience. The parameters include but are not limited to resolution, contrast, color gamut, volume, balance, sound field positioning, etc. When the browser detects through the millimeter radar that the user's position or displacement changes in front of the TV triggers the user's threshold interval switch, the browser automatically takes effect The pre-set display parameters and audio and video parameters of the new threshold interval ensure that when the user's position or displacement changes, the browser optimizes the user's web browsing and audio and video experience in real time

[0194] Intelligent performance optimization: Figure 8 As shown, the TV browser detects the user's location information through the millimeter radar. When the user leaves the TV, the browser sets a reasonable delay to avoid misjudgment. After confirming that the user has left the TV, the browser triggers the internal performance optimization module and performs corresponding performance optimization according to the current browser resource usage. For example, when the browser memory usage is greater than the standard threshold, the GC operation of releasing the memory is executed. When the browser memory usage is close to the limit threshold, the page refresh operation is executed. The performance optimization that affects the user's real-time experience is arranged to be executed at this time, which not only improves the performance of the browser, but also avoids the negative impact on the user's real-time experience.

[0195] Optimized off-screen solution: When the TV browser detects that the user has left the TV through millimeter radar (the judgment method is the same as above), the browser automatically logs out of the account to protect user privacy, calls the TV interface to enter energy-saving mode to reduce power consumption, and automatically mutes to reduce noise interference. If the browser is currently playing a video, it will automatically and intelligently pause the video playback to prevent the user from missing the video content or the inconvenience of watching the replay operation. When the user returns to the TV, the browser automatically restores the volume, exits the energy-saving mode, re-logins the user, and resumes the paused video to ensure a seamless connection between the user's off-screen and back-to-screen experience.

[0196] In some embodiments, Fig. 9 As shown in the figure, after the browser is started, the browser detects the user's location information and displacement information in real time through the millimeter radar. When the user's location or action changes, the millimeter radar sends the user's new location displacement information to the browser. After the browser receives the notification data from the millimeter radar, it uses an algorithm to determine the current user status. At this time, there are three judgment results:

[0197] 1) Result 1: The user has not left the TV. At this time, the user has just moved in front of the TV. In the next step, the browser maps the data fed back by the millimeter radar to the corresponding threshold interval through an algorithm. If the new threshold interval to which the user belongs at this time is the same as the old threshold interval to which the user was previously located, the browser remains the same. If the new threshold interval to which the user belongs at this time has changed compared to the old threshold interval to which the user was previously located, the browser extracts the display parameters and audio and video parameters prefabricated in the new threshold interval, sets and takes effect the new parameters. In this way, after the user's position changes, the browser's display parameters and audio and video parameters change in real time with the user, giving the user a better dynamic experience.

[0198] 2) Result 2: The user leaves the TV, and the browser sets a delay time. If the user still does not return to the TV after the delay time, it is considered that the user has indeed left the TV to avoid misjudging that the user has briefly left the TV and then returned. If the user has not really left the TV, it means that the user has only changed location, and the browser continues to execute the process of the above result 1. If the user has indeed left the TV, the browser will start the off-screen solution, which includes but is not limited to the browser automatically logging out of the account to protect user privacy, automatically entering the energy-saving mode to reduce power consumption, and automatically muting to reduce noise interference. At this time, the browser determines whether there is a video currently playing. If so, the browser automatically pauses the video playback to avoid the user missing the content they want to watch or the inconvenience of replaying after returning.

[0199] 3) Result 3: When the user returns after leaving the TV for a long time, the browser has already executed the off-screen solution. When the browser detects the user's return through the millimeter radar, it immediately starts the recovery solution. The recovery solution includes but is not limited to restoring the volume, exiting the energy-saving mode, re-logging in the user, and resuming the video, so that the user's experience of leaving the TV and returning to the TV is seamlessly connected.

[0200] When the browser is running, it detects through millimeter radar that the user has left the TV. Next, the browser determines whether the current performance status is better than the threshold of automatic off-screen optimization. This threshold is more relaxed than the conventional performance optimization threshold, because conventional performance optimization is an optimization that must be performed to ensure the availability of the browser. Automatic off-screen performance optimization is a performance optimization that is performed in advance without the user's perception. If the browser performance status is better than the threshold of automatic off-screen optimization at this time, then the status quo is maintained. If the browser performance status is not as good as the threshold of automatic off-screen optimization at this time, then the browser executes the performance optimization plan. The performance optimization plan includes but is not limited to GC operations that release memory, page refresh operations, etc. Performance optimization operations that users are aware of (stuttering, operation interruptions, etc.) are executed at this time, which not only optimizes the performance of the browser, but also avoids negative impacts on user experience.

[0201] Fig.10 The operating environment of the system architecture shown has added hardware device support for millimeter radar, which is used to detect user position and movement changes in real time.

[0202] The data layer of the system architecture has added a millimeter radar data collection and analysis module to receive and process the user position displacement information data fed back by the millimeter radar. A new millimeter radar data filtering and mapping module has been added to filter and smooth the collected millimeter radar data to remove abnormal values, and then map the processed data to the threshold intervals pre-set by the browser. A new user threshold interval data processing module has been added to manage the correspondence between the user's position displacement information and different threshold intervals. A new threshold interval parameter processing module has been added to map the threshold interval of the user's position displacement information to various setting parameters of the browser and TV.

[0203] A user status management module has been added to the business layer of the system architecture, which is used to determine the user's current status based on the millimeter radar feedback data, such as whether the user has left the TV or how the user has moved in front of the TV. A user threshold interval control module has been added to process the user's position displacement information when moving in front of the TV and map it to the threshold interval corresponding to the browser. A new off-screen solution control module has been added to control the solution processing after the user leaves the screen and the recovery solution processing after the user returns to the TV. A new parameter control module has been added to make the display parameters and audio and video parameter settings that currently need to be modified take effect. If the user manually modifies the parameters, this module will record the user's personal preferences in the threshold interval and update the prefabricated parameters of the threshold interval.

[0204] In an exemplary embodiment, a computer device is provided, including a memory and a processor, wherein a computer program is stored in the memory, and the method of the above embodiment is implemented when the processor executes the computer program.

[0205] In one embodiment, a computer-readable storage medium is provided, on which a computer program is stored. When the computer program is executed by a processor, the method of the above embodiment is implemented.

[0206] In one embodiment, a computer program product is provided, including a computer program, which implements the method of the above embodiment when executed by a processor.

[0207] It should be noted that the user information (including but not limited to user device information, user personal information, etc.) and data (including but not limited to data used for analysis, stored data, displayed data, etc.) involved in this application are all information and data authorized by the user or fully authorized by all parties, and the collection, use and processing of relevant data must comply with relevant regulations.

[0208] Those skilled in the art can understand that all or part of the processes in the above-mentioned embodiment methods can be completed by instructing the relevant hardware through a computer program, and the computer program can be stored in a non-volatile computer-readable storage medium. When the computer program is executed, it can include the processes of the embodiments of the above-mentioned methods. Among them, any reference to the memory, database or other medium used in the embodiments provided in the present application can include at least one of non-volatile memory and volatile memory. Non-volatile memory can include read-only memory (ROM), magnetic tape, floppy disk, flash memory, optical memory, high-density embedded non-volatile memory, resistive random access memory (ReRAM), magnetic random access memory (MRAM), ferroelectric random access memory (FRAM), phase change memory (PCM), graphene memory, etc. Volatile memory can include random access memory (RAM) or external cache memory, etc. As an illustration and not limitation, RAM can be in various forms, such as static random access memory (SRAM) or dynamic random access memory (DRAM). The database involved in each embodiment provided in this application may include at least one of a relational database and a non-relational database. Non-relational databases may include distributed databases based on blockchains, etc., but are not limited to this. The processor involved in each embodiment provided in this application may be a general-purpose processor, a central processing unit, a graphics processor, a digital signal processor, a programmable logic device, a data processing logic device based on quantum computing, an artificial intelligence (AI) processor, etc., but are not limited to this.

[0209] The technical features of the above embodiments may be combined arbitrarily. To make the description concise, not all possible combinations of the technical features in the above embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this application.

[0210] The above embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be understood as limiting the scope of the present application. It should be pointed out that, for a person of ordinary skill in the art, several variations and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A display device, characterized in that: The display device comprises: A display configured to display a browser interface; A radar component is configured to detect a user state change and send the detected state change data to a browser; The browser is configured to: Displaying the content viewed by the user logging into the target account on the browser interface; In the case where the state change data indicates that the user has left the detection area of ​​the radar component, starting an off-screen control strategy, the off-screen control strategy at least including logging out of the target account and recording display parameters matching the current display content; In the case where the state change data indicates that the user has returned to the detection area, starting a recovery control strategy, the recovery control strategy at least comprising logging into the target account again and continuing to display the current display content according to the display parameters; The controller is configured to receive and execute the off-screen control strategy and the restoration control strategy.

2. The display device according to claim 1, characterized in that The browser is further controlled to: When the state change data indicates that the position of the user in the detection area changes, determining a first position of the user before the movement and a second position of the user after the movement; In the case that the first position and the second position correspond to different position intervals respectively, the display parameters matched by the current display content are adjusted according to the display parameters matched by the position area corresponding to the second position.

3. The display device according to claim 2, characterized in that When the browser adjusts the display parameters matched by the current display content according to the display parameters matched by the position area corresponding to the second position, the browser is further controlled to: In the case where the currently displayed content is web page content, the section content of the web page content is layout-adjusted according to the section content display conditions matched by the position area corresponding to the second position, so as to display the content in the section content that meets the section content display conditions, and cancel the display of the content in the section content that does not meet the section content display level conditions.

4. The display device according to claim 2, characterized in that The browser is further controlled to: When the state change data indicates that the user has left the detection area of ​​the radar assembly and has not returned to the detection area after a preset time period, determining that the user has left the detection area; When the state change data indicates that the user leaves the detection area and returns to the detection area within a preset time period, it is determined that a position change of the user occurs in the detection area.

5. The display device according to claim 1, characterized in that The off-screen control strategy further includes: sending a screen-off control signal to the controller so that the controller controls the display device to turn off the screen; The recovery control strategy also includes: sending a screen light-up control signal to the controller, so that the controller controls the display device to light up the screen and continues to display the currently displayed content on the browser interface.

6. The display device according to claim 1, characterized in that The display parameter matched by the currently displayed content includes at least one of the display brightness and the playback volume of the display device; The off-screen control strategy further includes: sending an energy-saving mode start instruction to the controller, so that the controller performs at least one of reducing the display brightness and reducing the playback volume; The recovery control strategy also includes: sending an energy-saving mode exit instruction to the controller, so that the controller executes to restore the display brightness and the playback volume to the recorded original values ​​respectively.

7. A display device, characterized in that: The display device comprises: A display configured to display a browser interface; A radar component is configured to detect a user state change and send the detected state change data to a browser; The browser is configured to: Displaying the content viewed by the user on the browser interface; When the state change data indicates that the user has left the detection area of ​​the radar component, starting an off-screen control strategy, wherein the off-screen control strategy at least includes performing performance optimization processing on the browser when a performance indicator of the browser exceeds an off-screen optimization threshold; The off-screen optimization threshold is smaller than a conventional performance optimization threshold of the browser, and the conventional performance optimization threshold is a performance optimization threshold of the browser under continuous use.

8. The display device according to claim 7, characterized in that When the browser is performing the performance optimization process on the browser, the browser is further controlled to perform at least one of the following processes: Performing garbage collection on the browser's memory; Refresh the page of the browser.

9. A browser control method, characterized in that: The method comprises: Display the content viewed by the user logging into the target account through the browser, and obtain the status change data obtained by detecting the user status change of the user; In the case where the state change data indicates that the user has left the detection area, starting an off-screen control strategy, the off-screen control strategy at least including logging out of the target account in the browser and recording display parameters matching the current display content; When the state change data indicates that the user has returned to the detection area, a recovery control strategy is initiated, and the recovery control strategy at least includes logging into the target account again in the browser and continuing to display the current display content in the browser according to the display parameters.

10. A browser control method, characterized in that: The method comprises: Displaying the content viewed by the user through the browser, and acquiring state change data obtained by detecting changes in the user state of the user; When the state change data indicates that the user has left the detection area of ​​the radar component, starting an off-screen control strategy, wherein the off-screen control strategy at least includes performing performance optimization processing on the browser when the performance index of the browser exceeds an off-screen optimization threshold; The off-screen optimization threshold is smaller than a conventional performance optimization threshold of the browser, and the conventional performance optimization threshold is a performance optimization threshold of the browser under continuous use.

Images