Display device and display method of user interface

Abstract

The invention provides a display device and a display method of a user interface. The method comprises the steps of obtaining original environment data of an environment where the display device is located; the original environment data comprises environment data acquired by sensor equipment and / or environment data shot by a camera; analyzing environment parameters from the original environment data, wherein the environment parameters are used for representing environment feature information of the environment; obtaining effective environment parameters from the environment parameters; and adjusting image quality parameters corresponding to the user interface according to the effective environment parameters. According to the method, on the basis of the original image quality, the located environment is recognized, and the image quality parameters of the user interface are adjusted according to the located environment, so that the user interface is matched with the located environment. By adjusting the pixel value of the screen edge, the screen edge is also adapted to the environment where the screen edge is located, so that the effect of integrating the screen edge with the environment where the screen edge is located is achieved, and the problems that the sense of abrupt exists between an art television and the environment where the screen edge is located and the user interface presentation style is not adapted to the environment where the screen edge is located are solved.

Description

A display device and a display method for a user interface Technical Field

[0001] This application relates to the field of display device technology, and in particular to a display device and a display method for a user interface. Background Technology

[0002] As an art form integrated into the home décor, the art TV transcends being merely a cold screen; it exists as a work of art. The form factor of art TVs tends towards narrow bezels and full-screen designs, aiming to present a borderless effect to the user. Even if the bezel cannot be completely hidden, multiple bezel color options are offered for users to choose from. In terms of content, art TVs display artwork, creating an effect similar to a home mural for the viewer.

[0003] To ensure that the user interface on an art TV matches its environment, most current settings and adjustments rely on providing picture quality parameters, and depend heavily on manual user adjustments. For example, users manually adjust screen brightness, contrast, and other effects through a parameter adjustment interface to make the user interface style as consistent as possible with the surrounding environment.

[0004] However, in the above methods, the television picture quality may not match the surrounding environment. Specifically, the environment changes dynamically with time, light, temperature, and other factors. Although current technology can adjust picture quality parameters such as brightness and contrast, this adjustment is relatively coarse and cannot keep up with real-time changes in the environment, resulting in a lack of harmony between the television picture and the surrounding environment. Therefore, there are currently problems with artistic televisions and their user interface style being incompatible with the surrounding environment. Summary of the Invention

[0005] Some embodiments of this application provide a display device and a display method for a user interface to solve the problems of jarring visuals between art televisions and their surroundings, and the incompatibility of the style of the user interface with the environment.

[0006] In a first aspect, some embodiments of this application provide a display device, including: a display configured to display a user interface; and a controller configured to: acquire raw environmental data of the environment in which the display device is located; the raw environmental data including environmental data collected by sensor devices and / or environmental data captured by cameras; parse environmental parameters from the raw environmental data, the environmental parameters being used to characterize environmental feature information of the environment; acquire valid environmental parameters from the environmental parameters; and adjust image quality parameters corresponding to the user interface based on the valid environmental parameters.

[0007] The above technical solution has the following advantages or beneficial effects: Based on the original image quality, the display device identifies the environment in which it is located and adjusts the image quality parameters of the user interface accordingly, so that the content presented by the user interface is adapted to the environment. Simultaneously, by adjusting the pixel values ​​at the screen edges, the screen edges are also adapted to the environment, thereby achieving a seamless integration between the art television and its surroundings, and resolving the problems of jarring contrasts between the art television and its environment, and the incompatibility of the user interface style with the environment.

[0008] In some embodiments, the display device has a built-in sensor device, and the controller acquires raw environmental data of the environment in which the display device is located, specifically configured to: collect the raw environmental data through the sensor device; wherein, the sensor device includes at least one of an ambient light sensor for sensing ambient light intensity, a color temperature sensor for sensing ambient light color temperature, a time-of-flight sensor for sensing spatial distance, and a millimeter-wave radar for sensing spatial layout.

[0009] The above technical solution has the following advantages or beneficial effects: by collecting raw environmental data through sensor devices, the art TV can achieve intelligent control and automatically adapt to different environments without the need for manual adjustment by the user.

[0010] In some embodiments, the controller obtains valid environmental parameters from the environmental parameters, specifically configured to: obtain the raw environmental data collected by the sensor device; delete outliers in the raw environmental data to obtain the valid environmental parameters; the outliers include null values ​​and values ​​in which the fluctuation range of the raw environmental data exceeds a preset range.

[0011] The above technical solution has the following advantages or beneficial effects: deleting outliers can effectively avoid the interference of invalid or erroneous data on subsequent processing and analysis, thereby improving the overall data quality and reliability.

[0012] In some embodiments, the display device is equipped with a camera, and the controller acquires raw environmental data of the environment in which the display device is located. Specifically, the controller is configured to: pre-set a shooting time interval for the camera to capture images of the environment; and when the shooting time interval is reached, trigger the camera to capture images of the environment to obtain captured images, which are then used as the raw environmental data.

[0013] The above technical solution has the following advantages or beneficial effects: by pre-setting the shooting time interval and automatically triggering shooting, the display device can continuously and periodically acquire information about changes in the environment, thereby providing a data basis for automatically adjusting its display effect to adapt to different environmental scenarios.

[0014] In some embodiments, the controller obtains valid environmental parameters from the environmental parameters, specifically configured to: delete blank images or images with identical pixel values, or images with image quality parameters lower than a preset threshold, from the captured images; parse the captured images using a preset image recognition algorithm to obtain the environmental parameters; the preset image recognition algorithm includes AI large model algorithm, machine vision algorithm, Transformer-based multimodal large model algorithm, and residual network algorithm; the environmental parameters include the dominant environmental color tone; identify outliers in the environmental parameters; the outliers include values ​​where the brightness value of the dominant environmental color tone is lower than a first brightness threshold or higher than a second brightness threshold, and values ​​where the saturation value of the dominant environmental color tone is higher than a preset saturation threshold; wherein the first brightness threshold is less than the second brightness threshold; delete the outliers in the environmental parameters to obtain the valid environmental parameters.

[0015] The above technical solution has the following advantages or beneficial effects: by deleting low-quality images and outliers, the accuracy and reliability of environmental parameters can be significantly improved, which helps the display device to more accurately perceive and adapt to the environment, thereby optimizing the image quality parameters and enabling art TVs to better integrate into the environment.

[0016] In some embodiments, the display device is equipped with a camera and a sensor device. The controller obtains valid environmental parameters from the environmental parameters, specifically configured to: collect the original environmental parameters through the sensor device; the sensor device includes at least one of an ambient light sensor for sensing ambient light intensity, a color temperature sensor for sensing ambient light color temperature, a time-of-flight sensor for sensing spatial distance, and a millimeter-wave radar for sensing spatial layout; delete outliers in the original environmental data collected by the sensor device to obtain a first environmental parameter; the outliers include null values ​​and values ​​where the fluctuation range of the original environmental data exceeds a preset range; preset the shooting time interval for the camera to capture the environment, and, when the shooting time interval is reached, trigger the camera to capture the environment. The environment is described, and a captured image is obtained to serve as the original environmental data. Blank images, images with identical pixel values, or images with image quality parameters below a preset threshold are deleted from the captured image. The deleted captured image is parsed to obtain a second environmental parameter. The second environmental parameter includes the dominant environmental color tone. Outliers in the second environmental parameter are deleted. The outliers include values ​​where the brightness of the dominant environmental color tone is below a first brightness threshold or above a second brightness threshold, and values ​​where the saturation of the dominant environmental color tone is above a preset saturation threshold. The first brightness threshold is less than the second brightness threshold. The first environmental parameter and the second environmental parameter after deleting outliers are merged to obtain a third environmental parameter. Duplicate data in the third environmental parameter is deleted to obtain the valid environmental parameter.

[0017] The above technical solution has the following advantages or beneficial effects: sensors provide real-time, quantified physical parameters, and image recognition supplements semantic information such as style and layout. The combination of the two methods can avoid the limitations of a single data source and improve the comprehensiveness and accuracy of environmental perception. At the same time, through dual verification of data from both sensors and images (such as removing outliers and duplicate data), data noise (such as sensor false alarms and image recognition errors) can be eliminated, ensuring parameter reliability.

[0018] In some embodiments, the controller obtains raw environmental data of the environment in which the display device is located, specifically configured to: receive an environmental photo uploaded by a user through a first page, parse the environmental photo, and obtain the raw environmental data; or, receive raw environmental data input by a user through a second page.

[0019] The above technical solution has the following advantages or beneficial effects: the TV provides two different interaction methods to meet the needs and preferences of different users. By allowing users to upload photos or directly input parameters, the system can still obtain environmental parameters even without the support of sensors or cameras, thus improving the flexibility and adaptability of data acquisition.

[0020] In some embodiments, after the controller adjusts the image quality parameters corresponding to the user interface based on the valid environmental parameters, it is further configured to: parse the environmental parameters to obtain the dominant color tone of the current environment; and adjust the display parameters of the preset edge of the display frame based on the dominant color tone.

[0021] The above technical solution has the following advantages or beneficial effects: By analyzing the fused original environmental data, the display device further extracts the style characteristics of the surrounding environment and dynamically adjusts the screen edge pixels based on these characteristics, achieving deep adaptation between the display effect and the surrounding environment. Through main color matching, color conflicts between the screen edges and the surrounding environment can be eliminated, creating a unified visual atmosphere. When the surrounding environment changes (such as changing the color of curtains or adjusting the color temperature of lights), the system can re-analyze the environmental parameters and update the edge pixel values ​​to maintain continuous adaptation and achieve deep integration between the art TV and the surrounding environment.

[0022] In some embodiments, the controller adjusts the display parameters of the preset edge of the display bezel according to the ambient color tone, specifically configured to: reduce the pixel value of the preset edge of the bezel when the brightness value of the ambient color tone is lower than a first preset threshold; increase the pixel value of the preset edge of the bezel when the brightness value of the ambient color tone is higher than a second preset threshold; wherein the first preset threshold is less than the second preset threshold.

[0023] The above technical solution has the following advantages or beneficial effects: In dark environments (such as at night), excessively bright screen edges can create halos, causing visual fatigue or interfering with the displayed content. By reducing edge pixel values, the halo effect is reduced, allowing the screen edges to blend naturally with the dark environment. In bright environments (such as direct sunlight during the day), excessively dark screen edges can cause content to become blurry or be obscured by ambient light. By increasing edge pixel values ​​and enhancing edge contrast, it is possible to ensure that the displayed content remains clearly visible under strong light, achieving intelligent coordination with ambient lighting and improving the user experience.

[0024] Secondly, some embodiments of this application provide a user interface display method that can be applied to the display device of the first aspect. The display device includes a display and a controller. The method includes: acquiring raw environmental data of the environment in which the display device is located; the raw environmental data includes environmental data collected by sensor devices and / or environmental data captured by cameras; parsing environmental parameters from the raw environmental data, the environmental parameters being used to characterize environmental feature information of the environment; acquiring effective environmental parameters from the environmental parameters; and adjusting the image quality parameters corresponding to the user interface based on the effective environmental parameters.

[0025] The above technical solution has the following advantages or beneficial effects: Based on the original image quality, the method identifies the environment in which the display device is located and adjusts the image quality parameters of the user interface according to the environment, so that the content presented by the user interface is adapted to the environment. Simultaneously, by adjusting the pixel values ​​at the screen edges, the screen edges are also adapted to the environment, thereby achieving a seamless integration between the art television and its surroundings, solving the problems of jarring contrasts between the art television and its environment, and the incompatibility of the user interface style with the environment. Attached Figure Description

[0026] To more clearly illustrate the technical solutions in some embodiments of this application or in the prior art, the drawings used in the embodiments will be briefly introduced below. Obviously, the drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0027] Figure 1 is a schematic diagram of the operation scenario between the display device and the control device provided in some embodiments of this application; Figure 2 is a schematic diagram of the hardware configuration of the display device provided in some embodiments of this application; Figure 3 is a schematic diagram of the software configuration of the display device provided in some embodiments of this application; Figure 4 is a schematic diagram of the environment in which the art TV and the display device are located provided in some embodiments of this application; Figure 5 is a schematic diagram of the display method for the display device to execute the user interface provided in some embodiments of this application; Figure 6 is a schematic diagram of the usage scenario of the first page provided in some embodiments of this application; Figure 7 is a schematic diagram of the usage scenario of the second page provided in some embodiments of this application; Figure 8 is a schematic diagram of the overall architecture of the display method for the display device to implement the user interface provided in some embodiments of this application; Figure 9 is a schematic diagram of the functional structure of the core controller provided in some embodiments of this application; Figure 10 is a schematic diagram of the adjustment scenario of the image controller provided in some embodiments of this application. Detailed Implementation

[0028] The embodiments will now be described in detail, examples of which are illustrated in the accompanying drawings. When the following description relates to the drawings, unless otherwise indicated, the same numbers in different drawings represent the same or similar elements. The embodiments described below do not represent all embodiments consistent with this application. They are merely examples of systems and methods consistent with some aspects of this application as detailed in the claims.

[0029] It should be noted that the brief descriptions of terms in this application are only for the convenience of understanding the embodiments described below, and are not intended to limit the embodiments of this application. Unless otherwise stated, these terms should be understood in their ordinary and common meaning.

[0030] The terms "first," "second," "third," etc., used in the specification, claims, and accompanying drawings of this application are used to distinguish similar or related objects or entities, and do not necessarily imply a specific order or sequence, unless otherwise specified. It should be understood that such terms are interchangeable where appropriate.

[0031] The terms “comprising” and “having”, and any variations thereof, are intended to cover but not exclude inclusion, for example, a product or device that includes a range of components is not necessarily limited to all of the components that are clearly listed, but may include other components that are not clearly listed or that are inherent to such product or device.

[0032] The term "module" refers to any known or subsequently developed hardware, software, firmware, artificial intelligence, fuzzy logic, or combination of hardware and / or software code that is capable of performing the functions associated with that element.

[0033] In this embodiment, the display device 200 generally refers to a device with screen display and data processing capabilities. For example, the display device 200 includes, but is not limited to, smart TVs, mobile terminals, computers, monitors, advertising screens, wearable devices, virtual reality devices, augmented reality devices, etc.

[0034] Figure 1 is a schematic diagram of an operation scenario between a display device and a control device provided in some embodiments of this application. As shown in Figure 1, a user can operate the display device 200 through touch operation, a mobile terminal 300, and a control device 100. The control device 100 is used to receive operation commands input by the user and convert these commands into control commands that the display device 200 can recognize and respond to. For example, the control device 100 can be a remote control, a stylus, a gamepad, etc.

[0035] The mobile terminal 300 can function as a control device for human-computer interaction between the user and the display device 200. It can also function as a communication device for establishing a communication connection with the display device 200 and exchanging data. In some embodiments, the mobile terminal 300 can have software applications installed on it and communicate with the display device 200 via network communication protocols to achieve one-to-one control and data communication. Furthermore, it can transmit audio and video content displayed on the mobile terminal 300 to the display device 200 for synchronized display.

[0036] In some embodiments, the mobile terminal 300 or other electronic devices may also simulate the functions of the control device 100 by running an application that controls the display device 200.

[0037] As also shown in Figure 1, the display device 200 communicates with the server 400 via various communication methods. The display device 200 can communicate via a local area network (LAN), a wireless local area network (WLAN), and other networks.

[0038] Display device 200 can provide broadcast television reception function, and can also be equipped with intelligent network television function that provides computer support function, including but not limited to network television, smart television, Internet Protocol television (IPTV), etc.

[0039] Figure 2 is a hardware configuration block diagram of the display device 200 in Figure 1 provided in some embodiments of this application.

[0040] In some embodiments, the display device 200 may include at least one of a tuner 210, a communication device 220, a detector 230, a device interface 240, a controller 250, a display 260, an audio output device 270, a memory, a power supply, and a user input interface 280.

[0041] In some embodiments, detector 230 is used to acquire signals from the external environment or to interact with the outside world. For example, detector 230 includes a light receiver, a sensor for acquiring ambient light intensity; or, detector 230 includes an image acquisition device, such as a camera, which can be used to acquire external environmental scenes, user attributes, or user interaction gestures; or, detector 230 includes a sound acquisition device, such as a microphone, for receiving external sounds.

[0042] In some embodiments, the display 260 includes display function components for presenting images and driving components for driving image display. The display 260 is used to receive and display image signals output from the controller 250. For example, the display 260 can be used to display video content, image content, menu control interface components, and user control UI interfaces, etc.

[0043] In some embodiments, the communication device 220 is a component used to communicate with external devices or the server 400 according to various communication protocol types. The display device 200 may have multiple communication devices 220 depending on the supported communication methods. For example, when the display device 200 supports wireless network communication, it may have a communication device 220 with WiFi functionality. When the display device 200 supports Bluetooth connectivity, it needs to have a communication device 220 with Bluetooth functionality.

[0044] The communication device 220 enables the display device 200 to communicate with external devices or the server 400 via wireless or wired connections. Wired connections utilize data cables, interfaces, or other components to connect the display device 200 to external devices. Wireless connections utilize wireless signals or wireless networks. The display device 200 can directly establish a connection with external devices or indirectly through gateways, routers, or other connection devices.

[0045] In some embodiments, the controller 250 may include at least one of a central processing unit, a video processor, an audio processor, a graphics processor, and a power processor, and a first to an nth interface for input / output. The controller 250 controls the operation of the display device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the display device 200.

[0046] In some embodiments, the controller 250 and the tuner 210 may be located in different separate devices, that is, the tuner 210 may also be located in an external device of the main device where the controller 250 is located, such as an external set-top box.

[0047] In some embodiments, a user can input user commands through a graphical user interface (GUI) displayed on a display 260, and the user input interface 280 receives the user input commands through the graphical user interface (GUI).

[0048] In some embodiments, the audio output device 270 can be a built-in speaker of the display device 200 or an external audio output device connected to the display device 200. For the external audio output device connected to the display device 200, the display device 200 may also be provided with an external audio output terminal, through which the audio output device can be connected to the display device 200 to output sound from the display device 200.

[0049] In some embodiments, the user input interface 280 can be used to receive instructions from user input.

[0050] To enable user interaction, in some embodiments, the display device 200 may run an operating system. The operating system is a computer program used to manage and control the hardware and software resources of the display device 200. The operating system can control the display device to provide a user interface; for example, the operating system can directly control the display device to provide a user interface, or it can provide a user interface by running an application. The operating system also allows users to interact with the display device 200.

[0051] It should be noted that the operating system can be a native operating system based on a specific operating platform, a third-party operating system that is deeply customized based on a specific operating platform, or an independent operating system specifically developed for display devices.

[0052] Operating systems can be divided into different modules or layers based on the functions they implement. For example, as shown in Figure 3, in some embodiments, the system is divided into four layers, from top to bottom: the Applications layer (referred to as the "Application Layer"), the Application Framework layer (referred to as the "Framework Layer"), the System Library layer, and the Kernel layer.

[0053] In some embodiments, the application layer provides services and interfaces for applications, enabling the display device 200 to run applications and interact with the user based on the applications. The application layer may contain at least one application, which may be a built-in Windows program, system settings program, or clock program of the operating system; or it may be an application developed by a third-party developer. In specific implementations, the application packages in the application layer are not limited to the examples above.

[0054] The framework layer provides application programming interfaces (APIs) and a programming framework for applications. The application framework layer includes predefined functions. It acts as a central processing unit, determining the actions taken by applications within the application layer. Through the API, applications can access system resources and obtain system services during execution.

[0055] As shown in Figure 3, the application framework layer in this embodiment includes a view system, managers, and content providers. The view system designs and implements the application's interface and interactions, and includes lists, grids, text boxes, and buttons. The managers include at least one of the following modules: an activity manager for interacting with all running activities in the system; a location manager for providing system services or applications with access to system location services; a package manager for retrieving various information related to application packages currently installed on the device; a notification manager for controlling the display and clearing of notification messages; and a window manager for managing icons, windows, toolbars, wallpapers, and desktop widgets on the user interface.

[0056] In some embodiments, the Activity Manager manages the lifecycle of individual applications and common navigation and back functions, such as controlling application exit, opening, and back actions. The Window Manager manages all window programs, such as obtaining the screen size, determining if a status bar is present, locking the screen, capturing the screen, and controlling changes to the display window, such as shrinking the display window, shaking the display, or distorting the display.

[0057] In some embodiments, the system runtime library layer can provide support for the framework layer. When the framework layer is used, the operating system runs the instruction library contained in the system runtime library layer, such as the C / C++ instruction library, to implement the functions to be performed by the framework layer.

[0058] In some embodiments, the kernel layer is a functional layer between the hardware and software of the display device 200. The kernel layer can implement functions such as hardware abstraction, multitasking, and memory management. For example, as shown in Figure 3, the kernel layer can be configured with hardware drivers, which can be at least one of the following: audio driver, display driver, Bluetooth driver, camera driver, WIFI driver, USB driver, HDMI driver, sensor driver (such as fingerprint sensor, temperature sensor, pressure sensor, etc.), and power driver, etc.

[0059] It should be noted that the above examples are merely a simple division of operating system functions and do not limit the specific form of the operating system of the display device 200 in this application embodiment. Depending on the function of the display device, the type of operating system, and other factors, the number of levels and the specific level type of the operating system may be expressed in other forms.

[0060] With the popularization of smart home and artistic living concepts, art TVs, as home art pieces, are increasingly favored by consumers. Figure 4 is a scene diagram of an art TV and its surrounding environment provided in some embodiments of this application. As shown in Figure 4, art TVs, as a category of smart TV products, can be described as works of art integrated into the home. In the environment in which the TV is located, it is no longer just a cold screen, but exists as a work of art.

[0061] To better showcase their artistic qualities, art TVs undergo special customization in terms of structure, materials, and displayed content. For example, art TVs tend towards narrow bezels and full-screen designs, aiming to present a borderless effect to the user. Even if the bezel cannot be completely hidden, various bezel color options are offered for users to choose from. In terms of content, art paintings are displayed, giving users an effect similar to a home mural when viewing the TV.

[0062] To ensure that the user interface on an art TV matches its environment, most current settings and adjustments rely on providing picture quality parameters, and depend heavily on manual user adjustments. For example, users manually adjust screen brightness, contrast, and other effects through a parameter adjustment interface to make the user interface style as consistent as possible with the surrounding environment.

[0063] However, the above methods have the following problems. First, the television picture quality does not match the surrounding environment. The environment in which the display device is located changes dynamically with factors such as time, light, and temperature. Although existing technologies can adjust picture quality parameters such as brightness and contrast, this adjustment is relatively coarse and cannot keep up with real-time changes in the environment, resulting in a lack of harmony between the television picture and its surroundings. Second, the content displayed on the art television does not match the style of the environment. For example, in a clean and bright environment, if an art television displays dark content, it will create a strong contrast and conflict with the overall environment, disrupting the harmony of the surroundings. Therefore, currently, there is a problem of jarring interaction between art televisions and their surroundings, and the style of the user interface is incompatible with the environment.

[0064] To address the issues of jarring integration between the art television and its surrounding environment, and the mismatch between the user interface style and the environment, some embodiments of this application provide a display device 200, comprising a display 260 and a controller 250. The display 260 is configured to display the user interface, and the controller 250, by running an application, enables the display device 200 to execute the user interface display method. Based on the original image quality, the display device 200 identifies the environment in which it is located and adjusts the image quality parameters of the user interface accordingly, ensuring that the content presented in the user interface is adapted to the environment. Simultaneously, by adjusting the pixel values ​​at the screen edges, the screen edges are also adapted to the environment, thereby achieving a seamless integration between the art television and its surroundings, resolving the issues of jarring integration and the mismatch between the user interface style and the environment. In other words, this application identifies the external environment, extracts key environmental parameters, and combines this with AI large-scale model technology to analyze the most suitable parameters for the current display environment, dynamically adjusting the display effect of the art television to achieve a seamless integration with its surroundings.

[0065] To facilitate understanding of the technical solutions in some embodiments of this application, the steps are described in detail below with reference to some specific embodiments and accompanying drawings. Figure 5 is a schematic flowchart of a display device performing a user interface display method according to some embodiments of this application. As shown in Figure 5, in some embodiments, when the display device 200 performs the user interface display method, it may include the following steps: Step S1: The display device 200 acquires the original environmental data of the environment in which the display device is located; the original environmental data includes environmental data collected by sensor devices and / or environmental data captured by cameras.

[0066] In some embodiments, the display device (such as an art TV) can collect data about its surroundings in real time through built-in or external sensors, including but not limited to information such as light intensity, color temperature, contrast ratio, and spatial layout. Simultaneously, the display device can also periodically capture environmental photos using a built-in camera to obtain more intuitive and richer visual information about the environment.

[0067] In practical applications, to seamlessly integrate an art TV with its surroundings, it's essential to identify the environment. Currently, environmental factors, i.e., raw environmental data, can be identified through three methods (sensor recognition, camera recognition, and custom recognition), which will be described below.

[0068] In some embodiments, the display device may have a built-in sensor device. When acquiring raw environmental data of the environment in which the display device is located through sensor identification, it can be achieved in the following way: collecting raw environmental data through the sensor device; wherein, the sensor device includes at least one of an ambient light sensor for sensing ambient light intensity, a color temperature sensor for sensing ambient light color temperature, a time-of-flight sensor for sensing spatial distance, and a millimeter-wave radar for sensing spatial layout.

[0069] For example, if the TV has a built-in ambient light sensor, it can acquire environmental parameters such as light intensity, color temperature, and the main color tone and texture features of the wall / background. For instance, a set of low-power, non-camera miniature sensors can be used to sense environmental parameters. Table 1 is a statistical table of some sensor types and related measurement parameters shown in some embodiments of this application. Table 1 shows the optical environmental parameters and spatial environmental parameters that different types of sensor devices can sense, as well as their impact on display effects. It is understood that different sensor devices can acquire different environmental parameters. For example, an ambient light sensor is used to sense ambient light intensity. By acquiring ambient light intensity data, the TV can automatically adjust the screen brightness according to the intensity of ambient light, ensuring a comfortable viewing experience under different lighting conditions. A color temperature sensor is used to sense the ambient light color temperature. The color temperature sensor can measure the color temperature of ambient light, enabling the TV to adjust the screen's white balance to ensure that the picture color matches the ambient light color temperature. A time-of-flight sensor is used to sense spatial distance, calculating the distance to a target object by measuring the time difference between signal transmission and reception. In art-themed TVs, time-of-flight sensors precisely measure the distance from the TV to the viewer, automatically adjusting UI and text size, and optimizing pixel sharpening algorithms to ensure clear images and a comfortable viewing experience even at long distances. Millimeter-wave radar is used to perceive spatial layout; in art-themed TVs, it can sense room size, furniture outlines, and people's positions, automatically adjusting the TV's display mode and content recommendations based on the spatial arrangement. Thus, by collecting raw environmental data through sensor devices, art-themed TVs can achieve intelligent control, automatically adapting to different environments without manual user adjustments.

[0070] Table 1: Statistical Table of Some Sensor Types and Related Measurement Parameters

[0071] In some embodiments, the display device is equipped with a camera. In this case, raw environmental data of the surrounding environment can be acquired in the following manner: The display device 200 presets a shooting time interval for the camera to capture images of the surrounding environment. When the shooting time interval is reached, the camera is triggered to capture images of the surrounding environment to obtain captured images, which are then used as raw environmental data.

[0072] For example, if a television has a built-in camera, it can periodically take photos of its surroundings with the user's consent, providing the image data to relevant services for analysis. Environmental parameters are obtained by parsing the image data. For instance, image recognition technology can be used to extract information such as the dominant color tone, wall texture features, and the style of the environment. Extracting the dominant color tone helps the display device select colors that harmonize with the surrounding environment, while recognizing wall texture features and the style of the environment allows the display device to better integrate into home décor, enhancing overall aesthetics. In this way, by pre-setting shooting intervals and automatically triggering shooting, the display device can continuously and periodically acquire information about changes in its environment, providing a data foundation for automatically adjusting its display effects to adapt to different environmental scenarios.

[0073] In some embodiments, the original environmental data of the environment in which the display device is located can also be obtained in the following ways: The display device 200 receives an environmental photo uploaded by the user through a first page, parses the environmental photo, and obtains the original environmental data; or, it receives the original environmental data input by the user through a second page.

[0074] For example, Figure 6 is a schematic diagram of the use scenario of the first page provided in some embodiments of this application, and Figure 7 is a schematic diagram of the use scenario of the second page provided in some embodiments of this application. Combining Figures 6 and 7, users can obtain raw environmental data by uploading photos of their surroundings through the TV's built-in page or by scanning a QR code. The first page can refer to a specific page or function entry in the art TV interface, through which users can upload photos of their surroundings. The uploaded photos can then be passed to the image analysis module in the AI ​​large model service. This module can use image recognition algorithms (such as GLM-4V, Claude 3, GPT-4V, etc.) to analyze the photos and extract relevant parameters of the surrounding environment, such as spatial layout, design style, color matching, brightness, etc. After analysis, a set of raw environmental data reflecting the characteristics of the current environment is obtained. The second page can be another specific page or function entry in the art TV interface, allowing users to directly input known environmental parameters. After input, the TV records the environmental parameters input by the user as a basis for subsequent adjustments to the art TV display effect. In this way, the TV provides two different interaction methods to meet the needs and preferences of different users. By allowing users to upload photos or directly input parameters, the system can still acquire environmental parameters even without sensor or camera support, improving the flexibility and adaptability of data acquisition. After step S1 is completed, step S2 can be executed.

[0075] Step S2: The display device 200 parses environmental parameters from the original environmental data, and the environmental parameters are used to characterize the environmental features of the environment.

[0076] In some embodiments, the process by which the display device 200 parses environmental parameters from raw environmental data can be as follows: First, raw environmental data, including information such as light intensity, color temperature, and spatial layout, is collected through sensor devices (such as ambient light sensors, color temperature sensors, etc.) or cameras. If the data comes from sensors, the display device acquires and performs preliminary verification in real time, eliminating null values ​​and values ​​with excessive fluctuation ranges. If the data comes from a camera, environmental photos are taken periodically, and the images are analyzed using AI large model algorithms, machine vision algorithms, etc., to extract parameters such as the main color tone and texture features of the environment. During the analysis process, when both sensor and camera data are available, data consistency is ensured through verification and comparison, and the optimal parameters are selected. Finally, a set of environmental parameters is output to characterize the environmental features of the environment, providing a basis for subsequent image quality parameter adjustments. After step S2 is completed, step S3 can be executed.

[0077] Step S3: Obtain valid environmental parameters from the environmental parameters.

[0078] In some embodiments, the display device 200 can further filter and verify the parsed environmental parameters to exclude invalid or erroneous data and obtain valid environmental parameters. Specifically, methods such as data smoothing and outlier detection and removal can be used to ensure the accuracy and stability of the valid environmental parameters.

[0079] As described above, the raw environmental data can originate from sensor devices or from the television's built-in camera. When the television has both sensor devices and a camera, the raw environmental data can be a combination of both. Therefore, obtaining valid environmental parameters from the raw environmental data can be categorized into three cases: data originating solely from sensor devices, data originating solely from images captured by the camera, and data originating from both sensor devices and a camera. These will be discussed in detail below.

[0080] In some embodiments, when the raw environmental data originates solely from a sensor device, the acquisition of valid environmental parameters can be achieved as follows: The display device 200 acquires the raw environmental data collected by the sensor device; outliers in the raw environmental data are deleted to obtain valid environmental parameters; outliers include null values ​​and values ​​where the fluctuation range of the raw environmental data exceeds a preset range.

[0081] For example, null values ​​can refer to invalid or null values ​​returned by the sensor when it fails to collect valid data. These values ​​cannot reflect the true environmental parameters. Values ​​where the fluctuation range of the raw environmental data exceeds a preset range refer to situations where the data collected by the sensor may fluctuate significantly within a short period due to external interference or equipment malfunction. When the fluctuation range exceeds the system's preset reasonable range, these data are considered outliers. After receiving the raw environmental data collected by the sensor, the display device 200 first verifies this data, identifying and deleting null values ​​and values ​​with excessive fluctuation ranges. After deleting outliers, the remaining valid data is used as valid environmental parameters. In this way, deleting outliers effectively avoids interference from invalid or erroneous data in subsequent processing and analysis, thereby improving the overall data quality and reliability.

[0082] In some embodiments, when the original environmental data comes only from images captured by a camera, the process of obtaining valid environmental parameters can be implemented as follows: The display device 200 deletes blank images, images with identical pixel values, or images with image quality parameters lower than a preset threshold from the captured images; the deleted captured images are analyzed using a preset image recognition algorithm to obtain environmental parameters; the preset image recognition algorithm includes AI large model algorithm, machine vision algorithm, Transformer-based multimodal large model algorithm, and residual network algorithm; the environmental parameters include the dominant environmental color; outliers in the environmental parameters are identified; outliers include values ​​where the brightness of the dominant environmental color is lower than a first brightness threshold or higher than a second brightness threshold, and values ​​where the saturation of the dominant environmental color is higher than a preset saturation threshold; wherein, the first brightness threshold is lower than the second brightness threshold; outliers in the environmental parameters are deleted to obtain valid environmental parameters.

[0083] For example, when the display device 200 has a built-in camera, it can periodically take photos of the surrounding environment after user authorization. The system will delete blank images, images with identical pixel values, or images with quality below a preset threshold to ensure data quality. Subsequently, the processed images are analyzed using preset image recognition algorithms (including AI large model algorithms, machine vision algorithms, Transformer-based multimodal large model algorithms, and residual network algorithms) to extract environmental parameters, especially the dominant color tone of the environment. Next, the system will identify and delete outliers in the environmental parameters, such as values ​​with brightness below a first brightness threshold or exceeding a second brightness threshold, and values ​​with saturation above a preset saturation threshold. Finally, a set of valid environmental parameters is obtained. Among them, AI large model algorithms (such as GLM-4V and Claude 3) are general-purpose models based on deep learning, which can handle image semantic understanding in complex scenes and extract advanced environmental information such as spatial layout and style features. Machine vision algorithms include traditional algorithms such as edge detection and region segmentation, used to identify basic elements such as walls and furniture. Transformer-based multimodal large model algorithms can combine image and text information (such as home description text) to improve the ability to analyze mixed-modal data. The ResNet algorithm optimizes deep network training through residual connections, accurately extracting low-level features such as texture and color from images. Through multi-algorithm collaboration, the system can comprehensively acquire parameters such as brightness, color temperature, style, and material of the surrounding environment.

[0084] For example, image processing algorithms can perform the following steps: background segmentation, which uses lightweight computer vision models (such as semantic segmentation models based on MobileNet) or large models to segment the background area of ​​the TV image (such as walls, bookshelves, wall decorations), ignoring foreground objects such as furniture and people; dominant color extraction, which applies clustering algorithms (such as K-Means) to extract 3-5 dominant colors and their proportions from the segmented background area, outputting HEX or RGB values; and texture and material analysis, which uses image feature extraction algorithms (such as Local Binary Pattern (LBP) and Gray-Level Co-occurrence Matrix (GLCM)) to analyze the texture features of the background (smoothness, roughness, pattern, etc.). After performing the above processing, the parsed data can be verified. In this way, by removing low-quality images and outliers, the accuracy and reliability of environmental parameters can be significantly improved, helping display devices to more accurately perceive and adapt to their environment, thereby optimizing image quality parameters and allowing art TVs to better integrate into their surroundings.

[0085] In some embodiments, when the original environmental data originates from a combination of both, i.e., when the display device is equipped with both a camera and a sensor device, the acquisition process of the effective environmental parameters can be implemented as follows: The display device 200 collects the original environmental parameters through the sensor device; the sensor device includes at least one of an ambient light sensor for sensing ambient light intensity, a color temperature sensor for sensing ambient light color temperature, a time-of-flight sensor for sensing spatial distance, and a millimeter-wave radar for sensing spatial layout; outliers in the original environmental data collected by the sensor device are deleted to obtain the first environmental parameter; outliers include null values ​​and values ​​where the fluctuation range of the original environmental data exceeds a preset amplitude; a shooting time interval for the camera to capture the environment is preset, and when the shooting time interval is reached, the camera is triggered to capture the environment to obtain a captured image, which is used as the original environmental parameter. The process involves: 1. Deleting blank images, images with identical pixel values, or images with quality parameters below a preset threshold from the captured images; 2. Parsing the deleted images to obtain second environmental parameters; 3. Deleting outliers from the second environmental parameters; 4. Deleting values ​​where the brightness of the main environmental tone is below a first brightness threshold or above a second brightness threshold, and 5. Deleting values ​​where the saturation of the main environmental tone is above a preset saturation threshold; 6. Merging the first environmental parameters and the second environmental parameters after removing outliers to obtain third environmental parameters; 7. Deleting duplicate data from the third environmental parameters to obtain valid environmental parameters.

[0086] For example, the display device 200 collects raw environmental data through sensor devices and removes outliers (such as null values ​​and values ​​with excessive fluctuations) to obtain the first environmental parameter. Simultaneously, it presets a camera shooting time interval to periodically capture environmental images, removes low-quality images, and analyzes them to obtain the second environmental parameter (including the dominant color tone of the environment), removing outliers in brightness and saturation. Finally, it merges the first and second environmental parameters, removes duplicate data, and obtains the effective environmental parameter. During processing, the correlation and influence between various parameters are considered to ensure that the final effective environmental parameter comprehensively and accurately reflects the actual characteristics of the environment. In this way, sensors provide real-time, quantified physical parameters, and image recognition supplements semantic information such as style and layout. The combination of these two methods avoids the limitations of a single data source and improves the comprehensiveness and accuracy of environmental perception. Furthermore, through dual verification of both sensor and image data (such as removing outliers and duplicate data), data noise (such as sensor false alarms and image recognition errors) can be eliminated, ensuring parameter reliability. For example, by verifying and filtering multi-source data, outliers and noisy data can be eliminated, improving the accuracy and reliability of the data.

[0087] In some embodiments, the display device 200 may include a picture quality adjustment module, which can transmit environmental parameter data to the module. This module automatically adjusts the picture quality parameters of the user interface, including color temperature, brightness, contrast, and saturation, based on the characteristics of the environmental parameters (such as light intensity, color temperature, and dominant environmental color tone). For example, in environments with high light intensity, brightness and contrast are appropriately reduced to avoid overexposure; in environments with low color temperature (i.e., warmer tones), the display color temperature is adjusted to match the environment. Simultaneously, the color and texture effects of the displayed content are adjusted according to the dominant environmental color tone and wall texture characteristics to ensure harmony and consistency with the environment. Thus, by automatically adjusting picture quality parameters based on environmental parameters, the art television can adapt to different environments in real time, ensuring optimal visual effects in various conditions. By blending with its surroundings, the art television can better showcase its artistic expression and enhance the overall aesthetic appeal of the environment. After step S3 is completed, step S4 can be executed.

[0088] Step S4: The display device 200 adjusts the image quality parameters corresponding to the user interface based on the effective environmental parameters.

[0089] The display device 200 can dynamically adjust the image quality parameters of the art TV user interface, such as color temperature, brightness, and saturation, based on the acquired effective environmental parameters, so that the display effect of the art TV blends with the surrounding environment. Simultaneously, it recommends content adapted to the environment's style, further enhancing the consistency between the art TV and its surroundings.

[0090] In some embodiments, the display device 200 may include a display control module, and the image quality adjustment module can transmit the adjusted image quality parameters to the display control module. In this module, based on the received image quality parameters, the display effect of the monitor is adjusted in real time, including adjustments to parameters such as color temperature, brightness, contrast, and saturation, as well as switching and adapting the displayed content. Finally, the monitor displays the user interface according to the adjusted image quality parameters, ensuring perfect integration with the surrounding environment and optimal visual effects. In this way, by adjusting the monitor's image quality parameters in real time, it is possible to ensure that the user interface presents the best visual effect in various environments. Users can enjoy a visually seamless experience without manually adjusting image quality parameters, improving ease of use and comfort, and resolving issues such as the jarring effect between art televisions and their surroundings, and the incompatibility of the user interface style with the environment.

[0091] To further enhance the overall adaptability of the art TV to its environment, in some embodiments, the screen edges can be adaptively adjusted to further integrate the art TV with its surroundings.

[0092] In some embodiments, after adjusting the image quality parameters corresponding to the user interface based on valid environmental parameters, the following process can also be performed: Parse the environmental parameters to obtain the dominant color tone of the current environment; adjust the display parameters of the preset edge of the display border based on the dominant color tone.

[0093] For example, by parsing environmental parameters, key style features can be extracted from multi-dimensional parameters, including the dominant color of the environment. For instance, image recognition algorithms (such as color clustering analysis) can be used to count the most prevalent color in the environment (e.g., the dominant color of walls and furniture is off-white or light wood). Auxiliary style tags can also be included, such as semantic tags (e.g., "modern minimalist," "Nordic style," "industrial style") generated by combining style recognition algorithms (e.g., a Transformer-based multimodal model). The output of the environmental style parameters can then be structured environmental style parameters (e.g., {dominant color: "off-white", style tag: "modern minimalist"}). When obtaining the pixel values ​​of preset screen edges, such as the border areas on the top, bottom, left, and right sides, the width can be set to 5%-10% of the screen's width and height. The RGB values ​​of the edge pixels are read in real-time through the screen driver interface (e.g., the top edge pixel value is [R=240, G=230, B=220]), providing a baseline value for subsequent pixel adjustments and ensuring a natural transition between the adjusted edge color and the dominant color of the environment. Next, the pixel values ​​at the screen edges are shifted towards the dominant color of the environment (e.g., if the dominant color of the environment is off-white [R=245, G=240, B=220], the edge pixel values ​​are adjusted from [240,230,220] to [243,238,225], reducing color contrast). An adjustment strategy is then selected based on the style tag (e.g., Nordic style prefers low saturation, so the saturation of edge pixels is reduced; industrial style prefers cool tones, so the blue component is increased). Specifically, linear interpolation algorithms can be used to proportionally mix the original pixel values ​​with the dominant color of the environment. Alternatively, RGB values ​​can be converted to HSV / HSL space, and the hue and saturation adjusted before being converted back to RGB, further blending the screen edges with the environment. In this way, the display device analyzes the blended original environmental data to further extract the style characteristics of the environment and dynamically adjusts the screen edge pixels based on these characteristics, achieving a deep adaptation of the display effect to the surrounding environment. By matching the main color tone, color clashes between the screen edges and the surrounding environment can be eliminated, creating a unified visual atmosphere. When the environment changes (such as changing the color of curtains or adjusting the color temperature of lights), the system can re-analyze environmental parameters and update edge pixel values ​​to maintain continuous adaptation and achieve deep integration between the art TV and its surroundings.

[0094] In some embodiments, adjusting the display parameters of a preset edge of the display bezel according to the dominant ambient color can be achieved as follows: When the brightness value of the dominant ambient color is lower than a first preset threshold, the pixel value of the preset edge of the bezel is reduced; when the brightness value of the dominant ambient color is higher than a second preset threshold, the pixel value of the preset edge of the bezel is increased; wherein the first preset threshold is less than the second preset threshold.

[0095] For example, the first preset threshold can be a low brightness threshold, representing the critical value for relatively dark ambient light. When the brightness value of the dominant ambient color is lower than the first threshold, it indicates that the ambient light is relatively dark (such as at night or in a dark wall scene). In this case, the pixel values ​​at the screen edges can be reduced (e.g., by proportionally reducing the RGB values ​​or directly reducing the luminance component) to prevent the screen edges from being too bright in dark environments and reduce the halo effect. The second preset threshold can be a high brightness threshold, representing the critical value for relatively bright ambient light. When the brightness value of the dominant ambient color is higher than the second threshold, it indicates that the ambient light is sufficient (such as during the day or in a bright wall scene). In this case, the pixel values ​​at the screen edges can be increased (e.g., by proportionally increasing the RGB values ​​or directly increasing the luminance component) to enhance the visibility of the screen edges in bright environments and prevent the edge content from becoming blurred or submerged due to excessive ambient light. For example, the pixels in the edge area of ​​the TV screen can be used to adjust the edge display effect of the art TV by adding masking, shadow effects, or locally modifying the image quality. In this way, in dark environments (such as at night), excessive brightness at the screen edges will form a halo, causing visual fatigue or interfering with the displayed content. By reducing edge pixel values, the halo effect is reduced, allowing the screen edges to blend naturally into the dark environment. In bright environments (such as direct sunlight during the day), excessively dark screen edges can cause content to become blurry or be obscured by ambient light. By increasing edge pixel values ​​and enhancing edge contrast, the displayed content can be ensured to remain clearly visible under strong light, achieving intelligent coordination with ambient lighting and improving the user experience.

[0096] To facilitate a further understanding of the technical solution of this application, the entire process of implementing the technical solution of this application will be described in detail below with reference to the accompanying drawings.

[0097] Figure 8 is a schematic diagram of the overall architecture of the display device for implementing the user interface provided in some embodiments of this application. As shown in Figure 8, to achieve the above functions, the architecture can be divided into two parts: one is a local fusion service used to acquire environmental data and other parameters, and the other part relies on an AI large model (which can be deployed on the display device or on the server) for data analysis and processing. The fusion service is used to receive raw environmental data and apply the results fed back from the large model to the art television. The AI ​​module is used to analyze and process the data transmitted by various services, such as parsing image content, analyzing sensor data, performing verification, etc., and finally outputting a set of effective environmental parameter configurations. The main modules or services are described in detail below.

[0098] The sensor service is responsible for processing the raw environmental data from the sensors and mainly performs the following tasks: powering on and running, acquiring raw environmental data transmitted from the sensor devices in real time, performing preliminary verification processing on the raw environmental data to eliminate values ​​with large deviations; transmitting the data to the core controller, which then transmits it to the AI ​​big model, and finally the AI ​​big model performs in-depth processing and analysis on the data.

[0099] The camera service is responsible for processing camera data, primarily performing the following tasks: The service starts when the camera is turned on and stops when it is turned off. While the service is running, it takes a picture at regular intervals (the specific interval can be set via menu or settings, such as 5s -> 10s -> 20s, etc.). It's important to note that even while the service is running, users can stop it through menu settings, etc. The service also verifies the validity of the raw environmental data, such as whether the image was successfully captured and whether it contains content. Valid data is then passed to the AI ​​model for processing via the core controller.

[0100] Customization services are used for customized settings. As previously mentioned, if users need to set up customized services themselves, they can open the page through the menu options and configure them by scanning a QR code or registering. This part of the data is passed to the AI ​​large model for processing through the core controller.

[0101] Figure 9 is a functional structure diagram of the core controller provided in some embodiments of this application. As shown in Figure 9, the core controller is the core module, which mainly performs the following tasks: transmitting data from various services to the AI ​​big model and receiving the results fed back by the AI ​​big model; adjusting the picture quality mode based on the results and recommending content for the art TV display; and deciding whether to adjust the display effect at the screen edges based on the environment and the returned picture quality parameters.

[0102] Figure 10 is a schematic diagram of the adjustment scenario of the image controller provided in some embodiments of this application. As shown in Figure 10, the image controller is mainly responsible for adjusting the current image quality display effect according to the returned image quality parameters, such as setting bright mode, cinema mode, motion mode, gallery mode, enhancement mode, etc.

[0103] The content controller is mainly used to recommend appropriate content to be displayed in the current environment. Its main functions are as follows: receiving the returned raw environment data, classifying it according to the returned raw environment data, determining which type of effect should be displayed, such as bright and clear, romantic, dark, etc., and switching the displayed content according to the determined category (whether content adaptive switching is supported can be controlled through the menu).

[0104] The adaptive controller is used for screen edge adaptation and mainly performs the following tasks: receiving the results returned by the large AI model and determining whether screen adaptation is needed; if the screen edge differs too much from the environment, the screen edge is adapted by adding shadow effects or brightness effects.

[0105] Continuing with Figure 8, the AI ​​module in artificial intelligence processes the input raw environmental data through a large model and outputs a set of valid data. The sensor analysis module analyzes sensor data, such as calibrating sensor biases to ensure data accuracy. For example, in environmental monitoring, outliers need to be removed to improve the reliability of the analysis. The image analysis module performs image recognition and analysis. Using hybrid algorithms, different models (such as Gemini 1.5, Claude 3, etc.) are used to parse images and obtain image information. By filtering the image information, irrelevant factors, such as people and animals in the environment, are eliminated, and factors strongly related to the environment are obtained and output. These factors, as described previously, can include the overall layout, design style, decoration style, lighting conditions, etc.

[0106] For the data fusion processing module, when sensor data, image data, and custom data are available, the optimal data is selected based on a specific algorithm and priority. As described above, sensor data is the most direct data, image data is data that has been filtered through identification, and custom data is the data the user wants; there is overlap between these data types. Therefore, determining which type of data will be used requires optimization. First, custom data has the highest priority. When custom data is input, it means the user wants to use it, so settings and content recommendations need to be made based on this data. When both sensor data and image data exist, the original environmental data that overlaps needs to be verified. For example, if the room brightness can be identified in the image, and the light sensor can also detect it, their consistency needs to be checked first. For example, if the brightness of the current photo is too bright, and the sensor also indicates a bright image, then they are consistent, and the sensor data takes precedence. If they are inconsistent, multiple verifications of the image data and sensor data are required. For example, if the data in the photo remains unchanged for a certain period, but the sensor data fluctuates significantly, it indicates sensor distortion, and the image brightness data needs to be used.

[0107] The optimized data module outputs a set of AI-optimized environmental parameters, recommended data, and adaptive parameters. Environmental parameters are direct data obtained from sensors and images. Recommended data is a set of content parameters adapted to the art TV display, compiled based on environmental data identification, such as displaying bright content or sci-fi content; this data primarily references the TV's environment. Adaptive parameters adjust the display effect at the screen edges and are derived from the overall environmental parameters. The environmental parameters are set by the image controller, the recommended data is adapted by the content controller, and the adaptive parameters are adapted by the adaptive controller.

[0108] As can be seen from the above technical solutions, the above embodiments provide a display device 200, which acquires the original environmental data of the environment in which the display device is located; the original environmental data includes environmental data collected by sensor devices and / or environmental data captured by cameras; environmental parameters are parsed from the original environmental data, and the environmental parameters are used to characterize the environmental features of the environment; valid environmental parameters are obtained from the environmental parameters; and the image quality parameters corresponding to the user interface are adjusted according to the valid environmental parameters. Based on the original image quality, the display device, by identifying the environment in which the display device is located, adjusts the image quality parameters of the user interface according to the environment, so that the content presented by the user interface is adapted to the environment. Simultaneously, by adjusting the pixel values ​​at the screen edges, the screen edges are also adapted to the environment, thereby achieving the effect of seamlessly integrating the art television with the environment in which the display device is located, solving the problems of abruptness between the art television and its environment, and the incompatibility between the user interface style and the environment.

[0109] Based on the display device 200 described above, some embodiments of this application also provide a method for displaying a user interface, which can be applied to the display device 200 in the above embodiments. In some embodiments, the method may include the following: acquiring raw environmental data of the environment in which the display device is located; the raw environmental data includes environmental data collected by sensor devices and / or environmental data captured by cameras; parsing environmental parameters from the raw environmental data, the environmental parameters being used to characterize the environmental features of the environment; acquiring effective environmental parameters from the environmental parameters; and adjusting the image quality parameters corresponding to the user interface based on the effective environmental parameters.

[0110] As can be seen from the above technical solutions, the above embodiments provide a method for displaying a user interface. Based on the original image quality, this method identifies the environment in which the display device is located and adjusts the image quality parameters of the user interface according to the environment, so that the content presented by the user interface is adapted to the environment. Simultaneously, by adjusting the pixel values ​​at the screen edges, the screen edges are also adapted to the environment, thereby achieving a seamless integration between the art television and the environment of the display device, solving the problems of abruptness between the art television and its surroundings, and the incompatibility of the user interface presentation style with the environment.

[0111] The same or similar parts among the various embodiments in this specification can be referred to mutually, and will not be repeated here.

[0112] Those skilled in the art will clearly understand that the techniques in the embodiments of the present invention can be implemented using software plus necessary general-purpose hardware platforms. Based on this understanding, the technical solutions in the embodiments of the present invention, or the parts that contribute to the prior art, can be embodied in the form of a software product. This computer software product can be stored in a storage medium, such as ROM / RAM, magnetic disk, optical disk, etc., and includes several instructions to cause a computer device (which may be a personal computer, server, or network device, etc.) to execute the methods of various embodiments or certain parts of the embodiments of the present invention.

[0113] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of this application, and are not intended to limit them. Although this application has been described in detail with reference to the foregoing embodiments, those skilled in the art should understand that modifications can still be made to the technical solutions described in the foregoing embodiments, or equivalent substitutions can be made to some or all of the technical features therein. Such modifications or substitutions do not cause the essence of the corresponding technical solutions to deviate from the scope of the technical solutions of the embodiments of this application.

[0114] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the above exemplary discussion is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the described embodiments and various different variations of embodiments suitable for specific use considerations.

Claims

1. A display device, characterized in that, include: The display is configured to show the user interface. The controller is configured to: acquire raw environmental data of the environment in which the display device is located; the raw environmental data includes environmental data collected by sensor devices and / or environmental data captured by cameras; parse environmental parameters from the raw environmental data, the environmental parameters being used to characterize the environmental features of the environment; acquire valid environmental parameters from the environmental parameters; and adjust the image quality parameters corresponding to the user interface based on the valid environmental parameters.

2. The display device according to claim 1, characterized in that, The display device has the built-in sensor device, and the controller acquires the raw environmental data of the environment in which the display device is located. Specifically, the controller is configured to collect the raw environmental data through the sensor device. The sensor device includes at least one of the following: an ambient light sensor for sensing ambient light intensity, a color temperature sensor for sensing ambient light color temperature, a time-of-flight sensor for sensing spatial distance, and a millimeter-wave radar for sensing spatial layout.

3. The display device according to claim 2, characterized in that, The controller obtains valid environmental parameters from the environmental parameters, specifically configured to: acquire the raw environmental data collected by the sensor device; delete outliers in the raw environmental data to obtain the valid environmental parameters; the outliers include null values ​​and values ​​where the fluctuation range of the raw environmental data exceeds a preset range.

4. The display device according to claim 1, characterized in that, The display device is equipped with the camera. The controller acquires the raw environmental data of the environment in which the display device is located. Specifically, it is configured to: pre-set a shooting time interval for the camera to capture images corresponding to the environment; when the shooting time interval is reached, trigger the camera to capture images of the environment to obtain the captured images, and use the captured images as the raw environmental data.

5. The display device according to claim 4, characterized in that, The controller obtains valid environmental parameters from the environmental parameters, specifically configured to: delete blank images or images with identical pixel values, or images with image quality parameters lower than a preset threshold, from the captured images; analyze the deleted captured images using a preset image recognition algorithm to obtain the environmental parameters; the preset image recognition algorithm includes AI large model algorithm, machine vision algorithm, Transformer-based multimodal large model algorithm, and residual network algorithm; the environmental parameters include the dominant environmental color tone; identify outliers in the environmental parameters; the outliers include values ​​where the brightness of the dominant environmental color tone is lower than a first brightness threshold or higher than a second brightness threshold, and values ​​where the saturation of the dominant environmental color tone is higher than a preset saturation threshold; wherein, the first brightness threshold is lower than the second brightness threshold; delete the outliers in the environmental parameters to obtain the valid environmental parameters.

6. The display device according to claim 1, characterized in that, The display device is equipped with the camera and the sensor device. The controller obtains valid environmental parameters from the environmental parameters, specifically configured to: collect the original environmental parameters through the sensor device; the sensor device includes at least one of an ambient light sensor for sensing ambient light intensity, a color temperature sensor for sensing ambient light color temperature, a time-of-flight sensor for sensing spatial distance, and a millimeter-wave radar for sensing spatial layout; delete outliers from the original environmental data collected by the sensor device to obtain a first environmental parameter; the outliers include null values ​​and values ​​where the fluctuation range of the original environmental data exceeds a preset range; preset the shooting time interval for the camera to capture the environment, and, when the shooting time interval is reached, trigger the camera to capture the environment. The system obtains captured images and uses these images as the original environmental data. It then deletes blank images, images with identical pixel values, or images with quality parameters below a preset threshold from the captured images. The deleted captured images are then analyzed to obtain second environmental parameters, including the dominant environmental color tone. Outliers in the second environmental parameters are removed; these outliers include values ​​where the brightness of the dominant environmental color tone is below a first brightness threshold or above a second brightness threshold, and values ​​where the saturation of the dominant environmental color tone is above a preset saturation threshold. The first brightness threshold is less than the second brightness threshold. The first environmental parameters and the second environmental parameters after removing outliers are merged to obtain third environmental parameters. Duplicate data in the third environmental parameters are then removed to obtain the valid environmental parameters.

7. The display device according to claim 1, characterized in that, The controller acquires raw environmental data of the environment in which the display device is located, specifically configured to: receive environmental photos uploaded by the user through a first page, parse the environmental photos, and obtain the raw environmental data; or, receive raw environmental data input by the user through a second page.

8. The display device according to claim 1, characterized in that, After the controller adjusts the image quality parameters corresponding to the user interface based on the valid environmental parameters, it is further configured to: parse the environmental parameters to obtain the main color tone of the current environment; and adjust the display parameters of the preset edge of the display frame based on the main color tone.

9. The display device according to claim 8, characterized in that, The controller adjusts the display parameters of the preset edge of the display frame according to the ambient color tone. Specifically, it is configured to: reduce the pixel value of the preset edge of the frame when the brightness value of the ambient color tone is lower than a first preset threshold; and increase the pixel value of the preset edge of the frame when the brightness value of the ambient color tone is higher than a second preset threshold. The first preset threshold is less than the second preset threshold.

10. A method for displaying a user interface, applied to the display device according to any one of claims 1-9, the display device comprising a display and a controller, characterized in that, The method includes: acquiring raw environmental data of the environment in which the display device is located; the raw environmental data includes environmental data collected by sensor devices and / or environmental data captured by cameras; parsing environmental parameters from the raw environmental data, the environmental parameters being used to characterize the environmental features of the environment; acquiring effective environmental parameters from the environmental parameters; and adjusting the image quality parameters corresponding to the user interface based on the effective environmental parameters.

Images