Display, display adjustment method and display adjustment system

Abstract

A display includes a light sensor for detecting ambient light; a ToF sensor for tracking a user; a data processing unit, coupled to the light sensor and the ToF sensor for receiving a raw data of the light sensor and the ToF sensor and performing data mining and data analysis on the raw data to obtain a current ambient light information and a first user status of the user; an AI processing unit, coupled to the data processing unit, for determining a current scenario according to a first display screen of the display and determining a display optimization configuration according to the current ambient light information, the first user status and the current scenario; and a display control unit, coupled to the AI processing unit, for dynamically adjusting a plurality of display parameters according to the display optimization configure.

Description

[Technical Field]

[0001] This invention refers to a display, a display adjustment method, and a display adjustment system, and more particularly to a display, a display adjustment method, and a display adjustment system that can dynamically and automatically adjust display parameters according to the current usage context, the current ambient light, and the user. [Previous Technology]

[0002] Traditional display screens cannot automatically and instantly adjust display settings to suit the user's state, requiring manual adjustment by the user to meet the current usage scenario. This not only involves time-consuming trial and error adjustments based on user experience, but also may increase eye or physical strain due to improper settings. Therefore, there is an urgent need for a method and device that can automatically adjust display settings according to different usage scenarios and user states to improve the user experience. [Summary of the Invention]

[0003] Therefore, the present invention provides a display, an automatic display adjustment method, and a display adjustment system, which can dynamically and automatically adjust display parameters according to the current usage context, the current ambient light, and the user, thereby optimizing the display effect and improving viewing comfort and immersion.

[0004] This invention discloses a display comprising a light sensor, a time-of-flight (TOF) sensor, an artificial intelligence (AI) processing unit, and a display control unit. The light sensor is used to sense ambient light, and the TOF sensor is used to track a user. The data processing unit is coupled to the light sensor and the TOF sensor, and is used to receive raw data from the light sensor and the TOF sensor, and to perform data exploration and data analysis on the raw data to obtain current ambient light information and a first dynamic of the user. The AI ​​processing unit is used to determine a current usage scenario based on a first display screen of the display, and to determine a display optimization configuration based on the current ambient light information, the first dynamic, and the current usage scenario. The display control unit is coupled to the AI ​​processing unit and is used to dynamically adjust a plurality of display parameters of the display according to the display optimization configuration.

[0005] This invention also discloses an automatic display adjustment method for a display. The automatic display adjustment method includes receiving raw data from a light sensor and a time-of-flight distance sensor, and performing data exploration and analysis on the raw data to obtain current ambient light information and a first dynamic of a user; determining a current usage scenario through an artificial intelligence processing unit based on a first display screen of the display; determining a display optimization configuration through the artificial intelligence processing unit based on the current ambient light information, the first dynamic, and the current usage scenario; and dynamically adjusting a plurality of display parameters of the display according to the display optimization configuration.

[0006] This embodiment of the invention further discloses a display adjustment system, comprising a host, a light sensor, a time-of-flight (TOF) sensor, and a display. The light sensor is coupled to the host and is used to sense ambient light. The TOF sensor is coupled to the host and is used to track a user. The display is coupled to the host, and the host adjusts a plurality of display parameters of the display according to the aforementioned automatic display adjustment method.

Implementation Method

[0007] Certain terms are used in the specification and subsequent claims to refer to specific elements. It will be understood by those skilled in the art that hardware manufacturers may use different names to refer to the same element. This specification and subsequent claims do not distinguish elements by differences in name, but by differences in function. The term "comprising" as used throughout this specification and subsequent claims is an open-ended term and should be interpreted as "comprising but not limited to". Furthermore, the term "coupled" here includes any direct and indirect electrical connection means. Therefore, if a first device is described as coupled to a second device, it means that the first device can be directly electrically connected to the second device, or indirectly electrically connected to the second device through other devices or connection means.

[0008] Please refer to Figure 1, which is a schematic diagram of a display 10 according to one embodiment of the present invention. The display 10 may be, but is not limited to, a flat or curved liquid crystal display (LCD) or an organic light-emitting diode (OLED) display, or a projector or other type of display device. The display 10 includes a light sensor 100, a time-of-flight (ToF) sensor 102, a data processing unit 104, an image processing unit 105, an artificial intelligence (AI) processing unit 106, a display element 107, and a display control unit 108. It should be noted that the display 10 only illustrates the necessary components required to implement the embodiments of the present invention, and those skilled in the art can make different modifications and adjustments accordingly, and are not limited thereto.

[0009] The light sensor 100 is coupled to the data processing unit 104 and may be an ambient light sensor, RGB sensor, spectral sensor, or CMOS image sensor that is built into or external to the display 10, and is not limited thereto. The light sensor 100 is used to sense the intensity and color temperature of ambient light and transmits the raw data of the sensing results of the light sensor 100 to the data processing unit 104 for processing.

[0010] The time-of-flight ranging sensor 102 is coupled to the data processing unit 104 and can be built into or externally connected to the display 10 for tracking a user of the display 10. Specifically, the time-of-flight ranging sensor 102 can acquire sensing results related to the area in front of the display 10, especially depth (distance) information, and transmit the raw data of the sensing results to the data processing unit 104 for processing.

[0011] The data processing unit 104 is coupled to the light sensor 100, the time-of-flight ranging sensor 102, and the artificial intelligence processing unit 106. It receives raw data measured by the light sensor 100 and the time-of-flight ranging sensor 102, and performs data exploration and analysis on the raw data. The data processing unit 104 processes the raw data from the light sensor 100 and the time-of-flight ranging sensor 102 into ambient light information and user dynamics, and then transmits it to the artificial intelligence processing unit 106 for further analysis.

[0012] The image processing unit 105 is coupled to the artificial intelligence processing unit 106 and the display control unit 108. It receives and processes image signals from different sources such as network streaming, computer hosts, game consoles, and audio / video players, and converts them into processable image signals according to the display specifications of the display 10. Based on the resolution and display parameters of the display 10, the image processing unit 105 can scale, crop, and adjust the display position of the input image. In addition, based on the display parameters, the image processing unit 105 can also partially magnify the input image to generate a picture-in-picture (PIP), picture-by-picture (PBP), or other split-screen modes, and can simultaneously display the original image and the partially magnified image in the split-screen.

[0013] The display element 107 is coupled to the image processing unit 105 and the display control unit 108, and is used to receive the image signal processed by the image processing unit 105 and display the image according to the display parameters.

[0014] The artificial intelligence processing unit 106 is coupled to the data processing unit 104, the image processing unit 105, and the display control unit 108, and runs one or more artificial intelligence models to determine an optimized display configuration for the display 10. The artificial intelligence processing unit 106 may include a neural processing unit (NPU), a deep learning accelerator (DLA), or similar circuit or electronic components. Specifically, the optimized display configuration includes various related configurations for displaying the image in relation to the image processing unit 105 and the display element 107. The artificial intelligence processing unit 106 receives an image from the display 100 from the image processing unit 105 and receives ambient light information and user dynamics from the data processing unit 104. Based on this, the artificial intelligence model running in the artificial intelligence processing unit 106 makes adjustment decisions for the best display effect and transmits the determined optimized display configuration to the display control unit 108.

[0015] The display control unit 108 is coupled to the image processing unit 105, the artificial intelligence processing unit 106, and the display element 107, and is used to adjust a plurality of display parameters of the display 10 according to the display optimization configuration from the artificial intelligence processing unit 106. The display control unit 108 may be a typical timing controller or a timing controller that includes other control functions, or a controller or control element different from a timing controller, and may be implemented as an integrated circuit (IC), a programmable gate array (FPGA), an application-specific integrated circuit (ASIC), a general-purpose or special-purpose microprocessor, and / or similar circuits or electronic components. Specifically, the display element 107 can adjust the display of the image according to display parameters such as brightness, color temperature, contrast ratio, sharpness, refresh rate, overdrive (OD), and high dynamic range (HDR) of each area of ​​the image. The image processing unit 105 can adjust the content of the image according to display parameters such as the size and position of the display area of ​​each image content related to the image settings. The display control unit 108 adjusts the display elements 107 and the display parameters of the image processing unit 105 according to the display optimization configuration from the artificial intelligence processing unit 106, so as to achieve the best display effect.

[0016] In some embodiments, the display 10 further includes a backlight unit (not shown in Figure 1), and the display optimization configuration generated by the artificial intelligence processing unit 106 further includes adjusting parameters of the backlight unit, such as backlight zone and local dimming brightness, light source driving mode, backlight refresh rate, etc., and the display control unit 108 can control the backlight unit to provide brightness to the display element 107 accordingly. In some embodiments, the display 10 can be connected to other displays and the displayed image can be transmitted to the external display for display. In addition, the artificial intelligence processing unit 106 can generate a display optimization configuration corresponding to the external display, and the display 10 transmits the display optimization configuration to the external display and adjusts its display effect accordingly.

[0017] The display adjustment method of this invention can be summarized as an automatic display adjustment process 20, as shown in Figure 2. The automatic display adjustment process 20 includes the following steps:

[0018] Step 200: The display element 107 of the display 10 receives a display screen (first display screen) from the screen processing unit 105 and displays it. At the same time, the light sensor 100 and the time-of-flight range sensor 102 sense and generate raw data.

[0019] Step 202: The data processing unit 104 receives the raw data from the light sensor 100 and the time-of-flight ranging sensor 102, and performs data exploration and data analysis on the raw data to obtain current ambient light information and the first dynamic of a user.

[0020] Step 204: The artificial intelligence processing unit 106 receives the display screen from the screen processing unit 105 and analyzes the display screen to determine the current usage situation of the display 10.

[0021] Step 206: The artificial intelligence processing unit 106 determines a display optimization configuration based on the current ambient light information, the first dynamic and the current usage scenario.

[0022] Step 208: The display control unit 108 dynamically adjusts a plurality of display parameters of the display element 107 and the image processing unit 105 according to the display optimization configuration.

[0023] Step 210: The screen processing unit 105 generates a new display screen (second display screen) according to the display optimization configuration, and returns to step 200.

[0024] According to the automatic adjustment process 20, while displaying the screen, the monitor 10 continuously acquires raw data from the light sensor 100 and the time-of-flight distance sensor 102 (step 200), and performs data exploration and analysis on the raw data to obtain current ambient light information and the user's first dynamic (step 202). Next, the artificial intelligence processing unit 106 uses the artificial intelligence processing unit 106 to determine the current usage scenario of the screen (step 204), and determines the optimal display optimization configuration based on the current usage scenario, current ambient light information, and the first dynamic (step 206). Accordingly, the monitor 10 can dynamically adjust the display parameters of each component according to the display optimization configuration (step 208). Finally, the monitor 10 generates a new screen based on the adjusted plurality of display parameters (step 210), and returns to step 200. While displaying the new screen, the monitor 10 continues to detect current ambient light information and user dynamics to determine the usage scenario, and dynamically adjusts the monitor 10 accordingly to provide the best display effect for the user.

[0025] In detail, in step 200, the display element 107 of the display 10 receives and displays a display screen (first display screen) from the image processing unit 105. This display screen is generated by the image processing unit 105 receiving an image signal from the input signal source of the display 10 and according to a display configuration. The display configuration includes a plurality of display parameters. The display control unit 108 controls the display element 107 to display the display screen according to a portion of the plurality of display parameters. In some embodiments, the display control unit 108 also controls the backlight element to provide brightness to the display element 107 according to another portion of the plurality of display parameters. At the same time, the light sensor 100 and the time-of-flight distance sensor 102 continuously sense and generate raw data, including the light sensor 100 sensing the intensity and color temperature of ambient light, and the time-of-flight distance sensor 102 sensing the area in front of the display 10 and transmitting the raw data to the data processing unit 104 for processing. The light sensor 100 and the time-of-flight ranging sensor 102 can communicate with the data processing unit 104 through interfaces such as the Inter-Integrated Circuit (I2C Bus) and the Serial Peripheral Interface (SPI Bus) to transmit the measured raw data, but are not limited thereto.

[0026] In step 202, the data processing unit 104 receives raw data from the light sensor 100 and the time-of-flight ranging sensor 102, and performs data exploration and analysis on the raw data to obtain current ambient light information and the user's first dynamics. The raw data includes real-time data of the ambient light state measured by the light sensor 100 and real-time data of the depth information measured by the time-of-flight ranging sensor 102. First, based on the real-time data of the depth information measured by the time-of-flight ranging sensor 102, the data processing unit 104 can analyze and determine whether a user is present and the number of users, and further analyze and obtain information such as the user's position relative to the display 10, posture, viewing direction, and distance between the user and the display 10. Next, the data processing unit 104 can establish the user's current data based on the obtained number of users, user position, posture, viewing direction, and distance between the user and the display 10, and store it in one of the storage units of the data processing unit 104 for subsequent use. Simultaneously, the data processing unit 104 can read previously recorded data stored in the storage unit and analyze the differences between the current data and the previous data to further obtain the user's dynamics. The user's dynamics may include changes in the number of users, positional movement, posture changes, changes in viewing direction, and changes in the distance between the user and the display 10. The data processing unit 104 integrates the user's dynamics into a data array and then converts it into standardized data for the artificial intelligence model according to its computational requirements, thereby establishing the user's first dynamics. In one embodiment, the user's first dynamics may also include the user's current data. On the other hand, the data processing unit 104 can establish current data based on ambient light intensity, color temperature, and other data measured by the light sensor 100, and store the current data in the storage unit of the data processing unit 104. Simultaneously, the data processing unit 104 can read previously recorded data stored in the storage unit and further analyze the differences between the current ambient light data and the previously recorded data to obtain information on changes in ambient light, such as changes in ambient light brightness and color temperature. The data processing unit 104 can integrate the current ambient light data into a data array, and then convert it into standardized data for use by the artificial intelligence model according to the computational requirements of the artificial intelligence model, thereby establishing the current ambient light information. In one embodiment, the current ambient light information may also include ambient light change information. Finally, the data processing unit 104 transmits the user's first dynamic and the current ambient light information, which conform to the format requirements of the artificial intelligence model, to the artificial intelligence processing unit 106. In some embodiments, the data processing unit 104 integrates the aforementioned first dynamic and the corresponding sensing time of the data array of the current ambient light information array, and transmits it to the artificial intelligence processing unit 106 after converting it into a data format that the artificial intelligence model can compute.

[0027] It should be noted that in one embodiment, the time-of-flight distance sensor 102 has a high resolution, enabling it to obtain more precise depth information related to the user. Based on the precise depth information, the data processing unit 104 can analyze the user's face or facial contours and further determine the viewing direction. In one embodiment, the resolution of the time-of-flight distance sensor 102 is insufficient to analyze the user's face or facial contours. In this case, the data processing unit 104 can use the center of the display as the origin and the angle of the head relative to the display as the viewing direction. In another embodiment, the time-of-flight distance sensor 102 can have a built-in, clearer image capture module, or the display 10 can be externally connected to an image capture device to capture images of the area in front of the display 10 and provide real-time images as raw data input to the data processing unit 104. Based on the user image in the real-time image, the data processing unit 104 can more clearly identify the dynamics of the user's head and eyes, thereby determining the user's viewing direction. In this embodiment, the data processing unit 104 can further analyze the area of ​​the screen that the user's eyes are focused on, whether the user blinks frequently or has closed their eyes for a period of time, and input this as one of the user's first dynamics into the artificial intelligence processing unit 106.

[0028] In step 204, the artificial intelligence processing unit 106 receives the display screen from the screen processing unit 105 and determines the current usage scenario based on the display screen. Specifically, after receiving the display screen, the artificial intelligence processing unit 106 analyzes the image signal of the display screen to obtain screen content, and uses an artificial intelligence model to determine the current usage scenario of the display 10 based on the screen content. The current usage scenario can be one of several operating modes, such as: office mode, first-person shooter (FPS) mode, driving simulation mode, multiplayer online battle arena (MOBA) mode, movie viewing mode, power saving mode, and privacy mode, etc. The above operating mode names are only examples, but the present invention is not limited thereto. The artificial intelligence model can determine the most suitable display optimization configuration for the display 10 based on the current usage scenario and other received current data to provide the best display effect. It should be noted that the current usage scenario can be determined by the artificial intelligence processing unit 106 based on the first display screen of the display 10, or it can be manually set by the user. For example, power saving mode and privacy mode can be manually adjusted by the user through the operation interface provided by the display 10. Moreover, users can also manually adjust individual display settings at any time.

[0029] In some embodiments, the image signal of the displayed screen may simultaneously contain multiple screen contents. The artificial intelligence model can analyze the different screen contents and comprehensively determine the current usage scenario based on all the screen contents. In some embodiments, in addition to the image signal of the display 10, the artificial intelligence model can also simultaneously receive the image signal of an external display and analyze the current screen contents of each display to determine the current usage scenario. In some embodiments, the artificial intelligence model can also receive the current display optimization configuration of the display 10, including the current usage scenario and the display parameters of each component of the display 10. It can also directly read the display screen from each signal input terminal, such as receiving image signals from an HDMI input port, network video stream, USB connection terminal, or other video or image transmission interface, and then determine the current usage scenario based on all the received information.

[0030] In step 206, the artificial intelligence processing unit 106 determines the display optimization configuration based on the current ambient light information, the user's first dynamic, and the current usage scenario. Specifically, the artificial intelligence processing unit 106 calculates the optimal display optimization configuration based at least on the current ambient light information, the user's first dynamic, and the current usage scenario, and transmits the determined display optimization configuration to the display control unit 108. The current ambient light information and the user's first dynamic are converted by the data processing unit 104 into a format that the artificial intelligence processing unit 106 can process (step 202), and the current usage scenario is determined by the artificial intelligence processing unit 106 based on one or more screen contents in the current display screen (step 204). In some embodiments, the display optimization configuration includes settings for brightness, color temperature, contrast, sharpness, refresh rate, OD, HDR, etc., corresponding to the display screen, and also includes the definition of each display area in the display screen, such as which screen contents each display area corresponds to, the size of each display area, and the position of each display area.

[0031] For example, when the main content of the currently displayed screen is a game, the AI ​​processing unit 106 determines that the current usage scenario is an operation mode corresponding to the game type. Accordingly, the AI ​​processing unit 106 will adjust the display optimization configuration, including increasing the overall brightness of the display 10 to display game screen details, enabling the HDR function and increasing the brightness of the display element 107 and the backlight unit, enabling the OD function of the display element 107 and increasing the refresh rate of the display element 107 and the backlight unit to make the game screen smoother. In addition, it also includes optimization configuration corresponding to the game type. For example, when it is determined to be a first-person shooter game, the display screen is adjusted to a suitable size according to the user's distance so that the user's field of vision can fully see the entire game screen, and the screen contrast and outline sharpness are improved to display objects more clearly, or the area of ​​the screen being viewed is calculated based on the user's head distance and viewing direction, and that area is enhanced. When the AI ​​processing unit 106 determines that the current usage scenario is office mode, such as when the user is processing documents, editing images, writing code, or reading documents, it will adjust the display optimization configuration, including: adjusting the brightness of the display screen to a moderate level and the color temperature to a warmer level according to the ambient light. For example, it can moderately increase the brightness of the display element 107 while reducing the brightness of the backlight unit to reduce blue light, or set the contrast to medium and turn on the eye protection mode of the display element 107, etc. In some embodiments, the AI ​​processing unit 106 will record the user's viewing time on the display 10. When a certain time is exceeded, it will remind the user that they have been watching for a long time, or automatically adjust the display optimization configuration to avoid eye fatigue. In addition, in specific usage scenarios, the display optimization configuration may also include instructing a portion of the content of a screen to be displayed separately in another display area outside the original screen content using a picture-in-picture technique. For example, when the AI ​​processing unit 106 determines that the current usage scenario is MOBA mode, it can adjust the display optimization configuration to include capturing real-time image information of the minimap, and display a magnified real-time image of the minimap in other display areas next to the game screen area according to the user's viewing direction, allowing the user to view both the game screen and the minimap simultaneously. Similarly, when the AI ​​processing unit 106 determines that the usage scenario is racing game mode, it can display a magnified map next to the main game screen area. In some embodiments, the AI ​​processing unit 106 can adjust the display area of ​​each screen content according to the user's posture and position and angle relative to the display 10. Therefore, regardless of how the user adjusts their posture or position, the AI ​​processing unit 106 can adjust the display area of ​​the screen content in real time to correspond to the user's viewing angle.

[0032] In step 208, the display control unit 108 dynamically adjusts a plurality of display parameters of the display 10 according to the display optimization configuration determined by the artificial intelligence processing unit 106. Specifically, adjusting the plurality of display parameters of the display 10 includes controlling the brightness, color temperature, contrast ratio, sharpness, refresh rate, OD, HDR, etc. of the display element 107, and controlling the display area size and position of each screen content of the image processing unit 105, etc., and is not limited to these. Furthermore, in specific usage scenarios, the display control unit 108 further instructs the image processing unit 105, according to the display optimization configuration, to capture a portion of a screen content from the displayed screen, and simultaneously displays the original screen content and the portion of the screen content using a picture-in-picture technique according to the display optimization configuration.

[0033] In step 210, the screen processing unit 105 generates a new display screen (second display screen) according to the display optimization configuration and returns to step 200 to continuously adjust the most suitable display optimization configuration based on the newly acquired current ambient light information, the user's first dynamic, and the current usage scenario. In one embodiment, the adjusted display screen, display optimization configuration, and display settings parameters manually adjusted by the user are continuously sent to the artificial intelligence processing unit 106 as training data for machine learning or other artificial intelligence iterative learning techniques.

[0034] Accordingly, the display 10 can adjust the best display optimization configuration for the user at any time according to changes in ambient light, changes in user status and changes in usage context, so as to improve the user experience.

[0035] As mentioned above, when the automatic display adjustment process 20 is executed, the user can manually adjust the display settings at any time, and the artificial intelligence processing unit 106 can adjust the display optimization configuration of the display 10 accordingly. Specifically, after the display control unit 108 adjusts a plurality of display parameters of the display 10 according to the display optimization configuration, the display 10 will generate and display a new display screen based on the new display parameters. The artificial intelligence processing unit 106 can obtain the new display screen and the current display parameters from the screen processing unit 105. Simultaneously, the user can manually adjust the display settings, such as adjusting individual display setting parameters. When the data processing unit 104 receives the user's manually set display settings, it can transmit the user's manually set display settings to the artificial intelligence processing unit 106. In step 206, the artificial intelligence processing unit 106 can determine the display optimization configuration based on the user's manually set display settings, current ambient light information, the user's first dynamic state, and the current usage scenario. In one embodiment, the data processing unit 104 is coupled to the display control unit 108. When the data processing unit 104 receives the display settings manually set by the user, it can transmit the manually set display settings to the display control unit 108 to directly adjust the current display parameters.

[0036] In some embodiments, the artificial intelligence processing unit 106 can adjust the display optimization configuration of the display 10 based on a second dynamic of the user and the current display screen (second display screen). Specifically, the data processing unit 104 continuously obtains raw data sensed by the time-of-flight ranging sensor 102 and performs data analysis and processing to obtain the second dynamic of the user. The artificial intelligence processing unit 106 can determine whether the current display optimization configuration meets the user's needs based on the second dynamic, and fine-tune and correct the artificial intelligence model if it does not meet expectations to achieve self-learning of the artificial intelligence model. For example, the data processing unit 104 can analyze the raw data measured by the time-of-flight ranging sensor 102 to obtain the user's outline and distance, and further identify the user's posture and viewing direction. Accordingly, the artificial intelligence processing unit 106 can determine whether the user's posture and viewing direction have changed or whether other viewing states have been presented, in order to determine whether the current display configuration meets the user's needs. In addition, in some embodiments, the artificial intelligence processing unit 106 can also determine whether the current display configuration meets the user's needs based on whether the user has manually adjusted the display settings. For example, when the AI ​​processing unit 106 determines that the usage scenario of the display screen has not changed for a period of time, the user has maintained the current display settings for a period of time without manually adjusting them, and the user's posture and viewing direction have not changed significantly, the AI ​​processing unit 106 can determine that the current display configuration meets the user's needs and there is no need to change the usage scenario and display settings. In step 206, the display settings can be optimized to maintain the current display settings, or the display parameters can be finely adjusted only according to changes in ambient light, without changing the usage scenario and the display position of the screen area.

[0037] Please refer to Figure 3, which is a schematic diagram of how an artificial intelligence model adjusts the display optimization configuration based on user dynamics and the display screen of the display 10 according to an embodiment of the present invention. As shown in Figure 3, at time point T1, the display 10 displays a first display screen 321. At this time, the artificial intelligence processing unit 106 obtains the first display screen 321 through the screen processing unit 105, and determines a first display optimization configuration 311 for the display 10 based on a first user dynamic 301, current ambient light information (not shown), and the first display screen 321 obtained by the data processing unit 104 (not shown). The display control unit 108 then adjusts a plurality of display parameters of the display 10 according to the first display optimization configuration 311. Accordingly, a second display screen 322 adjusted according to the first display optimization configuration 311 is generated. At time point T2, the display 10 displays the second display screen 322. At this time, the AI ​​processing unit 106 obtains the second display screen 322 through the screen processing unit 105, and adjusts the first display optimization configuration 311 for the display 10 to a second display optimization configuration 312 based on the user's second dynamic 302, current ambient light information (not shown), and the second display screen 322 newly obtained by the data processing unit 104 (not shown). The display control unit 108 then readjusts a plurality of display parameters of the display 10 according to the second display optimization configuration 312. Accordingly, a third display screen 323 adjusted according to the second display optimization configuration 312 is generated. Similarly, at time point T3, the display 10 displays the third display screen 323 and simultaneously feeds it back to the AI ​​processing unit 106 to continuously and dynamically optimize the display optimization configuration.

[0038] For example, please refer to Figures 4A and 4B, which are schematic diagrams illustrating how, in one embodiment of the present invention, an artificial intelligence model adjusts the size of the display screen based on user dynamics and the display screen of the display 10. In some embodiments, the display 10 or the artificial intelligence processing unit 106 stores data on the user distance and optimal display range corresponding to the display 10. The display range can be adjusted to a preset optimal range based on the user distance sensed by the time-of-flight distance sensor 102. The larger the preset optimal display range is, the farther the user distance is. However, the present invention is not limited to this. Depending on different usage scenarios, the artificial intelligence processing unit 106 can make different adjustments to the display optimization configuration. For example, when the usage scenario of the display 10 is in FPS mode, as shown in Figure 4A, when a user 40 uses the display 10 at a position P1, the display 10 adjusts the first display screen in the image to a second display screen such as range 400 based on the user's position. Subsequently, when the time-of-flight distance sensor 102 of the display 10 detects that the user 40 is at position P2, the artificial intelligence processing unit 106, based on the increased user distance and unchanged usage scenario, determines that the user 40 is adjusting their distance because they cannot observe the complete range 400, thus increasing the distance to the display 10. Accordingly, the artificial intelligence processing unit 106 adjusts the display optimization configuration based on the new distance between the user and the display 10 and the second display screen, causing the display 10 to shrink the second display screen to a third display screen of range 401 as shown in Figure 4B. In this case, if the user 40 continues to move backward, the display 10 can continuously shrink the display screen range. If the user 40 moves forward and the usage scenario remains unchanged, the artificial intelligence processing unit 106 determines that the range 400 is too small, causing the user 40 to be unable to observe the details of the game screen, and the display 10 can accordingly enlarge the display screen range. If the user 40 maintains their position without moving forward or backward for a period of time, the display 10 can maintain the current display optimization configuration and record the current display range as the preset optimal display range corresponding to the current user distance in this usage scenario.

[0039] When the display 10 is used in other operating modes, the artificial intelligence processing unit 106 will adjust the display screen range to the preset optimal display range. The larger the user's distance, the larger the display screen range will be. When the range has been enlarged to the maximum value of the operating mode (e.g., full screen), the artificial intelligence processing unit 106 can continue to enlarge the display screen so that the edges of the screen content exceed the range and are not displayed, so as to display the center part of the enlarged screen content. In MOBA mode, the small map captured by the artificial intelligence processing unit 106 can also adjust the size of the range according to the distance; in movie viewing mode, if the user's distance exceeds a threshold distance, the artificial intelligence processing unit 106 will adjust the display screen range to the maximum range. If the user's distance is within the threshold distance, the display screen range will be adjusted to the preset optimal range according to the user's distance. It should be noted that the above description is merely an example illustrating that the range of the displayed screen can be adjusted in different ways under various usage scenarios. The present invention is not limited to this. Any of the aforementioned range adjustment methods can be used in place of the various usage scenarios. The artificial intelligence processing unit 106 can record the user's viewing distance, the range of the displayed screen, and the range adjustment method used in various usage scenarios, and iteratively train the artificial intelligence model. Accordingly, based on the user's dynamics, the display 10 can obtain an optimal display optimization configuration through the artificial intelligence model and dynamically adjust it accordingly.

[0040] In one embodiment, after the display control unit 108 dynamically adjusts a plurality of display parameters of the display 10 according to the display optimization configuration, the artificial intelligence processing unit 106 can adjust the current usage scenario based on the user's second dynamic obtained by the data processing unit 104. For example, when a user is playing a game or watching a game broadcast, the display screens in the two scenarios may be extremely similar. In this case, if the current usage scenario is judged solely based on the display screen, there is a possibility of misjudgment. Therefore, in this embodiment, the artificial intelligence model continuously judges the current usage scenario by considering the display screen and the user's dynamics, and judges whether the currently applied operation mode is correct. For example, if the artificial intelligence processing unit 106 judges that the current usage scenario of the display 10 is a game mode based on the display screen, and if the user's second dynamic shows that the distance between the user and the screen is far, the posture does not show the action of playing a game, or the user is in a relaxed posture such as tilting their head back, then the artificial intelligence processing unit 106 can correct the current usage scenario of the display 10 to a movie viewing mode, so as to adjust it to a display optimization configuration suitable for the user's viewing. Conversely, when the AI ​​processing unit 106 determines that the current usage scenario of the display 10 is a movie viewing mode based on the displayed screen, if the second dynamic display of the user in the original data shows that the distance between the user and the screen is too close, the hand is moving frequently, or the head is tilted forward, the AI ​​processing unit 106 can correct the current usage scenario of the display 10 to a game mode, so as to adjust it to a display optimization configuration suitable for operating games.

[0041] Therefore, the display 10 can determine whether to update the display optimization configuration of the display 10 based on the current ambient light information, the user's dynamics, and the current usage context through an artificial intelligence model, and dynamically optimize the display parameters of the display 10 according to the display optimization configuration. In addition, by continuously acquiring user dynamics, the artificial intelligence model can feed back the user dynamics to the artificial intelligence model, and adjust the current usage context and display optimization configuration of the display 10 according to the new user dynamics to optimize the display effect of the display 10, while iteratively training the artificial intelligence model.

[0042] In addition to adjusting the display optimization configuration based on the current ambient light information, user dynamics, and current usage scenario, this embodiment can further adjust the display optimization configuration based on the size and aspect ratio of the display screen. For example, when playing FPS games on a large screen (e.g., 32-inch, 40-inch, etc.), the user's field of vision usually cannot fully cover all the information in the game screen, causing the user to frequently turn their head to change their viewing angle. Therefore, in one embodiment of the present invention, the artificial intelligence processing unit 106 automatically adjusts the size of the display screen according to the user's distance in FPS mode, so that the generated display optimization configuration is suitable for the user to play FPS games. On the other hand, when using a widescreen display (e.g., a screen aspect ratio of 21:9 or 32:9, etc.), the artificial intelligence processing unit 106 can dynamically adjust the main screen to the display position corresponding to the user's viewing direction. Please refer to Figures 5A and 5B, which are schematic diagrams of adjusting the display screen position according to the angle of the user's viewing direction in an embodiment of the present invention. As shown in Figure 5A, when a user 50's viewing direction is at a relative angle A1 relative to the center of the display 10, the artificial intelligence processing unit adjusts the display image to a position, for example, range 500, within the display 10's screen based on the relative angle A1, allowing the user to view the image without turning their head. When the display 10 detects that the user 50's head has turned to the right to a relative angle A2, the artificial intelligence processing unit automatically adjusts the display image to a position, for example, range 501, within the display 10's screen based on the current relative angle A2. In one embodiment of the invention, the artificial intelligence processing unit can dynamically adjust the size and position of the display image on the screen in any operating mode, or only dynamically adjust the size and position of the display image on the screen in certain operating modes. In another embodiment of the invention, the user can manually adjust the size and position of the display image on the screen. The adjusted size and position, the current usage context of the display, the distance and relative angle between the user and the display 10 are all transmitted to the artificial intelligence processing unit 106 for iterative training of the artificial intelligence model.

[0043] In embodiments of the present invention, the usage scenarios of the display may include multiple operating modes. The artificial intelligence processing unit 106 determines the optimal display optimization configuration based on the current operating mode of the displayed screen, the current ambient light information, and the user's dynamics. As mentioned above, the artificial intelligence processing unit 106 needs to adjust the screen brightness of the display 10 according to the measured current ambient light information to adapt to the ambient light. In some embodiments, in addition to adjusting the display parameters related to screen brightness of the display element 107, such as brightness, contrast, gamma, or other setting parameters, the artificial intelligence processing unit 106 also adjusts the brightness of the backlight element. In embodiments of the present invention, the artificial intelligence processing unit 106 determines that the display 10 may have at least seven operating modes based on the displayed screen. For example, the operating modes may include office mode, FPS mode, driving simulation mode, MOBA mode, movie viewing mode, power saving mode, and privacy mode, but are not limited to these. The corresponding display optimization configurations have different adjustment strategies, which are detailed below.

[0044] The office mode includes general application scenarios such as users reading documents, editing documents, editing audio and video, and writing programs on the monitor 10 within a certain distance. When the artificial intelligence processing unit 106 determines that the current usage scenario is office mode based on the current display screen, the artificial intelligence processing unit 106 needs to determine the user's field of vision based on the distance between the user and the monitor 10 and the viewing direction, and adjust it to a display optimization configuration suitable for long-term viewing and reading. In office mode, the display optimization configuration generally includes a strategy of moderate brightness (avoiding excessive brightness or darkness), warm color temperature (2700K-3500K), and medium contrast. In some embodiments, the display optimization configuration also includes a strategy of improving sharpness and reducing blue light to improve text clarity and reduce user eye fatigue. In addition, the monitor 10 or the artificial intelligence processing unit 106 can record the usage time in office mode and provide the user with an eye overuse warning when the usage time exceeds a certain period of time. In one embodiment, the monitor 10 can provide an eye overuse warning through on-screen display (OSD) content, but is not limited to this.

[0045] FPS mode is an application scenario for shooting games where the user's perspective is primarily first-person. When the AI ​​processing unit 106 determines that the current usage scenario is FPS mode, the AI ​​processing unit 106 needs to determine the user's field of view based on the distance between the user and the display 10 and the viewing direction, and adjust it to an optimized display configuration that can clearly display the details of game objects. The optimized display configuration for FPS mode generally includes adjustment strategies such as increasing brightness, neutral color temperature (6500K), and enhancing contrast. In some embodiments, the optimized display configuration also includes adjustment strategies such as improving sharpness, increasing the screen refresh rate (e.g., greater than or equal to 120Hz), enabling the display's overdrive function and increasing the OD value, and enabling the high dynamic range function, in order to improve the response speed of the display element 107, reduce ghosting, and enhance screen brightness and refresh rate. As mentioned above, in one embodiment, the display 10 can record the user's usage time in FPS mode and provide an eye overuse warning when the usage time exceeds a certain period of time, and adjust the range of the displayed game screen to a suitable size and position to facilitate the user's complete observation of the game screen, but is not limited to this.

[0046] The simulated driving mode may include application scenarios where the user uses professional simulated driving software or plays racing games. When the artificial intelligence processing unit 106 determines that the current usage scenario is a simulated driving mode, the artificial intelligence processing unit 106 needs to determine the user's field of vision based on the distance between the user and the display 10 and the viewing direction, and adjust it to a display optimization configuration that can clearly display object details and the sense of speed. The display optimization configuration of the simulated driving mode generally includes adjustment strategies such as increasing brightness, neutral color temperature (6500K), enhancing contrast, and enabling high dynamic range function. In some embodiments, the display optimization configuration also includes adjustment strategies such as improving sharpness, increasing the screen refresh rate (e.g., greater than or equal to 120Hz), enabling the display's overdrive function, and increasing the OD value, in order to improve the response speed of the display element, reduce ghosting, and enhance the screen update speed. In some embodiments, the artificial intelligence processing unit 106 may adjust the display parameters of the display optimization configuration according to the graphics processor specifications of the image signal source device or the motion blur function of the driving software, so that the display screen presents a sense of driving speed. In some embodiments, the AI ​​processing unit 106 determines whether it is a driving simulation mode or another game mode based on the content and changes of the screen, such as whether the main object in the screen is a vehicle or dashboard, and whether the screen content is continuously moving. As mentioned above, in one embodiment, the display 10 can record the user's usage time in the driving simulation mode and provide an eye strain warning when the usage time exceeds a certain period of time, and adjust the range of the game screen to full screen, or use PIP to display a rearview mirror or map screen, but is not limited to these.

[0047] MOBA mode can include application scenarios such as multiplayer online battle arena games like DOTA, or other types of map battles or competitive games. In this case, the user needs to operate according to the game screen and simultaneously receive map screen information. When the artificial intelligence processing unit 106 determines that the current usage scenario is MOBA mode, the artificial intelligence processing unit 106 needs to determine the user's field of view based on the distance between the user and the display 10 and the viewing direction, and adjust it to a display optimization configuration that can clearly display the game screen and map information. The display optimization configuration of MOBA mode generally includes adjustment strategies such as brightness in the moderate to high range, color temperature neutral (6500K), and contrast in the moderate to high range. In some embodiments, the display optimization configuration also includes adjustment strategies such as improving sharpness, increasing the screen refresh rate (greater than or equal to 120Hz), enabling the display's overdrive function, and increasing the OD value. As mentioned above, the display 10 can adjust the range of the displayed game screen to a size that the user can observe without adjusting the viewing angle, and display the minimap screen using PIP magnification. Specifically, in some embodiments, the AI ​​processing unit 106 can determine the range of the game screen and the minimap based on the screen content and capture the real-time game screen and minimap accordingly, causing the display control unit 108 to generate a PIP screen. In some embodiments, the AI ​​processing unit 106 can define the capture range of the real-time game screen and the minimap, and the display control unit 108 instructs the screen processing unit 105 to capture the screen according to the capture range and generate a PIP screen. In one embodiment, the AI ​​processing unit 106 can enlarge the PIP minimap and display it on the left or right side of the main screen according to the user's viewing direction or recorded viewing habits, but it is not limited to this.

[0048] The viewing mode includes various types of video content such as movies, variety shows, online streaming videos, and live broadcasts. When the AI ​​processing unit 106 determines that the current usage scenario is viewing mode, the AI ​​processing unit 106 needs to adjust the display optimization configuration to clearly display the image. For example, it may adjust the display area to full screen, or determine the user's field of view based on the distance between the user and the monitor 10 and the viewing direction, and adjust the display area to suit the user's viewing range based on the resolution and aspect ratio of the display screen, while avoiding image distortion on the monitor 10. In addition, to make the display suitable for the user to watch for a long time, the AI ​​processing unit 106 needs to adjust the brightness and color temperature of the monitor 10 based on the measured ambient light information. The display optimization configuration of the viewing mode generally includes adjustment strategies such as adjusting the brightness to moderate to high according to the ambient light, warming the color temperature (greater than or equal to 6500K), and increasing the contrast. In some embodiments, the display optimization configuration further includes enabling high dynamic range functionality and adjustment strategies such as adjusting the screen refresh rate, overdrive function, and OD value of the display element according to the frame rate of the video or movie.

[0049] The power-saving mode is generally activated by the user or automatically based on the power status of the display 10. The user can also terminate the power-saving mode, or the display 10 can automatically exit the power-saving mode based on its power status. For example, the display 10 may be a portable display device with a built-in battery. The power-saving mode is activated based on the remaining battery power, or it is activated after a certain period of inactivity. When the AI ​​processing unit 106 determines that the current usage scenario is power-saving mode, the AI ​​processing unit 106 needs to reduce the brightness and display settings of the display 10 based on the measured ambient light information to save power. The display optimization configuration of the power-saving mode generally includes adjustment strategies such as reducing brightness to the minimum required level, neutral or warm color temperature, medium contrast, and adjusting brightness in real time according to changes in ambient light. In some embodiments, the display optimization configuration further includes reducing the brightness and refresh rate of the display element 107 and the backlight module, and setting the display control unit 108 to make minimal adjustments to the display screen so that the display can display the screen with less power consumption. In some embodiments, the display optimization configuration further includes disabling the high dynamic range function, reducing the OD value or disabling the overdrive function, reducing the sensing frequency of the light sensor 100 and the time-of-flight distance sensor 102, or reducing the operating frequency of the artificial intelligence processing unit 106, the data processing unit 104, and the image processing unit 105. In addition, when the time-of-flight distance sensor 102 detects that there is no user in front of the display 10, the artificial intelligence processing unit 106 automatically puts the display 10 into standby mode or turns off the display element 107.

[0050] Privacy mode is generally enabled by the user, or automatically enabled when the AI ​​processing unit 106 determines that an input interface or window, communication software, or email appears in the screen content. When the AI ​​processing unit 106 determines that the current usage scenario is privacy mode, the AI ​​processing unit 106 needs to determine the user's field of vision based on the distance between the user and the display 10 and the viewing direction, and adjust the display position and range according to the viewing angle range of the display 10 to prevent the screen from being viewed by others. The display optimization configuration of privacy mode generally includes moderate or reduced brightness, warmer color temperature, medium to low contrast, and reducing the viewing angle range of the screen. In some embodiments, the display optimization configuration also includes reducing the range of the display screen and moving it in front of the user's head. In some embodiments, the AI ​​processing unit 106 can determine whether the user has left the location or whether another user has appeared based on the time-of-flight ranging sensor 102. When the time-of-flight ranging sensor 102 detects that another user has appeared in front of the display 10, the AI ​​processing unit 106 automatically turns off the screen of the display 10 to protect user privacy. When only the original user remains in front of the display 10, the AI ​​processing unit 106 turns the screen of the display 10 back on. In some embodiments, the privacy mode can be turned off by the user when leaving, or the AI ​​processing unit 106 can automatically turn off the privacy mode when it determines that the screen content no longer contains input interfaces or windows, communication software, or emails. In some embodiments, user authentication is required before the display 10 turns off the privacy mode or turns the screen back on.

[0051] The aforementioned display 10 is an independent display, which can automatically adjust the display optimization configuration according to the displayed image and the light sensor 100 and time-of-flight sensor 102 built into or externally connected to the display body. In one embodiment, the light sensor 100 and the time-of-flight sensor 102 can be externally connected to a host computer and adjust the display settings of a display according to the display adjustment method of the present invention. Please refer to Figure 6, which is a schematic diagram of a display adjustment system 60 according to an embodiment of the present invention. As shown in Figure 6, the display adjustment system 60 includes a host computer 600, a light sensor 602, a time-of-flight sensor 604, and a display 606.

[0052] Specifically, the light sensor 602 is coupled to the host 600 for sensing ambient light. The time-of-flight (TOF) distance sensor 604 is coupled to the host 600 for tracking a user. The host 600 is coupled to the light sensor 602, the TOF distance sensor 604, and the display 606, and may include a data processing unit 104, an artificial intelligence processing unit 106, and a display control unit 108 (not shown in Figure 6), as shown in Figure 1. Through the display adjustment method of this embodiment, the host 600 can dynamically determine the display optimization configuration and adjust the display parameters of the display 606 based on the raw data measured by the light sensor 602 and the TOF distance sensor 604 and the display screen of the display 606.

[0053] Traditional displays often rely on manual settings by the user when adjusting display parameters, failing to automatically sense changes in the environment and current usage context. This not only increases the user's operational burden but also makes it difficult to optimize the display effect in real time. In contrast, the display, display adjustment method, and display adjustment system of the present invention, by integrating a light sensor, a time-of-flight distance sensor, and artificial intelligence processing technology, can adjust display parameters in real time and dynamically. This not only significantly reduces the complexity of user adjustments but also intelligently optimizes the display experience according to different usage contexts, enhancing the intelligence effect of display technology. The above description is only a preferred embodiment of the present invention. All equivalent variations and modifications made within the scope of the claims of the present invention should be considered within the scope of the present invention. [Simplified Explanation of the Diagram]

[0054] Figure 1 is a schematic diagram of a display according to one embodiment of the present invention. Figure 2 is a schematic diagram of an automatic display adjustment process according to one embodiment of the present invention. Figure 3 is a schematic diagram of adjusting the display optimization configuration based on user dynamics and the display screen feedback artificial intelligence model according to an embodiment of the present invention. Figures 4A and 4B are schematic diagrams of adjusting the display screen size based on user dynamics and the display screen feedback artificial intelligence model according to an embodiment of the present invention. Figures 5A and 5B are schematic diagrams of adjusting the display screen position according to the user's viewing direction according to an embodiment of the present invention. Figure 6 is a schematic diagram of a display adjustment system according to one embodiment of the present invention.

Claims

1. A display comprising: a light sensor for sensing ambient light; a time-of-flight (ToF) sensor for tracking a user; a data processing unit coupled to the light sensor and the ToF sensor for receiving raw data from the light sensor and the ToF sensor, and performing data exploration and data analysis on the raw data to obtain current ambient light information and a first dynamic of the user; an artificial intelligence (AI) processing unit coupled to the data processing unit for determining a current usage scenario based on a first display screen of the display, and determining a display optimization configuration based on the current ambient light information, the first dynamic, and the current usage scenario; and a display control unit coupled to the AI ​​processing unit for dynamically adjusting a plurality of display parameters of the display according to the display optimization configuration.

2. The display as claimed in claim 1, wherein the current ambient light information includes the intensity and color temperature of the ambient light, and the first dynamic includes a change in the position of one of the users, a change in posture, a change in viewing direction, and a change in the distance between the user and one of the displays.

3. The display as described in claim 1 further includes a display element and a screen processing unit, wherein the plurality of display parameters include brightness, color temperature, contrast ratio, sharpness, refresh rate, overdrive (OD), high dynamic range (HDR) related to the display element, and the size and position of the display area of ​​one or more screen contents related to the screen processing unit.

4. The display as described in claim 1, wherein the display control unit further captures a portion of the content of a screen in the first display screen according to the current usage context, and displays the screen content and the portion of the screen content simultaneously according to the display optimization configuration.

5. The display as described in claim 1, wherein after the display control unit dynamically adjusts a plurality of display parameters of the display according to the display optimization configuration, the data processing unit obtains a second dynamic of one of the users, and the artificial intelligence processing unit adjusts the current usage context according to the second dynamic.

6. The display as described in claim 5, wherein the artificial intelligence processing unit further receives a second display element adjusted according to the plurality of display parameters, and adjusts the display optimization configuration according to the second dynamic and the second display element.

7. A display automatic adjustment method for a display, comprising: receiving raw data from a light sensor and a time-of-flight (ToF) sensor, and performing data exploration and analysis on the raw data to obtain current ambient light information and a first dynamic of a user; determining a current usage scenario through an artificial intelligence (AI) processing unit based on a first display screen of the display; determining a display optimization configuration through the AI ​​processing unit based on the current ambient light information, the first dynamic, and the current usage scenario; and dynamically adjusting a plurality of display parameters of the display according to the display optimization configuration.

8. The automatic display adjustment method as described in claim 7, wherein the current ambient light information includes the intensity and color temperature of the ambient light, and the first dynamic includes a change in the position of the user, a change in posture, a change in viewing direction, and a change in the distance between the user and the display.

9. The automatic display adjustment method as described in claim 7, wherein the plurality of display parameters includes one of the display's brightness, color temperature, contrast ratio, sharpness, refresh rate, overdrive (OD), high dynamic range (HDR), and the display area size and position of one or more screen contents.

10. The automatic display adjustment method as described in claim 7 further includes capturing a portion of the content of a screen in the first display screen according to the current usage context, and displaying the screen content and the portion of the screen content simultaneously according to the display optimization configuration.

11. The automatic display adjustment method as described in claim 7, wherein after dynamically adjusting a plurality of display parameters of the display according to the display optimization configuration, a second dynamic of one of the users is obtained, and the artificial intelligence processing unit adjusts the current usage context according to the second dynamic.

12. The automatic display adjustment method as described in claim 11 further includes the artificial intelligence processing unit obtaining a second display screen adjusted according to the plurality of display parameters, and adjusting the display optimization configuration according to the second dynamic and the second display screen.

13. A display adjustment system, comprising: a main unit; a light sensor coupled to the main unit for sensing ambient light; a time-of-flight (ToF) sensor coupled to the main unit for tracking a user; and a display coupled to the main unit; wherein, The host adjusts a plurality of display parameters of the display according to the automatic display adjustment method described in request item 7.

Images