An adaptive screen optimization system

Abstract

The present invention relates to the field of screen display technology, and in particular to an adaptive screen optimization system, comprising: a sight tracker, which is used to collect the sight of a user and determine the main screen observed by the user; a sight processor, which is used to determine the sight normal vector of the user's sight according to the direction of the user's observation; a light collector, which is used to determine the direction of an interfering light source that interferes with the user's sight according to the orientation of the main screen; a polarization adjuster, which is used to adjust the angle of the polarizer and the backlight brightness of the main screen according to the direction of the interfering light source; an adjustment assistant, which is used to judge the clarity of the main screen according to pupil reflection or lens reflection, and output corresponding auxiliary adjustment results; the present invention uses a method of determining the user's sight and the corresponding interfering light source to adjust the angle of the polarizer and the brightness of the backlight of the screen, which effectively improves the user's sensory quality when the screen is interfered by the light source, and effectively improves the clarity of the screen display.

Description

Technical Field

[0001] The present invention relates to the field of screen display technology, and in particular to an adaptive screen optimization system. Background Art

[0002] When observing the screen, the color displayed on the screen is often distorted or the image is reflected due to the light generated by the viewing direction. For users who observe the screen from the side, the above phenomenon occurs particularly frequently.

[0003] With the development of current screen technology, users have higher and higher requirements for screens, and the above-mentioned problem is one of the key issues restricting the development of screens.

[0004] Chinese Patent Grant Announcement No.: CN106062776B discloses a method comprising: irradiating light along an outward light path to the eyes of a user wearing glasses. When the glasses are detected, the light is dynamically polarized in a polarization mode that switches between a random polarization stage and a single polarization stage, wherein the random polarization stage includes a first polarization along the outward light path and a second polarization orthogonal to the first polarization along the reflected light path. The single polarization stage has a single polarization. During the random polarization stage, glare reflected from the glasses is filtered out and a pupil image is captured. During the single polarization stage, a glint image is captured. Based on pupil characteristics and glint characteristics, the gaze position is repeatedly detected.

[0005] However, the above method has the following problem: it is unable to adjust the problem of unclear screen display caused by the influence of light source or observation angle. Summary of the invention

[0006] To this end, the present invention provides an adaptive screen optimization system to overcome the problem in the prior art that the screen display is unclear due to the influence of light source or observation angle, thereby causing the screen display to be unclear.

[0007] To achieve the above object, the present invention provides an adaptive screen optimization system, comprising:

[0008] An eye tracker, which is used to collect the user's eye gaze and determine the main screen that the user is observing;

[0009] Among them, the gaze tracker can also observe the user's pupil reflection or lens reflection;

[0010] A sight line processor connected to the sight line tracker to determine a sight line normal vector of the user's sight line according to the direction in which the user is observing;

[0011] A light collector connected to the sight tracker and the sight processor, for determining the direction of an interfering light source interfering with the user's sight according to the orientation of the main screen;

[0012] A polarization adjuster connected to the light collector to adjust the polarizer angle and backlight brightness of the main screen according to the direction of the interfering light source;

[0013] An adjustment assistant, connected to the sight tracker and the polarization adjuster, for judging the clarity of the main screen according to the pupil reflection or the lens reflection, and outputting a corresponding auxiliary adjustment result;

[0014] Wherein, the polarization adjuster increases the backlight brightness according to the auxiliary adjustment result.

[0015] Further, when observing the pupil reflection of the user, the eye tracking device compares the color in the user's pupil according to the main output color of the main screen, and records the brightness in the pupil corresponding to the main output color to form the pupil brightness;

[0016] When observing the user's lens reflection, the sight tracker records the color brightness of the virtual image in the lens reflection as the lens reflection brightness.

[0017] Furthermore, the adjustment assistant is provided with a preset brightness threshold, a preset brightness extreme value and a lens adjustment value, wherein:

[0018] For a user whose eyeglasses are not observed by the eye tracker, if the pupil brightness of the user observed by the eye tracker reaches a preset brightness threshold and does not reach a preset brightness extreme value, the adjustment assistant determines that the main screen adjustment is completed;

[0019] For the user whose lens is observed by the gaze tracker, the gaze tracker observes the lens brightness corresponding to the user, and outputs the adjusted brightness according to the lens adjustment value. If the adjusted brightness reaches the preset brightness threshold and does not reach the preset brightness extreme value, or the adjustment assistant determines that the main screen has completed the adjustment.

[0020] Furthermore, for a single user, if the gaze tracker observes the presence of lens reflection at any time during the process of the user observing the main screen, the gaze tracker makes adjustments based on the lens brightness.

[0021] Furthermore, the eye tracking device includes a plurality of sub-trackers, and each sub-tracker is arranged corresponding to each screen;

[0022] For a single user, the line of sight processor determines the focus of the line of sight based on the normal vector of the user's line of sight, and determines the corresponding main screen based on the focus direction of the line of sight, and starts the sub-tracker corresponding to the main screen as the main line of sight tracker to determine the pupil reflection or lens reflection of the user.

[0023] Furthermore, the preset brightness threshold and the preset brightness extreme value are adjusted in the light collector according to the normal brightness in the direction corresponding to the sight line normal vector;

[0024] Wherein, the preset brightness threshold is negatively correlated with the normal brightness;

[0025] The preset brightness extreme value is positively correlated with the normal brightness.

[0026] Furthermore, when the polarization adjuster adjusts the polarizer, the polarizer is adjusted to an optimal angle corresponding to the sight angle according to the sight normal vector.

[0027] Furthermore, the polarizer is provided with an adjustment range. If the optimal angle cannot be reached within the adjustment range, the polarization adjuster adjusts the backlight brightness accordingly according to the determination of the adjustment assistant.

[0028] Furthermore, when determining the direction of the interfering light source, the light collector determines the interfering light source in a direction parallel to the sight line normal vector, and determines a preset brightness threshold according to the brightness of the interfering light source and the sight line normal vector;

[0029] Furthermore, the interfering light source does not include backlights of screens adjacent to the main screen.

[0030] Furthermore, the polarization adjuster adjusts the optimal angle according to the brightness of the interfering light source on the line of sight normal vector.

[0031] Compared with the prior art, the beneficial effect of the present invention lies in that, by determining the user's line of sight and the corresponding interfering light source, the angle of the screen's polarizer and the brightness of the backlight are adjusted, thereby effectively improving the user's sensory quality when the screen is interfered with by the light source and effectively improving the clarity of the screen display.

[0032] Furthermore, by distinguishing whether the user is wearing lenses, the user's pupil reflection or lens reflection is determined, and the corresponding brightness is determined based on the pupil reflection or lens reflection. This effectively improves the distinction between users in different states and further improves the clarity of the screen display.

[0033] Furthermore, by setting up several sub-trackers, the light source of each screen is aligned with the user's line of sight, which effectively improves the targeted adjustment of the main screen and adjusts the brightness of the screen according to the interfering light source, thereby further improving the clarity of the screen display.

[0034] Furthermore, by synchronously adjusting the brightness of the polarizer and the backlight, and using the polarizer to adjust the polarized light of the screen, the image of the screen can be concentrated at the position corresponding to the user's line of sight. While effectively improving the screen brightness, the anti-interference performance of the screen is improved in conjunction with the backlight, thereby further improving the clarity of the screen display. BRIEF DESCRIPTION OF THE DRAWINGS

[0035] Figure 1 It is a structural schematic diagram of the adaptive screen optimization system of the present invention;

[0036] Figure 2 This is a schematic diagram of the main screen color partitioning according to an embodiment of the present invention;

[0037] Figure 3 Schematic diagram of the structure of the gaze tracker according to an embodiment of the present invention. DETAILED DESCRIPTION

[0038] In order to make the objects and advantages of the present invention more clearly understood, the present invention is further described below in conjunction with embodiments; it should be understood that the specific embodiments described herein are only used to explain the present invention and are not used to limit the present invention.

[0039] The preferred embodiments of the present invention are described below with reference to the accompanying drawings. It should be understood by those skilled in the art that these embodiments are only used to explain the technical principles of the present invention and are not intended to limit the protection scope of the present invention.

[0040] It should be noted that, in the description of the present invention, terms such as "up", "down", "left", "right", "inside" and "outside" indicating directions or positional relationships are based on the directions or positional relationships shown in the drawings. This is merely for the convenience of description and does not indicate or imply that the device or element must have a specific orientation, be constructed and operated in a specific orientation. Therefore, it cannot be understood as a limitation on the present invention.

[0041] In addition, it should be noted that in the description of the present invention, unless otherwise clearly specified and limited, the terms "installed", "connected", and "connected" should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection, or it can be indirectly connected through an intermediate medium, or it can be the internal communication of two components. For those skilled in the art, the specific meanings of the above terms in the present invention can be understood according to specific circumstances.

[0042] See also Figure 1 As shown, it is a schematic diagram of the structure of the adaptive screen optimization system of the present invention, including:

[0043] An eye tracker, which is used to collect the user's eye gaze and determine the main screen that the user is observing;

[0044] Among them, the gaze tracker can also observe the user's pupil reflection or lens reflection;

[0045] A gaze processor connected to the gaze tracker to determine a gaze normal vector of the user's gaze according to a direction in which the user is looking;

[0046] A light collector, which is connected to the sight tracker and the sight processor, and is used to determine the direction of the interfering light source that interferes with the user's sight according to the orientation of the main screen;

[0047] A polarization adjuster, which is connected to the light collector and is used to adjust the polarizer angle and backlight brightness of the main screen according to the direction of the interfering light source;

[0048] An adjustment assistant, which is connected to the sight tracker and the polarization adjuster, is used to judge the clarity of the main screen according to pupil reflection or lens reflection, and output a corresponding auxiliary adjustment result;

[0049] The polarization regulator increases the backlight brightness according to the auxiliary adjustment result.

[0050] Compared with the prior art, the beneficial effect of the present invention lies in that, by determining the user's line of sight and the corresponding interfering light source, the angle of the screen's polarizer and the brightness of the backlight are adjusted, thereby effectively improving the user's sensory quality when the screen is interfered with by the light source and effectively improving the clarity of the screen display.

[0051] Specifically, when observing the pupil reflection of the user, the gaze tracker compares the color in the user's pupil with the main output color of the main screen, and records the brightness in the pupil corresponding to the main output color to form the pupil brightness;

[0052] When the gaze tracker observes the user's lens reflection, it records the color brightness of the virtual image in the lens reflection as the lens reflection brightness.

[0053] The main output color is the color with shorter wavelength and higher brightness that can be output on the main screen. Figure 2 As shown, it is a schematic diagram of the main screen color partitioning according to an embodiment of the present invention. The main output colors are explained using this figure as an example. In the figure, the area of ​​region A is less than the area of ​​region C and less than the area of ​​region B.

[0054] Embodiment 1:

[0055] The color brightness of area A is 68, the color brightness of area B is 20, and the color brightness of area C is 68;

[0056] Then the main output color of the screen is: brightness is 68, hue and saturation are the corresponding colors with higher saturation in area A and area B;

[0057] Embodiment 2:

[0058] The color brightness of area A is 50, the color brightness of area B is 50, and the color brightness of area C is 50;

[0059] Then the main output color of the screen is: the corresponding color of area B;

[0060] Embodiment 3:

[0061] The color brightness of area A is 20, the color brightness of area B is 20, and the color brightness of area C is 70;

[0062] Then the main output color of the screen is: the corresponding color of area C.

[0063] It can be understood that, for a single screen, its reaction in the lens or pupil includes the corresponding characteristic color.

[0064] Specifically, the adjustment assistant is provided with a preset brightness threshold, a preset brightness extreme value and a lens adjustment value, wherein:

[0065] For a user whose eye tracker does not observe the lens, if the eye tracker observes that the pupil brightness of the user reaches a preset brightness threshold and does not reach a preset brightness extreme value, the adjustment assistant determines that the main screen adjustment is completed;

[0066] For the corresponding user whose lens is observed by the gaze tracker, the gaze tracker observes the brightness of the lens corresponding to the user, and outputs the adjusted brightness according to the lens adjustment value. If the adjusted brightness reaches the preset brightness threshold and does not reach the preset brightness extreme value, or the adjustment assistant determines that the main screen has completed the adjustment.

[0067] In implementation, for users wearing glasses, the image that can be captured by the device is the image formed by the glasses, and the image will reduce or increase the brightness of the corresponding color on the screen to a certain extent;

[0068] To correct the brightness reflected by the lens, a lens adjustment value is set to repair the brightness;

[0069] Among them, the lens adjustment value is related to the degree of the corresponding lens. When obtaining the value, machine learning is used to determine the lens adjustment value of the lens worn by the corresponding user.

[0070] Embodiment 4:

[0071] The user's pupil reflection brightness is 30, 40, 50. When the user uses the corresponding lenses, the lens reflection brightness is 38, 50, 63. It can be determined that the lens adjustment value corresponding to the lens is 1.25.

[0072] The preset brightness threshold is the minimum brightness that can clearly distinguish the color and boundaries of the picture, which is generally set to 25;

[0073] The preset brightness limit is the maximum brightness that can clearly distinguish the color and boundaries of the picture, which is generally set to 95.

[0074] Specifically, for a single user, if the gaze tracker observes that there is lens reflection at any time when the user is observing the main screen, the gaze tracker makes adjustments based on the lens brightness.

[0075] By distinguishing whether the user is wearing lenses, the user's pupil reflection or lens reflection is determined, and the corresponding brightness is determined based on the pupil reflection or lens reflection. This effectively improves the distinction between users in different states and further improves the clarity of the screen display.

[0076] See also Figure 3 As shown, it is a schematic diagram of the structure of the gaze tracker according to an embodiment of the present invention. The gaze tracker includes a plurality of sub-trackers, and each sub-tracker is correspondingly arranged for each screen;

[0077] For a single user, the line of sight processor determines the focus of the line of sight based on the normal vector of the user's line of sight, and determines the corresponding main screen based on the focus direction of the line of sight, and starts the sub-tracker corresponding to the main screen as the main line of sight tracker to determine the user's pupil reflection or lens reflection.

[0078] Specifically, the preset brightness threshold and the preset brightness extreme value are adjusted in the light collector according to the normal brightness in the direction corresponding to the sight line normal vector;

[0079] Among them, the preset brightness threshold is negatively correlated with the normal brightness;

[0080] The preset brightness extreme value is positively correlated with the normal brightness.

[0081] By setting up several sub-trackers, the light source of each screen is aligned with the user's line of sight. While effectively improving the targeted adjustment of the main screen, the brightness of the screen is adjusted according to the interfering light source, thereby further improving the clarity of the screen display.

[0082] Specifically, when the polarizer adjusts the polarizer, the polarizer is adjusted to an optimal angle corresponding to the sight angle according to the sight normal vector.

[0083] Specifically, the polarizer is provided with an adjustment range. If the optimal angle cannot be reached within the adjustment range, the polarization adjuster adjusts the backlight brightness accordingly according to the determination of the adjustment assistant.

[0084] In practice, when the polarizer is adjusted, the polarized light is directed to the corresponding user as much as possible according to the movable range of the polarizer, and the backlight is used for fill light according to the brightness of the user's pupil reflection or lens reflection.

[0085] Specifically, when determining the direction of the interfering light source, the light collector determines the interfering light source in a direction parallel to the sight line normal vector, and determines a preset brightness threshold according to the brightness of the interfering light source and the sight line normal vector;

[0086] Furthermore, the interfering light source does not include the backlights of the screens adjacent to the main screen.

[0087] Specifically, the polarization adjuster adjusts the optimal angle according to the brightness of the interfering light source on the line of sight normal vector.

[0088] By adjusting the polarizer and backlight brightness synchronously and using the polarizer to adjust the polarized light of the screen, the image on the screen can be concentrated at the position corresponding to the user's line of sight. While effectively improving the screen brightness, it also improves the screen's anti-interference performance in conjunction with the backlight, thereby further improving the clarity of the screen display.

[0089] So far, the technical solutions of the present invention have been described in conjunction with the preferred embodiments shown in the accompanying drawings. However, it is easy for those skilled in the art to understand that the protection scope of the present invention is obviously not limited to these specific embodiments. Without departing from the principle of the present invention, those skilled in the art can make equivalent changes or substitutions to the relevant technical features, and the technical solutions after these changes or substitutions will fall within the protection scope of the present invention.

[0090] The above description is only a preferred embodiment of the present invention and is not intended to limit the present invention. For those skilled in the art, the present invention may have various modifications and variations. Any modification, equivalent replacement, improvement, etc. made within the spirit and principle of the present invention shall be included in the protection scope of the present invention.

Claims

1. An adaptive screen optimization system, characterized in that: include: An eye tracking device, which includes a plurality of sub-trackers, and each sub-tracker is set corresponding to each screen, so as to collect the user's eye line and determine the main screen observed by the user; Among them, the gaze tracker can also observe the user's pupil reflection or lens reflection; A sight line processor connected to the sight line tracker to determine a sight line normal vector of the user's sight line according to the direction in which the user is observing; For a single user, the sight line processor determines the focus of the sight line according to the normal vector of the user's sight line, and determines the corresponding main screen according to the focus direction of the sight line, and starts the sub-tracker corresponding to the main screen as the main sight line tracker to determine the pupil reflection or lens reflection of the user; A light collector connected to the sight tracker and the sight processor, for determining the direction of an interfering light source interfering with the user's sight according to the orientation of the main screen; A polarization adjuster connected to the light collector to adjust the polarizer angle and backlight brightness of the main screen according to the direction of the interfering light source; An adjustment assistant, connected to the sight tracker and the polarization adjuster, for judging the clarity of the main screen according to the pupil reflection or the lens reflection, and outputting a corresponding auxiliary adjustment result; Wherein, the polarization adjuster increases the backlight brightness according to the auxiliary adjustment result.

2. The adaptive screen optimization system according to claim 1, characterized in that: When observing the pupil reflection of the user, the eye tracking device compares the color in the user's pupil according to the main output color of the main screen, and records the brightness in the pupil corresponding to the main output color to form the pupil brightness; When observing the user's lens reflection, the sight tracker records the color brightness of the virtual image in the lens reflection as the lens reflection brightness.

3. The adaptive screen optimization system according to claim 2, characterized in that: The adjustment assistant is provided with a preset brightness threshold, a preset brightness extreme value and a lens adjustment value, wherein: For a user whose eyeglasses are not observed by the eye tracker, if the pupil brightness of the user observed by the eye tracker reaches a preset brightness threshold and does not reach a preset brightness extreme value, the adjustment assistant determines that the main screen adjustment is completed; For the user whose lens is observed by the gaze tracker, the gaze tracker observes the lens brightness corresponding to the user, and outputs the adjusted brightness according to the lens adjustment value. If the adjusted brightness reaches the preset brightness threshold and does not reach the preset brightness extreme value, or the adjustment assistant determines that the main screen has completed the adjustment.

4. The adaptive screen optimization system according to claim 3, characterized in that: For a single user, if the gaze tracker observes the presence of lens reflection at any time during the process of the user observing the main screen, the gaze tracker makes adjustments based on the lens brightness.

5. The adaptive screen optimization system according to claim 3, characterized in that: The light collector adjusts the preset brightness threshold and the preset brightness extreme value respectively according to the normal brightness in the direction corresponding to the sight line normal vector; Wherein, the preset brightness threshold is negatively correlated with the normal brightness; The preset brightness extreme value is positively correlated with the normal brightness.

6. The adaptive screen optimization system according to any one of claims 4 or 5, characterized in that: When the polarizing adjuster adjusts the polarizing plate, the polarizing plate is adjusted to an optimal angle corresponding to the sight angle according to the sight normal vector.

7. The adaptive screen optimization system according to claim 6, characterized in that: The polarizer is provided with an adjustment range. If the optimal angle cannot be reached within the adjustment range, the polarization adjuster adjusts the backlight brightness accordingly according to the determination of the adjustment assistant.

8. The adaptive screen optimization system according to claim 7, characterized in that: When determining the direction of the interfering light source, the light collector determines the interfering light source in a direction parallel to the sight line normal vector, and determines a preset brightness threshold according to the brightness of the interfering light source and the sight line normal vector; Furthermore, the interfering light source does not include backlights of screens adjacent to the main screen.

9. The adaptive screen optimization system according to claim 8, characterized in that: The polarization adjuster adjusts the optimal angle according to the brightness of the interfering light source on the line of sight normal vector.

Images