Method and device for adjusting in-eye brightness of near-eye display equipment and near-eye display equipment

Abstract

The invention relates to the technical field of augmented reality, and discloses a near-to-eye display equipment in-eye brightness adjusting method and device and near-to-eye display equipment, and the near-to-eye display equipment, and the near-to-eye display equipment comprises the following steps: determining a target lens transmittance matched with the currently obtained external environment light brightness based on a corresponding relation between an environment light brightness range and the lens transmittance; and the transmittance of the lens is adjusted to be the target lens transmittance, so that the brightness of the light entering the human eyes is in a proper range. Determining virtual image display brightness according to the target lens transmittance, the external environment light brightness, the luminous efficiency coefficient of the optical module and the contrast ratio matched with the current demand; and adjusting the image brightness of the display module to the virtual image display brightness. The contrast ratio is used for representing the in-eye brightness difference between virtual image display and ambient light, the virtual image display brightness is determined according to the contrast ratio, and the experience of a user on the virtual image display effect and optical perspective of the near-eye display equipment is optimized.

Description

Technical Field

[0001] The present application relates to the field of augmented reality technology, and in particular to a method and device for adjusting the eye brightness of a near-eye display device, and a near-eye display device. Background Art

[0002] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. With the development of AR technology, the derived AR products are widely used. Common AR products include AR glasses, AR head-mounted displays, etc.

[0003] Taking AR glasses as an example, when using AR glasses, users' requirements for eye brightness will change as the external environment or their own needs change. For example, when the outdoor light intensity is high, in order to reduce the stimulation of strong light to the human eye, the user hopes that the eye brightness of AR glasses can be reduced; when the user is in a darker indoor environment, in order to observe the indoor environment more clearly, the user hopes that the eye brightness of AR glasses can be increased.

[0004] Electrochromic materials can switch optical properties between different transmittances. Applying electrochromic materials to the lenses of AR glasses can adjust the intensity of external light that passes through the lenses and enters the human eye, allowing users to have a more comfortable visual experience.

[0005] AR glasses and AR head-mounted displays are all near-eye display devices. The current method of adjusting the brightness of near-eye display devices mainly focuses on the brightness of ambient light entering the eye. When users pay more attention to the effect of virtual image display, the current method of adjusting the brightness of ambient light entering the eye cannot well meet the needs of users.

[0006] It can be seen that how to optimize the user's experience of the virtual image display effect and optical perspective of the near-eye display device is a problem that technical personnel in this field need to solve. Summary of the invention

[0007] The purpose of the embodiments of the present application is to provide a method, device and near-eye display device for adjusting the eye brightness of a near-eye display device, which can optimize the user's experience of the virtual image display effect and optical perspective of the near-eye display device.

[0008] In order to solve the above technical problems, an embodiment of the present application provides a method for adjusting the eye brightness of a near-eye display device, comprising:

[0009] Based on the corresponding relationship between the ambient light brightness range and the lens transmittance, determine the target lens transmittance that matches the currently acquired external ambient light brightness;

[0010] Adjusting the transmittance of the lens to the target lens transmittance;

[0011] Determine the virtual image display brightness according to the target lens transmittance, the ambient light brightness, the optical efficiency coefficient of the optical module, and the contrast matching the current demand; wherein the contrast is used to characterize the eye brightness difference between the virtual image display and the ambient light;

[0012] The image brightness of the display module is adjusted to the virtual image display brightness.

[0013] Optionally, determining the virtual image display brightness according to the target lens transmittance, the ambient light brightness, the optical efficiency coefficient of the optical module, and a contrast ratio matching the current demand includes:

[0014] Determining the ambient light entering the eye brightness based on the target lens transmittance and the ambient light brightness;

[0015] Obtaining a contrast ratio that matches current requirements; wherein the current requirements include environmental requirements and functional requirements;

[0016] The virtual image display brightness is determined according to the ambient light entering the eye brightness, the contrast and the light efficiency coefficient of the optical module.

[0017] Optionally, determining the virtual image display brightness according to the ambient light entering the eye brightness, the contrast, and the light efficiency coefficient of the optical module includes:

[0018] Determining the virtual image display eye brightness based on the contrast and the ambient light eye brightness;

[0019] The ratio of the virtual image display eye brightness to the light efficiency coefficient of the optical module is used as the virtual image display brightness.

[0020] Optionally, the determining of a target lens transmittance matching the currently acquired external ambient light brightness based on the correspondence between the ambient light brightness range and the lens transmittance comprises:

[0021] Receive the brightness of external ambient light transmitted by the optical sensor;

[0022] According to the demand instruction input by the user, a target correspondence list of ambient light brightness range and lens transmittance matching the demand instruction is selected from a plurality of set correspondence lists; wherein each correspondence list has its corresponding environmental demand and functional demand;

[0023] The target lens transmittance matching the external environment light brightness is searched from the target correspondence list.

[0024] Optionally, after selecting, according to the demand instruction input by the user, a target correspondence list of ambient light brightness range and lens transmittance matching the demand instruction from a plurality of set correspondence lists, the method further includes:

[0025] When a change in the user's environment is detected, the latest environmental requirements are determined based on the environmental changes, and a target correspondence list of ambient light brightness ranges and lens transmittances matching the latest environmental requirements is selected from a plurality of set correspondence lists.

[0026] Optionally, each correspondence list also includes contrasts corresponding to different ambient light brightness ranges and different lens transmittances;

[0027] Accordingly, obtaining a contrast ratio that matches the current requirement includes:

[0028] After obtaining a target correspondence list of ambient light brightness ranges and lens transmittances matching the current requirement, the contrast in the target correspondence list that matches the external ambient light brightness is used as the contrast that matches the current requirement.

[0029] Optionally, acquiring a contrast ratio matching current requirements includes:

[0030] A contrast ratio matching the current requirement is searched from a contrast ratio list; wherein the contrast ratio list includes contrast ratios corresponding to different environmental requirements and functional requirements.

[0031] Optionally, adjusting the transmittance of the lens to the target lens transmittance comprises:

[0032] According to the set adjustment step length, the transmittance of the lens is adjusted step by step to the target lens transmittance.

[0033] The embodiment of the present application also provides a device for adjusting the brightness of a near-eye display device, including a transmittance determining unit, a transmittance adjusting unit, a brightness determining unit, and a brightness adjusting unit;

[0034] The transmittance determination unit is used to determine the target lens transmittance that matches the currently acquired external ambient light brightness based on the corresponding relationship between the ambient light brightness range and the lens transmittance;

[0035] The transmittance adjustment unit is used to adjust the transmittance of the lens to the target lens transmittance;

[0036] The brightness determination unit is used to determine the virtual image display brightness according to the target lens transmittance, the external ambient light brightness, the optical efficiency coefficient of the optical module and the contrast matching the current demand; wherein the contrast is used to characterize the eye brightness difference between the virtual image display and the ambient light;

[0037] The brightness adjustment unit is used to adjust the image brightness of the display module to the virtual image display brightness.

[0038] Optionally, the brightness determination unit includes a first determination subunit, an acquisition subunit and a second determination subunit;

[0039] The first determination subunit is used to determine the ambient light entering the eye brightness based on the target lens transmittance and the external ambient light brightness;

[0040] The acquisition subunit is used to acquire a contrast ratio that matches current requirements; wherein the current requirements include environmental requirements and functional requirements;

[0041] The second determination subunit is used to determine the virtual image display brightness according to the ambient light entering the eye brightness, the contrast and the light efficiency coefficient of the optical module.

[0042] Optionally, the second determining subunit is used to determine the virtual image display eye brightness based on the contrast and the ambient light eye brightness; and take the ratio of the virtual image display eye brightness to the light efficiency coefficient of the optical module as the virtual image display brightness.

[0043] Optionally, the transmittance determination unit includes a receiving subunit, a selecting subunit and a querying subunit;

[0044] The receiving subunit is used to receive the brightness of the external environment light transmitted by the optical sensor;

[0045] The selection subunit is used to select a target correspondence list of ambient light brightness range and lens transmittance matching the demand instruction from a plurality of set correspondence lists according to the demand instruction input by the user; wherein each correspondence list has its corresponding environmental demand and functional demand;

[0046] The query subunit is used to query the target lens transmittance that matches the external environment light brightness from the target correspondence list.

[0047] Optionally, it also includes a demand determination unit and a selection unit;

[0048] The demand determination unit is used to determine the latest environmental demand based on the environmental change when detecting that the environment in which the user is located has changed;

[0049] The selection unit is used to select a target correspondence list of ambient light brightness range and lens transmittance matching the latest environmental requirement from a plurality of set correspondence lists.

[0050] Optionally, each correspondence list also includes contrasts corresponding to different ambient light brightness ranges and different lens transmittances;

[0051] Correspondingly, the acquisition subunit is used to use the contrast in the target correspondence list that matches the external ambient light brightness as the contrast that matches the current demand after acquiring the target correspondence list of ambient light brightness ranges and lens transmittances that match the current demand.

[0052] Optionally, the acquisition subunit is used to query a contrast ratio that matches the current requirement from a contrast ratio list; wherein the contrast ratio list includes contrast ratios corresponding to different environmental requirements and functional requirements.

[0053] Optionally, the transmittance adjustment unit is used to adjust the transmittance of the lens step by step to the target lens transmittance according to a set adjustment step.

[0054] The embodiment of the present application also provides a near-eye display device, including an optical sensor, a lens, a lens control component, a display component and an application processor; the display component includes an optical module and a display module;

[0055] The optical sensor is connected to the application processor and is used to transmit the collected external ambient light brightness to the application processor;

[0056] The application processor is connected to the lens control component and the display component respectively, and is used to determine the target lens transmittance matching the currently acquired external ambient light brightness based on the corresponding relationship between the ambient light brightness range and the lens transmittance; transmit a transmittance adjustment instruction carrying the target lens transmittance to the lens control component; determine the virtual image display brightness according to the target lens transmittance, the external ambient light brightness, the optical efficiency coefficient of the optical module and the contrast matching the current demand; adjust the image brightness of the display module to the virtual image display brightness; wherein the contrast is used to characterize the difference in eye brightness between the virtual image display and the ambient light;

[0057] The lens control component is connected to the lens, and is used to adjust the transmittance of the lens to the target lens transmittance after receiving a transmittance adjustment instruction carrying the target lens transmittance transmitted by the application processor.

[0058] It can be seen from the above technical scheme that based on the correspondence between the ambient light brightness range and the lens transmittance, the target lens transmittance matching the currently acquired external ambient light brightness is determined; the lens transmittance will directly affect the ambient light brightness entering the eye, so the lens transmittance can be adjusted to the target lens transmittance, thereby ensuring that the brightness entering the human eye will not be too bright or too dark. According to the target lens transmittance, the external ambient light brightness, the optical efficiency coefficient of the optical module and the contrast matching the current demand, the virtual image display brightness is determined; wherein the contrast is used to characterize the difference in eye brightness between the virtual image display and the ambient light. The image brightness of the display module is adjusted to the virtual image display brightness, ensuring that the user has a clearer virtual image display when wearing a near-eye display device. In this technical scheme, the near-eye display device can dynamically adjust the lens transmittance by obtaining the external ambient light brightness, based on the correspondence between the ambient light brightness range and the lens transmittance, thereby controlling the brightness of the light entering the human eye to be within an appropriate range. In addition, the virtual image display brightness is determined based on the contrast that matches the current needs, achieving coordination between the virtual image display brightness and the ambient light brightness, and optimizing the user's experience of the virtual image display effect and optical perspective of the near-eye display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0059] In order to more clearly illustrate the embodiments of the present application, the following is a brief introduction to the drawings required for use in the embodiments. Obviously, the drawings described below are only some embodiments of the present application. For ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative work.

[0060] Figure 1 A flowchart of a method for adjusting the eye brightness of a near-eye display device provided in an embodiment of the present application;

[0061] Figure 2 A flow chart of a method for determining virtual image display brightness provided in an embodiment of the present application;

[0062] Figure 3 A flow chart of a method for determining the transmittance of a target lens provided in an embodiment of the present application;

[0063] Figure 4 A schematic diagram of the structure of a device for adjusting the eye brightness of a near-eye display device provided in an embodiment of the present application;

[0064] Figure 5 A schematic diagram of the structure of a near-eye display device provided in an embodiment of the present application. DETAILED DESCRIPTION

[0065] The following will be combined with the drawings in the embodiments of the present application to clearly and completely describe the technical solutions in the embodiments of the present application. Obviously, the described embodiments are only part of the embodiments of the present application, not all of the embodiments. Based on the embodiments in the present application, all other embodiments obtained by ordinary technicians in this field without creative work are within the scope of protection of this application.

[0066] The terms "including" and "having" in the specification and claims of this application and the above drawings, as well as any variations thereof, are intended to cover non-exclusive inclusions. For example, a process, method, system, product or device comprising a series of steps or units is not limited to the listed steps or units, but may include steps or units that are not listed.

[0067] In order to enable those skilled in the art to better understand the present application, the present application is further described in detail below in conjunction with the accompanying drawings and specific implementation methods.

[0068] Next, a method for adjusting the eye brightness of a near-eye display device provided in an embodiment of the present application is described in detail. Figure 1 A flowchart of a method for adjusting the eye brightness of a near-eye display device provided in an embodiment of the present application, the method comprising:

[0069] S101: Based on the correspondence between the ambient light brightness range and the lens transmittance, a target lens transmittance matching the currently acquired external ambient light brightness is determined.

[0070] The near-eye display device applicable to the embodiments of the present application may be AR glasses, AR head-mounted displays, etc.

[0071] In an embodiment of the present application, an optical sensor may be used to detect the brightness of the external ambient light, and the ambient light brightness data may be sent to an application processor of the near-eye display device in real time.

[0072] Different lens transmittances are suitable for different ambient light brightnesses. In the embodiment of the present application, a correspondence between different ambient light brightness ranges and lens transmittances that match them can be established in advance. After obtaining the external ambient light brightness, the transmittance that matches the external ambient light brightness can be determined based on the correspondence. For the sake of distinction, the transmittance that matches the external ambient light brightness can be referred to as the target lens transmittance.

[0073] In a specific implementation, different ambient light brightness levels can be divided according to different ambient light brightness ranges, and a lens transmittance corresponding to each brightness level can be recorded. Table 1 is a corresponding relationship list of lens transmittance, ambient light brightness level and ambient light brightness range provided in an embodiment of the present application.

[0074] Table 1

[0075] Lens transmittance Ambient light level Ambient light brightness range <![CDATA[T a ]]> <![CDATA[L a ]]> <![CDATA[L0<L≤L1]]> <![CDATA[T b ]]> <![CDATA[L b ]]> <![CDATA[L1<L≤L2]]> <![CDATA[T c ]]> <![CDATA[L c ]]> <![CDATA[L2<L≤L3]]> …… …… …… <![CDATA[T m ]]> <![CDATA[L m ]]> <![CDATA[L i-1 <L≤L i ]]> …… …… ……

[0076] Assuming that the obtained external ambient light brightness L is greater than L2 and less than L3, combined with Table 1, it can be determined that the ambient light brightness level corresponding to the external ambient light brightness is L c The lens transmittance matched by this grade is T c , so T c It is the target lens transmittance that matches the current ambient light brightness.

[0077] S102: Adjust the transmittance of the lens to a target lens transmittance.

[0078] In the embodiment of the present application, the lens with adjustable transmittance may be an electrochromic lens.

[0079] Electrochromic lenses can be made of solid electrochromic materials or liquid electrochromic materials, etc., and are controlled by the lens control component to adjust the intensity of ambient light passing through the lens into the human eye. After determining the target lens transmittance, the application processor of the near-eye display device can transmit the target lens transmittance to the lens control component so that the lens control component adjusts the lens transmittance to the target lens transmittance.

[0080] As the lens transmittance changes, the brightness of the ambient light entering the user's eyes will change. When the lens transmittance changes suddenly, it will cause a sudden change in the brightness of the user's eyes, causing discomfort to the user's glasses. Therefore, for this situation, the adjustment step length of the lens transmittance can be set in advance.

[0081] In a specific implementation, after the target lens transmittance is determined, the lens transmittance can be adjusted step by step to the target lens transmittance according to a set adjustment step.

[0082] For example, if the adjustment step is 5%, and the transmittance of the current lens is 50%, and the target lens transmittance is 30%, the transmittance of the lens can be reduced by 5% each time. After 4 adjustments, the transmittance of the lens will become 30%.

[0083] S103: Determine the virtual image display brightness according to the target lens transmittance, the external environment light brightness, the optical efficiency coefficient of the optical module and the contrast matching the current demand.

[0084] Contrast is used to characterize the difference in eye brightness between the virtual image display and the ambient light. Considering that the requirements for eye brightness may vary in different environments and functional requirements, a contrast list may be established in advance in a specific implementation, in which the contrasts corresponding to different environmental requirements and functional requirements may be recorded.

[0085] In actual applications, the application processor of the near-eye display device can trigger the display component to display a contrast list, so that the user can select a contrast that matches the current demand from the contrast list based on the current demand. In addition, the user can also input a demand instruction through the user interface provided by the near-eye display device, and the demand instruction can carry environmental requirements and functional requirements. After receiving the demand instruction, the application processor of the near-eye display device can query the contrast that matches the environmental requirements and functional requirements from the contrast list.

[0086] For example, when the ambient light brightness is greater than or equal to the range specified by the preset ambient light brightness level, the contrast ratio c between the virtual image display eye brightness and the ambient light eye brightness is greater than or equal to 1.2, which can satisfy the user's experience of the virtual image display effect of the near-eye display device in a high-brightness environment. When the ambient light brightness is lower than the range specified by the preset ambient light brightness level, the contrast ratio c between the virtual image display eye brightness and the ambient light eye brightness is greater than or equal to 2, which can satisfy the user's experience of the virtual image display effect of the near-eye display device in a low-brightness environment.

[0087] In the embodiment of the present application, the ambient light entering the eye brightness can be determined based on the target lens transmittance and the external ambient light brightness. The contrast characterizes the difference between the virtual image display entering the eye brightness and the ambient light entering the eye brightness. Therefore, after determining the ambient light entering the eye brightness, combined with the contrast, the virtual image display entering the eye brightness can be determined.

[0088] The virtual image display eye brightness is determined by the light efficiency coefficient of the optical module in the near-eye display device and the virtual image display brightness. Therefore, after determining the virtual image display eye brightness, combined with the light efficiency coefficient of the optical module, the virtual image display brightness can be determined.

[0089] S104: Adjusting the image brightness of the display module to the virtual image display brightness.

[0090] After determining the virtual image display brightness, the application processor of the near-eye display device may adjust the image brightness of the display module in the display component to the virtual image display brightness.

[0091] It can be seen from the above technical scheme that based on the correspondence between the ambient light brightness range and the lens transmittance, the target lens transmittance matching the currently acquired external ambient light brightness is determined; the lens transmittance will directly affect the ambient light brightness entering the eye, so the lens transmittance can be adjusted to the target lens transmittance, thereby ensuring that the brightness entering the human eye will not be too bright or too dark. According to the target lens transmittance, the external ambient light brightness, the optical efficiency coefficient of the optical module and the contrast matching the current demand, the virtual image display brightness is determined; wherein the contrast is used to characterize the difference in eye brightness between the virtual image display and the ambient light. The image brightness of the display module is adjusted to the virtual image display brightness, ensuring that the user has a clearer virtual image display when wearing a near-eye display device. In this technical scheme, the near-eye display device can dynamically adjust the lens transmittance by obtaining the external ambient light brightness, based on the correspondence between the ambient light brightness range and the lens transmittance, thereby controlling the brightness of the light entering the human eye to be within an appropriate range. In addition, the virtual image display brightness is determined based on the contrast that matches the current needs, achieving coordination between the virtual image display brightness and the ambient light brightness, and optimizing the user's experience of the virtual image display effect and optical perspective of the near-eye display device.

[0092] Figure 2 A flowchart of a method for determining virtual image display brightness provided in an embodiment of the present application, the method comprising:

[0093] S201: Determine the brightness of ambient light entering the eye based on the target lens transmittance and the brightness of the external ambient light.

[0094] In the embodiment of the present application, the product of the target lens transmittance and the external ambient light brightness can be used as the ambient light entering the eye brightness.

[0095] For example, when the transmittance T of the lens is 20%, the ambient light brightness L is 700cd / m 2 When the ambient light enters the eye, the brightness is B eye =T*L=700*20%=140cd / m 2 , that is, the brightness of the ambient light entering the human eye is 140cd / m 2 .

[0096] S202: Obtain a contrast ratio that matches current requirements.

[0097] Among them, current requirements may include environmental requirements and functional requirements.

[0098] Environmental requirements are used to indicate the environment in which the user is in when wearing the near-eye display device, for example, indoor environment, outdoor environment, etc.

[0099] Functional requirements are used to indicate the functions that users focus on when wearing near-eye display devices, for example, focusing on the effect of virtual image display or focusing on the viewing effect of the real environment.

[0100] Different users have different requirements for eye-catching brightness, which can include ambient light eye-catching brightness and virtual image display eye-catching brightness.

[0101] In the embodiment of the present application, the formula Calculate the contrast, where c represents the contrast, L eye Indicates the brightness of ambient light entering the eye, B eye Indicates the brightness of the virtual image as it appears to the eye.

[0102] In order to achieve coordination between the brightness of ambient light entering the eye and the brightness of virtual image display entering the eye, the contrast corresponding to different requirements can be established. After obtaining the current requirements, the matching contrast can be found.

[0103] S203: Determine the virtual image display brightness according to the ambient light entering the eye brightness, contrast, and the light efficiency coefficient of the optical module.

[0104] In the embodiment of the present application, based on the contrast and the ambient light entering the eye brightness, the virtual image display entering the eye brightness can be determined; the ratio of the virtual image display entering the eye brightness to the light efficiency coefficient of the optical module is used as the virtual image display brightness.

[0105] By combining the above contrast calculation formula and substituting the determined contrast and ambient light eye brightness into the formula, the virtual image display eye brightness can be obtained.

[0106] The optical module may be a Birdbath structure optical module, a Freeform structure optical module or an optical waveguide, etc. The light efficiency coefficient of the optical module in the near-eye display device is known information, so the virtual image display brightness is obtained by dividing the virtual image display brightness by the light efficiency coefficient.

[0107] Taking the near-eye display device as AR glasses as an example, the optical sensor on the AR glasses detects the ambient light brightness and sends the ambient light brightness data to the application processor of the AR glasses in real time. In a low-light environment, the contrast can be selected as 2. When the ambient light brightness value L is within the preset ambient light brightness level L a When within the range, the level L a If the range is L0<L≤L1, the application processor of the AR glasses controls the lens control component to adjust the transmittance level of the lens step by step to T a , that is, the ambient light brightness L eye =T a *L. At the same time, the application processor adjusts the image brightness of the display module in the display component to B panel , that is, Beye =η*B panel , so that the contrast between the virtual image brightness and the ambient light brightness is c = (L eye +B eye ) / L eye =(T a *L+η*B panel ) / (T a *L), where c≥c1. Generally speaking, c1 can be equal to 2.

[0108] In a high-brightness environment, the contrast ratio can be selected as 1.2. When the ambient light brightness value L' is at the preset ambient light brightness level l m When L i-1 <L'≤L i , the application processor of the AR glasses controls the lens control component to adjust the light transmittance level of the lens step by step to T m , that is, the ambient light brightness L' eye =T m *L'. At the same time, the application processor adjusts the image brightness of the display module of the display component to B' panel , that is, B' eye =η*B' panel , so that the contrast between the virtual image brightness and the ambient light brightness is c = (L' eye +B' eye ) / L' eye =(T a *L+η*B' panel ) / (T a *L'), where c ≥ c2. Generally speaking, c2 can be equal to 1.2.

[0109] In the embodiment of the present application, the ambient light entering the eye represents the intensity of the light from the outside world entering the human eye through the lens. By adjusting the transmittance of the lens, a better optical perspective experience can be provided to the user. The virtual image display entering the eye brightness represents the brightness of the image projected to the human eye by the near-eye display device through the display module in the display component. The virtual image display entering the eye brightness affects the virtual image display effect. By relying on contrast to determine the virtual image display brightness, a comprehensive consideration of the virtual image display effect and the optical perspective experience is achieved, so that the user can obtain a more comfortable visual experience.

[0110] Figure 3 A flow chart of a method for determining the transmittance of a target lens provided in an embodiment of the present application, the method comprising:

[0111] S301: Receive the brightness of external ambient light transmitted by an optical sensor.

[0112] The optical sensor can detect the brightness of the external environment light and send the external environment light brightness data to the application processor of the near-eye display device in real time.

[0113] S302: According to the demand instruction input by the user, a target correspondence relationship list of ambient light brightness range and lens transmittance matching the demand instruction is selected from a plurality of set correspondence relationship lists.

[0114] Each corresponding relationship list has its corresponding environmental requirements and functional requirements.

[0115] In different environments and with different functional needs, users have different requirements for virtual image display effects and optical perspective.

[0116] For example, in a dimly lit environment, when users watch movies through a near-eye display device, they will pay more attention to the virtual image display effect and have lower requirements for optical perspective. Therefore, in this case, the transmittance of the lens can be set lower and the display brightness of the display module can be set higher. In the same environment, when users wear a near-eye display device and want to communicate with other people in the environment, they will pay more attention to the optical perspective effect and have lower requirements for the virtual image display effect. Therefore, in this case, the transmittance of the lens can be set higher and the display brightness of the display module can be set lower.

[0117] Taking into account the differences in environments and functional requirements, users' requirements for virtual image display and optical perspective will also be different. Therefore, in an embodiment of the present application, a corresponding correspondence list can be constructed for different environments and different functional requirements, and the correspondence list records the lens transmittance matching different ambient light brightness ranges.

[0118] When the application processor of the near-eye display device obtains a demand instruction input by the user, it can select a target correspondence list of ambient light brightness range and lens transmittance that matches the demand instruction from multiple set correspondence lists based on the environment and function carried in the demand instruction.

[0119] S303: Query the target lens transmittance that matches the external ambient light brightness from the target correspondence list.

[0120] The target correspondence list records the lens transmittances that match different ambient light brightness ranges. Therefore, based on the target correspondence list, the ambient light brightness range to which the external ambient light brightness belongs can be determined, thereby determining the matching lens transmittance. For ease of distinction, the matching lens transmittance can be referred to as the target lens transmittance.

[0121] In actual applications, as the user's activity range changes, the user's environment may change. In order to adapt to environmental changes more intelligently, when changes in the user's environment are detected, the latest environmental requirements can be determined based on the environmental changes, and a target correspondence list of ambient light brightness range and lens transmittance that matches the latest environmental requirements can be selected from the set multiple correspondence lists.

[0122] For example, when a user wears a near-eye display device to watch a movie, if he enters a dark indoor environment from a bright outdoor environment, the environment is: a dark indoor environment; the functional requirement is: a high demand for virtual image display effect. According to the environment and functional requirements, a matching correspondence list can be obtained, and then the target lens transmittance that matches the current external ambient light brightness is determined based on the correspondence list.

[0123] In the embodiment of the present application, in addition to establishing a contrast list separately, the contrast can also be recorded in each correspondence list, that is, in addition to recording the lens transmittance matched with different ambient light brightness ranges, the correspondence list can also include the contrasts corresponding to different ambient light brightness ranges and different lens transmittances.

[0124] Correspondingly, after obtaining a target correspondence list of ambient light brightness ranges and lens transmittances matching the current requirement, the contrast in the target correspondence list that matches the external ambient light brightness can be used as the contrast that matches the current requirement.

[0125] In an embodiment of the present application, a corresponding correspondence list is established based on different needs, and the lens transmittance matching different ambient light brightness ranges is recorded in the correspondence list. When the eye brightness adjustment is required, the target lens transmittance required under the current demand can be quickly and accurately determined.

[0126] Figure 4 A schematic diagram of the structure of a device for adjusting the eye brightness of a near-eye display device provided in an embodiment of the present application, comprising a transmittance determining unit 41, a transmittance adjusting unit 42, a brightness determining unit 43 and a brightness adjusting unit 44;

[0127] The transmittance determination unit 41 is used to determine the target lens transmittance matching the currently acquired external ambient light brightness based on the corresponding relationship between the ambient light brightness range and the lens transmittance;

[0128] A transmittance adjustment unit 42, used to adjust the transmittance of the lens to a target lens transmittance;

[0129] The brightness determination unit 43 is used to determine the brightness of the virtual image display according to the target lens transmittance, the brightness of the external ambient light, the light efficiency coefficient of the optical module and the contrast matching the current demand; wherein the contrast is used to characterize the difference in eye brightness between the virtual image display and the ambient light;

[0130] The brightness adjustment unit 44 is used to adjust the image brightness of the display module to the virtual image display brightness.

[0131] Optionally, the brightness determination unit includes a first determination subunit, an acquisition subunit and a second determination subunit;

[0132] The first determination subunit is used to determine the brightness of the ambient light entering the eye based on the target lens transmittance and the brightness of the external ambient light;

[0133] An acquisition subunit, used to acquire a contrast ratio that matches current requirements; wherein the current requirements include environmental requirements and functional requirements;

[0134] The second determination subunit is used to determine the virtual image display brightness according to the ambient light entering the eye brightness, contrast and the light efficiency coefficient of the optical module.

[0135] Optionally, the second determining subunit is used to determine the virtual image display eye brightness based on the contrast and the ambient light eye brightness; and take the ratio of the virtual image display eye brightness to the light efficiency coefficient of the optical module as the virtual image display brightness.

[0136] Optionally, the transmittance determination unit includes a receiving subunit, a selecting subunit and a querying subunit;

[0137] A receiving subunit, used for receiving the brightness of external ambient light transmitted by the optical sensor;

[0138] A selection subunit is used to select a target correspondence list of ambient light brightness range and lens transmittance matching the demand instruction from a plurality of set correspondence lists according to the demand instruction input by the user; wherein each correspondence list has its corresponding environmental demand and functional demand;

[0139] The query subunit is used to query the target lens transmittance that matches the external ambient light brightness from the target correspondence list.

[0140] Optionally, it also includes a demand determination unit and a selection unit;

[0141] A demand determination unit, configured to determine the latest environmental demand based on the environmental change when a change in the environment in which the user is located is detected;

[0142] The selection unit is used to select a target correspondence list of ambient light brightness range and lens transmittance that matches the latest environmental requirements from a plurality of set correspondence lists.

[0143] Optionally, each correspondence list also includes contrasts corresponding to different ambient light brightness ranges and different lens transmittances;

[0144] Correspondingly, the acquisition subunit is used to use the contrast matching the external ambient light brightness in the target correspondence list as the contrast matching the current demand after acquiring the target correspondence list of ambient light brightness ranges and lens transmittances matching the current demand.

[0145] Optionally, the acquisition subunit is used to query a contrast ratio that matches the current requirement from a contrast ratio list; wherein the contrast ratio list includes contrast ratios corresponding to different environmental requirements and functional requirements.

[0146] Optionally, the transmittance adjustment unit is used to adjust the transmittance of the lens step by step to a target lens transmittance according to a set adjustment step.

[0147] Figure 4 The description of the features in the corresponding embodiments can be found in Figures 1 to 3 The relevant descriptions of the corresponding embodiments will not be repeated here one by one.

[0148] It can be seen from the above technical scheme that based on the correspondence between the ambient light brightness range and the lens transmittance, the target lens transmittance matching the currently acquired external ambient light brightness is determined; the lens transmittance will directly affect the ambient light brightness entering the eye, so the lens transmittance can be adjusted to the target lens transmittance, thereby ensuring that the brightness entering the human eye will not be too bright or too dark. According to the target lens transmittance, the external ambient light brightness, the optical efficiency coefficient of the optical module and the contrast matching the current demand, the virtual image display brightness is determined; wherein the contrast is used to characterize the difference in eye brightness between the virtual image display and the ambient light. The image brightness of the display module is adjusted to the virtual image display brightness, ensuring that the user has a clearer virtual image display when wearing a near-eye display device. In this technical scheme, the near-eye display device can dynamically adjust the lens transmittance by obtaining the external ambient light brightness, based on the correspondence between the ambient light brightness range and the lens transmittance, thereby controlling the brightness of the light entering the human eye to be within an appropriate range. In addition, the virtual image display brightness is determined based on the contrast that matches the current needs, achieving coordination between the virtual image display brightness and the ambient light brightness, and optimizing the user's experience of the virtual image display effect and optical perspective of the near-eye display device.

[0149] Figure 5 A schematic diagram of the structure of a near-eye display device provided in an embodiment of the present application includes an optical sensor 51, a lens 52, a lens control component 53, a display component 54 and an application processor 55; the display component 54 includes an optical module and a display module;

[0150] The optical sensor 51 is connected to the application processor 55 and is used to transmit the collected external ambient light brightness to the application processor 55;

[0151] The application processor 55 is connected to the lens control component 53 and the display component 54 respectively, and is used to determine the target lens transmittance that matches the currently acquired external ambient light brightness based on the corresponding relationship between the ambient light brightness range and the lens transmittance; transmit the transmittance adjustment instruction carrying the target lens transmittance to the lens control component 53; determine the virtual image display brightness according to the target lens transmittance, the external ambient light brightness, the optical efficiency coefficient of the optical module and the contrast that matches the current demand; adjust the image brightness of the display module to the virtual image display brightness; wherein the contrast is used to characterize the difference in eye brightness between the virtual image display and the ambient light;

[0152] The lens control component 53 is connected to the lens 52 and is used to adjust the transmittance of the lens 52 to the target lens transmittance after receiving a transmittance adjustment instruction carrying the target lens transmittance transmitted by the application processor 55 .

[0153] In a specific implementation, the optical module in the display component 54 may be a Birdbath structure optical module, a Freeform structure optical module or an optical waveguide, etc. The display module in the display component 54 may be a Miro-OLED, Miro-LED, LCOS optical machine or DPL optical machine, etc.

[0154] Different optical solutions have different light efficiency coefficients η of display modules. For example, the light efficiency coefficient η of an optical module with a Freeform structure is about 40%.

[0155] The display component 54 may include a structural support, which is mainly used to fix the optical module and the display module, and fix the display module to the overall structure of the near-eye display device. The optical module can project part of the light of the display module to the human eye. The projection method includes but is not limited to reflection, refraction, diffraction and the like.

[0156] Figure 5 The description of the features in the corresponding embodiments can be found in Figures 1 to 3 The relevant descriptions of the corresponding embodiments will not be repeated here one by one.

[0157] It can be seen from the above technical solution that the near-eye display device includes an optical sensor, a lens, a lens control component, a display component and an application processor; the display component includes an optical module and a display module. The optical sensor is connected to the application processor and is used to transmit the collected external ambient light brightness to the application processor. The application processor is connected to the lens control component and the display component respectively, and is used to determine the target lens transmittance matching the currently acquired external ambient light brightness based on the corresponding relationship between the ambient light brightness range and the lens transmittance; transmit the transmittance adjustment instruction carrying the target lens transmittance to the lens control component; determine the virtual image display brightness according to the target lens transmittance, the external ambient light brightness, the optical efficiency coefficient of the optical module and the contrast matching the current demand; adjust the image brightness of the display module to the virtual image display brightness; wherein the contrast is used to characterize the eye brightness difference between the virtual image display and the ambient light. The lens control component is connected to the lens, and is used to adjust the lens transmittance to the target lens transmittance after receiving the transmittance adjustment instruction carrying the target lens transmittance transmitted by the application processor. The transmittance of the lens will directly affect the brightness of the ambient light entering the eye. The transmittance of the lens is adjusted to the target lens transmittance to ensure that the brightness entering the human eye will not be too bright or too dark. The image brightness of the display module is adjusted to the virtual image display brightness to ensure that the user has a clearer virtual image display when wearing a near-eye display device. In addition, the virtual image display brightness is determined based on the contrast that matches the current needs, the target lens transmittance, and the brightness of the external ambient light, achieving coordination between the virtual image display brightness and the ambient light brightness, and optimizing the user's experience of the virtual image display effect and optical perspective of the near-eye display device.

[0158] The above is a detailed introduction to a method, device and near-eye display device for adjusting the eye brightness of a near-eye display device provided in an embodiment of the present application. The various embodiments in the specification are described in a progressive manner, and each embodiment focuses on the differences from other embodiments. The same and similar parts between the various embodiments can be referenced to each other. For the device disclosed in the embodiment, since it corresponds to the method disclosed in the embodiment, the description is relatively simple, and the relevant parts can be referred to the method part description.

[0159] Professionals may further appreciate that the units and algorithm steps of each example described in conjunction with the embodiments disclosed herein can be implemented in electronic hardware, computer software, or a combination of the two. In order to clearly illustrate the interchangeability of hardware and software, the composition and steps of each example have been generally described in the above description according to function. Whether these functions are performed in hardware or software depends on the specific application and design constraints of the technical solution. Professionals and technicians may use different methods to implement the described functions for each specific application, but such implementation should not be considered to be beyond the scope of this application.

[0160] The above is a detailed introduction to a method, device and near-eye display device for adjusting the eye brightness of a near-eye display device provided by the present application. This article uses specific examples to illustrate the principles and implementation methods of the present application. The description of the above embodiments is only used to help understand the method of the present application and its core idea. It should be pointed out that for ordinary technicians in this technical field, without departing from the principles of the present application, several improvements and modifications can be made to the present application, and these improvements and modifications also fall within the scope of protection of the claims of the present application.

Claims

1. A method for adjusting the brightness of a near-eye display device, characterized in that: include: Based on the corresponding relationship between the ambient light brightness range and the lens transmittance, determine the target lens transmittance that matches the currently acquired external ambient light brightness; Adjusting the transmittance of the lens to the target lens transmittance; Determine the virtual image display brightness according to the target lens transmittance, the ambient light brightness, the optical efficiency coefficient of the optical module, and the contrast matching the current demand; wherein the contrast is used to characterize the eye brightness difference between the virtual image display and the ambient light; The image brightness of the display module is adjusted to the virtual image display brightness.

2. The method for adjusting the near-eye display device eye brightness according to claim 1, characterized in that: Determining the virtual image display brightness according to the target lens transmittance, the ambient light brightness, the optical efficiency coefficient of the optical module, and the contrast matching the current demand includes: Determining the ambient light entering the eye brightness based on the target lens transmittance and the ambient light brightness; Obtaining a contrast ratio that matches current requirements; wherein the current requirements include environmental requirements and functional requirements; The virtual image display brightness is determined according to the ambient light entering the eye brightness, the contrast and the light efficiency coefficient of the optical module.

3. The method for adjusting the near-eye display device eye brightness according to claim 2, characterized in that: Determining the virtual image display brightness according to the ambient light entering the eye brightness, the contrast, and the light efficiency coefficient of the optical module includes: Determining the virtual image display eye brightness based on the contrast and the ambient light eye brightness; The ratio of the virtual image display eye brightness to the light efficiency coefficient of the optical module is used as the virtual image display brightness.

4. The method for adjusting the near-eye display device eye brightness according to claim 2, characterized in that: The step of determining the target lens transmittance that matches the currently acquired external ambient light brightness based on the correspondence between the ambient light brightness range and the lens transmittance includes: Receive the brightness of external ambient light transmitted by the optical sensor; According to the demand instruction input by the user, a target correspondence list of ambient light brightness range and lens transmittance matching the demand instruction is selected from a plurality of set correspondence lists; wherein each correspondence list has its corresponding environmental requirements and functional requirements; The target lens transmittance matching the external environment light brightness is searched from the target correspondence list.

5. The method for adjusting the near-eye display device eye brightness according to claim 4, characterized in that: After selecting a target correspondence list of ambient light brightness range and lens transmittance matching the demand instruction from a plurality of set correspondence lists according to the demand instruction input by the user, the method further includes: When a change in the user's environment is detected, the latest environmental requirements are determined based on the environmental changes, and a target correspondence list of ambient light brightness ranges and lens transmittances matching the latest environmental requirements is selected from a plurality of set correspondence lists.

6. The method for adjusting the near-eye display device eye brightness according to claim 4, characterized in that: Each correspondence list also includes the contrasts corresponding to different ambient light brightness ranges and different lens transmittances; Accordingly, obtaining a contrast ratio that matches the current requirement includes: After obtaining a target correspondence list of ambient light brightness ranges and lens transmittances matching the current requirement, the contrast in the target correspondence list that matches the external ambient light brightness is used as the contrast that matches the current requirement.

7. The method for adjusting the near-eye display device eye brightness according to claim 2, characterized in that: The obtaining of a contrast ratio matching the current requirement includes: A contrast ratio matching the current requirement is searched from a contrast ratio list; wherein the contrast ratio list includes contrast ratios corresponding to different environmental requirements and functional requirements.

8. The method for adjusting the eye brightness of a near-eye display device according to any one of claims 1 to 7, characterized in that: The step of adjusting the transmittance of the lens to the target lens transmittance comprises: According to the set adjustment step length, the transmittance of the lens is adjusted step by step to the target lens transmittance.

9. A device for adjusting the brightness of a near-eye display device, characterized in that: It includes a transmittance determining unit, a transmittance adjusting unit, a brightness determining unit and a brightness adjusting unit; The transmittance determination unit is used to determine the target lens transmittance that matches the currently acquired external ambient light brightness based on the corresponding relationship between the ambient light brightness range and the lens transmittance; The transmittance adjustment unit is used to adjust the transmittance of the lens to the target lens transmittance; The brightness determination unit is used to determine the virtual image display brightness according to the target lens transmittance, the external ambient light brightness, the optical efficiency coefficient of the optical module and the contrast matching the current demand; wherein the contrast is used to characterize the eye brightness difference between the virtual image display and the ambient light; The brightness adjustment unit is used to adjust the image brightness of the display module to the virtual image display brightness.

10. A near-eye display device, characterized in that: It includes an optical sensor, a lens, a lens control component, a display component and an application processor; the display component includes an optical module and a display module; The optical sensor is connected to the application processor and is used to transmit the collected external ambient light brightness to the application processor; The application processor is connected to the lens control component and the display component respectively, and is used to determine the target lens transmittance matching the currently acquired external ambient light brightness based on the corresponding relationship between the ambient light brightness range and the lens transmittance; transmit a transmittance adjustment instruction carrying the target lens transmittance to the lens control component; determine the virtual image display brightness according to the target lens transmittance, the external ambient light brightness, the optical efficiency coefficient of the optical module and the contrast matching the current demand; adjust the image brightness of the display module to the virtual image display brightness; wherein the contrast is used to characterize the difference in eye brightness between the virtual image display and the ambient light; The lens control component is connected to the lens, and is used to adjust the transmittance of the lens to the target lens transmittance after receiving a transmittance adjustment instruction carrying the target lens transmittance transmitted by the application processor.

Images