Display component, display control method, storage medium, and glasses

By introducing an adjustable light transmittance layer into the display components of the AR device and the MR device, and adjusting the light transmittance using the scene detection unit and the control unit, the problem of the light brightness mismatch between the virtual scene and the real ambient light is solved, and the display effect of the device is improved.

CN111399222BActive Publication Date: 2025-03-11GUANGDONG OPPO MOBILE TELECOMMUNICATIONS CORP LTD
View PDF 3 Cites 0 Cited by

Patent Information

Application Number
CN202010265266.4
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Filing Date
2020-04-07
Publication Date
2025-03-11
Estimated Expiration
2040-04-07

AI Technical Summary

Technical Problem

In AR devices and MR devices, the brightness of the virtual scene does not match the brightness of the light in the real environment, resulting in poor display effects.

Method used

A display component is designed, including a display unit, an adjustable light transmittance layer, a scene detection unit and a control unit. The scene detection unit acquires image data of the real environment, and the control unit adjusts the light transmittance of the adjustable light transmittance layer based on the virtual image data and the image data of the real environment, so as to adjust the brightness of the light transmitted through the display component.

Benefits of technology

By adjusting the light transmittance, the problem of mismatch between the light brightness of the virtual scene and the real ambient is solved, and the display effect of AR devices and MR devices is improved.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN111399222B_ABST
    Figure CN111399222B_ABST
Patent Text Reader

Abstract

The present disclosure relates to a display component and a display control method, a storage medium, and glasses. The display component includes a display unit, an adjustable light-transmitting layer, a scene detection unit, and a control unit. The display unit is used to display a virtual image; the adjustable light-transmitting layer is arranged on a side of the display unit away from a display light-emitting side; the scene detection unit is used to detect the brightness of light in a real environment; the control unit is respectively connected to the display unit, the adjustable light-transmitting layer, and the scene detection unit, and the control unit is used to control the transmittance of the adjustable light-transmitting layer according to the display brightness of the virtual image and the brightness of light in the real environment.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] The present disclosure relates to the technical field of electronic devices, and in particular to a display component and a display control method, a storage medium, and glasses. Background Art

[0002] An augmented reality (AR) device and a mixed reality (MR) device are often provided with a display device, which is used to display a virtual scene and has a light-transmitting function, so that light in a real environment can pass through.

[0003] At present, during the use of AR devices and MR devices, when the display device simultaneously presents the virtual scene and the real environment, there is often a problem of mismatch between the brightness of the virtual scene and the brightness of the light in the display scene, which leads to poor display effects of the AR devices and MR devices.

[0004] It should be noted that the information disclosed in the above background technology section is only used to enhance the understanding of the background of the present disclosure, and therefore may include information that does not constitute the prior art known to ordinary technicians in the field. Summary of the invention

[0005] The purpose of the present disclosure is to provide a display component and a display control method, a storage medium, and glasses, thereby at least to a certain extent overcoming the problem of poor display effects of AR devices and MR devices due to the mismatch between the brightness of the virtual scene and the brightness of the light in the display scene.

[0006] According to a first aspect of the present disclosure, a display assembly is provided, the display assembly comprising:

[0007] A display unit, wherein the display unit is used to display a virtual image;

[0008] An adjustable light-transmitting layer, the adjustable light-transmitting layer being arranged on a side of the display unit away from a display light-emitting side;

[0009] A scene detection unit, the scene detection unit is used to obtain image data of a real environment;

[0010] A control unit, wherein the control unit is connected to the display unit, the adjustable light-transmitting layer and the scene detection unit respectively, and the control unit is used to control the light transmittance of the adjustable light-transmitting layer according to the virtual image data and the image data of the real environment.

[0011] According to a second aspect of the present disclosure, a display control method is provided, which is used for the above-mentioned display component, and the display control method includes:

[0012] Acquire image data of a real environment and virtual image data;

[0013] Determine the scene of the real environment according to the image data of the real environment;

[0014] The transmittance of the adjustable light-transmitting layer is adjusted according to the image data of the real environment, the virtual image data and the scene preset brightness range, wherein the scene preset brightness range is the preset brightness range of the scene of the current real environment.

[0015] According to a third aspect of the present disclosure, a computer-readable storage medium is provided, on which a computer program is stored, and when the computer program is executed by a processor, the above method is implemented.

[0016] According to a fourth aspect of the present disclosure, a pair of glasses is provided, comprising the above-mentioned display assembly.

[0017] The display component provided by the embodiment of the present disclosure detects image data of the real environment through a scene detection unit, and the control unit controls the transmittance of the adjustable light-transmitting layer according to the virtual image data and the image data of the real environment, so as to adjust the brightness of the light passing through the display component through the adjustable light-transmitting layer, thereby at least to a certain extent overcoming the problem of poor display effects of AR devices and MR devices caused by the mismatch between the brightness of the virtual scene and the brightness of the light in the display scene, thereby improving the display effects of AR devices and MR devices.

[0018] It is to be understood that the foregoing general description and the following detailed description are exemplary and explanatory only and are not restrictive of the present disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] The accompanying drawings herein are incorporated into the specification and constitute a part of the specification, illustrate embodiments consistent with the present disclosure, and together with the specification are used to explain the principles of the present disclosure. Obviously, the accompanying drawings described below are only some embodiments of the present disclosure, and for ordinary technicians in this field, other accompanying drawings can be obtained based on these accompanying drawings without creative work.

[0020] Figure 1 A schematic structural diagram of a first display assembly provided by an exemplary embodiment of the present disclosure.

[0021] Figure 2 A schematic block diagram of a first display assembly provided for an exemplary embodiment of the present disclosure.

[0022] Figure 3 A schematic structural diagram of a first display unit provided by an exemplary embodiment of the present disclosure.

[0023] Figure 4 A schematic structural diagram of a second display assembly provided by an exemplary embodiment of the present disclosure.

[0024] Figure 5A schematic structural diagram of a third display assembly provided by an exemplary embodiment of the present disclosure.

[0025] Figure 6 A schematic diagram of a first electrode provided according to an exemplary embodiment of the present disclosure.

[0026] Figure 7 A schematic block diagram of a second display assembly provided for an exemplary embodiment of the present disclosure.

[0027] Figure 8 A schematic structural diagram of a fourth display assembly provided by an exemplary embodiment of the present disclosure.

[0028] Fig. 9 The present invention is a flowchart of a first display control method provided by an exemplary embodiment of the present disclosure.

[0029] Fig.10 A schematic diagram of a first computer-readable storage medium provided for exemplary embodiments of the present disclosure.

[0030] Fig.11 A schematic diagram of a pair of glasses provided according to an exemplary embodiment of the present disclosure.

[0031] In the figure:

[0032] 110. display unit; 111. optical waveguide; 112. image light source; 120. adjustable light-transmitting layer; 121. first electrode layer; 1211. first electrode unit; 122. electrochromic layer; 123. second electrode layer; 124. liquid crystal layer; 130. scene detection unit; 131. light sensor; 140. control unit; 141. controller; 142. adjustment drive circuit; 100. display component; 200. glasses leg; 300. frame. DETAILED DESCRIPTION

[0033] Example embodiments will now be described more fully with reference to the accompanying drawings. However, example embodiments can be implemented in a variety of forms and should not be construed as limited to the embodiments set forth herein; rather, these embodiments are provided so that the present invention will be comprehensive and complete and fully convey the concepts of the example embodiments to those skilled in the art. The same reference numerals in the figures represent the same or similar structures, and thus their detailed description will be omitted.

[0034] Although relative terms such as "upper" and "lower" are used in this specification to describe the relative relationship of one component of the illustration to another component, these terms are used in this specification only for convenience, such as according to the orientation of the examples described in the drawings. It is understood that if the device of the illustration is turned upside down, the component described as "upper" will become the component "lower". When a structure is "on" other structures, it may mean that the structure is formed integrally on the other structure, or that the structure is "directly" disposed on the other structure, or that the structure is "indirectly" disposed on the other structure through another structure.

[0035] In addition, the described features, structures or characteristics may be combined in one or more embodiments in any suitable manner. In the following description, many specific details are provided to provide a full understanding of the embodiments of the present disclosure. However, those skilled in the art will appreciate that the technical solutions of the present disclosure may be practiced without one or more of the specific details, or other methods, components, materials, devices, steps, etc. may be adopted. In other cases, known structures, methods, devices, implementations, materials or operations are not shown or described in detail to avoid blurring the various aspects of the present disclosure.

[0036] In this example implementation, a display component is first provided, such as Figure 1 and Figure 2 As shown, the display component includes: a display unit 110, an adjustable light-transmitting layer 120, a scene detection unit 130 and a control unit 140, the display unit 110 is used to display a virtual image; the adjustable light-transmitting layer 120 is arranged on the side of the display unit 110 away from the display light-emitting side; the scene detection unit 130 is used to obtain image data of a real environment; the control unit 140 is respectively connected to the display unit 110, the adjustable light-transmitting layer 120 and the scene detection unit 130, and the control unit 140 is used to control the transmittance of the adjustable light-transmitting layer 120 according to the virtual image data and the image data of the real environment.

[0037] The display component provided by the embodiment of the present disclosure detects image data in the real environment through the scene detection unit 130, and the control unit 140 controls the transmittance of the adjustable light-transmitting layer 120 according to the virtual image data and the image data of the real environment. The brightness of the light passing through the display component is adjusted through the adjustable light-transmitting layer 120, thereby at least to a certain extent overcoming the problem of poor display effects of AR devices and MR devices caused by the mismatch between the brightness of the virtual scene and the brightness of the light in the display scene, thereby improving the display effects of AR devices and MR devices.

[0038] The following is a detailed description of each part of the display assembly provided in the embodiment of the present disclosure:

[0039] The display mode of the display unit 110 provided in the embodiment of the present disclosure is optical perspective, and the user can observe the external real environment through the display unit 110, while the virtual scene is transmitted to the user's eyes through the optical structure of the display unit 110.

[0040] The display unit 110 may be a light waveguide 111 display unit, such as Figure 3 As shown, the display unit 110 may include an optical waveguide 111 and an image light source 112 . The optical waveguide 111 and the adjustable light-transmitting layer 120 are arranged in parallel. The image light source 112 is connected to the optical waveguide 111 , and the image light emitted by the image light source 112 forms a virtual image through the optical waveguide 111 .

[0041] The optical waveguide 111 may be a holographic optical waveguide 111 sheet. The holographic optical waveguide 111 allows parallel light of different viewing angles to enter the waveguide through total reflection, and allows the incident light to propagate along the first direction along the waveguide structure. Light of a single viewing field enters the glass substrate of the optical waveguide 111 through a glass prism. The incident angle of the light on the glass substrate is greater than the maximum total reflection critical angle of the glass substrate, so that the light propagates in the optical waveguide 111 in a total reflection manner.

[0042] A holographic grating can be added to the waveguide, and the parallel light in the waveguide will diffract when it enters the holographic grating. The wave vector direction angle of the complex amplitude of the light passing through the holographic grating can be controlled so that a portion of the light passing through the holographic grating each time is diffracted at a fixed angle and emitted from the waveguide through the holographic grating. The light that has not been diffracted continues to propagate in the glass film, which can reduce the loss of light energy and allow the exit pupil to be expanded. Alternatively, the diffraction efficiency of the holographic grating can be controlled so that the intensity of the light passing through the holographic grating is the same each time. For example, only one-tenth of the light intensity is emitted each time, and the diffraction efficiency of the manufactured holographic grating is 10%. In this way, the light output of the display unit 110 can be uniform, and a soft image can be obtained after the exit pupil is expanded.

[0043] When a holographic grating is used for coupling, the diffraction angle of the holographic grating at the coupling point is the same as the diffraction angle of the holographic grating inside the waveguide, which can ensure that the incident angle when entering the waveguide is the same as the exit angle when emitting from the waveguide, so that the field of view of the system is the same as the field of view of the collimator. The addition of the holographic grating will not affect the user's observation of the real scene.

[0044] The image light source 112 is connected to the optical waveguide 111. The image light source 112 emits light to the optical waveguide 111 according to the virtual image to be displayed by the display unit 110. The light passes through the optical waveguide 111 and is transmitted to the user's pupil, thereby realizing the display of the virtual scene. For example, the image light source 112 can be arranged at one end of the optical waveguide 111, and the direction in which the light of the image light source 112 is emitted is perpendicular to the surface of the optical waveguide 111. The light emitted by the image light source 112 is perpendicular to the optical waveguide 111, and is emitted at the user's pupil after total reflection of the optical waveguide 111 to display the virtual scene.

[0045] like Figure 4 As shown, the adjustable light transmission layer 120 includes: a first electrode layer 121, an electrochromic layer 122 and a second electrode layer 123. The first electrode layer 121 is arranged on a side of the display unit 110 away from the display light side; the electrochromic layer 122 is arranged on a side of the first electrode layer 121 away from the display unit 110; and the second electrode layer 123 is arranged on a side of the electrochromic layer 122 away from the first electrode layer 121. The light transmittance of the electrochromic layer 122 is adjusted by the electric field formed by the first electrode layer 121 and the second electrode layer 123.

[0046] The electrochromic layer 122 may include: an electrochromic material layer, an electrolyte layer and an ion storage layer, wherein the electrochromic material layer is arranged on a side of the first electrode away from the display unit 110; the electrolyte layer is arranged on a side of the electrochromic material layer away from the first electrode, for transmitting charged ions; the ion storage layer is arranged on a side of the electrolyte layer away from the electrochromic material layer, for storing charged ions.

[0047] Of course, in actual applications, the order of the electrochromic material layer, the electrolyte layer and the ion storage layer between the first electrode layer 121 and the second electrode layer 123 can also be that the electrochromic material layer is arranged on the side of the second electrode layer 123 close to the display unit 110, the electrolyte layer is arranged on the side of the electrochromic material layer close to the display unit 110, and the ion storage layer is arranged on the side of the electrolyte layer close to the display unit 110. The embodiments of the present disclosure do not make specific limitations on this.

[0048] The charged ions stored in the ion storage layer pass through the electrolyte layer and enter the electrochromic material layer in the electric field formed after the first electrode and the second electrode layer 123 are energized, so that the color of the electrochromic material layer changes. For example, the material of the electrochromic material layer is tungsten oxide (WO 3 ), the ion storage layer stores lithium ions, which enter the WO through the electrolyte layer 232 under the action of the electric field. 3 layer, forming tungsten bronze LiWO 3-x , resulting in W 6+ Restored to a low-priced W 5+ , the electrons from W 6+ To W5+ The interband transition absorbs photons and causes color change.

[0049] The first electrode layer 121 may be a cathode, and on this basis, the material of the electrochromic material layer may be a cathode color-changing material, and the material of the electrochromic material layer includes one or more metal oxides of Group VIB, such as tungsten oxide, molybdenum oxide, and chromium oxide.

[0050] It is understandable that the first electrode layer 121 can also be an anode, on this basis, the material of the electrochromic material layer includes one or more of Group VIII metal oxides and Pt group metal oxides or hydrates, such as nickel oxide, iridium oxide, cobalt oxide, rhodium oxide, manganese oxide, etc.

[0051] Of course, in practical applications, the electrochromic material layer can also be an organic electrochromic film. There are relatively many types of organic electrochromic films, which can be divided into two categories: organic small molecule electrochromic materials and conductive polymer electrochromic materials. Under the action of the electric field, the doping of conductive polymers in organic electrochromic films, the doping process of conductive polymers is a redox reversible process. In the doping process, the transition between the molecular conduction band and the valence band is triggered, including the transition of polar energy level, soliton energy level, bipolar energy level, and different energy levels of electrons, which causes different changes in the spectrum. The degree of doping is determined by controlling the voltage within a certain range, which leads to different absorption in the visible light region, showing changes in color and brightness, and electrochromic phenomena.

[0052] The material of the electrolyte layer may include one or more of a liquid electrolyte material, a gel electrolyte material, and a solid electrolyte material. The electrolyte is a transparent layer, and a transparent gel electrolyte material may be selected as the electrolyte layer material. For example, polyethylene oxide, polymethyl methacrylate, polyacrylonitrile, and polyvinylidene fluoride, etc. Since the gel electrolyte has a high ionic conductivity, the response speed of the adjustable light-transmitting layer 120 can be improved.

[0053] It is understandable that if Figure 5 As shown, the adjustable light-transmitting layer 120 may also include a first electrode layer 121, a liquid crystal layer 124 and a second electrode layer 123. The first electrode layer 121 is arranged on a side of the display unit 110 away from the display light-emitting side; the liquid crystal layer 124 is arranged on a side of the first electrode layer 121 away from the display unit 110; and the second electrode layer 123 is arranged on a side of the liquid crystal layer 124 away from the first electrode layer 121.

[0054] A spacer may be provided between the first electrode layer 121 and the second electrode layer 123, and the spacer can keep the first electrode layer 121 and the second electrode layer 123 at a preset distance to form a liquid crystal box. Liquid crystal is filled in the liquid crystal box to form a liquid crystal layer 124. When the display component is in use, the electric field formed by the first electrode layer 121 and the second electrode layer 123 drives the liquid crystal to deflect, thereby adjusting the light transmittance of the display component.

[0055] The first electrode layer 121 and the second electrode layer 123 may be transparent electrodes, for example, an ITO film. The material of the first electrode layer 121 may include one or more of silver, chromium, black chromium, ruthenium, stainless steel, titanium, nickel, molybdenum, nickel-chromium, chromium-nickel-inconel, indium, palladium, osmium, cobalt, cadmium, niobium, brass, bronze, tungsten, rhenium, iridium, aluminum, aluminum alloy, scandium, yttrium, zirconium, vanadium, manganese, iron, zinc, tin, lead, bismuth, antimony, rhodium, tantalum, copper, gold, platinum, platinum group metals and other suitable reflective materials, preferably one or more of copper, gold, platinum, aluminum, aluminum alloy, chromium, nickel, ruthenium, silver and silver alloy. The material of the second electrode layer 123 may include one or more of silver, chromium, black chromium, ruthenium, stainless steel, titanium, nickel, molybdenum, nickel-chromium, chromium-nickel-inconel, indium, palladium, osmium, cobalt, cadmium, niobium, brass, bronze, tungsten, rhenium, iridium, aluminum, aluminum alloy, scandium, yttrium, zirconium, vanadium, manganese, iron, zinc, tin, lead, bismuth, antimony, rhodium, tantalum, copper, gold, platinum, platinum group metals and other suitable reflective materials, preferably one or more of copper, gold, platinum, aluminum, aluminum alloy, chromium, nickel, ruthenium, silver and silver alloy, but the embodiments of the present disclosure are not limited thereto.

[0056] The first electrode layer 121 provided in the embodiment of the present disclosure may be an integral structure or a split structure, and the second electrode layer 123 may be an integral structure or a split structure. The first electrode layer 121 and the second electrode layer 123 may both be integral structures, or either of the first electrode layer 121 and the second electrode layer 123 may be a split structure.

[0057] For example, Figure 6 As shown, the first electrode layer 121 may include a plurality of first electrode units 1211, the plurality of first electrode units 1211 are distributed on the surface of the display unit 110, and the plurality of first electrode units 1211 are insulated from each other. The first electrode unit 1211 may be a rectangular structure, and the plurality of first electrode units 1211 are distributed in an array. Of course, in actual use, the second electrode layer 123 may also include a second electrode unit, the plurality of second electrode units are distributed on the surface of the display unit 110, and the plurality of second electrode units are insulated from each other. The second electrode unit may be a rectangular structure, and the plurality of second electrode units are distributed in an array.

[0058] By configuring the first electrode layer 121 or the second electrode layer 123 as a split structure, the brightness of the display area corresponding to each electrode unit can be controlled separately, which is beneficial to the application of the display component in different scenarios.

[0059] like Figure 7 As shown, the control unit 140 may include a controller 141 and an adjustment drive circuit 142, the controller 141 is respectively connected to the display unit 110 and the scene detection unit 130; the adjustment drive circuit 142 is respectively connected to the controller 141 and the first electrode, the controller 141 determines the target transmittance of the adjustable light-transmitting layer 120 according to the virtual image data and the image data of the real environment, and outputs a control signal according to the target transmittance of the adjustable light-transmitting layer 120, and the adjustment drive circuit 142 adjusts the transmittance of the adjustable light-transmitting layer 120 according to the control signal.

[0060] The controller 141 is used to obtain the brightness of the virtual image displayed by the display unit 110 and the detection result of the scene detection unit 130. The controller 141 can obtain the brightness of the virtual image by obtaining the grayscale of the virtual image displayed by the display unit 110. Alternatively, the controller 141 can obtain the electrical signal in the driving circuit of the display unit 110 to determine the brightness of the virtual image.

[0061] After acquiring the brightness of the virtual image and the brightness of the light in the real environment, the controller 141 determines the target transmittance of the adjustable light-transmitting layer 120 according to the brightness of the virtual image and the brightness of the light in the real environment, and determines the electric field loaded on the first electrode layer 121 and the second electrode layer 123 according to the target transmittance, and then adjusts the transmittance of the adjustable light-transmitting layer 120 to the target transmittance.

[0062] The regulating driving circuit 142 is connected to the first electrode, and the second electrode is connected to a power supply with a fixed potential, and the electric field between the first electrode layer 121 and the second electrode layer 123 is regulated by the regulating driving circuit 142. When the first electrode layer 121 includes a plurality of first electrode units 1211, each first electrode unit 1211 is correspondingly connected to an regulating driving circuit 142. The regulating driving circuit 142 may be disposed in the frame of the display component, or the display component may include a driving circuit layer, and the driving circuit layer may be disposed between the display unit 110 and the first electrode layer 121, and the regulating driving circuit 142 is disposed in the driving circuit layer.

[0063] When adjusting the light transmittance of the adjustable light-transmitting layer 120, the brightness of the external light passing through the adjustable light-transmitting layer 120 may be detected to determine whether the light brightness matches a preset brightness threshold; when the light brightness does not match the preset brightness threshold, the light transmittance of the adjustable light-transmitting layer 120 is adjusted. The preset brightness threshold may be a certain value stored in a storage device of the display component; or the preset brightness threshold may be a value related to the brightness of the virtual image, for example, the preset threshold may be a function of the brightness value of the virtual image.

[0064] The scene detection unit 130 may include a light detection subunit 131 and an image acquisition subunit 132. The image acquisition subunit 132 is connected to the control unit 140 and is used to acquire images of the real environment. The image acquisition subunit 132 may be a camera, which may be arranged on the display unit 110, or the camera may also be arranged on the legs of glasses, etc. The camera acquires images of the real environment and transmits the images of the real environment to the controller 141. The controller 141 determines the scene of the current real environment based on the images acquired by the camera. For example, the real scene is day or night, and sunny or cloudy. Different real environment scenes have different corresponding brightness threshold ranges. For example, the maximum brightness during the day cannot be less than a specified threshold. When adjusting the transmittance of the adjustable light-transmitting layer, it is necessary to ensure that the light passing through the adjustable light-transmitting layer is within the corresponding brightness threshold range.

[0065] The light detection subunit 131 includes a light sensor, which collects light signals in the real environment and converts the light signals into electrical signals, and transmits the electrical signals to the control unit 140. The light sensor is provided on the display unit 110, and the adjustable light-transmitting layer 120 covers the light-entering part of the light sensor, so that the light in the real environment enters the light sensor through the adjustable light-transmitting layer 120.

[0066] The light sensor can be disposed at an end of the display unit, such as the upper end or the lower end. The adjustable light-transmitting layer covers the display unit 110 and the light sensor. At this time, the light collected by the light sensor is the light passing through the adjustable light-transmitting layer 120. The light transmittance of the adjustable light-transmitting layer 120 is adjusted according to the relationship between the light passing through the adjustable light-transmitting layer 120 and the preset threshold value.

[0067] Alternatively, the light sensor is disposed in the adjustable light-transmitting layer 120, and the light-incoming portion of the light sensor is used to collect light from the real environment. In this case, the light sensor extends out of the adjustable light-transmitting layer 120 to directly collect light from the real environment.

[0068] like Figure 8As shown, the light-entering part of the light sensor is exposed to the adjustable light-transmitting layer 120. For example, the light sensor can be arranged at the end of the display unit 110, such as the upper end or the lower end. The light sensor can be provided with a through hole at the projection part of the adjustable light-transmitting layer 120 so that the external light can directly enter the light sensor. The through hole can be filled with a transparent material to protect the light sensor. Alternatively, the light sensor can be arranged on the upper side or the lower side of the adjustable light-transmitting layer 120, that is, the adjustable light-transmitting layer 120 is not arranged at the position where the light sensor is located.

[0069] The display component provided by the embodiment of the present disclosure detects the light intensity in the real environment through the scene detection unit 130, and the control unit 140 controls the transmittance of the adjustable light-transmitting layer 120 according to the image data and the virtual image data in the real environment. The brightness of the light passing through the display component is adjusted through the adjustable light-transmitting layer 120, thereby at least to a certain extent overcoming the problem of poor display effects of AR devices and MR devices caused by the mismatch between the brightness of the virtual scene and the brightness of the light in the display scene, thereby improving the display effects of AR devices and MR devices.

[0070] The exemplary embodiments of the present disclosure also provide a display control method, which is used for the above-mentioned display component, such as Fig. 9 As shown, the display control method may include the following steps:

[0071] Step S910, acquiring image data of a real environment and virtual image data.

[0072] Step S930: determining the scene of the real environment according to the image data of the real environment.

[0073] Step S950, adjusting the transmittance of the adjustable light-transmitting layer according to the image data of the real environment, the virtual image data and the scene preset brightness range, where the scene preset brightness range is the preset brightness range of the scene of the current real environment.

[0074] The display control method provided by the embodiment of the present disclosure detects real environment image data through light, controls the transmittance of the adjustable light-transmitting layer 120 according to the image data in the real environment and the virtual image data, and adjusts the brightness of the light passing through the display component through the adjustable light-transmitting layer 120, thereby at least to a certain extent overcoming the problem of poor display effects of AR devices and MR devices caused by the mismatch between the brightness of the virtual scene and the brightness of the light in the display scene, thereby improving the display effects of AR devices and MR devices.

[0075] In step S910, image data of a real environment and virtual image data may be acquired.

[0076] Among them, obtaining the image data of the real environment can obtain the image of the real environment and obtain the light brightness in the real environment. The image of the real environment can be obtained by a camera. The light brightness in the real environment can be obtained by a light sensor. The light brightness in the display scene obtained by the light sensor can be the brightness of the real environment directly detected, or the light sensor obtains the light of the real environment passing through the adjustable light-transmitting layer 120. In actual applications, the image data of the real environment can be obtained once at a preset time interval, for example, every 1 second, 3 seconds, 5 seconds or 1 minute.

[0077] The brightness of the virtual image may be obtained by obtaining the gray scale of the virtual image displayed by the display unit 110. Alternatively, the brightness of the virtual image may be determined by obtaining an electrical signal in a driving circuit of the display unit 110.

[0078] In step S930, the scene of the real environment may be determined based on the image data of the real environment.

[0079] The real environment may include a variety of scenes, such as night, day, cloudy, sunny, indoor and outdoor. Different environmental scenes correspond to different brightness ranges. In order to prevent the light passing through the adjustable light-transmitting layer from exceeding the preset range of the scene when the adjustable light-transmitting layer is adjusted, the scene of the real environment needs to be determined.

[0080] The image of the real environment can be captured by the camera, and the image of the real environment can be transmitted to the controller 141. The controller 141 determines the scene of the current real environment based on the image captured by the camera. For example, the real scene is daytime, nighttime, sunny or cloudy. Different real environment scenes have different corresponding brightness threshold ranges. For example, the maximum brightness during the day cannot be less than a specified threshold. In actual applications, the scene preset brightness range corresponding to the scene of the real environment can be stored as a mapping in the storage device of the display device. When adjusting the transmittance of the adjustable light-transmitting layer, the stored mapping is called to determine the scene preset brightness range.

[0081] In step S950, the transmittance of the adjustable light-transmitting layer may be adjusted according to the image data of the real environment, the virtual image data, and the preset brightness range of the scene of the real environment.

[0082] Adjusting the transmittance of the adjustable light-transmitting layer can be achieved in the following manner: determining the difference between the brightness of the virtual image and the brightness of the light in the real environment; when the absolute value of the difference between the brightness of the virtual image and the brightness of the light in the real environment is greater than a preset threshold, determining the brightness of the target real environment so that the difference between the brightness of the virtual image and the brightness of the target real environment is less than or equal to the preset threshold; when the brightness of the target real environment is within the preset brightness range of the scene, adjusting the transmittance of the adjustable light-transmitting layer so that the brightness of the light of the real environment passing through the adjustable light-transmitting layer is the brightness of the target real environment; when the brightness of the target real environment is outside the preset brightness range of the scene, adjusting the transmittance of the adjustable light-transmitting layer so that the brightness of the light of the real environment passing through the adjustable light-transmitting layer is the first boundary value of the preset brightness range of the scene, and the first boundary value is the boundary value of the scene preset brightness range close to the brightness of the target real environment.

[0083] When the absolute value of the difference between the brightness of the virtual image and the brightness of the light in the real environment is greater than a preset threshold, it may cause discomfort to the user's eyes. Specifically, the preset threshold can be determined based on experiments or experience. When the absolute value of the difference between the brightness of the virtual image and the brightness of the light in the real environment is less than or equal to the preset threshold, the transmittance of the adjustable light-transmitting layer is not adjusted.

[0084] When adjusting the light transmittance of the adjustable light-transmitting layer, it is necessary to take into account the scene of the real environment to avoid distortion of the scene of the real environment after adjusting the adjustable light-transmitting layer. Therefore, when adjusting the adjustable light-transmitting layer, when the display environment light passing through the adjustable light-transmitting layer is within the scene preset brightness range, it is considered that there is no problem with the adjustment; when the display environment light passing through the adjustable light-transmitting layer is outside the scene preset brightness range, it is necessary to make corrections so that the brightness of the adjustable light-transmitting layer after adjustment is within the limit of the scene preset brightness range, thereby solving the partial difference between the brightness of the virtual image and the brightness of the display light, and avoiding distortion of the scene of the real environment.

[0085] When the brightness of light in the real environment is greater than the preset brightness threshold of the virtual image, the transmittance of the adjustable light-transmitting layer 120 is reduced; when the brightness of light in the real environment is less than the preset brightness threshold of the virtual image, the transmittance of the adjustable light-transmitting layer 120 is increased.

[0086] The display control method provided by the embodiment of the present disclosure detects the light intensity in the real environment through light, controls the transmittance of the adjustable light-transmitting layer 120 according to the brightness of the light in the real environment and the brightness of the virtual image, and adjusts the brightness of the light passing through the display component through the adjustable light-transmitting layer 120, thereby at least to a certain extent overcoming the problem of poor display effects of AR devices and MR devices caused by the mismatch between the brightness of the virtual scene and the brightness of the light in the display scene, thereby improving the display effects of AR devices and MR devices.

[0087] It should be noted that, although the steps of the method in the present disclosure are described in a specific order in the drawings, this does not require or imply that the steps must be performed in this specific order, or that all the steps shown must be performed to achieve the desired results. Additionally or alternatively, some steps may be omitted, multiple steps may be combined into one step, and / or one step may be decomposed into multiple steps, etc.

[0088] In an exemplary embodiment of the present disclosure, a computer-readable storage medium is also provided, on which a program product capable of implementing the above method of the present specification is stored. In some possible embodiments, various aspects of the present invention can also be implemented in the form of a program product, which includes a program code, and when the program product is run on a terminal device, the program code is used to enable the terminal device to perform the steps according to various exemplary embodiments of the present invention described in the above "Exemplary Method" section of the present specification.

[0089] refer to Fig.10 As shown, a program product 1100 for implementing the above method according to an embodiment of the present invention is described, which can adopt a portable compact disk read-only memory (CD-ROM) and include program code, and can be run on a terminal device, such as a personal computer. However, the program product of the present invention is not limited thereto. In this document, a readable storage medium can be any tangible medium containing or storing a program, which can be used by or in combination with an instruction execution system, an apparatus or a device.

[0090] The program product may use any combination of one or more readable media. The readable medium may be a readable signal medium or a readable storage medium. The readable storage medium may be, for example, but not limited to, an electrical, magnetic, optical, electromagnetic, infrared, or semiconductor system, device or device, or any combination of the above. More specific examples (non-exhaustive list) of readable storage media include: an electrical connection with one or more wires, a portable disk, a hard disk, a random access memory (RAM), a read-only memory (ROM), an erasable programmable read-only memory (EPROM or flash memory), an optical fiber, a portable compact disk read-only memory (CD-ROM), an optical storage device, a magnetic storage device, or any suitable combination of the above.

[0091] Computer readable signal media may include data signals propagated in baseband or as part of a carrier wave, in which readable program code is carried. Such propagated data signals may take a variety of forms, including but not limited to electromagnetic signals, optical signals, or any suitable combination of the above. Readable signal media may also be any readable medium other than a readable storage medium, which may send, propagate, or transmit a program for use by or in conjunction with an instruction execution system, apparatus, or device.

[0092] The program code embodied on the readable medium may be transmitted using any appropriate medium, including but not limited to wireless, wired, optical cable, RF, etc., or any suitable combination of the foregoing.

[0093] Program code for performing the operations of the present invention may be written in any combination of one or more programming languages, including object-oriented programming languages ​​such as Java, C++, etc., and conventional procedural programming languages ​​such as "C" or similar programming languages. The program code may be executed entirely on the user computing device, partially on the user device, as a separate software package, partially on the user computing device and partially on a remote computing device, or entirely on a remote computing device or server. In cases involving a remote computing device, the remote computing device may be connected to the user computing device through any type of network, including a local area network (LAN) or a wide area network (WAN), or may be connected to an external computing device (e.g., through the Internet using an Internet service provider).

[0094] The exemplary embodiments of the present disclosure also provide a pair of glasses, such as Fig.11 As shown, the glasses may include the above-mentioned display assembly.

[0095] Furthermore, the glasses may also include a frame 300 and temples 200 , and the display assembly 100 is disposed on the frame 300 ; the temples 200 are connected to the frame 300 , and the temples 200 can rotate relative to the frame 300 .

[0096] It should be noted that the glasses provided in the embodiments of the present disclosure may be AR glasses or MR glasses. By providing an adjustable light-transmitting layer on the side of the glasses away from the user, the brightness of the light of the real environment entering the glasses can be adjusted, so that the brightness of the real scene and the virtual scene is balanced.

[0097] Those skilled in the art will readily appreciate other embodiments of the present disclosure after considering the specification and practicing the invention disclosed herein. This application is intended to cover any modification, use or adaptation of the present disclosure, which follows the general principles of the present disclosure and includes common knowledge or customary techniques in the art that are not disclosed in the present disclosure. The specification and examples are intended to be exemplary only, and the true scope and spirit of the present disclosure are indicated by the appended claims.

Claims

1. A display component, characterized in that: The display assembly comprises: A display unit, wherein the display unit is used to display a virtual image; An adjustable light-transmitting layer, the adjustable light-transmitting layer being arranged on a side of the display unit away from a display light-emitting side; A scene detection unit, the scene detection unit is used to obtain image data of a real environment; A control unit, the control unit being connected to the display unit, the adjustable light-transmitting layer and the scene detection unit respectively, and the control unit being used to control the light transmittance of the adjustable light-transmitting layer according to the virtual image data and the image data of the real environment; The control unit is used for: Acquire image data of a real environment and virtual image data; Determine the scene of the real environment according to the image data of the real environment; Determine the difference between the brightness of the virtual image and the brightness of light in the real environment; When the absolute value of the difference between the brightness of the virtual image and the brightness of the light in the real environment is greater than a preset threshold, determining the brightness of the target real environment so that the difference between the brightness of the virtual image and the brightness of the target real environment is less than or equal to the preset threshold; When the target real environment brightness is within the preset brightness range of the scene, adjusting the transmittance of the adjustable light-transmitting layer so that the brightness of the light of the real environment passing through the adjustable light-transmitting layer is the target real environment brightness; When the target real environment brightness is outside the scene preset brightness range, the transmittance of the adjustable light-transmitting layer is adjusted so that the brightness of the light of the real environment passing through the adjustable light-transmitting layer is the first boundary value of the scene preset brightness range, and the first boundary value is the boundary value of the scene preset brightness range close to the target real environment brightness.

2. The display assembly according to claim 1, wherein: The adjustable light-transmitting layer comprises: A first electrode layer, the first electrode layer is arranged on a side of the display unit away from a display light emitting side; an electrochromic layer, the electrochromic layer being disposed on a side of the first electrode layer away from the display unit; The second electrode layer is arranged on a side of the electrochromic layer away from the first electrode layer.

3. The display assembly according to claim 1, wherein: The adjustable light-transmitting layer comprises: A first electrode layer, the first electrode layer is arranged on a side of the display unit away from a display light emitting side; a liquid crystal layer, the liquid crystal layer being disposed on a side of the first electrode layer away from the display unit; The second electrode layer is arranged on a side of the liquid crystal layer away from the first electrode layer.

4. The display assembly according to claim 2 or 3, characterized in that: The first electrode layer comprises: A plurality of first electrode units are distributed on the surface of the display unit and are insulated from each other.

5. The display assembly according to claim 4, characterized in that The control unit comprises: A controller, the controller being connected to the display unit and the scene detection unit respectively; An adjusting drive circuit, wherein the adjusting drive circuit is respectively connected to the controller and the first electrode layer, the controller determines a target transmittance of the adjustable light-transmitting layer according to the virtual image data and the image data of the real environment, and outputs a control signal according to the target transmittance of the adjustable light-transmitting layer, and the adjusting drive circuit adjusts the transmittance of the adjustable light-transmitting layer according to the control signal.

6. The display assembly according to claim 1, wherein: The display unit comprises: An optical waveguide sheet, wherein the optical waveguide sheet and the adjustable light-transmitting layer are arranged in parallel; An image light source is connected to the optical waveguide sheet, and image light emitted by the image light source forms a virtual image through the optical waveguide sheet.

7. The display assembly according to claim 1, wherein: The scene detection unit comprises: An image acquisition subunit, connected to the control unit and used to acquire images of a real environment; A light detection subunit, wherein the light detection subunit is connected to the control unit and is used to detect the light intensity in the real environment.

8. The display assembly according to claim 7, characterized in that The light detection subunit comprises: A light sensor is arranged on the display unit, and the adjustable light-transmitting layer covers the light-entering part of the light sensor, so that the light in the real environment enters the light sensor through the adjustable light-transmitting layer.

9. The display assembly according to claim 7, characterized in that: The light detection subunit comprises: A light sensor, wherein the light sensor is arranged on the adjustable light-transmitting layer, and the light-incoming part of the light sensor is used to collect light in the real environment. 10 . A computer-readable storage medium having a computer program stored thereon, wherein the computer program, when executed by a processor, implements the display control method of the display component according to claim 1 .

11. A pair of glasses, characterized in that: The glasses include the display assembly according to any one of claims 1-9.

12. The glasses according to claim 11, characterized in that The glasses also include: a frame, wherein the display assembly is arranged on the frame; The glasses legs are connected to the frame and can rotate relative to the frame.

Citation Information

Patent Citations

  • Head-mounted display equipment, control method and storage medium

    CN110187508A

  • AR glasses and wearable system

    CN110346935A

  • Display assembly and glasses

    CN212135067U