Display picture adjusting method and device, head-mounted display equipment and storage medium

Abstract

The invention discloses a display picture adjusting method and device, head-mounted display equipment and a storage medium, and relates to the technical field of optics. The method comprises the steps that the head-mounted display equipment detects a light leakage electric signal of a display waveguide through a photoelectric detector; if the light leakage electric signal is not matched with a preset electric signal, the driving current of the RGB light source is adjusted so that a light beam output by the adjusted RGB light source can be coupled out to the human eye through the display waveguide to achieve white balance display, and the preset electric signal is a preset signal when the light machine modulates the incident light beam to display a full-white picture. The photoelectric detector detects a light leakage electric signal of the display waveguide, and the incident light beam is the light beam output by the RGB light source. Thus, the leaked light beam of the display waveguide is reused, and the driving current of the RGB light source is adjusted in time, so that the light beam output by the adjusted RGB light source is coupled out to the human eyes through the display waveguide to realize white balance display, and the accuracy and balance of the color of a display picture seen by the human eyes are ensured.

Description

Technical Field

[0001] This application relates to the field of optical technologies, and in particular, to a method and device for adjusting a display screen, a head-mounted display device, and a storage medium. Background Art

[0002] In the related art, as the usage time of a head-mounted display device increases, the light source of the device will age, resulting in a decline in the brightness of the light source under the same driving current, and the brightness attenuation rates of the RGB three-color light sources are inconsistent, thereby causing a problem of color deviation in the display screen presented to the user by the head-mounted display device. Summary of the Invention

[0003] This application provides a method and device for adjusting a display screen, a head-mounted display device, and a storage medium to avoid the problem of color deviation in the display screen.

[0004] In a first aspect, an embodiment of this application provides a method for adjusting a display screen, which is applied to a head-mounted display device. The head-mounted display device includes an RGB light source, an optical engine, a display waveguide, and a photodetector. The method includes: detecting, by the photodetector, a light leakage electrical signal of the display waveguide; if the light leakage electrical signal does not match a preset electrical signal, adjusting a driving current of the RGB light source so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to the human eye to achieve white balance display, where the preset electrical signal is the light leakage electrical signal of the display waveguide detected by the photodetector when the optical engine modulates an incident light beam to display a full-white screen, and the incident light beam is the light beam output by the RGB light source.

[0005] In a second aspect, an embodiment of this application provides a device for adjusting a display screen, which is applied to a head-mounted display device. The head-mounted display device includes an RGB light source, an optical engine, a display waveguide, and a photodetector. The device includes: a light leakage signal detection module, configured to detect, by the photodetector, a light leakage electrical signal of the display waveguide; a light source adjustment module, configured to adjust a driving current of the RGB light source if the light leakage electrical signal does not match a preset electrical signal so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to the human eye to achieve white balance display, where the preset electrical signal is the light leakage electrical signal of the display waveguide detected by the photodetector when the optical engine modulates an incident light beam to display a full-white screen, and the incident light beam is the light beam output by the RGB light source.

[0006] In a third aspect, an embodiment of the present application provides a head-mounted display device, including: one or more processors; a memory; one or more programs, where the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the above-mentioned method.

[0007] In a fourth aspect, an embodiment of the present application provides a computer-readable storage medium, in which program code is stored, and the program code can be called by a processor to execute the above-mentioned method.

[0008] In the solution provided by the present application, the head-mounted display device detects the light leakage electrical signal of the display waveguide through the photodetector; if the light leakage electrical signal does not match a preset electrical signal, the drive current of the RGB light source is adjusted so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to the human eye to achieve white balance display. The preset electrical signal is the light leakage electrical signal detected by the photodetector when the optical engine modulates the incident light beam to display a full-white picture, and the incident light beam is the light beam output by the RGB light source. In this way, the reuse of the leaked light beam of the display waveguide is realized. When the light leakage electrical signal detected by the photodetector at the light leakage location does not match the preset electrical signal detected during the white balance of the display picture, the drive current of the RGB light source is adjusted in a timely manner so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to the human eye to achieve white balance display; that is, it ensures the accuracy and balance of the color of the display picture seen by the human eye, and improves the picture display quality and user experience of the head-mounted display device. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] In order to more clearly illustrate the technical solutions in the embodiments of the present application, the following will briefly introduce the drawings required for the description of the embodiments. Obviously, the following drawings are only some embodiments of the present application. For those skilled in the art, without creative efforts, other drawings can be obtained based on these drawings.

[0010] Figure 1 FIG. shows a schematic system architecture diagram of an adjustment system for picture display provided by an embodiment of the present application.

[0011] Figure 2 FIG. shows a schematic system architecture diagram of another adjustment system for picture display provided by an embodiment of the present application.

[0012] Figure 3 FIG. shows a schematic system architecture diagram of another adjustment system for picture display provided by an embodiment of the present application.

[0013] Figure 4It shows a schematic diagram of the system architecture of another screen display adjustment system provided by an embodiment of the present application.

[0014] Figure 5 It shows a schematic flowchart of a method for adjusting a display screen provided by an embodiment of the present application.

[0015] Figure 6 It shows a schematic flowchart of a method for adjusting a display screen provided by another embodiment of the present application.

[0016] Figure 7 It shows a schematic diagram of the optical path for a photodetector to detect RGB three-color light provided by an embodiment of the present application.

[0017] Figure 8 It shows a schematic diagram of another optical path for a photodetector to detect RGB three-color light provided by an embodiment of the present application.

[0018] Figure 9 It shows a schematic flowchart of a method for adjusting a display screen provided by still another embodiment of the present application.

[0019] Figure 10 It shows a schematic flowchart of a method for adjusting a display screen provided by yet another embodiment of the present application.

[0020] Figure 11 It shows a schematic diagram of the structure of a photodetector provided by an embodiment of the present application.

[0021] Figure 12 It shows a schematic diagram of the structure of another photodetector provided by an embodiment of the present application.

[0022] Figure 13 It is a block diagram of an apparatus for adjusting a display screen provided by an embodiment of the present application.

[0023] Figure 14 It is a block diagram of a head-mounted display device for executing a method for adjusting a display screen according to an embodiment of the present application.

[0024] Figure 15 It is a storage unit for storing or carrying program codes for implementing a method for adjusting a display screen according to an embodiment of the present application. Detailed implementation manners

[0025] To enable those skilled in the art to better understand the solution of this application, the following will clearly and completely describe the technical solution in the embodiments of this application with reference to the accompanying drawings in the embodiments of this application. Obviously, the described embodiments are only a part of the embodiments of this application, rather than all the embodiments. Based on the embodiments in this application, all other embodiments obtained by those of ordinary skill in the art without creative efforts belong to the scope of protection of this application.

[0026] It should be noted that in some processes described in the specification, claims and the above-mentioned accompanying drawings of this application, there are multiple operations that appear in a specific order. These operations may not be executed in the order in which they appear in this article or may be executed in parallel. The serial numbers of the operations, such as S110, S120, etc., are only used to distinguish different operations, and the serial numbers themselves do not represent any execution order. In addition, these processes may include more or fewer operations, and these operations may be executed in sequence or in parallel. Also, the terms "first", "second", etc. in the specification, claims and the above-mentioned accompanying drawings of this application are used to distinguish similar objects and do not necessarily need to describe a specific order or sequence. It should be understood that such data can be interchanged under appropriate circumstances so that the embodiments of this application described here can be implemented in an order other than those illustrated or described here. In addition, the terms "including" and "having" and any variations thereof are intended to cover non-exclusive inclusion. For example, a process, method, system, product or server that includes a series of steps or sub-modules does not necessarily have to be limited to those steps or sub-modules clearly listed, but may include other steps or sub-modules that are not clearly listed or are inherent to these processes, methods, products or devices.

[0027] The inventor proposes a method, device, head-mounted display device and storage medium for adjusting a display screen. The following will describe in detail the method for adjusting a display screen provided in the embodiments of this application.

[0028] Please refer to Figure 1 , Figure 1 FIG. 13 shows an adjustment system 10 for a display screen provided in an embodiment of this application. The adjustment system 10 for a display screen is applied to a head-mounted display device. Among them, the adjustment system 10 for a display screen may include an RGB light source 110, an optical engine 120, a display waveguide 130, and a photodetector 140. The display waveguide 130 includes a light beam coupling-in area and a light beam coupling-out area.

[0029] In this embodiment, the head-mounted display device includes, but is not limited to, a head-mounted display device of the Augmented Reality (AR) type, a head-mounted display device of the Virtual Reality (VR) type, and a head-mounted display device of the Extended Reality (XR) type.

[0030] Optionally, the RGB light source 110 may be a light-emitting diode or other light-emitting light sources such as a laser diode. The RGB light source 110 essentially includes a red light source, a green light source, and a blue light source. Each color light source is driven to emit light by a different current. Moreover, the greater the driving current, the greater the luminous power, that is, the greater the luminous brightness of the light source. The RGB light source 110 is used to output three-color light beams, namely, red light beam, green light beam, and blue light beam. The three-color light beams are incident into the optical engine 120. The optical engine 120 can modulate the three-color light beams, divide the light spot formed by the three-color light beams into multiple pixels, and control the brightness and darkness of each pixel, thereby realizing the display of different images. Further, the optical engine 120 couples the modulated light beam (i.e., the light beam with image information) into the light beam coupling-in area of the display waveguide 130. The coupled light beam can be totally reflected and transmitted inside the waveguide 130. Finally, the modulated light beam is coupled out by the light beam coupling-out area of the waveguide 130 and enters the human eye, that is, a display screen is formed in the human eye.

[0031] In practical applications, the light beam coupling-in area of the display waveguide 130 utilizes the principle of a grating. Most of the light energy enters the waveguide for transmission along the direction of the first-order or minus-first-order diffraction and satisfies the total internal reflection condition inside the waveguide. A small part of the light energy travels along the zero-order diffraction direction. Since the zero-order diffraction does not change the light transmission direction, the zero-order diffracted light does not satisfy the total internal reflection condition of the waveguide and will exit from the other side of the waveguide. That is to say, during the process of the light beam output by the RGB light source 110 being transmitted to the human eye, the light propagation efficiency is not 100%, and some light beams will leak.

[0032] Based on this, in some embodiments, such as Figure 1As shown, the beam coupling-in region can be set on the first side of the display waveguide 130; the photodetector 140 is attached to the second side of the display waveguide 130, and both the beam coupling-in region and the photodetector 140 are in the light output direction of the optical engine 120. In this way, the photodetector 140 can collect part of the light signal of the 0th-order diffraction and convert the light signal into an electrical signal, so that the light power can be calculated by detecting the electrical signal. The ratio of the light power of the RGB light source 110 to the light power collected by the photodetector 140 is usually constant. Therefore, the light power value of the light source can be simply calculated according to the value of the electrical signal. Based on this, the optical engine 120 can be pre-controlled to modulate the incident light beam to display a full-white screen. Then, the photodetector 140 is used to detect the light leakage electrical signal of the display waveguide and store the light leakage electrical signal as a preset electrical signal. Further, during the subsequent use of the head-mounted display device, to avoid the aging of the RGB light source as the usage time increases, that is, it is still driven with a preset driving current, but the light beam emitted by the RGB light source cannot reach the required brightness, resulting in the final display screen projected onto the human eye not meeting the preset requirements, such as the brightness not meeting the standard or the color of the display screen having color differences. Based on this, the head-mounted display device can detect the light leakage electrical signal of the display waveguide 130 through the photodetector 140; if the light leakage electrical signal does not match the preset electrical signal, the driving current of the RGB light source 110 is adjusted so that the light beam output by the adjusted RGB light source 110 is coupled out through the display waveguide to the human eye to achieve white balance display, that is, the color of the display screen seen by the human eye has no color difference.

[0033] In some other embodiments, considering that there is generally also light leaking out at the end of the waveguide coupling-out region, therefore, as Figure 2 shown, the photodetector 140 can also be attached to the end of the side where the beam coupling-out region of the display waveguide 130 is located.

[0034] As Figure 1 and Figure 2 shown, generally two display waveguides 130 are provided in the head-mounted display device, one display waveguide 130 corresponds to the left eye of a person, and one display waveguide 130 corresponds to the right eye of a person. In this embodiment, for the photodetectors 140 provided for the two display waveguides 130, they can all be as Figure 1 shown, attached to the second side of the display waveguide 130, or as Figure 2 shown, all provided at the end of the side where the beam coupling-out region is located. In addition, it can also be as Figure 3As shown in the figure, the photodetector 140 corresponding to the display waveguide 130 of the left eye is arranged on the second side of the display waveguide 130, while the photodetector 140 corresponding to the display waveguide 130 of the right eye is attached to the end of the side where the light beam coupling-out area of the display waveguide 130 is located. Optionally, it can also be as Figure 4 shown that the photodetector 140 corresponding to the display waveguide 130 of the right eye is arranged on the second side of the display waveguide 130, while the photodetector 140 corresponding to the display waveguide 130 of the left eye is attached to the end of the side where the light beam coupling-out area of the display waveguide 130 is located.

[0035] It can be seen that the photodetector 140 can be arranged at any light leakage point of the waveguide 130. The specific light leakage points of different waveguides may also be different. The technical solutions in which the photodetector 140 is arranged at the light leakage points other than those exemplified in this embodiment are still within the protection scope of this application, and will not be elaborated one by one here.

[0036] Please refer to Figure 5 , Figure 5 which is a schematic flowchart of a method for adjusting a display screen provided in an embodiment of this application, and is applied to a head-mounted display device. The head-mounted display device includes an RGB light source, an optical engine, a display waveguide, and a photodetector. The following will be combined with Figure 5 to elaborate in detail on the method for adjusting the display screen provided in the embodiment of this application. The method for adjusting the display screen may include the following steps:

[0037] Step S210: Detect the light leakage electrical signal of the display waveguide through the photodetector.

[0038] In this embodiment, the specific setting position of the light spot detector can refer to the content in the foregoing embodiment, and will not be elaborated here. The head-mounted display device further includes a processor module, which has a data processing function and is the execution subject of this embodiment. The photodetector can convert the detected optical signal into an electrical signal, and this electrical signal can be a current value. Since the photodetector is arranged at the light leakage point of the display waveguide, the photodetector can detect the optical signal of the light leakage beam of the display waveguide, convert this optical signal into a current value, and use the current value as the light leakage electrical signal.

[0039] Step S220: If the light leakage electrical signal does not match the preset electrical signal, adjust the driving current of the RGB light source so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to the human eye to achieve white balance display. The preset electrical signal is the light leakage electrical signal detected by the photodetector when the optical engine modulates the incident light beam to display a full-white screen, and the incident light beam is the light beam output by the RGB light source.

[0040] Similarly, the preset electrical signal can be understood as the preset current value obtained by the photodetector through photoelectric conversion of the light signal of the light leakage of the display waveguide it detects, which is used as the preset electrical signal. That is to say, before the RGB light source of the head-mounted display device leaves the factory (not aged), the RGB light source is driven to emit light with a first preset driving current, and the current value detected by the photodetector at the light leakage position of the display waveguide is the preset light leakage current value. That is to say, if the RGB light source is not aged, during the subsequent use of the head-mounted display device, the current value detected by the photodetector in real time should be consistent with the preset light leakage current value. If the current value detected in real time (i.e., the light leakage point signal detected in real time) is inconsistent with the preset light leakage current value (i.e., the preset electrical signal), it indicates that there is a problem with the aging of the RGB light source. At this time, the driving current of the RGB light source can be adjusted so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to the human eye to achieve white balance display, that is, to make the color of the display picture coupled out to the human eye have no color difference.

[0041] It should be noted that in this embodiment, the preset electrical signal includes a left-eye preset electrical signal and a right-eye preset electrical signal. The left-eye preset electrical signal is the light leakage electrical signal detected by the photodetector corresponding to the left eye when the optical engine corresponding to the left eye modulates the incident light beam to display a full-white picture; the right-eye preset electrical signal is the light leakage electrical signal detected by the photodetector corresponding to the right eye when the optical engine corresponding to the right eye modulates the incident light beam to display a full-white picture.

[0042] Based on this, if the light leakage electrical signal detected by the photodetector corresponding to the left eye does not match the left-eye preset electrical signal, the driving current of the RGB light source corresponding to the left eye can be adjusted so that white balance display is achieved by coupling out through the display waveguide to the left eye of the person. Specifically, it can be to adjust the driving current of one of the red light source, green light source, and blue light source in the RGB light source corresponding to the left eye, or to adjust the driving currents of multiple light sources among the red light source, green light source, and blue light source in the RGB light source corresponding to the left eye. This embodiment does not limit this.

[0043] Similarly, if the light leakage electrical signal detected by the photodetector corresponding to the right eye does not match the right-eye preset electrical signal, the driving current of the RGB light source corresponding to the right eye can be adjusted so that white balance display is achieved by coupling out through the display waveguide to the right eye of the person. Specifically, it can be to adjust the driving current of one of the red light source, green light source, and blue light source in the RGB light source corresponding to the right eye, or to adjust the driving currents of multiple light sources among the red light source, green light source, and blue light source in the RGB light source corresponding to the right eye. This embodiment does not limit this.

[0044] It can be seen that the drive current of the RGB light source corresponding to the left eye and / or the right eye can be adjusted, so that the light beams coupled out from the head-mounted display device to the left and right eyes of a person can achieve white balance, realizing better binocular display and ensuring the binocular viewing experience of the user through the head-mounted display device.

[0045] In this embodiment, a photodetector is arranged at the light leakage position of the display waveguide, and the light leakage signal detected by the photodetector at the light leakage position is matched with a preset electrical signal detected during the white balance of the display screen. If the two do not match, the drive current of the RGB light source is adjusted so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to achieve white balance display at the human eye. In this way, the reuse of the leaked light beam of the display waveguide is realized, so that the light beam output from the head-mounted display device to the human eye reaches white balance, ensuring the accuracy and balance of the color of the display screen seen by the human eye, and improving the picture display quality and user experience of the head-mounted display device.

[0046] Please refer to Figure 6 , Figure 6 which is a schematic flow chart of a method for adjusting a display screen provided in another embodiment of the present application, applied to a head-mounted display device. The head-mounted display device includes an RGB light source, an optical engine, a display waveguide, and a photodetector. The following will be combined with Figure 6 to elaborate in detail on the method for adjusting the display screen provided in the embodiments of the present application. The method for adjusting the display screen may include the following steps:

[0047] Step S310: Detect the light leakage electrical signal of the display waveguide through the photodetector.

[0048] In this embodiment, the light leakage electrical signal includes a red light leakage current value, a green light leakage current value, and a blue light leakage current value. The photodetector can be adhesively arranged on the second side of the display waveguide as described in the foregoing embodiment, and both the light beam coupling-in area and the photodetector are in the light output direction of the optical engine. As Figure 7 shown, the photodetector can detect the light leakage signals of three primary colors of light, red, green, and blue, and perform photoelectric conversion on the light leakage signals to obtain the light leakage electrical signal, that is, the foregoing three current values. Of course, the photodetector can also be adhesively arranged at the end of the side where the light beam coupling-out area of the display waveguide is adhesively arranged as described in the foregoing embodiment. As Figure 8 shown, similarly, the photodetector can detect the light leakage signals of three primary colors of light, red, green, and blue, and perform photoelectric conversion on the light leakage signals to obtain the light leakage electrical signal, that is, the foregoing three current values. 0

[0049] It should be noted that the deployment position of the photodetector in this embodiment can refer to the content in the foregoing embodiment, and this embodiment will not be elaborated one by one here.

[0050] Step S320: Obtain the current ratio of the red light leakage current value, the green light leakage current value, and the blue light leakage current value as the target current ratio.

[0051] Step S330: If the target current ratio does not match the preset current ratio, determine that the leakage optical signal does not match the preset electrical signal, and determine at least one light source from the red light source, the green light source, and the blue light source as the light source to be adjusted, where the preset current ratio is the current ratio of the preset red light current value, the preset green light current value, and the preset blue light current value.

[0052] In this embodiment, the preset electrical signal includes a preset red light current value, a preset green light current value, and a preset blue light current value. The preset red light current value, the preset green light current value, and the preset blue light current value respectively correspond to the red light leakage current value, the green light leakage current value, and the blue light leakage current value of the display waveguide detected by the photodetector when the optical engine modulates the incident light beam to display a full white screen (i.e., white balance). Further, the current ratio of the preset red light current value, the preset green light current value, and the preset blue light current value can be obtained as the preset current ratio, and this preset current ratio can be understood as the white field current calibration ratio λ. 标 , which can be specifically expressed by the following formula:

[0053] λ 标 = I red : I green : I blue = a: b: c

[0054] Among them, I red is used to represent the preset red light current value, I green is used to represent the preset green light current value, I blue is used to represent the preset blue light current value. It should be noted that the reason why the photodetector can detect the red light leakage current value, the green light leakage current value, and the blue light leakage current value respectively when displaying a full white screen is mainly by using the visual persistence effect of the human eye and the technology of using RGB three-color light for projection display. The visual persistence effect of the human eye can be understood as that when the human eye looks at an external object, the light signal is transmitted into the brain nerve and requires a short period of time. After the action of the light ends, the visual image does not disappear immediately. Based on this, when using RGB three-color light projection to form a full white screen, the RGB three-color light is not projected simultaneously, but within the visual persistence duration of the human eye, the RGB three-color light is projected in sequence, so as to form a full white screen by superposition in the human eye. Therefore, the red light leakage current value, the green light leakage current value, and the blue light leakage current value can be detected by the photodetector respectively.

[0055] That is to say, without replacing the RGB light source, optical engine, and display waveguide of the head-mounted display device, to achieve a display white balance for the display image coupled out to the human eye, it is necessary to ensure that the ratio of the red light leakage current value, green light leakage current value, and blue light leakage current value detected by the photodetector is a:b:c.

[0056] It should be noted that the head-mounted display device can pre-store a preset red light current value, a preset green light current value, and a preset blue light current value. When the preset current ratio is needed, these three current values are called from the storage module, and the current ratio among these three current values is obtained to get the above-mentioned preset current ratio. Of course, the head-mounted display device can also directly obtain the current ratio among the three when the preset red light current value, preset green light current value, and preset blue light current value are obtained, use it as the preset current ratio, and store this preset current ratio in its own storage module. When the preset current ratio is needed, this preset current ratio is directly called.

[0057] Based on this, during the actual display of the image by the head-mounted display device, the photodetector can be used to detect the leakage current values of red light, green light, and blue light in real time, obtaining the real-time red light leakage current value, green light leakage current value, and blue light leakage current value. Further, the current ratio of the real-time detected red light leakage current value, green light leakage current value, and blue light leakage current value is obtained as the target current ratio. Among them, the target current ratio λ 实 can be expressed by the following formula:

[0058] λ 实 = I red0 : I green0 : I blue0 = a0:b0:c0

[0059] Among them, I red0 is used to represent the real-time red light leakage current value, I green0 is used to represent the real-time green light leakage current value, I blue0 is used to represent the real-time blue light leakage current value.

[0060] Further, it is determined whether the target current ratio is consistent with the preset current ratio. If the target current ratio is inconsistent with the preset current ratio, it is determined that the target current ratio does not match the preset current ratio; if the target current ratio is consistent with the preset current ratio, it is determined that the target current ratio matches the preset current ratio.

[0061] Exemplarily, taking the preset current ratio a:b:c = 1:1:1 as an example, at this time, if the obtained target current ratio a0:b0:c0 = 1:2:2, obviously, the target current ratio is inconsistent with the preset current ratio, and it can be determined that the target current ratio does not match the preset current ratio.

[0062] When it is determined that the target current ratio does not match the preset current ratio, at least one light source needs to be determined from the three-color light sources of RGB as the light source to be adjusted, so as to adjust the drive current of the light source to be adjusted subsequently, so that the aforementioned target current ratio is consistent with the preset current ratio. Among them, which specific light source is determined as the light source to be adjusted is not limited in this embodiment. For example, taking the preset current ratio a:b:c = 1:1:1 and the obtained target current ratio a0:b0:c0 = 1:2:2 as an example, at this time, the red light source can be used as the light source to be adjusted, that is, the drive current value of the red light source is adjusted, so that the adjusted target current ratio is consistent with the preset current ratio.

[0063] Optionally, the green light source and the blue light source can also be used as the light sources to be adjusted, that is, the drive current values of the green light source and the blue light source are adjusted simultaneously, so that the adjusted target current ratio is consistent with the preset current ratio.

[0064] Optionally, the red light source, the green light source, and the blue light source can also be used as the light sources to be adjusted, that is, the drive current values of the three light sources can be adjusted simultaneously, so that the adjusted target current ratio is consistent with the preset current ratio.

[0065] It should be noted that the present application does not limit the determination strategy for determining the light source to be adjusted. As long as the target current ratio detected after adjustment can be made consistent with the preset current ratio by adjusting the drive current of the light source to be adjusted, the solutions are within the protection scope of the present application.

[0066] Step S340: Adjust the drive current of the light source to be adjusted, so that the light beam output by the adjusted RGB light source is coupled out to the human eye through the display waveguide to achieve white balance display.

[0067] Further, after determining the light source to be adjusted, the drive current of the light source to be adjusted can be adjusted until the adjusted target current ratio is consistent with the preset current ratio. Specifically, if the ratio coefficient corresponding to the light source to be adjusted in the target current ratio is smaller than the ratio coefficients of other light sources, it can be determined at this time that the light source to be adjusted has aged, that is, the brightness value of the light source to be adjusted driven by the original drive current cannot reach the original preset brightness value. Since the luminous power of the light source is linearly related to the change of the current value and is a positively correlated linear relationship. Based on this, the drive current of the light source to be adjusted can be increased, thereby increasing the luminous power of the light source to be adjusted, that is, increasing the brightness value of the light source to be adjusted, so that the target current ratio is consistent with the preset current ratio. Among them, how many times the drive current of the light source to be adjusted is specifically increased can be determined jointly based on the ratio coefficients corresponding to other light sources in the target current ratio and the preset current ratio.

[0068] For example, taking the preset current ratio a:b:c = 1:1:1 and the obtained target current ratio a0:b0:c0 = 1:2:2 as an example, the drive current of the red light source can be increased. Specifically, the drive current of the red light source can be increased to 2 times the original drive current, so that a0:b0:c0 = 2:2:2 = 1:1:1 = a:b:c.

[0069] Optionally, if the ratio coefficient corresponding to the light source to be adjusted in the target current ratio is greater than the ratio coefficients of other light sources, it can be determined at this time that other light sources have aged, that is, the brightness value of the light source to be adjusted driven by the original drive current cannot match the brightness values of other aged light sources. Since the luminous power of the light source is linearly related to the change of the current value and is a positively correlated linear relationship. Based on this, the drive current of the light source to be adjusted can be decreased, thereby decreasing the luminous power of the light source to be adjusted, that is, decreasing the brightness value of the light source to be adjusted, so that the target current ratio is consistent with the preset current ratio. Among them, how many times the drive current of the light source to be adjusted is specifically decreased can be determined jointly based on the ratio coefficients corresponding to other light sources in the target current ratio and the preset current ratio.

[0070] For example, taking the preset current ratio a:b:c = 1:1:1 and the obtained target current ratio a0:b0:c0 = 1:2:2 as an example, the drive currents of the green light source and the blue light source can be decreased. Specifically, the drive currents of the green light source and the blue light source can be decreased to half of their original drive currents, so that a0:b0:c0 = 1:1:1 = a:b:c.

[0071] It can be seen that during the display process of the head-mounted display device, the photodetector is used to detect the light leakage electrical signal of the display waveguide in real time. When the target current ratio determined based on the real-time light leakage electrical signal does not match the preset current ratio during white balance, the drive current of the light source to be adjusted is adjusted in real time until the target current ratio matches the preset current ratio, so that the light beam coupled out to the human eye through the display waveguide achieves white balance display, that is, the white field image is always white, ensuring that there is no color difference in the image color seen by the human eye through the head-mounted display device.

[0072] Step S350: If the target current ratio matches the preset current ratio, it is determined that the light leakage electrical signal matches the preset electrical signal.

[0073] Optionally, if the target current ratio matches the preset current ratio, it indicates that there is no color difference in the image color of the display image seen by the human eye through the head-mounted display device at this time. Therefore, the drive current of the RGB light source can be not adjusted.

[0074] In some embodiments, the photodetector can detect the light leakage electrical signal of the display waveguide every preset time period, and then perform the foregoing steps S320 to S350 based on the detected light leakage electrical signal. The preset time period can be a preset time, for example, 30 seconds or 1 day, and this embodiment does not limit this. Considering that in this embodiment, the photodetector is used to detect the light leakage electrical signal mainly to avoid the problem that some light sources in the RGB light source are aged due to long-term use, resulting in the brightness of the light emission driven by the original drive current not reaching the preset brightness; therefore, the preset time period can be set to 1 day or 3 days, or alternatively, when the photodetector is started for the first time every day, steps S310 to S350 can be performed. In this way, the computing resources of the head-mounted display device can be saved to a certain extent, and at the same time, the battery life of the head-mounted display device can be ensured.

[0075] It should be noted that in this embodiment, the head-mounted display device generally includes a display waveguide corresponding to the left eye, an RGB light source, an optical engine, and a photodetector, and a display waveguide corresponding to the right eye, an RGB light source, an optical engine, and a photodetector; based on this, the foregoing steps S310 to S350 are performed for both the display waveguide corresponding to the left eye and the display waveguide corresponding to the right eye. In this way, it can be ensured that there is no color difference in the image color of the binocular display image of the head-mounted display device.

[0076] In this embodiment, during the display process of the head-mounted display device, the red light leakage current value, green light leakage current value, and blue light leakage current value of the display waveguide are detected in real time by a photodetector. When the target current ratio of the leakage current values of the three primary colors detected in real time does not match the preset current ratio during white balance, the drive current of the light source to be adjusted is adjusted in real time until the target current ratio matches the preset current ratio, so that the light beam coupled out to the human eye through the display waveguide achieves white balance display, that is, the white field image is always white, ensuring that there is no color difference in the color of the image seen by the human eye through the head-mounted display device, guaranteeing the accuracy and balance of the color of the display image seen by the human eye, and improving the display quality of the head-mounted display device and the user experience.

[0077] Please refer to Figure 9 , Figure 9 which is a schematic flowchart of a method for adjusting a display image provided in another embodiment of the present application, and is applied to a head-mounted display device. The head-mounted display device includes an RGB light source, an optical engine, a display waveguide, and a photodetector. The following will be combined with Figure 9 to elaborate in detail on the method for adjusting a display image provided in an embodiment of the present application. The method for adjusting a display image may include the following steps:

[0078] Step S410: Detect the leakage photoelectric signal of the display waveguide through the photodetector.

[0079] In this embodiment, the specific implementation manner in step S410 may refer to the content in the foregoing embodiment, and will not be elaborated here.

[0080] Step S420: If the red light leakage current value does not match the preset red light current value, the green light leakage current value does not match the preset green light current value, and / or the blue light leakage current value does not match the preset blue light current value, it is determined that the leakage photoelectric signal does not match the preset electric signal, and the drive current of the light source to be adjusted is adjusted. The light source to be adjusted is the light source corresponding to the leakage current value in the leakage photoelectric signal that does not match the preset electric signal.

[0081] In this embodiment, the leakage photoelectric signal includes the red light leakage current value, green light leakage current value, and blue light leakage current value detected in real time by the photodetector during the display process of the head-mounted display device. The head-mounted display device stores a preset electric signal, which includes a preset red light current value, a preset green light current value, and a preset blue light current value. The preset red light current value, preset green light current value, and preset blue light current value respectively correspond to the red light leakage current value, green light leakage current value, and blue light leakage current value of the display waveguide detected by the photodetector when the optical engine modulates the incident light beam to display a full white image (i.e., white balance).

[0082] That is to say, without replacing the RGB light source, optical engine, and display waveguide of the head-mounted display device, to make the display screen coupled to the human eye achieve display white balance and the brightness of the display screen be the same as that before the factory state, it is necessary to ensure that the red light leakage current value, green light leakage current value, and blue light leakage current value detected by the photodetector respectively match the preset red light current value, preset green light current value, and preset blue light current value.

[0083] Optionally, if the red light leakage current value does not match the preset red light current value, the green light leakage current value does not match the preset green light current value, and / or the blue light leakage current value does not match the preset blue light current value, it can be determined that the leakage optical signal does not match the preset electrical signal. And the light source corresponding to the leakage current value in the leakage optical signal that does not match the preset electrical signal is determined as the light source to be adjusted. Then, the drive current of the light source to be adjusted is adjusted until the leakage current value corresponding to the light source to be adjusted in the leakage optical signal detected by the photodetector in real time is consistent with the preset current value corresponding to the light source to be adjusted.

[0084] Exemplarily, if the red light leakage current value does not match the preset red light current value, the green light leakage current value matches the preset green light current value, and the blue light leakage current value matches the preset blue light current value, at this time, the red light source can be determined as the light source to be adjusted. Optionally, if the red light leakage current value is less than the preset red light current value, the drive current of the red light source can be increased, that is, the luminous power of the red light source is increased, thereby increasing the luminous brightness of the red light source. Since the photodetector has a high sensitivity to the detection of light power, that is to say, it can detect the change of light intensity more sensitively and convert it into an electrical signal (i.e., current value) for representation. Thus, when the red light leakage current value detected by the photodetector in real time is consistent with the preset red light current value, the adjustment of the drive current value of the red light source can be stopped, and the red light source is maintained to emit light with this drive current value.

[0085] Similarly, when the green light leakage current value does not match the preset green light current value, or the blue light leakage current value does not match the preset blue light current value, the drive current of the corresponding light source is adjusted in a similar manner, so that the detected leakage current value after adjustment is consistent with the preset current value, that is, the brightness of the light beam emitted by each color light source in the RGB light source can reach the preset brightness (such as the luminous brightness at the time of factory).

[0086] In practical applications, as the usage time of the head-mounted display device is too long, the light source will age. At the level of the light emission brightness of the light source, it means that when the light source is driven to emit light according to the original driving current, the brightness of the emitted light beam cannot reach the preset brightness. Obviously, in this embodiment, the photoelectric detector can be used to detect the leakage photoelectric signal in real time, and based on this leakage photoelectric signal, it can be determined which color light source in the RGB light source has a light emission brightness that cannot reach the preset brightness, so as to increase the driving current of the light source of this color light in time to ensure

[0087] Of course, the RGB light source may also have a hardware failure, resulting in the light beam emitted when the light source is driven to emit light according to the original driving current having a brightness greater than the preset brightness. At this time, the driving current for this light source needs to be reduced, so that the brightness of the emitted light beam is reduced by the preset brightness. In other words, if the leakage current value of any color light detected in real time is less than its corresponding preset current value, the driving current of this color light is increased; if the leakage current value of any color light detected in real time is greater than its corresponding preset current value, the driving current of this color light should be reduced.

[0088] Step S430: If the red light leakage current value matches the preset red light current value, the green light leakage current value matches the preset green light current value, and the blue light leakage current value matches the preset blue light current value, it is determined that the leakage photoelectric signal matches the preset electric signal.

[0089] Optionally, when it is determined that the leakage photoelectric signal matches the preset electric signal, it indicates that the display brightness of the current display screen of the head-mounted display device is the same as the preset brightness, and the driving current of the RGB light source can be not adjusted.

[0090] In some other embodiments, considering that the change value of the optical power and the change value of the current are linearly related, that is, the ratio between the optical power value and the current value is a fixed value α, which can be obtained by pre-calibration. That is, after obtaining the current value, the optical power can be calculated. Among them, for light beams with different wavelengths, their linear relationships are also different, that is, the ratios between the optical power values and the current values are also different. Since the head-mounted display device includes a display waveguide corresponding to the left eye and a display waveguide corresponding to the right eye, and photoelectric detectors are correspondingly arranged for both display waveguides, therefore, for each display waveguide, the fixed value α corresponding to each color light in the RGB three-color light can be pre-calibrated, denoted as α 左red 、α 左green 、α 左blue 、α 右red 、α 右green 、α 右blue 。 Further, when the head-mounted display device leaves the factory, the leakage current values of the RGB three-color lights detected by the photoelectric detector corresponding to the left eye when the light engine corresponding to the left eye displays a white field image can be recorded, denoted as I左red 、I 左green 、I 左blue value, the optical power can be expressed as P = α * I. Therefore, the light leakage powers of the RGB three-color lights are respectively α 左red * I 左red 、α 左green * I 左green 、α 左blue * I 左blue , denoted as P 0red 、P 0green 、P 0blue . Among them, P 0red 、P 0green 、P 0blue can also be understood as the preset light leakage powers of the RGB three-color lights in the display waveguide when displaying a white field image (i.e., white balance). Similarly, through a similar calibration method, the light leakage powers of the RGB three-color lights corresponding to the right eye, α 右red * I 右red 、α 右green * I 右green 、α 右blue * I 右blue , denoted as P 0red 、P 0green 、P 0blue . At this time, since the preset light leakage powers detected by the photodetectors corresponding to the left eye and the right eye are the same (i.e., the luminous powers of the RGB light sources of the left eye and the right eye are the same), in the case of good waveguide consistency, the picture brightness entering the human eyes from the left and right eyes is also the same.

[0091] In this method, if the detected red light leakage power does not match the preset red light leakage power, the detected green light leakage power does not match the preset green light leakage power, and / or the detected blue light leakage power does not match the preset blue light leakage power, it is determined that the light leakage electric signal does not match the preset electric signal, and the drive current of the light source to be adjusted is adjusted until the detected P red 、P green 、P blue returns to P 0red 、P 0green 、P 0blue . The light source to be adjusted is the light source corresponding to the light leakage current value that does not match the preset electric signal in the light leakage electric signal. In this way, the brightness of the white field image of the head-mounted display device can be made consistent with the factory state, that is, the brightness of the image seen by the human eye will not decline; at the same time, during use, the brightness attenuation speeds of the left and right light engines are also inconsistent. By adjusting the drive currents of the left and right RGB light sources with different amplitudes in this method, it is ensured that the brightness of the display images entering the left and right eyes remains the same, thereby preventing problems such as eye fatigue caused by inconsistent brightness of the left and right eye images.

[0092] Optionally, if the detected red light leakage power matches the preset red light leakage power in real time, the detected green light leakage power matches the preset green light leakage power, and the detected blue light leakage power matches the preset blue light leakage power, it is determined that the leakage optical signal matches the preset optical signal, and there is no need to adjust the driving current of the RGB light source.

[0093] In some other embodiments, the RGB light source includes a first RGB light source and a second RGB light source. The optical engine includes a first optical engine corresponding to the first RGB light source and a second optical engine corresponding to the second RGB light source. The display waveguide includes a first display waveguide corresponding to the first optical engine and a second display waveguide corresponding to the second optical engine. The photodetector includes a first photodetector corresponding to the first display waveguide and a second photodetector corresponding to the second display waveguide. The leakage optical signal includes a first leakage power value detected by the first photodetector and a second leakage power value detected by the second photodetector. The preset optical signal is the preset leakage power value of the display waveguide detected by the photodetector corresponding to the target optical engine when the target optical engine modulates the incident light beam to display a full white screen. The target optical engine is any one of the first optical engine and the second optical engine. Among them, the first display waveguide and the second display waveguide respectively correspond to the left eye and the right eye of a person.

[0094] In this case, if the target leakage power value does not match the preset leakage power value, the driving current of the RGB light source corresponding to the target leakage power value is adjusted. The target leakage power value is any one of the first leakage power value and the second leakage power value. That is to say, it is possible to calibrate the leakage power value of the display waveguide corresponding to the left eye or the right eye when displaying a full white screen. Thus, in the subsequent actual display process, if it is detected that the actual leakage power value of the display waveguide corresponding to the left eye and / or the right eye does not match the calibrated preset leakage power value, the driving current of the RGB light source corresponding to the left eye and / or the right eye is adjusted so that the actual leakage power value detected for the display waveguide corresponding to the adjusted left eye and / or right eye matches the calibrated preset leakage power value, thereby making the display screen brightness projected onto the left and right eyes of a person the same, and at the same time making the screen brightness of the display screens for the left and right eyes consistent with the factory state.

[0095] It should be noted that the preset light leakage power value in this mode also includes the preset red light power value, the preset green light power value, and the preset blue light power value. The actual light leakage power value also includes the actual red light power value, the actual green light power value, and the actual blue light power value. To adjust the driving current of the RGB light source corresponding to the target light leakage power value, the driving current of the red light source corresponding to the target light leakage power value can be adjusted based on the actual red light power value and the preset red light power value. Similarly, based on the actual green light power value and the preset green light power value, the driving current of the green light source corresponding to the target light leakage power value is adjusted. Similarly, based on the actual blue light power value and the preset blue light power value, the driving current of the blue light source corresponding to the target light leakage power value is adjusted. Among them, the linear relationship between the driving current and the power value can refer to the foregoing content and will not be elaborated here.

[0096] In this embodiment, the photodetector can detect the light leakage electrical signal of the display waveguide every preset time period, and then perform the foregoing steps S420 to S430 based on the detected light leakage electrical signal. The preset time period can be a pre-set time period. For example, it can be 30 seconds or 1 day, and this embodiment does not limit this. Considering that in this embodiment, the photodetector is used to detect the light leakage electrical signal mainly to avoid the problem that some light sources in the RGB light source are aged due to long-term use, resulting in the brightness of the light emission driven by the original driving current not reaching the preset brightness; or, due to hardware failure, the brightness of the light emission driven by the original driving current exceeds the preset brightness. Therefore, the preset time period can be set to 1 day or 3 days, or alternatively, when the photodetector is started for the first time every day, steps S310 to S350 are executed. In this way, the problems of excessive consumption of computing resources caused by frequent detection and analysis of light leakage signals are avoided, that is, the computing resources of the head-mounted display device are saved to a certain extent, and at the same time, the battery life of the head-mounted display device is guaranteed.

[0097] It should be noted that the head-mounted display device in this embodiment generally includes a display waveguide corresponding to the left eye, an RGB light source, an optical engine, and a photodetector, as well as a display waveguide corresponding to the right eye, an RGB light source, an optical engine, and a photodetector. Based on this, the content of the foregoing steps S410 to S430 will be executed for both the display waveguide corresponding to the left eye and the display waveguide corresponding to the right eye.

[0098] In this embodiment, for the RGB light sources of the left and right eyes, the leakage current values of each color light can be detected through respective photodetectors, and the leakage current value of each color light is compared with the preset current value corresponding to each color light to determine the light source to be adjusted. And the drive current of the light source to be adjusted is adjusted in a timely manner so that the display pictures coupled into the left and right eyes of a person through the display waveguide can both reach the preset brightness, and at the same time, the brightness consistency of the display pictures coupled into the left and right eyes of the head-mounted display device is ensured, preventing problems such as eye fatigue caused by inconsistent brightness of the left and right eye pictures. And it can achieve the white balance of the display picture, ensuring that the display picture seen by the human eye will not fade, and at the same time, ensuring that there is no color difference in the picture color of the display picture.

[0099] Please refer to Figure 10 , Figure 10 which is a schematic flowchart of a method for adjusting a display picture provided in another embodiment of the present application, and is applied to a head-mounted display device. The head-mounted display device includes an RGB light source, an optical engine, a display waveguide, and a photodetector. The following will be combined with Figure 10 to elaborate in detail on the method for adjusting the display picture provided in the embodiment of the present application. The method for adjusting the display picture may include the following steps:

[0100] Step S510: Detect the leakage photoelectric signal of the display waveguide through the photodetector.

[0101] Step S520: If the leakage photoelectric signal does not match the preset electric signal, adjust the drive current of the RGB light source so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to the human eye to achieve white balance display. The preset electric signal is the leakage photoelectric signal of the display waveguide detected by the photodetector when the optical engine modulates the incident light beam to display a full-white picture, and the incident light beam is the light beam output by the RGB light source.

[0102] In this embodiment, the specific implementation manners of steps S510 to S520 can refer to the content in the foregoing embodiment and will not be elaborated herein.

[0103] Step S530: Detect the current ambient photoelectric signal of the environment where the enhanced display device is located through the photodetector.

[0104] In this embodiment, the deployment position of the photodetector can refer to the content in the foregoing embodiment, which will not be elaborated here. The head-mounted display device is an AR-type head-mounted display device. The AR-type head-mounted display device needs to have a certain transmittance so that the wearer can see the external environment while seeing the image screen; considering that when the brightness of the environment where the wearer is located changes suddenly, such as from a dark place to a bright place, or from a bright place to a dark place, the pupil of the human eye will change to adapt to the environmental brightness and protect the eyes. Based on this, the AR-type head-mounted display device can also adjust the driving current of the RGB light source in real time according to the light intensity of the external environment, so as to adjust the brightness of the light beam coupled out to the human eye area through the display waveguide, so that the brightness of the display screen matches the brightness of the external environment.

[0105] In some embodiments, referring to Figure 11 , the photodetector may include a first photodetector and a second photodetector. Among them, electrical isolation is performed between the first photodetector and the second photodetector to avoid mutual influence between the first photodetector and the second photodetector, resulting in inaccurate detection results of both. In this way, the second photodetector is attached to the second side of the display waveguide, and both the light beam coupling-in area and the second photodetector are in the light output direction of the optical engine; the second photodetector is used to detect the leakage optical signal of the display waveguide, and the first photodetector is used to detect the electrical signal of the ambient light in the external environment. Among them, the value obtained after the photodetector performs photoelectric conversion is a current value. As described in the foregoing embodiment, the ratio between the optical power value and the current value is a fixed value and can be calibrated in advance. Therefore, it can also be understood that the second photodetector is used to detect the leakage optical power of the display waveguide, and the first photodetector is used to detect the ambient optical power of the external environment.

[0106] In other embodiments, referring to Figure 12 , the photodetector is a single photodetector. Since the RGB light source does not emit light continuously. For example, in the Figure 12 light emission time period from t1 to t2, the photodetector detects the sum of the leakage optical signal and the ambient optical signal, while in the Figure 12 non-light emission time period from t2 to t3, the photodetector detects the ambient optical signal. Among them, the value obtained after the photodetector performs photoelectric conversion is a current value. As described in the foregoing embodiment, the ratio between the optical power value and the current value is a fixed value and can be calibrated in advance, that is, after obtaining the current value, the optical power can be calculated. Therefore, it can also be understood that the photodetector detects the ambient optical power P1 during the non-light emission time period of the RGB light source, and detects the sum of the leakage optical power and the ambient optical power P2 during the light emission time period of the RGB light source; based on this, the leakage optical power of the display waveguide can be obtained by obtaining the power difference between P2 and P1.

[0107] Understandably, the photodetector can detect the current ambient optoelectronic signal of the environment where the augmented reality head-mounted display device is located at regular intervals, that is, detect the ambient light power at regular intervals. β

[0108] Step S540: If the current ambient optoelectronic signal does not match the preset ambient optoelectronic signal, determine the degree of ambient light change based on the current ambient optoelectronic signal and the preset ambient optoelectronic signal.

[0109] Optionally, if the currently detected ambient light power is different from the preset ambient light power, or if the power difference between the currently detected ambient light power and the preset ambient light power is greater than the preset power threshold, it is determined that the current ambient optoelectronic signal does not match the preset ambient optoelectronic signal. In this way, it can be determined that the ambient light in the external environment where the head-mounted display device is located has changed, and then the power ratio between the currently detected ambient light power and the preset ambient light power can be obtained as the degree of ambient light change.

[0110] Among them, the preset ambient light power can be the ambient light power under the set ambient light intensity set at the factory of the head-mounted display device.

[0111] Step S550: Based on the degree of ambient light change, adjust the drive current of the RGB light source so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to match the display brightness at the human eye with the ambient brightness of the environment.

[0112] Furthermore, the drive current of the RGB light source can be adjusted correspondingly based on the degree of ambient light change. Exemplarily, if the power ratio between the ambient light power and the preset ambient light power is β, at this time, the drive currents of the red light source, green light source, and blue light source in the RGB light source can be adjusted to β times the preset drive current, so that the leakage light powers corresponding to the red light source, green light source, and blue light source become β times the preset leakage light power, that is:

[0113] P red = βP 0red

[0114] P green = βP 0green

[0115] P blue = βP 0blue

[0116] Among them, P 0red is used to represent the preset leakage light power of the red light source, P 0green is used to represent the preset leakage light power of the green light source, P 0blue is used to represent the preset leakage light power of the blue light source, Pred Used to characterize the light leakage power P after adjustment of the red light source green Used to characterize the light leakage power P after adjustment of the green light source blue Used to characterize the light leakage power after adjustment of the blue light source

[0117] In this embodiment, the head-mounted display device generally includes a display waveguide corresponding to the left eye, an RGB light source, an optical engine, and a photodetector, and a display waveguide corresponding to the right eye, an RGB light source, an optical engine, and a photodetector; based on this, the content of the foregoing steps S510 to S550 will be executed for both the display waveguide corresponding to the left eye and the display waveguide corresponding to the right eye

[0118] It should be noted that the content of steps S510 to S520 can be executed first, and then the content of steps S530 to S550 can be executed; alternatively, the content of steps S530 to S550 can be executed first, and then the content of steps S510 to S520 can be executed; it is also possible to determine the adjustment strategy for the driving current of the RGB light source according to steps S510, S530, and S540 at the same time, and then directly adjust the driving current of the RGB light source based on the adjustment strategy, so that the light beam output by the adjusted RGB light source is coupled out to the human eye through the display waveguide to achieve white balance display, and at the same time, the light beam output by the adjusted RGB light source is also coupled out to the human eye through the display waveguide, and the display brightness matches the ambient brightness of the environment

[0119] In this embodiment, the photodetector is integrated outside the display waveguide, which can detect both the 0th-order diffraction light intensity and the ambient light intensity of the external environment. When the head-mounted display device is powered on, white, red, green, and blue fields can be quickly played, and the photodetector can quickly detect the optical signals of each color field, feedback to the control board, and adjust the current of the RGB light source to compensate for the brightness decline caused by the aging of the overall optical engine or a single lamp bead. In addition, the photodetector can also detect the light intensity of the environment. When the ambient light intensity changes suddenly, it can quickly adjust the current of the optical engine light source and adjust the brightness of the projection screen in real time to match the brightness of the projection screen with the external environment. And both eyes test the brightness of each color field of the optical engine, adjust the current of the light sources of both eyes' optical engines, compensate for the difference in the aging speed of both eyes' optical engines, ensure that the brightness of both eyes is consistent, timely compensate for the color and brightness of the picture, and improve the wearing experience of the head-mounted display device

[0120] Please refer to Figure 13 , which shows a structural block diagram of an adjustment device 600 for a display screen provided in an embodiment of the present application. The device 600 may include: a light leakage signal detection module 610 and a light source adjustment module 620

[0121] The light leakage signal detection module 610 is configured to detect the light leakage electrical signal of the display waveguide through the photodetector.

[0122] The light source adjustment module 620 is configured to adjust the driving current of the RGB light source if the light leakage electrical signal does not match the preset electrical signal, so that the light beam output by the adjusted RGB light source is coupled out through the display waveguide to the human eye to achieve white balance display. The preset electrical signal is the light leakage electrical signal of the display waveguide detected by the photodetector when the optical engine modulates the incident light beam to display a full white screen, and the incident light beam is the light beam output by the RGB light source.

[0123] In some embodiments, the RGB light source includes a red light source, a green light source, and a blue light source. The light leakage electrical signal includes a red light leakage current value, a green light leakage current value, and a blue light leakage current value. The preset electrical signal includes a preset red light current value, a preset green light current value, and a preset blue light current value. The display screen adjustment device 600 may further include a first matching module. Specifically, the first matching module may be configured to obtain the current ratio of the red light leakage current value, the green light leakage current value, and the blue light leakage current value as the target current ratio before adjusting the driving current of the RGB light source if the light leakage electrical signal does not match the preset electrical signal; if the target current ratio does not match the preset current ratio, it is determined that the light leakage electrical signal does not match the preset electrical signal, and the preset current ratio is the current ratio of the preset red light current value, the preset green light current value, and the preset blue light current value; if the target current ratio matches the preset current ratio, it is determined that the light leakage electrical signal matches the preset electrical signal.

[0124] In this manner, the light source adjustment module 620 may be specifically configured to determine at least one light source from the red light source, the green light source, and the blue light source as the light source to be adjusted if the light leakage electrical signal does not match the preset electrical signal; and adjust the driving current of the light source to be adjusted.

[0125] In some other embodiments, the RGB light source includes a red light source, a green light source, and a blue light source. The leakage photoelectric signal includes a red light leakage current value, a green light leakage current value, and a blue light leakage current value. The preset electric signal includes a preset red light current value, a preset green light current value, and a preset blue light current value. The display screen adjusting device 600 may further include a second matching module. Specifically, the second matching module may be configured to determine that the leakage photoelectric signal does not match the preset electric signal if the red light leakage current value does not match the preset red light current value, the green light leakage current value does not match the preset green light current value, and / or the blue light leakage current value does not match the preset blue light current value, before adjusting the driving current of the RGB light source when the leakage photoelectric signal does not match the preset electric signal; and determine that the leakage photoelectric signal matches the preset electric signal if the red light leakage current value matches the preset red light current value, the green light leakage current value matches the preset green light current value, and the blue light leakage current value matches the preset blue light current value.

[0126] In this case, the light source adjusting module 620 may be specifically configured to adjust the driving current of the light source to be adjusted if the leakage photoelectric signal does not match the preset electric signal, where the light source to be adjusted is the light source corresponding to the leakage current value that does not match the preset electric signal in the leakage photoelectric signal.

[0127] In some embodiments, the head-mounted display device is an augmented reality head-mounted display device. The display screen adjusting device 600 may further include an ambient light detection module and an ambient light change determination module. The ambient light detection module may be configured to detect the current ambient photoelectric signal of the environment where the augmented reality head-mounted display device is located through the photodetector. The ambient light change determination module may be configured to determine the degree of ambient light change based on the current ambient photoelectric signal and the preset ambient photoelectric signal if the current ambient photoelectric signal does not match the preset ambient photoelectric signal. The light source adjusting module 620 may be specifically configured to adjust the driving current of the RGB light source based on the degree of ambient light change, so that the brightness of the light beam output by the adjusted RGB light source coupled out to the human eye through the display waveguide matches the ambient brightness of the environment.

[0128] In some embodiments, the RGB light source includes a first RGB light source and a second RGB light source. The optical engine includes a first optical engine corresponding to the first RGB light source and a second optical engine corresponding to the second RGB light source. The display waveguide includes a first display waveguide corresponding to the first optical engine and a second display waveguide corresponding to the second optical engine. The photodetector includes a first photodetector corresponding to the first display waveguide and a second photodetector corresponding to the second display waveguide. The leaked optical signal includes a first leaked light power value detected by the first photodetector and a second leaked light power value detected by the second photodetector. The preset electrical signal is the preset leaked light power value of the display waveguide detected by the photodetector corresponding to the target optical engine when the target optical engine modulates the incident light beam to display a full-white screen, and the target optical engine is any one of the first optical engine and the second optical engine. The light source adjustment module 620 can be specifically configured to: if the target leaked light power value does not match the preset leaked light power value, adjust the drive current of the RGB light source corresponding to the target leaked light power value, and the target leaked light power value is any one of the first leaked light power value and the second leaked light power value.

[0129] In some embodiments, the display waveguide includes a light beam coupling-in region and a light beam coupling-out region. The light beam coupling-in region is disposed on a first side of the display waveguide; the photodetector is disposed in a fitting manner on a second side of the display waveguide, and both the light beam coupling-in region and the photodetector are in the light output direction of the optical engine; or, the photodetector is disposed in a fitting manner at an end of the side where the light beam coupling-out region of the display waveguide is located.

[0130] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0131] In several embodiments provided in the present application, the coupling between modules can be electrical, mechanical, or other forms of coupling.

[0132] In addition, in each embodiment of the present application, each functional module can be integrated into a processing module, or each module can exist physically alone, or two or more modules can be integrated into one module. The above-mentioned integrated module can be implemented in the form of hardware or in the form of a software functional module.

[0133] In summary, integrating the photodetector outside the display waveguide can detect both the intensity of the 0th-order diffracted light and the ambient light intensity of the external environment. When the head-mounted display device is powered on, white, red, green, and blue fields can be quickly played. The photodetector can quickly detect the optical signals of each color field, feedback to the control board, adjust the current of the RGB light source, and compensate for the brightness decline caused by the aging of the entire optical engine or a single lamp bead. Moreover, the photodetector can also detect the ambient light intensity. When the ambient light intensity changes suddenly, it can quickly adjust the current of the optical engine light source, adjust the brightness of the projection screen in real time, and make the brightness of the projection screen match the brightness of the external environment. Additionally, the brightness of each color field of the optical engine is measured for both eyes, the current of the light sources of the binocular optical engines is adjusted, the difference in the aging speed of the binocular optical engines is compensated, the binocular brightness is ensured to be consistent, the color and brightness of the picture are timely compensated, and the wearing experience of the head-mounted display device is improved.

[0134] Next, a head-mounted display device provided by the present application will be described in conjunction with Figure 14 the following.

[0135] Referring to Figure 14 , Figure 14 FIG. shows a structural block diagram of a head-mounted display device 700 provided by an embodiment of the present application. The above method provided by the embodiment of the present application can be executed by the head-mounted display device 700.

[0136] The head-mounted display device 700 in the embodiment of the present application may include one or more of the following components: a processor 701, a memory 702, and one or more application programs. One or more application programs may be stored in the memory 702 and configured to be executed by one or more processors 701. One or more programs are configured to execute the method described in the foregoing method embodiment.

[0137] The processor 701 may include one or more processing cores. The processor 701 connects various parts within the entire head-mounted display device 700 using various interfaces and circuits. By running or executing instructions, programs, code sets, or instruction sets stored in the memory 702, and by invoking the data stored in the memory 702, it performs various functions of the head-mounted display device 700 and processes data. Optionally, the processor 701 may be implemented in at least one hardware form of digital signal processing (DSP), field-programmable gate array (FPGA), or programmable logic array (PLA). The processor 701 may integrate a combination of one or several of a central processing unit (CPU), a graphics processing unit (GPU), and a modem, etc. Among them, the CPU mainly processes the operating system, user interface, application programs, etc.; the GPU is responsible for rendering and drawing the display content; the modem is used to process wireless communications. It can be understood that the above-mentioned modem may also be integrated into the processor 701 and implemented separately through a communication chip.

[0138] The memory 702 may include random access memory (RAM) and may also include read-only memory. The memory 702 can be used to store instructions, programs, code, code sets, or instruction sets. The memory 702 may include a program storage area and a data storage area. Among them, the program storage area may store instructions for implementing the operating system, instructions for implementing at least one function (such as touch function, sound playback function, image playback function, etc.), instructions for implementing the following various method embodiments, etc. The data storage area may also store the data created during the use of the head-mounted display device 700 (such as the various corresponding relationships mentioned above), etc.

[0139] Those skilled in the art can clearly understand that for the convenience and brevity of description, the specific working processes of the above-described devices and modules can refer to the corresponding processes in the foregoing method embodiments and will not be elaborated herein.

[0140] In several embodiments provided in the present application, the coupling, direct coupling, or communication connection between the displayed or discussed modules may be through some interfaces. The indirect coupling or communication connection of the devices or modules may be in an electrical, mechanical, or other form.

[0141] In addition, in each embodiment of the present application, each functional module can be integrated into one processing module, can exist separately physically for each module, or two or more modules can be integrated into one module. The above integrated modules can be implemented in the form of hardware or in the form of software functional modules.

[0142] Please refer to Figure 15 , which shows a structural block diagram of a computer-readable storage medium provided by an embodiment of the present application. Program code is stored in the computer-readable medium 800, and the program code can be called by a processor to execute the method described in the above method embodiments.

[0143] The computer-readable storage medium 800 can be an electronic memory such as a flash memory, EEPROM (electrically erasable programmable read-only memory), EPROM, hard disk, or ROM. Optionally, the computer-readable storage medium 800 includes a non-transitory computer-readable storage medium. The computer-readable storage medium 800 has a storage space for the program code 810 for executing any method step in the above method. These program codes can be read out from or written into one or more computer program products. The program code 810 can be compressed in an appropriate form, for example.

[0144] In some embodiments, a computer program product or a computer program is provided. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the electronic device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the electronic device executes the steps in the above method embodiments.

[0145] Finally, it should be noted that the above embodiments are only used to illustrate the technical solutions of the present application and are not intended to limit them. Although the present application has been described in detail with reference to the foregoing embodiments, those of ordinary skill in the art should understand that they can still modify the technical solutions recorded in the foregoing embodiments, or perform equivalent replacements for some of the technical features. And these modifications or replacements do not cause the essence of the corresponding technical solutions to deviate from the spirit and scope of the technical solutions of the embodiments of the present application.

Claims

1. A method for adjusting a display screen, characterized in that Applied to a head-mounted display device, the head-mounted display device includes an RGB light source, an optical engine, a display waveguide, and a photodetector. The method includes: Detecting a leakage optical signal of the display waveguide through the photodetector; If the leakage optical signal does not match a preset electrical signal, adjusting a driving current of the RGB light source so that a light beam output by the adjusted RGB light source is coupled out through the display waveguide to the human eye to achieve white balance display. The preset electrical signal is the leakage optical signal of the display waveguide detected by the photodetector when the optical engine modulates an incident light beam to display a full-white screen, and the incident light beam is the light beam output by the RGB light source.

2. The method according to claim 1, characterized in that, The RGB light source includes a red light source, a green light source, and a blue light source. The leakage optical signal includes a red light leakage current value, a green light leakage current value, and a blue light leakage current value. The preset electrical signal includes a preset red light current value, a preset green light current value, and a preset blue light current value; Before the step of "if the leakage optical signal does not match the preset electrical signal, adjusting the driving current of the RGB light source", the method further includes: Obtaining a current ratio of the red light leakage current value, the green light leakage current value, and the blue light leakage current value as a target current ratio; If the target current ratio does not match a preset current ratio, determining that the leakage optical signal does not match the preset electrical signal. The preset current ratio is a current ratio of the preset red light current value, the preset green light current value, and the preset blue light current value; If the target current ratio matches the preset current ratio, determining that the leakage optical signal matches the preset electrical signal.

3. The method according to claim 2, characterized in that, The step of "if the leakage optical signal does not match the preset electrical signal, adjusting the driving current of the RGB light source" includes: If the leakage optical signal does not match the preset electrical signal, determining at least one light source from the red light source, the green light source, and the blue light source as a light source to be adjusted; Adjusting the driving current of the light source to be adjusted.

4. The method according to claim 1, wherein The RGB light source includes a red light source, a green light source, and a blue light source. The leakage optical signal includes a red light leakage current value, a green light leakage current value, and a blue light leakage current value. The preset electrical signal includes a preset red light current value, a preset green light current value, and a preset blue light current value; Before the step of "if the leakage optical signal does not match the preset electrical signal, adjusting the driving current of the RGB light source", the method further includes: If the red light leakage current value does not match the preset red light current value, the green light leakage current value does not match the preset green light current value, and / or the blue light leakage current value does not match the preset blue light current value, determining that the leakage optical signal does not match the preset electrical signal; If the red light leakage current value matches the preset red light current value, the green light leakage current value matches the preset green light current value, and the blue light leakage current value matches the preset blue light current value, determining that the leakage optical signal matches the preset electrical signal.

5. The method according to claim 4, characterized in that, If the detected light leakage signal does not match the preset electrical signal, adjusting the drive current of the RGB light source includes: If the detected light leakage signal does not match the preset electrical signal, adjusting the drive current of the light source to be adjusted, where the light source to be adjusted is the light source corresponding to the light leakage current value that does not match the preset electrical signal in the detected light leakage signal.

6. The method according to claim 1, characterized in that, The head-mounted display device is an augmented reality head-mounted display device, and the method further includes: Detecting a current ambient optical signal of the environment where the augmented reality head-mounted display device is located through the photodetector; If the current ambient optical signal does not match the preset ambient optical signal, determining the degree of ambient light change based on the current ambient optical signal and the preset ambient optical signal; Adjusting the drive current of the RGB light source based on the degree of ambient light change, so that the brightness of the light beam output by the adjusted RGB light source coupled out to the human eye through the display waveguide matches the ambient brightness of the environment.

7. The method according to claim 1, characterized in that, The RGB light source includes a first RGB light source and a second RGB light source. The optical engine includes a first optical engine corresponding to the first RGB light source and a second optical engine corresponding to the second RGB light source. The display waveguide includes a first display waveguide corresponding to the first optical engine and a second display waveguide corresponding to the second optical engine. The photodetector includes a first photodetector corresponding to the first display waveguide and a second photodetector corresponding to the second display waveguide. The detected light leakage signal includes a first light leakage power value detected by the first photodetector and a second light leakage power value detected by the second photodetector. The preset electrical signal is the preset light leakage power value of the display waveguide detected by the photodetector corresponding to the target optical engine when the target optical engine modulates the incident light beam to display a full-white screen, and the target optical engine is any one of the first optical engine and the second optical engine; If the detected light leakage signal does not match the preset electrical signal, adjusting the drive current of the RGB light source includes: If the target light leakage power value does not match the preset light leakage power value, adjusting the drive current of the RGB light source corresponding to the target light leakage power value, where the target light leakage power value is any one of the first light leakage power value and the second light leakage power value.

8. The method according to any one of claims 1-7, characterized in that, The display waveguide includes a light beam coupling-in area and a light beam coupling-out area. The light beam coupling-in area is provided on a first side of the display waveguide; the photodetector is attached to a second side of the display waveguide, and both the light beam coupling-in area and the photodetector are in the light output direction of the optical engine; Or, The photodetector is attached to an end of the side where the light beam coupling-out area of the display waveguide is located.

9. An adjustment device for a display screen, characterized in that Applied to a head-mounted display device, the head-mounted display device includes an RGB light source, an optical engine, a display waveguide, and a photodetector. The device includes: A light leakage signal detection module, configured to detect a light leakage signal of the display waveguide through the photodetector; A light source adjustment module, which is configured to adjust the driving current of the RGB light source if the detected light leakage electrical signal does not match a preset electrical signal, so that the light beam output by the adjusted RGB light source is coupled out to the human eye through the display waveguide to achieve white balance display. The preset electrical signal is the light leakage electrical signal of the display waveguide detected by the photodetector when the optical engine modulates the incident light beam to display a full white screen, and the incident light beam is the light beam output by the RGB light source.

10. A head-mounted display device, characterized in that, Comprising: One or more processors; A memory; One or more programs, wherein the one or more programs are stored in the memory and configured to be executed by the one or more processors, and the one or more programs are configured to execute the method according to any one of claims 1 to 8.

11. A computer-readable storage medium, characterized in that, Program code is stored in the computer-readable storage medium, and the program code can be called by a processor to execute the method according to any one of claims 1 to 8.

Images