Augmented reality terminal device, adjustment method of augmented reality terminal device, and medium
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- HISENSE VISUAL TECH CO LTD
- Filing Date
- 2023-07-19
- Publication Date
- 2026-06-26
Smart Images
Figure CN119335743B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to the field of augmented reality technology, and in particular to a display device, an adjustment method for an augmented reality terminal device, and a medium. Background Technology
[0002] Augmented Reality (AR) terminal devices, such as AR glasses, are smart glasses with augmented reality functions. AR glasses can combine virtual images with real-world scenes to enhance the real world and improve the user's interactive experience.
[0003] In existing technologies, in the process of AR glasses combining virtual images with real-world scenes, real-world images corresponding to the real-world scene are captured by acquisition devices such as cameras. Areas in the real-world images are then enhanced to generate corresponding virtual images, thereby merging the virtual and real images to achieve enhancement of the real world.
[0004] However, due to the significant brightness difference between virtual and real images, the resulting blended virtual and real images may result in unclear display. Summary of the Invention
[0005] To address or at least partially address the aforementioned technical problems, this disclosure provides an augmented reality terminal device, an adjustment method for the augmented reality terminal device, and a medium. This method simultaneously combines the ambient light brightness value and the image brightness value of the augmented reality terminal device to determine a target adjustable brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, a second adjustable transmittance value for adjusting the transmittance of a first area of the transparent screen, and a first adjustable transmittance value for adjusting the transmittance of a second area. This avoids the influence of ambient light brightness and image brightness on the virtual image to be displayed, solving the problem of significant brightness differences between the virtual image and the real image during fusion, thereby improving the clarity of the virtual image and enhancing the user experience.
[0006] In a first aspect, this disclosure provides an augmented reality terminal device, which includes: a controller configured to:
[0007] In response to an adjustment command, the system acquires the ambient light brightness value of the augmented reality terminal device, the image brightness value, a first area on the transparent screen, and a second area of the transparent screen excluding the first area. The image brightness value is the brightness value of the target area on the real image corresponding to the target augmented area on the virtual image to be displayed. The first area is the mapping area of the target augmented area on the transparent screen. The adjustment command is used to instruct the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device.
[0008] Based on the relationship between the ambient light brightness value and the preset threshold, the first adjustable transmittance and the target adjustable brightness value are determined;
[0009] The second adjustment transmittance is determined based on the image brightness value, the target adjusted brightness value, and the first adjustment transmittance;
[0010] The brightness of the microdisplay is adjusted by the target brightness adjustment value, the transmittance of the second region is adjusted by the first transmittance adjustment, and the transmittance of the first region is adjusted by the second transmittance adjustment.
[0011] As an optional implementation of this disclosure, the controller is configured to:
[0012] Obtain the initial transmittance of the transparent screen, the first initial brightness value of the virtual image to be displayed, and the size of the virtual display interface used to display the virtual image to be displayed;
[0013] The preset threshold is determined based on the initial transmittance, the first initial brightness value, the size of the virtual display interface, and preset parameters.
[0014] As an optional implementation of this disclosure, the controller is specifically configured as follows:
[0015] When the ambient light brightness value is less than or equal to the preset threshold, the initial transmittance of the transparent screen is determined to be the first adjustable transmittance.
[0016] The target adjustable brightness value is determined based on the initial transmittance, the ambient light brightness value, the virtual display interface size, and the preset parameters.
[0017] As an optional implementation of this disclosure, the controller is specifically configured as follows:
[0018] When the ambient light intensity value is greater than the preset threshold, the first adjustable transmittance is determined based on the preset threshold and the ambient light intensity value;
[0019] The second initial brightness value of the microdisplay is determined to be the target adjusted brightness value, and the second initial brightness value is the brightness value of the microdisplay before brightness adjustment.
[0020] As an optional implementation of this disclosure, the controller is specifically configured as follows:
[0021] The second initial adjustment transmittance is determined based on the image brightness value and the target adjusted brightness value;
[0022] The second adjustable transmittance is obtained by summing the second initial adjustable transmittance and the first adjustable transmittance.
[0023] As an optional implementation of this disclosure, the controller is specifically configured as follows:
[0024] The target result is obtained by multiplying the preset value and the image brightness value.
[0025] Calculate the ratio of the target regulated brightness value to the target result to determine the second initial regulated transmittance.
[0026] As an optional implementation of this disclosure, the controller is further configured to:
[0027] Enhancement processing is performed on the target area of the real image captured by the acquisition device to obtain the virtual image to be displayed, which includes the target enhancement area.
[0028] Secondly, this disclosure provides a method for adjusting an augmented reality terminal device, including:
[0029] In response to an adjustment command, the system acquires the ambient light brightness value, image brightness value, a first area on the transparent screen, and a second area on the transparent screen excluding the first area. The image brightness value is the brightness value of the target area on the real image corresponding to the target augmented area on the virtual image to be displayed. The first area is the mapping area of the target augmented area on the transparent screen. The adjustment command is used to instruct the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device.
[0030] Based on the relationship between the ambient light brightness value and the preset threshold, the first adjustable transmittance and the target adjustable brightness value are determined;
[0031] The second adjustment transmittance is determined based on the image brightness value, the target adjusted brightness value, and the first adjustment transmittance;
[0032] The brightness of the microdisplay is adjusted by the target brightness adjustment value, the transmittance of the second region is adjusted by the first transmittance adjustment, and the transmittance of the first region is adjusted by the second transmittance adjustment.
[0033] As an optional implementation of this disclosure, before determining the first adjustable transmittance and the target adjustable brightness value based on the relationship between the ambient light brightness value and the preset threshold, the method further includes:
[0034] Obtain the initial transmittance of the transparent screen, the first initial brightness value of the virtual image to be displayed, and the size of the virtual display interface used to display the virtual image to be displayed;
[0035] The preset threshold is determined based on the initial transmittance, the first initial brightness value, the size of the virtual display interface, and preset parameters.
[0036] Thirdly, this disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the adjustment method for an augmented reality terminal device as described in the second aspect.
[0037] The technical solution provided in this disclosure has the following advantages compared with the prior art:
[0038] The controller of the augmented reality terminal device responds to the adjustment command by acquiring the ambient light brightness value, the image brightness value, a first area on the transparent screen, and a second area on the transparent screen excluding the first area. The image brightness value is the brightness value of the target area on the real image corresponding to the target augmented area on the virtual image to be displayed. The first area is the mapping area of the target augmented area on the transparent screen. The adjustment command instructs the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen. Based on the relationship between the ambient light brightness value and a preset threshold, a first adjustable transmittance and a target adjustable brightness value are determined. Based on the image brightness value, the target adjustable brightness value, and the first adjustable transmittance, a second adjustable transmittance is determined. The brightness of the microdisplay is adjusted using the target adjustable brightness value, the transmittance of the second area is adjusted using the first adjustable transmittance, and the transmittance of the first area is adjusted using the second adjustable transmittance. The above technical solution can simultaneously combine the ambient light brightness value and the image brightness value of the augmented reality terminal device to determine the target adjustable brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, as well as the second adjustable transmittance for adjusting the transmittance of the first area of the transparent screen and the first adjustable transmittance for adjusting the transmittance of the second area. This avoids the influence of ambient light brightness and image brightness on the virtual image to be displayed, solves the problem of large brightness differences between the virtual image to be displayed and the real image when they are blended, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience. Attached Figure Description
[0039] The accompanying drawings, which are incorporated in and form a part of this specification, illustrate embodiments consistent with this disclosure and, together with the description, serve to explain the principles of this disclosure.
[0040] To more clearly illustrate the technical solutions in the embodiments of this disclosure or the prior art, the accompanying drawings used in the description of the embodiments or the prior art will be briefly introduced below. Obviously, those skilled in the art can obtain other drawings based on these drawings without creative effort.
[0041] Figure 1 This is a schematic diagram illustrating an application scenario of an adjustment method for augmented reality terminal devices provided in an embodiment of this disclosure;
[0042] Figure 2 This is a hardware configuration block diagram of an augmented reality terminal device 200 according to one or more embodiments of the present disclosure;
[0043] Figure 3 A system framework diagram for adjusting augmented reality terminal devices according to one or more embodiments of this disclosure;
[0044] Figure 4 A flowchart illustrating an adjustment method for an augmented reality terminal device provided in this embodiment of the present disclosure;
[0045] Figure 5A A schematic diagram of a real image including a target area provided in an embodiment of this disclosure;
[0046] Figure 5B A schematic diagram of a virtual image to be displayed, including a target enhancement region, provided for an embodiment of this disclosure;
[0047] Figure 5C A schematic diagram of a first region provided in an embodiment of this disclosure;
[0048] Figure 6A A flowchart illustrating another adjustment method for an augmented reality terminal device provided in this embodiment of the present disclosure;
[0049] Figure 6B This is a schematic diagram of a virtual display interface 600 for displaying a virtual image to be displayed, provided in an embodiment of this disclosure.
[0050] Figure 7 A flowchart illustrating another adjustment method for an augmented reality terminal device provided in this embodiment of the present disclosure;
[0051] Figure 8 A flowchart illustrating another adjustment method for an augmented reality terminal device provided in this embodiment of the present disclosure;
[0052] Figure 9 This is a flowchart illustrating another adjustment method for an augmented reality terminal device provided in an embodiment of this disclosure. Detailed Implementation
[0053] To better understand the above-mentioned objectives, features, and advantages of this disclosure, the solutions disclosed herein will be further described below. It should be noted that, unless otherwise specified, the embodiments and features described herein can be combined with each other.
[0054] Numerous specific details are set forth in the following description in order to provide a full understanding of this disclosure, but this disclosure may also be implemented in other ways different from those described herein; obviously, the embodiments in the specification are only some, and not all, of the embodiments of this disclosure.
[0055] The terms "first" and "second," etc., used in this disclosure are used to distinguish different objects, not to describe a specific order of objects. For example, "first processing result" and "second processing result," etc., are used to distinguish different processing results, not to describe a specific order of processing results.
[0056] The display device provided in this application can have various implementation forms, such as a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. This disclosure does not limit the specific type of display device.
[0057] Augmented reality (AR) technology is a technique that cleverly integrates virtual images with real-world scenes. It widely utilizes various technologies such as multimedia, 3D modeling, intelligent interaction, and sensing to simulate and then apply virtual information such as generated text, images, 3D models, music, and videos to the real world, thereby achieving the fusion between virtual images and real-world scenes and enhancing the real world.
[0058] For example, Figure 1 This is a schematic diagram of an application scenario for an adjustment method for augmented reality terminal devices provided in this embodiment of the present disclosure. In the prior art, for augmented reality terminal devices such as AR glasses 200, in the process of combining virtual images with real scenes, a real image corresponding to the real scene can be acquired by a data acquisition device such as a camera 202, and the area in the real image can be enhanced to generate a corresponding virtual image. In this way, the virtual image and the real image are merged, thereby enhancing the real world and improving the user's visual experience.
[0059] However, for virtual images, their brightness can be affected by various factors, such as the brightness of the microdisplay in the AR glasses 200, the transmittance of the transparent screen, the brightness of the corresponding real image, and the ambient light level in which the AR glasses 200 are located. For example, when the user is outdoors, the strong ambient light entering the AR glasses can affect the contrast between the virtual image and the real image, making it difficult for the user to see the virtual image clearly. In other words, it is understandable that because there are many factors affecting the brightness of the virtual image, there may be a significant difference between the brightness of the virtual image and the brightness of the real image. This can result in unclear display after the virtual and real images are merged, thus reducing the user experience.
[0060] To address the aforementioned issues, this disclosure proposes an adjustment method for an augmented reality terminal device. Responding to an adjustment command, the method acquires the ambient light brightness value, image brightness value, a first area on a transparent screen, and a second area on the transparent screen excluding the first area. The image brightness value is the brightness value of the target area on the real image corresponding to the target augmented area on the virtual image to be displayed. The first area is the mapping area of the target augmented area on the transparent screen. The adjustment command instructs the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen. A first adjustment transmittance and a target adjustment brightness value are determined based on the relationship between the ambient light brightness value and a preset threshold. A second adjustment transmittance is determined based on the image brightness value, the target adjustment brightness value, and the first adjustment transmittance. The brightness of the microdisplay is adjusted using the target adjustment brightness value, the transmittance of the second area is adjusted using the first adjustment transmittance, and the transmittance of the first area is adjusted using the second adjustment transmittance. The above technical solution can simultaneously combine the ambient light brightness value and the image brightness value of the augmented reality terminal device to determine the target adjustable brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, as well as the second adjustable transmittance for adjusting the transmittance of the first area of the transparent screen and the first adjustable transmittance for adjusting the transmittance of the second area. This avoids the influence of ambient light brightness and image brightness on the virtual image to be displayed, solves the problem of large brightness differences between the virtual image to be displayed and the real image when they are blended, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience.
[0061] In some embodiments, the terminal device may install software applications with the augmented reality terminal device 200 to establish a connection and communication via network communication protocols, achieving one-to-one control operations and data communication. The augmented reality terminal device 200 can also communicate with a server through various communication methods, allowing it to connect via a local area network (LAN), wireless local area network (WLAN), and other networks. The server can be a cluster or multiple clusters, and may include one or more types of servers. The server can provide various content and interactive features to the augmented reality terminal device 200. The augmented reality terminal device 200 may be AR glasses.
[0062] Figure 2 This is a hardware configuration block diagram of an augmented reality terminal device 200 according to one or more embodiments of this disclosure. Figure 2 The augmented reality terminal device 200 shown includes at least one of the following: a communicator 220, a detector 230, an external device interface 240, a controller 250, a microdisplay 260, a memory, and a power supply. The controller 250 includes a central processing unit, a video processor, an audio processor, a graphics processor, RAM, ROM, and a first to nth interface for input / output. The microdisplay 260 can be a projection display, or a projection device and projection screen. The communicator 220 is a component used to communicate with external devices or servers according to various communication protocol types. For example, the communicator may include at least one of the following: a Wi-Fi module, a Bluetooth module, a wired Ethernet module, other network communication protocol chips or near-field communication protocol chips, and an infrared receiver. The augmented reality terminal device 200 can establish the transmission and reception of control signals and data signals with external control devices or servers through the communicator 220. The detector 230 is used to collect signals from the external environment or to interact with the external environment. The controller 250 can be located in different separate devices. The user interface can be used to receive control signals from control devices (such as infrared remote controls).
[0063] In some embodiments, the controller 250 controls the operation of the augmented reality terminal device and responds to user operations through various software control programs stored in memory. The controller 250 controls the overall operation of the augmented reality terminal device 200. The user can input user commands through a graphical user interface (GUI) displayed on the microdisplay 260, and the user input interface receives the user input commands through the GUI. Alternatively, the user can input user commands by entering specific sounds or gestures, and the user input interface receives the user input commands by recognizing the sounds or gestures through sensors.
[0064] In some embodiments, a "user interface" is the medium through which an application or operating system interacts and exchanges information with a user, enabling the conversion between the internal form of information and a form acceptable to the user. A common form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed graphically. It can be interface elements such as icons, windows, and controls displayed on the screen of an electronic device. Controls can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, and widgets.
[0065] In some embodiments, the augmented reality terminal device described above is a terminal device with augmented reality functionality, such as AR glasses. The controller of the augmented reality terminal device responds to an adjustment command by acquiring the ambient light brightness value, image brightness value, a first area on the transparent screen, and a second area on the transparent screen excluding the first area. The image brightness value is the brightness value of the target area on the real image corresponding to the target augmented area on the virtual image to be displayed. The first area is the mapping area of the target augmented area on the transparent screen. The adjustment command is used to instruct the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device. A first adjustable transmittance and a target adjustable brightness value are determined based on the relationship between the ambient light brightness value and a preset threshold. A second adjustable transmittance is determined based on the image brightness value, the target adjustable brightness value, and the first adjustable transmittance. The brightness of the microdisplay is adjusted using the target adjustable brightness value, the transmittance of the second area is adjusted using the first adjustable transmittance, and the transmittance of the first area is adjusted using the second adjustable transmittance. The above technical solution can simultaneously combine the ambient light brightness value and the image brightness value of the augmented reality terminal device to determine the target adjustable brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, as well as the second adjustable transmittance for adjusting the transmittance of the first area of the transparent screen and the first adjustable transmittance for adjusting the transmittance of the second area. This avoids the influence of ambient light brightness and image brightness on the virtual image to be displayed, solves the problem of large brightness differences between the virtual image to be displayed and the real image when they are blended, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience.
[0066] Figure 3 This is a system framework diagram for adjusting augmented reality terminal devices according to one or more embodiments of this disclosure, such as... Figure 3As shown, the system may include an acquisition module 31, a first determination module 32, a second determination module 33, and an adjustment module 34. The acquisition module 31, in response to an adjustment command, acquires the ambient light brightness value, image brightness value, a first area on the transparent screen, and a second area on the transparent screen excluding the first area. The image brightness value is the brightness value of the target area on the real image corresponding to the target augmented area on the virtual image to be displayed. The first area is the mapping area of the target augmented area on the transparent screen. The adjustment command instructs the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device. The first determination module 32 determines a first adjustable transmittance and a target adjustable brightness value based on the relationship between the ambient light brightness value and a preset threshold. The second determination module 33 determines a second adjustable transmittance based on the image brightness value, the target adjustable brightness value, and the first adjustable transmittance. The adjustment module 34 adjusts the brightness of the microdisplay using the target adjustable brightness value, adjusts the transmittance of the second area using the first adjustable transmittance, and adjusts the transmittance of the first area using the second adjustable transmittance. The above technical solution can simultaneously combine the ambient light brightness value and the image brightness value of the augmented reality terminal device to determine the target adjustable brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, as well as the second adjustable transmittance for adjusting the transmittance of the first area of the transparent screen and the first adjustable transmittance for adjusting the transmittance of the second area. This avoids the influence of ambient light brightness and image brightness on the virtual image to be displayed, solves the problem of large brightness differences between the virtual image to be displayed and the real image when they are blended, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience.
[0067] To illustrate this solution in more detail, the following will use examples to illustrate it. Figure 4 To explain, it is understandable that Figure 4 The steps involved may include more or fewer steps in actual implementation, and the order of these steps may also be different, depending on whether the adjustment method of the augmented reality terminal device provided in the embodiments of this disclosure can be implemented. The embodiments of this disclosure do not limit the steps.
[0068] Figure 4 This is a flowchart illustrating an adjustment method for an augmented reality terminal device provided in an embodiment of this disclosure. The augmented reality terminal device in this embodiment is described using AR glasses. The AR glasses are equipped with acquisition devices such as a camera, a controller, a microdisplay, and a transparent screen. Based on this, as... Figure 4 As shown, the adjustment method for this augmented reality terminal device specifically includes the following steps:
[0069] S41, in response to the adjustment command, acquires the ambient light brightness value of the augmented reality terminal device, the image brightness value, the first area on the transparent screen, and the second area of the transparent screen excluding the first area.
[0070] Wherein, the image brightness value is the brightness value of the target area corresponding to the enhanced area on the virtual image to be displayed in the real image. The virtual image to be displayed is obtained by enhancing the real image. Based on this, one way to obtain the virtual image to be displayed can be:
[0071] Enhancement processing is performed on the target area of the real image captured by the acquisition device to obtain a virtual image to be displayed, which includes the enhanced target area.
[0072] Specifically, the controller of the augmented reality terminal device receives the real image captured by the acquisition device, performs enhancement processing on the target area of the real image, and obtains a virtual image to be displayed, including the target enhancement area.
[0073] For example, refer to Figures 5A-5B As shown, the target area 501 on the real image 500 is enhanced to obtain a virtual image 502 to be displayed, which includes the target enhanced area 503. Based on this, in this embodiment, the image brightness value is the brightness value corresponding to the target area 501 on the real image 500, but it is not limited thereto, and this disclosure does not specifically limit it.
[0074] The first region mentioned above is the mapping area of the target enhancement region on the transparent screen. For example, refer to... Figure 5C As shown, the mapping area 504 corresponding to the target enhancement area 503 on the transparent screen 201 is the first area, but it is not limited thereto, and this disclosure does not specifically limit it.
[0075] The aforementioned adjustment commands are used to instruct the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device. Transmittance refers to the ability of external light to pass through a medium, specifically the percentage of luminous flux passing through a transparent or semi-transparent screen relative to the incident luminous flux. Furthermore, it should be noted that the transmittance of the transparent screen directly affects the display effect of the virtual image to be displayed, such as the contrast between the virtual image and the real image. Therefore, determining an appropriate transmittance can improve the display effect of the virtual image, thereby enhancing the user's visual experience.
[0076] Optionally, the ambient light value of the augmented reality terminal device can be obtained through sensors installed on the augmented reality terminal device. However, this is not a limitation, and this disclosure does not impose specific restrictions. Those skilled in the art can set the appropriate settings according to the actual situation.
[0077] Specifically, the controller of the augmented reality terminal device receives and responds to adjustment commands for instructing the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the adjustment of the transmittance of the transparent screen, and obtains the ambient light brightness value of the augmented reality terminal device, the image brightness value of the target area corresponding to the target area on the real image on the virtual image to be displayed, the first area of the target enhancement area mapped on the transparent screen, and the second area of the transparent screen excluding the first area.
[0078] Optionally, based on the above embodiments, in some embodiments of this disclosure, the adjustment command can be user input or generated based on the ambient light brightness value of the augmented reality terminal device. For example, when the ambient light around the augmented reality terminal device suddenly increases or decreases, resulting in a significant change in the ambient light brightness value, an adjustment command will be generated to adjust the brightness of the microdisplay and the transmittance of the transparent screen of the augmented reality terminal device in real time, so as to avoid a large brightness difference between the virtual image and the real image to be displayed, thereby providing a good visual experience for the user. However, this is not limited to this, and this disclosure does not specifically limit it. Those skilled in the art can set it according to the actual situation.
[0079] S42, determine the first adjustable transmittance and the target adjustable brightness value based on the relationship between the ambient light brightness value and the preset threshold.
[0080] The first adjustable transmittance is used to adjust the transmittance of the second area of the transparent screen of the augmented reality terminal device, and the target adjustable brightness value is used to adjust the brightness of the microdisplay of the augmented reality terminal device. The preset threshold is used to determine the parameter values of the first adjustable transmittance and the target adjustable brightness value. The value of the preset threshold can be determined based on the initial transmittance of the transparent screen, the first initial brightness value of the virtual image to be displayed, and the size of the virtual display interface used to display the virtual image to be displayed.
[0081] Specifically, the controller of the augmented reality terminal device compares the acquired ambient light brightness value with the preset threshold value, and determines the first adjustment transmittance and the target adjustment brightness value based on the relationship between the ambient light brightness value and the preset threshold value.
[0082] S43, determine the second adjustment transmittance based on the image brightness value, the target adjusted brightness value, and the first adjustment transmittance.
[0083] The second adjustment transmittance is used to adjust the transmittance of the first area of the transparent screen of the augmented reality terminal device.
[0084] Specifically, after obtaining the image brightness value, the target adjusted brightness value, and the first adjustment transmittance, the controller of the augmented reality terminal device determines the second adjustment transmittance based on the image brightness value, the target adjusted brightness value, and the first adjustment transmittance.
[0085] S44, adjust the brightness of the microdisplay by adjusting the target brightness value, adjust the transmittance of the second region by adjusting the first transmittance, and adjust the transmittance of the first region by adjusting the second transmittance.
[0086] Specifically, after obtaining the target adjustable brightness value for adjusting the brightness of the microdisplay, and the second and first adjustable transmittances corresponding to the first and second regions of the transparent screen, respectively, the controller of the augmented reality terminal device adjusts the brightness of the microdisplay according to the target adjustable brightness value, adjusts the transmittance of the second region of the transparent screen according to the first adjustable transmittance, and adjusts the transmittance of the first region of the transparent screen according to the second adjustable transmittance.
[0087] In the technical solution provided in this embodiment, the controller of the augmented reality terminal device responds to an adjustment command by acquiring the ambient light brightness value, the image brightness value, a first area on the transparent screen, and a second area on the transparent screen excluding the first area. The image brightness value is the brightness value of the target area on the real image corresponding to the target augmented area on the virtual image to be displayed. The first area is the mapping area of the target augmented area on the transparent screen. The adjustment command is used to instruct the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device. A first adjustable transmittance and a target adjustable brightness value are determined based on the relationship between the ambient light brightness value and a preset threshold. A second adjustable transmittance is determined based on the image brightness value, the target adjustable brightness value, and the first adjustable transmittance. The brightness of the microdisplay is adjusted using the target adjustable brightness value, the transmittance of the second area is adjusted using the first adjustable transmittance, and the transmittance of the first area is adjusted using the second adjustable transmittance. The above technical solution can simultaneously combine the ambient light brightness value and the image brightness value of the augmented reality terminal device to determine the target adjustable brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, as well as the second adjustable transmittance for adjusting the transmittance of the first area of the transparent screen and the first adjustable transmittance for adjusting the transmittance of the second area. This avoids the influence of ambient light brightness and image brightness on the virtual image to be displayed, solves the problem of large brightness differences between the virtual image to be displayed and the real image when they are blended, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience.
[0088] Optional, Figure 6A This is a flowchart illustrating another adjustment method for an augmented reality terminal device provided in an embodiment of this disclosure. Figure 6A Is Figure 4Further optimization based on the relationship between the ambient light brightness value and the preset threshold, before determining the first adjustable transmittance and the target adjustable brightness value, such as... Figure 6A As shown, one way to determine the preset threshold is:
[0089] S61, obtain the initial transmittance of the transparent screen, the first initial brightness value of the virtual image to be displayed, and the size of the virtual display interface used to display the virtual image to be displayed.
[0090] Among them, the initial transmittance refers to the initial transmittance of the transparent screen before adjustment, the first initial brightness value refers to the initial brightness value of the virtual image to be displayed as seen by the user before adjustment, and the virtual display interface size refers to the size of the virtual display interface for displaying the virtual image to be displayed.
[0091] For example, such as Figure 6B The diagram shown is a virtual display interface 600 used by an augmented reality terminal device to display a virtual image to be displayed. The size of the virtual display interface is the size of the virtual display interface 600, but it is not limited thereto. This disclosure does not impose specific limitations, and those skilled in the art can set it according to the actual situation.
[0092] S62, determine the preset threshold based on the initial transmittance, the first initial brightness value, the size of the virtual display interface, and preset parameters.
[0093] The preset parameter is used to ensure that the target adjustable brightness value corresponding to the brightness of the microdisplay of the augmented reality terminal device determined by the initial transmittance, the first initial brightness value, the virtual display interface, and the adjustable transmittance of the transparent screen of the augmented reality terminal device can meet the ambient light brightness of the current augmented reality terminal device. For example, the preset parameter can be 0.8. This disclosure does not specifically limit it. Those skilled in the art can set it according to the actual situation.
[0094] Specifically, the controller of the augmented reality terminal device obtains the initial transmittance of the transparent screen before adjustment, the first initial brightness value corresponding to the virtual image to be displayed, and the size of the virtual display interface used to display the virtual image to be displayed. After obtaining the initial transmittance, the first initial brightness value, and the size of the virtual display interface, a preset threshold is determined based on the initial transmittance, the first initial brightness value, the size of the virtual display interface, and preset parameters.
[0095] Optionally, based on the above embodiments, in some embodiments of this disclosure, the preset threshold is determined according to the initial transmittance, the first initial brightness value, the size of the virtual display interface, and preset parameters, and can be specifically limited by the following expression:
[0096]
[0097] Where m represents the initial transmittance of the transparent screen, n represents the first initial brightness value of the virtual image to be displayed, and s represents the size of the virtual display interface used to display the virtual image. However, this is not a limitation, and this disclosure does not impose specific restrictions. Those skilled in the art can set the values according to the actual situation.
[0098] In the technical solution provided by the embodiments of this disclosure, during the above process, a preset threshold can be determined based on the initial transmittance of the transparent screen without adjustment, the first initial brightness value corresponding to the virtual image to be displayed, the size of the virtual display interface displaying the virtual image to be displayed, and preset parameters. This enables the subsequent acquisition of a more accurate first adjustable transmittance, a second adjustable transmittance, and a target adjustable brightness value that conform to the ambient light brightness of the current augmented reality terminal device, thereby improving the clarity of the virtual image to be displayed and enhancing the user's visual experience.
[0099] Optional, Figure 7 This is a flowchart illustrating another adjustment method for an augmented reality terminal device provided in an embodiment of this disclosure. Figure 7 Is Figure 6A Further optimization is needed based on this. Since the preset threshold is determined by the initial transmittance of the unadjusted transparent screen, the first initial brightness value corresponding to the virtual image to be displayed, the size of the virtual display interface displaying the virtual image, and preset parameters, the relationship between the ambient light brightness value of the augmented reality terminal device and the preset threshold will affect the adjustment of the microdisplay's brightness and the transmittance of the transparent screen. Therefore, it is necessary to compare the ambient light brightness value with the preset threshold to determine the target adjustable brightness value for adjusting the microdisplay's brightness and the adjustable transmittance for adjusting the transparent screen. Figure 7 As shown, one way to determine the first adjustable transmittance and the target adjustable brightness value based on the relationship between the ambient light brightness value and the preset threshold is as follows:
[0100] S71, when the ambient light brightness value is less than or equal to a preset threshold, the initial transmittance of the transparent screen is determined to be the first adjustable transmittance.
[0101] It should be noted that when the ambient light brightness value is less than or equal to the preset threshold, it indicates that the ambient light brightness of the augmented reality terminal device is relatively dark. Based on this, in order to ensure that users can see the actual scene in which the augmented reality terminal device is located in the virtual image to be displayed after the augmentation processing based on the real image, the transmittance of the transparent screen can be left unadjusted. That is, the first adjustable transmittance is determined to be the initial transmittance of the transparent screen.
[0102] S72 determines the target brightness adjustment value based on the initial transmittance, ambient light brightness value, virtual display interface size, and preset parameters.
[0103] Specifically, the controller of the augmented reality terminal device compares the ambient light brightness value of the augmented reality terminal device with a preset threshold. When the ambient light brightness value is less than or equal to the preset threshold, the initial transmittance of the transparent screen is determined as the first adjustable transmittance. Furthermore, based on the initial transmittance, ambient light brightness value, virtual display interface size, and preset parameters, the target adjustable brightness value is determined.
[0104] Optionally, based on the above embodiments, in some embodiments of this disclosure, the target adjustable brightness value is determined according to the initial transmittance, ambient light brightness value, virtual display interface size, and preset parameters, and can be specifically limited by the following expression:
[0105] C = l × m ÷ s ÷ 0.8
[0106] Wherein, l represents the ambient light level of the augmented reality terminal device, m represents the initial transmittance of the transparent screen, and s represents the size of the virtual display interface used to display the virtual image to be displayed. However, this is not a limitation, and this disclosure does not impose specific restrictions. Those skilled in the art can set the values according to the actual situation.
[0107] Optionally, based on the above embodiments, reference may continue to be made to some embodiments of this disclosure. Figure 7 As shown, another way to determine the first adjustable transmittance and the target adjustable brightness value based on the relationship between the ambient light brightness value and the preset threshold is as follows:
[0108] S73, when the ambient light intensity value is greater than the preset threshold, determine the first adjustable transmittance based on the preset threshold and the ambient light intensity value.
[0109] S74, determine the second initial brightness value of the microdisplay as the target adjusted brightness value.
[0110] The second initial brightness value is the brightness value of the microdisplay before brightness adjustment. It should be noted that since the preset second initial brightness value of the microdisplay is determined based on historical experience, and adjusting the brightness of the microdisplay consumes a significant amount of power, when the ambient light brightness value is determined to be greater than the preset threshold, it indicates that the ambient light brightness of the augmented reality terminal device is currently relatively bright. Furthermore, the second initial brightness value of the microdisplay allows the current user to view the virtual image to be displayed at a comfortable viewing brightness. To avoid excessive power consumption, no brightness adjustment of the microdisplay is required; that is, the second initial brightness value of the microdisplay is determined to be the target brightness adjustment value.
[0111] Specifically, the controller of the augmented reality terminal device compares the ambient light brightness value of the augmented reality terminal device with a preset threshold. When it is determined that the ambient light brightness value is greater than the preset threshold, the controller determines the first adjustable transmittance based on the preset threshold and the ambient light brightness value. Furthermore, the controller determines the second initial brightness value of the microdisplay as the target adjustable brightness value.
[0112] Optionally, based on the above embodiments, in some embodiments of this disclosure, one way to determine the first adjustable transmittance according to the preset threshold and the ambient light brightness value is to calculate the ratio of the preset threshold to the ambient light brightness value and determine the ratio result as the first adjustable transmittance.
[0113] Optionally, based on the above embodiments, in some embodiments of this disclosure, the first adjustable transmittance may be specifically limited by the following expression:
[0114]
[0115] Among them, A T 1 represents the preset threshold; l represents the ambient light level of the augmented reality terminal device.
[0116] Figure 8 This is a flowchart illustrating another adjustment method for an augmented reality terminal device provided in this embodiment of the present disclosure. Figure 8 Is Figure 7 Further optimizations based on this, such as Figure 8 As shown, one way to determine the second adjustment transmittance based on the image brightness value, the target adjusted brightness value, and the first adjustment transmittance is as follows:
[0117] S81, determine the second initial adjustment transmittance based on the image brightness value and the target adjustment brightness value.
[0118] Specifically, the controller of the augmented reality terminal device determines the second initial adjustment transmittance based on the image brightness value and the target adjustment brightness value.
[0119] Optional, Figure 9 This is a flowchart illustrating another adjustment method for an augmented reality terminal device provided in this embodiment of the present disclosure. Figure 9 Is Figure 8 Further optimizations based on this, such as Figure 9 As shown, one way to determine the second initial adjustable transmittance based on the image brightness value and the target adjusted brightness value is as follows:
[0120] S91. Multiply the preset value and the image brightness value to obtain the target result.
[0121] The preset value is a parameter set to reduce the display contrast between the target enhancement area and the real image on the virtual image to be displayed when the transmittance of the first area of the transparent screen is adjusted according to the image brightness value. The preset value can be, for example, 1 or 2, and the value of the preset value can be specifically limited according to the current image brightness value.
[0122] S92. Calculate the ratio of the target regulated brightness value to the target result to determine the second initial regulated transmittance.
[0123] Specifically, the controller of the augmented reality terminal device performs a product operation on the preset value and the image brightness value to obtain the corresponding target result. Furthermore, it calculates the ratio of the target adjusted brightness value to the target result, and determines the ratio result as the second initial adjustment transmittance.
[0124] For example, following the above embodiments, when the preset value is 1, the second adjustable transmittance can be specifically defined by the following expression:
[0125] Wherein, C represents the target brightness adjustment value and L represents the image brightness value, but is not limited thereto. This disclosure does not impose specific limitations, and those skilled in the art can set it according to the actual situation.
[0126] When the preset value is 2, the second adjustable transmittance can be specifically limited by the following expression:
[0127]
[0128] S82, sum the second initial controlled transmittance and the first controlled transmittance to obtain the second controlled transmittance.
[0129] In the technical solution provided by this disclosure embodiment, during the above process, a second initial adjustment transmittance can be determined based on the image brightness value and the target adjustment brightness value; the second initial adjustment transmittance and the first adjustment transmittance are summed to obtain the second adjustment transmittance. That is, when adjusting the transmittance of the first region obtained by mapping the target enhancement region on the transparent screen, the influence of the image brightness of the corresponding target region on the display contrast of the target enhancement region on the real image is avoided, thereby improving the overall display effect of the virtual image to be displayed and providing users with a good visual experience.
[0130] This disclosure provides a computer-readable storage medium storing a computer program. When executed by a processor, the computer program implements the various processes of the adjustment method for the augmented reality terminal device described above, and achieves the same technical effect. To avoid repetition, further details are omitted here.
[0131] The computer-readable storage medium can be a read-only memory (ROM), a random access memory (RAM), a magnetic disk, or an optical disk, etc.
[0132] For ease of explanation, the above description has been provided in conjunction with specific embodiments. However, the discussion in some embodiments above is not intended to be exhaustive or to limit the embodiments to the specific forms disclosed above. Various modifications and variations can be obtained based on the above teachings. The selection and description of the above embodiments are for the purpose of better explaining the principles and practical applications, thereby enabling those skilled in the art to better utilize the embodiments and various different variations of the embodiments suitable for specific application considerations.
Claims
1. An augmented reality terminal device, characterized in that, include: The controller is configured as follows: In response to an adjustment command, the system acquires the ambient light brightness value, image brightness value, a first area on the transparent screen, and a second area on the transparent screen excluding the first area. The image brightness value is the brightness value of the target area on the real image corresponding to the target enhancement area on the virtual image to be displayed. The virtual image to be displayed is obtained by enhancing the real image. The first area is the mapping area of the target enhancement area on the transparent screen. The adjustment command is used to instruct the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device. Based on the relationship between the ambient light brightness value and the preset threshold, the first adjustable transmittance and the target adjustable brightness value are determined; The second adjustment transmittance is determined based on the image brightness value, the target adjusted brightness value, and the first adjustment transmittance; The brightness of the microdisplay is adjusted by adjusting the target brightness value, the transmittance of the second region is adjusted by adjusting the first transmittance, and the transmittance of the first region is adjusted by adjusting the second transmittance.
2. The augmented reality terminal device according to claim 1, characterized in that, The controller is configured as follows: Obtain the initial transmittance of the transparent screen, the first initial brightness value of the virtual image to be displayed, and the size of the virtual display interface used to display the virtual image to be displayed; The preset threshold is determined based on the initial transmittance, the first initial brightness value, the size of the virtual display interface, and preset parameters.
3. The augmented reality terminal device according to claim 2, characterized in that, The controller is specifically configured as follows: When the ambient light brightness value is less than or equal to the preset threshold, the initial transmittance of the transparent screen is determined to be the first adjustable transmittance. The target adjustable brightness value is determined based on the initial transmittance, the ambient light brightness value, the virtual display interface size, and the preset parameters.
4. The augmented reality terminal device according to claim 2, characterized in that, The controller is specifically configured as follows: When the ambient light intensity value is greater than the preset threshold, the first adjustable transmittance is determined based on the preset threshold and the ambient light intensity value; The second initial brightness value of the microdisplay is determined to be the target adjusted brightness value, and the second initial brightness value is the brightness value of the microdisplay before brightness adjustment.
5. The augmented reality terminal device according to claim 1, characterized in that, The controller is specifically configured as follows: The second initial adjustment transmittance is determined based on the image brightness value and the target adjusted brightness value; The second adjustable transmittance is obtained by summing the second initial adjustable transmittance and the first adjustable transmittance.
6. The augmented reality terminal device according to claim 5, characterized in that, The controller is specifically configured as follows: The target result is obtained by multiplying the preset value and the image brightness value. Calculate the ratio of the target regulated brightness value to the target result to determine the second initial regulated transmittance.
7. The augmented reality terminal device according to claim 1, characterized in that, The controller is also configured to: Enhancement processing is performed on the target area of the real image captured by the acquisition device to obtain the virtual image to be displayed, which includes the target enhancement area.
8. A method for adjusting an augmented reality terminal device, characterized in that, include: In response to an adjustment command, the system acquires the ambient light brightness value, image brightness value, a first area on the transparent screen, and a second area on the transparent screen excluding the first area. The image brightness value is the brightness value of the target area on the real image corresponding to the target enhancement area on the virtual image to be displayed. The virtual image to be displayed is obtained by enhancing the real image. The first area is the mapping area of the target enhancement area on the transparent screen. The adjustment command is used to instruct the adjustment of the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device. Based on the relationship between the ambient light brightness value and the preset threshold, the first adjustable transmittance and the target adjustable brightness value are determined; The second adjustment transmittance is determined based on the image brightness value, the target adjusted brightness value, and the first adjustment transmittance; The brightness of the microdisplay is adjusted by adjusting the target brightness value, the transmittance of the second region is adjusted by adjusting the first transmittance, and the transmittance of the first region is adjusted by adjusting the second transmittance.
9. The adjustment method for an augmented reality terminal device according to claim 8, characterized in that, Before determining the first adjustable transmittance and the target adjustable brightness value based on the relationship between the ambient light brightness value and the preset threshold, the method further includes: Obtain the initial transmittance of the transparent screen, the first initial brightness value of the virtual image to be displayed, and the size of the virtual display interface used to display the virtual image to be displayed; The preset threshold is determined based on the initial transmittance, the first initial brightness value, the size of the virtual display interface, and preset parameters.
10. A computer-readable storage medium having a computer program stored thereon, characterized in that, When the program is executed by the processor, it implements the steps of the adjustment method for the augmented reality terminal device as described in any one of claims 8-9.