Augmented reality terminal equipment, adjustment method of augmented reality terminal equipment and medium

Abstract

The invention relates to augmented reality terminal equipment, an augmented reality terminal equipment adjusting method and a medium, and the method comprises the steps: obtaining an environment light brightness value and a picture brightness value of the augmented reality terminal equipment, a first region on a transparent screen, and a second region, except the first region, of the transparent screen in response to an adjusting instruction, determining a first adjustment transmittance and a target adjustment brightness value according to a size relationship between the ambient light brightness value and a preset threshold value; determining a second adjustment transmittance according to the picture brightness value, the target adjustment brightness value and the first adjustment transmittance; and adjusting the brightness of the micro-display through the target adjustment brightness value, adjusting the transmittance of the second area through the first adjustment transmittance, and adjusting the transmittance of the first area through the second adjustment transmittance. According to the technical scheme, the definition of the virtual image to be displayed can be improved, and the user experience is improved.

Description

Technical Field

[0001] The present disclosure relates to the field of augmented reality technology, and in particular to a display device, an adjustment method for an augmented reality terminal device, and a medium. Background Art

[0002] Augmented Reality (AR) terminal devices, such as AR glasses, refer to smart glasses with augmented reality functions. AR glasses can combine virtual images with real scenes to enhance the real world and improve the user's interactive experience.

[0003] In the prior art, in the process of AR glasses combining virtual images with real scenes, real images corresponding to the real scenes are collected through collection devices such as cameras, and the areas in the real images are enhanced to generate corresponding virtual images, thereby merging the virtual images with the real images, thereby achieving enhancement of the real world.

[0004] However, since there may be a large brightness difference between the virtual image and the real image, there may be an issue of unclear display after the virtual image and the real image are merged. Summary of the invention

[0005] In order to solve the above technical problems or at least partially solve the above technical problems, the present disclosure provides an augmented reality terminal device, an adjustment method for the augmented reality terminal device and a medium, which can simultaneously combine the ambient light brightness value and the picture brightness value of the augmented reality terminal device to determine a target adjustment brightness value for adjusting the brightness of a micro display of the augmented reality terminal device, and a second adjustment transmittance for adjusting the transmittance of a first area of ​​a transparent screen, and a first adjustment transmittance of the transmittance of a second area, so as to avoid the influence of ambient light brightness and picture brightness on the virtual image to be displayed, solve the problem of large brightness difference between the virtual image to be displayed and the real image when they are merged, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience.

[0006] In a first aspect, the present disclosure provides an augmented reality terminal device, the augmented reality terminal device comprising: a controller configured to:

[0007] In response to the adjustment instruction, the brightness value of the ambient light in which the augmented reality terminal device is located, the brightness value of the picture, the first area on the transparent screen, and the second area of ​​the transparent screen excluding the first area are obtained, wherein the picture brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, the first area is the mapping area of ​​the target enhanced area on the transparent screen, and the adjustment instruction is used to instruct to adjust the brightness of the micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device;

[0008] Determining a first adjustment transmittance and a target adjustment brightness value according to a magnitude relationship between the ambient light brightness value and a preset threshold;

[0009] determining a second adjustment transmittance according to the picture brightness value, the target adjustment brightness value, and the first adjustment transmittance;

[0010] The brightness of the micro display is adjusted by the target adjustment brightness value, the transmittance of the second area is adjusted by the first adjustment transmittance, and the transmittance of the first area is adjusted by the second adjustment transmittance.

[0011] As an optional implementation of the embodiment of the present disclosure, the controller is configured as follows:

[0012] Acquire an initial transmittance corresponding to the transparent screen, a first initial brightness value corresponding to the virtual image to be displayed, and a size of a virtual display interface for displaying the virtual image to be displayed;

[0013] The preset threshold is determined according to the initial transmittance, the first initial brightness value, the size of the virtual display interface and preset parameters.

[0014] As an optional implementation of the embodiment of the present disclosure, the controller is specifically configured as follows:

[0015] When the ambient light brightness value is less than or equal to the preset threshold, determining the initial transmittance of the transparent screen to be the first adjusted transmittance;

[0016] The target adjustment brightness value is determined according to the initial transmittance, the ambient light brightness value, the virtual display interface size and the preset parameters.

[0017] As an optional implementation of the embodiment of the present disclosure, the controller is specifically configured as follows:

[0018] When the ambient light brightness value is greater than the preset threshold, determining the first adjustment transmittance according to the preset threshold and the ambient light brightness value;

[0019] A second initial brightness value of the micro display is determined to be the target adjusted brightness value, wherein the second initial brightness value is the brightness value of the micro display before brightness adjustment is performed.

[0020] As an optional implementation of the embodiment of the present disclosure, the controller is specifically configured as follows:

[0021] Determining a second initial adjustment transmittance according to the image brightness value and the target adjustment brightness value;

[0022] The second initial adjusted transmittance and the first adjusted transmittance are summed to obtain the second adjusted transmittance.

[0023] As an optional implementation of the embodiment of the present disclosure, the controller is specifically configured as follows:

[0024] Performing a product operation on the preset value and the brightness value of the image to obtain a target result;

[0025] The ratio of the target adjusted brightness value to the target result is calculated to determine the second initial adjusted transmittance.

[0026] As an optional implementation of the embodiment of the present disclosure, the controller is further configured as follows:

[0027] An enhancement process is performed on a target area of ​​the real image captured by the acquisition device to obtain the virtual image to be displayed including the target enhanced area.

[0028] In a second aspect, the present disclosure provides an adjustment method for an augmented reality terminal device, comprising:

[0029] In response to the adjustment instruction, the brightness value of the ambient light in which the augmented reality terminal device is located, the brightness value of the picture, the first area on the transparent screen, and the second area of ​​the transparent screen excluding the first area are obtained, wherein the picture brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, the first area is the mapping area of ​​the target enhanced area on the transparent screen, and the adjustment instruction is used to instruct to adjust the brightness of the micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device;

[0030] Determining a first adjustment transmittance and a target adjustment brightness value according to a magnitude relationship between the ambient light brightness value and a preset threshold;

[0031] determining a second adjustment transmittance according to the picture brightness value, the target adjustment brightness value, and the first adjustment transmittance;

[0032] The brightness of the micro display is adjusted by the target adjustment brightness value, the transmittance of the second area is adjusted by the first adjustment transmittance, and the transmittance of the first area is adjusted by the second adjustment transmittance.

[0033] As an optional implementation of the embodiment of the present disclosure, before determining the first adjustment transmittance and the target adjustment brightness value according to the magnitude relationship between the ambient light brightness value and the preset threshold, the method further includes:

[0034] Acquire an initial transmittance corresponding to the transparent screen, a first initial brightness value corresponding to the virtual image to be displayed, and a size of a virtual display interface for displaying the virtual image to be displayed;

[0035] The preset threshold is determined according to the initial transmittance, the first initial brightness value, the size of the virtual display interface and preset parameters.

[0036] In a third aspect, the present disclosure provides a computer-readable storage medium having a computer program stored thereon, which, when executed by a processor, implements the adjustment method of the augmented reality terminal device as described in the second aspect.

[0037] Compared with the prior art, the technical solution provided by the embodiments of the present disclosure has the following advantages:

[0038] The controller of the augmented reality terminal device responds to the adjustment instruction to obtain the ambient light brightness value, the image brightness value, the first area on the transparent screen and the second area of ​​the transparent screen excluding the first area of ​​the augmented reality terminal device, wherein the image brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, and the first area is the mapping area of ​​the target enhanced area on the transparent screen. The adjustment instruction is used to instruct to adjust the brightness of the micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device; determine the first adjustment transmittance and the target adjustment brightness value according to the relationship between the ambient light brightness value and the preset threshold; determine the second adjustment transmittance according to the image brightness value, the target adjustment brightness value and the first adjustment transmittance; adjust the brightness of the micro display by the target adjustment brightness value, adjust the transmittance of the second area by the first adjustment transmittance, and adjust the transmittance of the first area by the second adjustment transmittance. In the above technical scheme, the target adjustment brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, the second adjustment transmittance for adjusting the transmittance of the first area of ​​the transparent screen, and the first adjustment transmittance of the transmittance of the second area can be determined by combining the ambient light brightness value and the picture brightness value of the augmented reality terminal device at the same time, so as to avoid the influence of the ambient light brightness and the picture brightness on the virtual image to be displayed, solve the problem of large brightness difference between the virtual image to be displayed and the real image when they are merged, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience. BRIEF DESCRIPTION OF THE DRAWINGS

[0039] The accompanying drawings, which are incorporated in and constitute a part of this specification, illustrate embodiments consistent with the present disclosure and, together with the description, serve to explain the principles of the present disclosure.

[0040] In order to more clearly illustrate the embodiments of the present invention or the technical solutions in the prior art, the drawings required for use in the embodiments or the description of the prior art will be briefly introduced below. Obviously, for ordinary technicians in this field, other drawings can be obtained based on these drawings without paying any creative labor.

[0041] Figure 1 A schematic diagram of an application scenario of an adjustment method supporting an augmented reality terminal device provided by an embodiment of the present disclosure;

[0042] Figure 2 is a hardware configuration block diagram of an augmented reality terminal device 200 according to one or more embodiments of the present disclosure;

[0043] Figure 3 A system framework diagram for adjusting an augmented reality terminal device according to one or more embodiments of the present disclosure;

[0044] Figure 4 A flowchart of an adjustment method for an augmented reality terminal device provided by an embodiment of the present disclosure;

[0045] Figure 5A A schematic diagram of a real image picture including a target area provided by an embodiment of the present disclosure;

[0046] Figure 5B A schematic diagram of a virtual image to be displayed including a target enhancement area provided in an embodiment of the present disclosure;

[0047] Figure 5C A schematic diagram of a first area provided in an embodiment of the present disclosure;

[0048] Fig. 6A A flowchart of another method for adjusting an augmented reality terminal device provided by an embodiment of the present disclosure;

[0049] Figure 6B A schematic diagram of an interface of a virtual display interface 600 for displaying a virtual image to be displayed provided by an embodiment of the present disclosure;

[0050] Figure 7 A flowchart of another method for adjusting an augmented reality terminal device provided in an embodiment of the present disclosure;

[0051] Figure 8 A flowchart of another method for adjusting an augmented reality terminal device provided by an embodiment of the present disclosure;

[0052] Fig. 9 A flowchart of another method for adjusting an augmented reality terminal device provided in an embodiment of the present disclosure. DETAILED DESCRIPTION

[0053] In order to more clearly understand the above-mentioned objectives, features and advantages of the present disclosure, the scheme of the present disclosure will be further described below. It should be noted that the embodiments of the present disclosure and the features in the embodiments can be combined with each other without conflict.

[0054] In the following description, many specific details are set forth to facilitate a full understanding of the present disclosure, but the present disclosure may also be implemented in other ways different from those described herein; it is obvious that the embodiments in the specification are only part of the embodiments of the present disclosure, rather than all of the embodiments.

[0055] The terms "first" and "second" in this disclosure are used to distinguish different objects rather than to describe a specific order of objects. For example, a first processing result and a second processing result are used to distinguish different processing results rather than to describe a specific order of processing results.

[0056] The display device provided in the embodiments of the present application may have various implementation forms, for example, it may be a television, a smart television, a laser projection device, a monitor, an electronic bulletin board, an electronic table, etc. The embodiments of the present disclosure do not limit the specific type of the display device.

[0057] Augmented reality technology is a technology that cleverly combines virtual images with real reality scenes. It widely uses various technical means such as multimedia, three-dimensional modeling, intelligent interaction, and sensing. After simulating the generated virtual information such as text, images, three-dimensional models, music, and videos, it is further applied to the real world to achieve the fusion of virtual images and real scenes, thereby enhancing the real world.

[0058] For example, Figure 1 A schematic diagram of an application scenario of an adjustment method supporting an augmented reality terminal device provided in an embodiment of the present disclosure. In the prior art, in the process of realizing the combination of a virtual image and a real scene, an augmented reality terminal device such as AR glasses 200 can capture a real image corresponding to the real scene through a capture device such as a camera 202, enhance the area in the real image, and generate a corresponding virtual image, so as to merge the virtual image with the real image, thereby realizing the enhancement of the real world and improving the user's visual experience.

[0059] However, for virtual images, since the brightness of the virtual images may be affected by multiple factors such as the brightness of the microdisplay of the AR glasses 200, the transmittance of the transparent screen, the brightness corresponding to the real image, and the brightness of the ambient light in which the AR glasses 200 are located, for example, when the user is in an outdoor environment, the outdoor ambient light is strong. When the strong light enters the AR glasses, it will affect the contrast between the virtual image to be displayed and the real image, causing the user to not be able to see the virtual image to be displayed clearly. That is, it can be understood that since there are many factors affecting the brightness of the virtual image to be displayed, there may be a large difference between the brightness corresponding to the virtual image to be displayed and the brightness corresponding to the real image, which makes the virtual image and the real image merge. When the display is unclear, there is a problem of unclear display, which reduces the user experience.

[0060] In order to solve the above problems, an embodiment of the present disclosure proposes an adjustment method for an augmented reality terminal device, which obtains the ambient light brightness value, image brightness value, a first area on a transparent screen and a second area of ​​the transparent screen excluding the first area of ​​the augmented reality terminal device in response to an adjustment instruction, wherein the image brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, and the first area is the mapping area of ​​the target enhanced area on the transparent screen. The adjustment instruction is used to instruct to adjust the brightness of a micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device; determine the first adjustment transmittance and the target adjustment brightness value according to the relationship between the ambient light brightness value and a preset threshold; determine the second adjustment transmittance according to the image brightness value, the target adjustment brightness value and the first adjustment transmittance; adjust the brightness of the micro display by the target adjustment brightness value, adjust the transmittance of the second area by the first adjustment transmittance, and adjust the transmittance of the first area by the second adjustment transmittance. In the above technical scheme, the target adjustment brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, the second adjustment transmittance for adjusting the transmittance of the first area of ​​the transparent screen, and the first adjustment transmittance of the transmittance of the second area can be determined by combining the ambient light brightness value and the picture brightness value of the augmented reality terminal device at the same time, so as to avoid the influence of the ambient light brightness and the picture brightness on the virtual image to be displayed, solve the problem of large brightness difference between the virtual image to be displayed and the real image when they are merged, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience.

[0061] In some embodiments, the terminal device can install software applications with the augmented reality terminal device 200, and achieve connection and communication through a network communication protocol to achieve the purpose of one-to-one control operation and data communication. The augmented reality terminal device 200 can also communicate data with the server through a variety of communication methods, allowing the augmented reality terminal device 200 to communicate and connect through a local area network (LAN), a wireless local area network (WLAN) and other networks. The server can be a cluster or multiple clusters, and can include one or more types of servers. The server can provide various content and interactions to the augmented reality terminal device 200. The augmented reality terminal device 200 can be AR glasses.

[0062] Figure 2 FIG. 2 is a block diagram of a hardware configuration of an augmented reality terminal device 200 according to one or more embodiments of the present disclosure. Figure 2 The augmented reality terminal device 200 shown includes at least one of a communicator 220, a detector 230, an external device interface 240, a controller 250, a microdisplay 260, a memory, and a power supply. The controller 250 includes a central processing unit, a video processor, an audio processor, a graphics processor, a RAM, a ROM, and a first interface to an nth interface for input / output. The microdisplay 260 can be a projection display, and can also be a projection device and a projection screen. The communicator 220 is a component for communicating with an external device or server according to various communication protocol types. For example: the communicator may include other network communication protocol chips or near field communication protocol chips such as a Wifi module, a Bluetooth module, a wired Ethernet module, and at least one of an infrared receiver. The augmented reality terminal device 200 can establish the sending and receiving of control signals and data signals with an external control device or server through the communicator 220. The detector 230 is used to collect signals of the external environment or interact with the outside. The controller 250 can be located in different split devices. The user interface can be used to receive control signals of a control device (such as an infrared remote controller, etc.).

[0063] In some embodiments, the controller 250 controls the operation of the augmented reality terminal device and responds to the user's operation through various software control programs stored in the memory. The controller 250 controls the overall operation of the augmented reality terminal device 200. The user can input a user command in the graphical user interface (GUI) displayed on the micro display 260, and the user input interface receives the user input command through the graphical user interface (GUI). Alternatively, the user can input a user command by inputting a specific sound or gesture, and the user input interface recognizes the sound or gesture through the sensor to receive the user input command.

[0064] In some embodiments, "user interface" is a medium interface for interaction and information exchange between an application or operating system and a user, which realizes the conversion between the internal form of information and the form acceptable to the user. The commonly used form of user interface is the graphical user interface (GUI), which refers to a user interface related to computer operation displayed in a graphical manner. It can be an interface element such as an icon, window, and control displayed on the display screen of an electronic device, where the control can include at least one of the visual interface elements such as icons, buttons, menus, tabs, text boxes, dialog boxes, status bars, navigation bars, widgets, etc.

[0065] In some embodiments, the above-mentioned augmented reality terminal device is a terminal device with augmented reality function, such as AR glasses. The controller of the augmented reality terminal device responds to the adjustment instruction to obtain the ambient light brightness value, the picture brightness value, the first area on the transparent screen, and the second area of ​​the transparent screen excluding the first area where the augmented reality terminal device is located, wherein the picture brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, and the first area is the mapping area of ​​the target enhanced area on the transparent screen. The adjustment instruction is used to instruct to adjust the brightness of the micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device; determine the first adjustment transmittance and the target adjustment brightness value according to the size relationship between the ambient light brightness value and the preset threshold; determine the second adjustment transmittance according to the picture brightness value, the target adjustment brightness value and the first adjustment transmittance; adjust the brightness of the micro display by the target adjustment brightness value, adjust the transmittance of the second area by the first adjustment transmittance, and adjust the transmittance of the first area by the second adjustment transmittance. In the above technical scheme, the target adjustment brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, the second adjustment transmittance for adjusting the transmittance of the first area of ​​the transparent screen, and the first adjustment transmittance of the transmittance of the second area can be determined by combining the ambient light brightness value and the picture brightness value of the augmented reality terminal device at the same time, so as to avoid the influence of the ambient light brightness and the picture brightness on the virtual image to be displayed, solve the problem of large brightness difference between the virtual image to be displayed and the real image when they are merged, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience.

[0066] Figure 3 A system framework diagram for adjusting an augmented reality terminal device according to one or more embodiments of the present disclosure is shown as follows: Figure 3As shown, the system may include an acquisition module 31, a first determination module 32, a second determination module 33 and an adjustment module 34. The acquisition module 31 is used to respond to the adjustment instruction to acquire the ambient light brightness value, the image brightness value, the first area on the transparent screen and the second area of ​​the transparent screen excluding the first area of ​​the augmented reality terminal device, wherein the image brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, and the first area is the mapping area of ​​the target enhanced area on the transparent screen. The adjustment instruction is used to instruct to adjust the brightness of the micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device; the first determination module 32 is used to determine the first adjustment transmittance and the target adjustment brightness value according to the magnitude relationship between the ambient light brightness value and the preset threshold; the second determination module 33 is used to determine the second adjustment transmittance according to the image brightness value, the target adjustment brightness value and the first adjustment transmittance; the adjustment module 34 is used to adjust the brightness of the micro display by the target adjustment brightness value, adjust the transmittance of the second area by the first adjustment transmittance, and adjust the transmittance of the first area by the second adjustment transmittance. In the above technical scheme, the target adjustment brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, the second adjustment transmittance for adjusting the transmittance of the first area of ​​the transparent screen, and the first adjustment transmittance of the transmittance of the second area can be determined by combining the ambient light brightness value and the picture brightness value of the augmented reality terminal device at the same time, so as to avoid the influence of the ambient light brightness and the picture brightness on the virtual image to be displayed, solve the problem of large brightness difference between the virtual image to be displayed and the real image when they are merged, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience.

[0067] In order to explain this scheme in more detail, the following will be combined in an exemplary manner Figure 4 To explain, it is understandable that Figure 4 The steps involved may include more steps or fewer steps in actual implementation, and the order of these steps may also be different, subject to the ability to implement the adjustment method of the augmented reality terminal device provided in the embodiment of the present disclosure, and the embodiment of the present disclosure is not limited.

[0068] Figure 4 A flowchart of an adjustment method for an augmented reality terminal device provided in an embodiment of the present disclosure is provided. The augmented reality terminal device in this embodiment is illustrated by AR glasses. The AR glasses are provided with acquisition devices such as a camera, a controller, a micro display, and a transparent screen. Based on this, Figure 4 As shown, the adjustment method of the augmented reality terminal device specifically includes the following steps:

[0069] S41, in response to the adjustment instruction, obtaining the ambient light brightness value of the augmented reality terminal device, the image brightness value, the first area on the transparent screen, and the second area of ​​the transparent screen excluding the first area.

[0070] The image brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image. The virtual image to be displayed is obtained by enhancing the real image. Based on this, one way to obtain the virtual image to be displayed may be:

[0071] The target area of ​​the real image captured by the acquisition device is enhanced to obtain a virtual image to be displayed including the target enhanced area.

[0072] Specifically, the controller of the augmented reality terminal device receives the real image picture collected by the collection device, and performs enhancement processing on the target area of ​​the real image picture to obtain a virtual image to be displayed including the target enhanced area.

[0073] Exemplary, reference Figure 5A-Figure 5B As shown, the target area 501 on the real image 500 is enhanced to obtain a virtual image 502 to be displayed including a target enhanced area 503. Based on this, in this embodiment, the image brightness value is the brightness value corresponding to the target area 501 on the real image 500, but is not limited to this, and the present disclosure does not specifically limit it.

[0074] The first area is the mapping area of ​​the target enhancement area on the transparent screen, for example, refer to Figure 5C As shown, the mapping area 504 corresponding to the target enhancement area 503 on the transparent screen 201 is the first area, but it is not limited thereto and the present disclosure does not specifically limit this.

[0075] The above adjustment instructions are used to instruct the adjustment of the brightness of the micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device. Among them, the transmittance refers to the ability of external light to pass through the medium, specifically the percentage of the luminous flux passing through the transparent screen or the semi-transparent screen to its incident luminous flux. Further, it should be noted that the transmittance of the transparent screen can directly affect the display effect of the virtual image to be displayed, such as the contrast between the virtual image to be displayed and the real image. Therefore, determining the appropriate transmittance can improve the display effect of the virtual image to be displayed, thereby improving the user's visual experience.

[0076] Optionally, the brightness value of the ambient light in which the augmented reality terminal device is located may be obtained by a sensor provided on the augmented reality terminal device. However, the present disclosure is not limited thereto, and those skilled in the art may set the brightness value according to actual conditions.

[0077] Specifically, the controller of the augmented reality terminal device receives and responds to adjustment instructions for instructing to adjust the brightness of the microdisplay of the augmented reality terminal device and adjusting the transmittance of the transparent screen, and obtains the brightness value of the ambient light in which the augmented reality terminal device is located, the image brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, the first area of ​​the transparent screen where the target enhanced area is mapped, and the second area of ​​the transparent screen excluding the first area.

[0078] Optionally, based on the above embodiments, in some embodiments of the present disclosure, the adjustment instruction can be input by the user, or can be generated according to the brightness value of the ambient light in which the augmented reality terminal device is located. For example, for the augmented reality terminal device, when the external light in the environment in which the augmented reality terminal device is located suddenly increases or decreases, thereby causing the brightness value of the ambient light in which it is located to change significantly, an adjustment instruction will be generated at this time to adjust the brightness of the microdisplay of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device in real time to avoid a large brightness difference between the virtual image to be displayed and the real image, thereby providing the user with a good visual experience, but not limited to this, the present disclosure is not specifically limited, and those skilled in the art can set it according to actual conditions.

[0079] S42, determining a first adjustment transmittance and a target adjustment brightness value according to a magnitude relationship between the ambient light brightness value and a preset threshold value.

[0080] Among them, the first adjustment transmittance is used to adjust the transmittance of the second area of ​​the transparent screen of the augmented reality terminal device, and the target adjustment brightness value is used to adjust the brightness of the micro display of the augmented reality terminal device. The preset threshold is used to determine how to obtain the parameter value of the first adjustment transmittance and the target adjustment brightness value. The value of the preset threshold can be determined according to the initial transmittance corresponding to the transparent screen, the first initial brightness value corresponding to the virtual image to be displayed, and the size of the virtual display interface for displaying the virtual image to be displayed.

[0081] Specifically, the controller of the augmented reality terminal device compares the acquired ambient light brightness value with the preset threshold value, and determines the first adjustment transmittance and the target adjustment brightness value according to the relationship between the ambient light brightness value and the preset threshold value.

[0082] S43, determining a second adjustment transmittance according to the picture brightness value, the target adjustment brightness value and the first adjustment transmittance.

[0083] The second adjusted transmittance is used to adjust the transmittance of the first area of ​​the transparent screen of the augmented reality terminal device.

[0084] Specifically, after obtaining the image brightness value, the target adjustment brightness value and the first adjustment transmittance, the controller of the augmented reality terminal device determines the second adjustment transmittance according to the image brightness value, the target adjustment brightness value and the first adjustment transmittance.

[0085] S44, adjusting the brightness of the micro display by adjusting the target brightness value, adjusting the transmittance of the second area by the first adjustment transmittance, and adjusting the transmittance of the first area by the second adjustment transmittance.

[0086] Specifically, after obtaining the target adjustment brightness value for adjusting the brightness of the microdisplay, and the second adjustment transmittance and the first adjustment transmittance respectively corresponding to the first area and the second area of ​​the transparent screen, the controller of the augmented reality terminal device adjusts the brightness of the microdisplay according to the target adjustment brightness value, adjusts the transmittance of the second area of ​​the transparent screen according to the first adjustment transmittance, and adjusts the transmittance of the first area of ​​the transparent screen according to the second adjustment transmittance.

[0087] In the technical solution provided by the embodiment of the present disclosure, the controller of the augmented reality terminal device obtains the ambient light brightness value, the picture brightness value, the first area on the transparent screen and the second area of ​​the transparent screen excluding the first area of ​​the augmented reality terminal device in response to the adjustment instruction, wherein the picture brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, and the first area is the mapping area of ​​the target enhanced area on the transparent screen. The adjustment instruction is used to instruct to adjust the brightness of the micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device; determine the first adjustment transmittance and the target adjustment brightness value according to the relationship between the ambient light brightness value and the preset threshold; determine the second adjustment transmittance according to the picture brightness value, the target adjustment brightness value and the first adjustment transmittance; adjust the brightness of the micro display by the target adjustment brightness value, adjust the transmittance of the second area by the first adjustment transmittance, and adjust the transmittance of the first area by the second adjustment transmittance. In the above technical scheme, the target adjustment brightness value for adjusting the brightness of the microdisplay of the augmented reality terminal device, the second adjustment transmittance for adjusting the transmittance of the first area of ​​the transparent screen, and the first adjustment transmittance of the transmittance of the second area can be determined by combining the ambient light brightness value and the picture brightness value of the augmented reality terminal device at the same time, so as to avoid the influence of the ambient light brightness and the picture brightness on the virtual image to be displayed, solve the problem of large brightness difference between the virtual image to be displayed and the real image when they are merged, thereby improving the clarity of the virtual image to be displayed and enhancing the user experience.

[0088] Optional, Fig. 6A A flowchart of another method for adjusting an augmented reality terminal device provided in an embodiment of the present disclosure is provided. Fig. 6A is Figure 4Based on the further optimization, according to the magnitude relationship between the ambient light brightness value and the preset threshold, before determining the first adjustment transmittance and the target adjustment brightness value, as Fig. 6A As shown, one way to determine the preset threshold value may be:

[0089] S61, obtaining an initial transmittance corresponding to the transparent screen, a first initial brightness value corresponding to the virtual image to be displayed, and a size of a virtual display interface for displaying the virtual image to be displayed.

[0090] Among them, the initial transmittance refers to the initial transmittance of the transparent screen without adjustment processing, the first initial brightness value refers to the initial brightness value corresponding to the virtual image to be displayed seen by the user without adjustment processing, and the virtual display interface size refers to the size of the virtual display interface displaying the virtual image to be displayed.

[0091] For example, Figure 6B The figure shows an interface diagram of a virtual display interface 600 used by an augmented reality terminal device to display a virtual image to be displayed. The size of the virtual display interface is the size corresponding to the virtual display interface 600, but is not limited to this. The present disclosure does not specifically limit this, and those skilled in the art can set it according to actual conditions.

[0092] S62, determining a preset threshold value according to the initial transmittance, the first initial brightness value, the size of the virtual display interface and the preset parameters.

[0093] Among them, the preset parameters are used to ensure that the target adjustment brightness value corresponding to the brightness of the microdisplay of the augmented reality terminal device determined according to the initial transmittance, the first initial brightness value, and the virtual display interface, and the adjustment transmittance used to adjust the transmittance of the transparent screen of the augmented reality terminal device can meet the ambient light brightness of the current augmented reality terminal device. The preset parameters can be 0.8, for example. This disclosure does not specifically limit it, and those skilled in the art can set it according to actual conditions.

[0094] Specifically, the controller of the augmented reality terminal device obtains the initial transmittance of the transparent screen before adjustment, the first initial brightness value corresponding to the virtual image to be displayed, and the size of the virtual display interface used to display the virtual image to be displayed. After obtaining the initial transmittance, the first initial brightness value, and the size of the virtual display interface, the preset threshold is determined according to the initial transmittance, the first initial brightness value, the size of the virtual display interface and the preset parameters.

[0095] Optionally, based on the above embodiments, in some embodiments of the present disclosure, the preset threshold is determined according to the initial transmittance, the first initial brightness value, the size of the virtual display interface and the preset parameters, which can be specifically defined by the following expression:

[0096]

[0097] Among them, m represents the initial transmittance corresponding to the transparent screen, n represents the first initial brightness value corresponding to the virtual image to be displayed, and s represents the size of the virtual display interface for displaying the virtual image to be displayed. However, it is not limited to this, and the present disclosure does not specifically limit it. Those skilled in the art can set it according to actual conditions.

[0098] In the technical solution provided by the embodiment of the present disclosure, in the above process, the preset threshold can be determined according to the initial transmittance of the transparent screen that has not been adjusted, the first initial brightness value corresponding to the virtual image to be displayed, the size of the virtual display interface displaying the virtual image to be displayed, and the preset parameters, so that the first adjustment transmittance, the second adjustment transmittance and the target adjustment brightness value that are more accurate and consistent with the ambient light brightness of the current augmented reality terminal device can be obtained later, so as to improve the clarity of the virtual image to be displayed and enhance the user's visual experience.

[0099] Optional, Figure 7 A flowchart of another method for adjusting an augmented reality terminal device provided in an embodiment of the present disclosure is provided. Figure 7 is Fig. 6A Based on the further optimization, since the preset threshold is determined according to the initial transmittance of the transparent screen that has not been adjusted, the first initial brightness value corresponding to the virtual image to be displayed, the size of the virtual display interface that displays the virtual image to be displayed, and the preset parameters, the relationship between the ambient light brightness value of the augmented reality terminal device and the preset threshold will affect the adjustment of the brightness of the microdisplay and the adjustment of the transmittance of the transparent screen. Based on this, it is necessary to compare the ambient light brightness value with the preset threshold to determine the target adjustment brightness value for adjusting the brightness of the microdisplay and the adjustment transmittance for adjusting the transparent screen. Figure 7 As shown, according to the magnitude relationship between the ambient light brightness value and the preset threshold, one implementation method for determining the first adjustment transmittance and the target adjustment brightness value may be:

[0100] S71, when the ambient light brightness value is less than or equal to a preset threshold, determining that the initial transmittance of the transparent screen is a first adjusted transmittance.

[0101] It should be noted that when the ambient light brightness value is less than or equal to the preset threshold, it indicates that the ambient light brightness of the augmented reality terminal device is relatively dark. Based on this, in order to ensure that the user can clearly see the actual scene of the augmented reality terminal device in the virtual image to be displayed after the real image is enhanced through the augmented reality terminal device, the transmittance of the transparent screen may not be adjusted, that is, the first adjusted transmittance is determined to be the initial transmittance of the transparent screen.

[0102] S72, determining a target adjustment brightness value according to the initial transmittance, the ambient light brightness value, the size of the virtual display interface and preset parameters.

[0103] Specifically, the controller of the augmented reality terminal device compares the acquired ambient light brightness value of the augmented reality terminal device with a preset threshold value. When it is determined that the ambient light brightness value is less than or equal to the preset threshold value, the initial transmittance of the transparent screen is determined to be the first adjustment transmittance. Further, the target adjustment brightness value is determined based on the initial transmittance, the ambient light brightness value, the size of the virtual display interface and the preset parameters.

[0104] Optionally, based on the above embodiments, in some embodiments of the present disclosure, the target adjustment brightness value is determined according to the initial transmittance, the ambient light brightness value, the size of the virtual display interface and the preset parameters, which can be specifically limited by the following expression:

[0105] C=l×m÷s÷0.8

[0106] Wherein, l represents the ambient light brightness value of the augmented reality terminal device, m represents the initial transmittance corresponding to the transparent screen, and s represents the size of the virtual display interface for displaying the virtual image to be displayed. However, it is not limited to this, and the present disclosure is not specifically limited, and those skilled in the art can set it according to actual conditions.

[0107] Optionally, based on the above embodiments, in some embodiments of the present disclosure, continue to refer to Figure 7 As shown, another implementation method of determining the first adjustment transmittance and the target adjustment brightness value according to the magnitude relationship between the ambient light brightness value and the preset threshold value may be:

[0108] S73, when the ambient light brightness value is greater than a preset threshold, determining a first adjustment transmittance according to the preset threshold and the ambient light brightness value.

[0109] S74, determining a second initial brightness value of the micro display as a target adjusted brightness value.

[0110] Among them, the second initial brightness value is the brightness value before the microdisplay performs brightness adjustment. It should be noted that since the pre-set second initial brightness value of the microdisplay is determined based on historical experience, and adjusting the brightness of the microdisplay consumes more power, at this time, when it is determined that the ambient light brightness value is greater than the preset threshold, it indicates that the ambient light brightness of the augmented reality terminal device is brighter, and the second initial brightness value of the microdisplay enables the current user to watch the virtual image to be displayed through a more comfortable observation brightness. At the same time, in order to avoid consuming more power, there is no need to adjust the brightness of the microdisplay, that is, the second initial brightness value of the microdisplay is determined to be the target adjustment brightness value.

[0111] Specifically, the controller of the augmented reality terminal device compares the acquired ambient light brightness value of the augmented reality terminal device with a preset threshold value. When it is determined that the ambient light brightness value is greater than the preset threshold value, the first adjustment transmittance is determined based on the preset threshold value and the ambient light brightness value. Further, the second initial brightness value of the micro display is determined as the target adjustment brightness value.

[0112] Optionally, based on the above embodiments, in some embodiments of the present disclosure, a method for determining the first adjusted transmittance according to a preset threshold and an ambient light brightness value may be: calculating the ratio of the preset threshold to the ambient light brightness value, and determining the ratio result as the first adjusted transmittance.

[0113] Optionally, based on the above embodiments, in some embodiments of the present disclosure, the first adjusted transmittance may be specifically limited by the following expression:

[0114]

[0115] Among them, A T represents the preset threshold; l represents the ambient light brightness value of the augmented reality terminal device.

[0116] Figure 8 A flowchart of another method for adjusting an augmented reality terminal device provided in an embodiment of the present disclosure is provided. Figure 8 is Figure 7 Further optimization based on Figure 8 As shown, one implementation method of determining the second adjustment transmittance according to the picture brightness value, the target adjustment brightness value and the first adjustment transmittance may be:

[0117] S81, determining a second initial adjustment transmittance according to the image brightness value and the target adjustment brightness value.

[0118] Specifically, the controller of the augmented reality terminal device determines the second initial adjustment transmittance according to the image brightness value and the target adjustment brightness value.

[0119] Optional, Fig. 9 A flowchart of another method for adjusting an augmented reality terminal device provided in an embodiment of the present disclosure is provided. Fig. 9 is Figure 8 Further optimization based on Fig. 9 As shown, one implementation method of determining the second initial adjustment transmittance according to the image brightness value and the target adjustment brightness value may be:

[0120] S91. Perform a product operation on the preset value and the image brightness value to obtain a target result.

[0121] Among them, the preset value is used to reduce the parameter value set for reducing the display contrast between the target enhanced area on the virtual image to be displayed and the real image when the transmittance of the first area of ​​the transparent screen is adjusted according to the image brightness value. The preset value can be 1 or 2, for example. The value of the preset value can be specifically limited according to the current image brightness value.

[0122] S92: Calculate the ratio of the target adjusted brightness value to the target result, and determine the second initial adjusted transmittance.

[0123] Specifically, the controller of the augmented reality terminal device performs a product operation on the preset value and the image brightness value to obtain a corresponding target result. Further, the ratio of the target adjustment brightness value to the target result is calculated, and the ratio result is determined to be the second initial adjustment transmittance.

[0124] Exemplarily, following the above embodiment, when the preset value is 1, the second adjustment transmittance can be specifically defined by the following expression:

[0125] Among them, C represents the target adjustment brightness value, and L represents the image brightness value, but is not limited to this. The present disclosure does not specifically limit it, and those skilled in the art can set it according to actual conditions.

[0126] When the preset value is 2, the second adjusted transmittance can be specifically defined by the following expression:

[0127]

[0128] S82, performing a sum operation on the second initial adjusted transmittance and the first adjusted transmittance to obtain a second adjusted transmittance.

[0129] In the technical solution provided by the embodiment of the present disclosure, in the above process, the second initial adjustment transmittance can be determined according to the image brightness value and the target adjustment brightness value; the second initial adjustment transmittance and the first adjustment transmittance are summed to obtain the second adjustment transmittance, that is, when the transmittance of the first area obtained by mapping the target enhancement area on the transparent screen is adjusted, the influence of the image brightness of the corresponding target area on the real image on the display contrast of the target enhancement area is avoided, thereby improving the overall display effect of the virtual image to be displayed and providing users with a good visual experience.

[0130] The embodiment of the present disclosure provides a computer-readable storage medium, on which a computer program is stored. When the computer program is executed by a processor, the various processes of the adjustment method of the above-mentioned augmented reality terminal device are implemented, and the same technical effect can be achieved. To avoid repetition, it will not be repeated here.

[0131] The computer readable storage medium may be a read-only memory (ROM), a random access memory (RAM), a magnetic disk or an optical disk, etc.

[0132] For the convenience of explanation, the above description has been made in conjunction with specific embodiments. However, the above discussion in some embodiments is not intended to be exhaustive or limit the embodiments to the specific forms disclosed above. According to the above teachings, various modifications and variations can be obtained. The selection and description of the above embodiments are to better explain the principles and practical applications, so that those skilled in the art can better use the embodiments and various different variations of the embodiments suitable for specific use considerations.

Claims

1. An augmented reality terminal device, characterized in that: include: The controller is configured as: In response to the adjustment instruction, the brightness value of the ambient light in which the augmented reality terminal device is located, the brightness value of the picture, the first area on the transparent screen, and the second area of ​​the transparent screen excluding the first area are obtained, wherein the picture brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, the first area is the mapping area of ​​the target enhanced area on the transparent screen, and the adjustment instruction is used to instruct to adjust the brightness of the micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device; Determining a first adjustment transmittance and a target adjustment brightness value according to a magnitude relationship between the ambient light brightness value and a preset threshold; determining a second adjustment transmittance according to the picture brightness value, the target adjustment brightness value, and the first adjustment transmittance; The brightness of the micro display is adjusted by the target adjustment brightness value, the transmittance of the second area is adjusted by the first adjustment transmittance, and the transmittance of the first area is adjusted by the second adjustment transmittance.

2. The augmented reality terminal device according to claim 1, characterized in that: The controller is configured to: Acquire an initial transmittance corresponding to the transparent screen, a first initial brightness value corresponding to the virtual image to be displayed, and a size of a virtual display interface for displaying the virtual image to be displayed; The preset threshold is determined according to the initial transmittance, the first initial brightness value, the size of the virtual display interface and preset parameters.

3. The augmented reality terminal device according to claim 2, characterized in that: The controller is specifically configured as follows: When the ambient light brightness value is less than or equal to the preset threshold, determining the initial transmittance of the transparent screen to be the first adjusted transmittance; The target adjustment brightness value is determined according to the initial transmittance, the ambient light brightness value, the virtual display interface size and the preset parameters.

4. The augmented reality terminal device according to claim 2, characterized in that: The controller is specifically configured as follows: When the ambient light brightness value is greater than the preset threshold, determining the first adjustment transmittance according to the preset threshold and the ambient light brightness value; A second initial brightness value of the micro display is determined to be the target adjusted brightness value, wherein the second initial brightness value is the brightness value of the micro display before brightness adjustment is performed.

5. The augmented reality terminal device according to claim 1, characterized in that: The controller is specifically configured as follows: Determining a second initial adjustment transmittance according to the image brightness value and the target adjustment brightness value; The second initial adjusted transmittance and the first adjusted transmittance are summed to obtain the second adjusted transmittance.

6. The augmented reality terminal device according to claim 5, characterized in that: The controller is specifically configured as follows: Performing a product operation on the preset value and the brightness value of the image to obtain a target result; The ratio of the target adjusted brightness value to the target result is calculated to determine the second initial adjusted transmittance.

7. The augmented reality terminal device according to claim 1, characterized in that: The controller is further configured to: An enhancement process is performed on a target area of ​​the real image captured by the acquisition device to obtain the virtual image to be displayed including the target enhancement area.

8. A method for adjusting an augmented reality terminal device, characterized in that: include: In response to the adjustment instruction, the brightness value of the ambient light in which the augmented reality terminal device is located, the brightness value of the picture, the first area on the transparent screen, and the second area of ​​the transparent screen excluding the first area are obtained, wherein the picture brightness value is the brightness value of the target area corresponding to the target enhanced area on the virtual image to be displayed on the real image, the first area is the mapping area of ​​the target enhanced area on the transparent screen, and the adjustment instruction is used to instruct to adjust the brightness of the micro display of the augmented reality terminal device and the transmittance of the transparent screen of the augmented reality terminal device; Determining a first adjustment transmittance and a target adjustment brightness value according to a magnitude relationship between the ambient light brightness value and a preset threshold; determining a second adjustment transmittance according to the picture brightness value, the target adjustment brightness value, and the first adjustment transmittance; The brightness of the micro display is adjusted by the target adjustment brightness value, the transmittance of the second area is adjusted by the first adjustment transmittance, and the transmittance of the first area is adjusted by the second adjustment transmittance.

9. The method for adjusting the augmented reality terminal device according to claim 8, characterized in that: Before determining the first adjustment transmittance and the target adjustment brightness value according to the magnitude relationship between the ambient light brightness value and the preset threshold, the method further includes: Acquire an initial transmittance corresponding to the transparent screen, a first initial brightness value corresponding to the virtual image to be displayed, and a size of a virtual display interface for displaying the virtual image to be displayed; The preset threshold is determined according to the initial transmittance, the first initial brightness value, the size of the virtual display interface and preset parameters.

10. A computer-readable storage medium having a computer program stored thereon, characterized in that: When the program is executed by a processor, the steps of the adjustment method of the augmented reality terminal device as described in any one of claims 8 to 9 are implemented.

Images