Display method of display device, display device, and storage medium

Abstract

The embodiment of the application discloses a display method of a display device, the display device and a storage medium. The display device comprises an electrochromic substrate, and the electrochromic substrate is used for transmitting light of an environment image and displaying a virtual image. The display method comprises the following steps: acquiring the environment image; matching the environment image with the virtual image to determine a display area of the virtual image on the electrochromic substrate; and determining a target image from the environment image, and light of the target image is transmitted by the display area. The embodiment of the application can improve the definition of virtual image display.

Description

Technical Field

[0001] This application relates to the field of electronic technology, and in particular to a display method, display device, and storage medium for a display device. Background Technology

[0002] As the concept of the metaverse becomes increasingly popular, virtual reality integrated display devices, such as VR glasses, are widely accepted and used by users. Users can see both external environment images and virtual images simultaneously through the display device. In related technologies, when the brightness of the external environment image does not match the brightness of the virtual image, the virtual content is not displayed clearly. Summary of the Invention

[0003] This application provides a display method for a display device, which can improve the clarity of virtual image display.

[0004] In a first aspect, embodiments of this application provide a display method for a display device, the display device including an electrochromic substrate, the electrochromic substrate being used to transmit light from an ambient image and to display a virtual image, the display method including:

[0005] Acquire the environmental image;

[0006] The environmental image is matched with the virtual image to determine the display area of ​​the virtual image on the electrochromic substrate;

[0007] A target image is determined from the environmental image, wherein light from the target image is transmitted through the display area;

[0008] The transmittance of the display area is controlled based on the brightness of the target image.

[0009] Optionally, controlling the transmittance of the display area based on the brightness of the target image includes:

[0010] If the brightness of the target image is greater than a first threshold, the transmittance of the display area is reduced.

[0011] Optionally, reducing the transmittance of the display area if the brightness of the target image is greater than a first threshold includes:

[0012] Obtain the brightness of multiple first sub-regions in the target image;

[0013] The first sub-regions whose brightness is greater than the first threshold among the plurality of first sub-regions are determined as the first target sub-regions;

[0014] A first display area is determined from the display area based on the first target sub-region, wherein light from the first target sub-region is transmitted through the first display area;

[0015] Reduce the transmittance of the first display area.

[0016] Optionally, reducing the transmittance of the first display area includes:

[0017] Obtain the average brightness of the virtual image;

[0018] Reduce the transmittance of the first display area so that the brightness of the light from the first target sub-region after passing through the first display area is less than the average brightness of the virtual image.

[0019] Optionally, after reducing the transmittance of the first display area, the method further includes:

[0020] The first sub-regions whose brightness is not greater than the first threshold among the plurality of first sub-regions are determined as the second target sub-regions;

[0021] A second display area is determined from the display area based on the second target sub-region, wherein light from the second target sub-region is transmitted through the second display area;

[0022] Adjust the brightness of the virtual image displayed in the second display area.

[0023] Optionally, after reducing the transmittance of the first display area, the method further includes:

[0024] Obtain the brightness of multiple second sub-regions in the environmental image other than the target image;

[0025] The second sub-regions whose brightness is greater than the first threshold among the plurality of second sub-regions are determined as the third target sub-regions;

[0026] A third display area is determined from the electrochromic substrate based on the third target sub-region, wherein light from the third target sub-region is transmitted through the third display area;

[0027] The transmittance of the third display area is controlled so that the transmittance of the third display area is positively correlated with the distance from the first display area.

[0028] Optionally, determining the target image from the environmental image, wherein the light from the target image is transmitted through the display area, includes:

[0029] Obtain the maximum brightness of multiple sub-regions in the environmental image;

[0030] If the maximum brightness is less than the first threshold, the virtual image is displayed on the electrochromic substrate;

[0031] If the maximum brightness is greater than a first threshold, a target image is determined from the environmental image, and the light from the target image is transmitted through the display area.

[0032] Optionally, matching the environmental image with the virtual image to determine the display area of ​​the virtual image on the electrochromic substrate includes:

[0033] If there are multiple virtual images, the environmental image is matched with the multiple virtual images to determine multiple display areas corresponding to the multiple virtual images on the electrochromic substrate;

[0034] Determining a target image from the environmental image, wherein light from the target image is transmitted through the display area includes:

[0035] Multiple target images are determined from the environmental image, and light from the multiple target images is transmitted through the display area;

[0036] The step of controlling the transmittance of the display area based on the brightness of the target image includes:

[0037] The transmittance of the multiple display areas is controlled based on the brightness of the multiple target images.

[0038] Secondly, embodiments of this application provide a display device, comprising:

[0039] Electrochromic substrates can transmit light from ambient images and display virtual images;

[0040] A camera, disposed adjacent to the electrochromic substrate, is capable of acquiring images of the environment;

[0041] A processor, electrically connected to the electrochromic substrate and the camera, is used to execute the method described in any of the above-described embodiments.

[0042] Optionally, the electrochromic substrate includes an electrochromic layer, a plurality of first electrodes and a plurality of second electrodes, the electrochromic layer is disposed between the plurality of first electrodes and the plurality of second electrodes, and the electrochromic layer connects the plurality of first electrodes and the plurality of second electrodes, the plurality of first electrodes are arranged along a first direction, the plurality of second electrodes are arranged along a second direction, and the first direction is perpendicular to the second direction;

[0043] The processor is further configured to: determine the transmittance of the display area based on the brightness of the target image, and provide a first voltage signal to the first electrode corresponding to the display area, and provide a second voltage signal to the corresponding second electrode.

[0044] Optionally, the processor is further configured to perform: if there are multiple target images, determine the transmittance of multiple display areas based on the brightness of the multiple target images, and sequentially provide a first voltage signal to the first electrode corresponding to the multiple display areas, and provide a second voltage signal to the corresponding second electrode.

[0045] Optionally, the electrochromic substrate includes an electrochromic layer, a plurality of first electrodes and a plurality of second electrodes, the electrochromic layer includes a plurality of electrochromic units, and each electrochromic unit is correspondingly disposed with one first electrode and one second electrode; the processor is further configured to perform: determining the transmittance of the display area according to the brightness of the target image, and providing a first voltage signal to the first electrode corresponding to the display area, and providing a second voltage signal to the corresponding second electrode.

[0046] Optionally, the processor is further configured to: control the duration of providing the first voltage signal corresponding to the first electrode and control the duration of providing the second voltage signal corresponding to the second electrode, so as to control the transmittance of the display area.

[0047] Thirdly, embodiments of this application provide a storage medium storing a computer program thereon, characterized in that, when the computer program is executed on a computer, it causes the computer to perform the method described in any of the preceding claims.

[0048] This application embodiment defines a display area for displaying a virtual image on an electrochromic substrate and a target image in an environmental image. The human eye can simultaneously see both the target image and the virtual image through the display area. The transmittance of the display area is controlled based on the brightness of the target image. For example, when the brightness of the target image is greater than the brightness of the virtual image, the transmittance of the display area is reduced, decreasing the amount of light transmitted from the target image into the display area, thereby reducing the brightness of the target image entering the human eye. This allows the virtual image to be clearly displayed in the display area. Furthermore, this application embodiment adjusts the transmittance of the display area of ​​the electrochromic substrate according to the brightness of the target image, while maintaining or slightly adjusting the transmittance of non-display areas of the electrochromic substrate as needed. This makes the brightness of areas other than the target image in the environmental image entering the human eye closer to the brightness of the real environmental image. Therefore, the human eye can see a clear virtual image in the display area of ​​the electrochromic substrate and a more natural and realistic environmental image in the non-display areas of the electrochromic substrate, allowing for better integration and display of the virtual and environmental images. Attached Figure Description

[0049] To more clearly illustrate the technical solutions in the embodiments of this application, the accompanying drawings used in the description of the embodiments will be briefly introduced below. Obviously, the accompanying drawings described below are only some embodiments of this application. For those skilled in the art, other drawings can be obtained based on these drawings without creative effort.

[0050] Figure 1 This is a schematic flowchart of a first method for displaying a display device provided in an embodiment of this application.

[0051] Figure 2 This is a second flowchart illustrating the display method of the display device provided in the embodiments of this application.

[0052] Figure 3 This is a schematic diagram of a scene where a virtual image and an environmental image are fused and displayed as seen by the human eye through an electrochromic substrate, as provided in an embodiment of this application.

[0053] Figure 4 This is a schematic diagram showing the distribution of different regions in the electrochromic substrate provided in the embodiments of this application.

[0054] Figure 5 This is a schematic diagram of a first structure of a display device provided in an embodiment of this application.

[0055] Figure 6 This is a schematic diagram of a first structure of an electrochromic substrate provided in an embodiment of this application.

[0056] Figure 7 The embodiments of this application provide a second structural schematic diagram of an electrochromic substrate.

[0057] Figure 8 This is a schematic diagram of a third structure of the electrochromic substrate provided in an embodiment of this application.

[0058] Figure 9 This is a schematic diagram showing a colored state in a display area of ​​an electrochromic substrate provided in an embodiment of this application.

[0059] Figure 10 This is a schematic diagram showing multiple display areas in a colored state in an electrochromic substrate provided in an embodiment of this application.

[0060] Figure 11 This is a schematic diagram of a fourth structure of the electrochromic substrate provided in an embodiment of this application.

[0061] Figure 12 This is a schematic diagram of the structure of the first electrode or second electrode driving circuit provided in the embodiments of this application.

[0062] Figure 13 This application provides a second structural schematic diagram of a display device according to an embodiment. Detailed Implementation

[0063] The technical solutions of the embodiments of this application will be clearly and completely described below with reference to the accompanying drawings. Obviously, the described embodiments are only some embodiments of this application, and not all embodiments. The following description of at least one exemplary embodiment is merely illustrative and is in no way intended to limit this application or its application or use. All other embodiments obtained by those skilled in the art based on the embodiments of this application without creative effort are within the protection scope of this application.

[0064] Please see Figure 1 , Figure 1 This is a schematic flowchart of a first method for displaying a display device provided in an embodiment of this application.

[0065] The display device in this embodiment is a virtual reality fusion display device. With the increasing attention garnered by technologies such as AR (Augmented Reality) and MR (Mixed Reality), virtual reality fusion display devices are widely used, such as AR / MR glasses, AR / MR headsets, and automotive head-up display systems. These devices allow users to simultaneously view both the external environment and virtual images. This article uses AR glasses as an example for illustration.

[0066] In 101, acquire the environmental image.

[0067] In this embodiment, the display device includes an electrochromic substrate, which is used to transmit light from an ambient image and display a virtual image, so that the human eye can see both the ambient image and the virtual image simultaneously through the electrochromic substrate.

[0068] In one embodiment, the display device includes a camera disposed adjacent to an electrochromic substrate. The camera is capable of acquiring environmental images, and the environmental images captured by the camera can be equivalent to the real environmental images that a user can see through the electrochromic substrate. For example, based on the visual correspondence between the two eyes and the camera, the camera can capture real environmental images within the user's field of vision.

[0069] The display device can be, for example, AR glasses, and the electrochromic substrate can be the lens of the AR glasses. The environmental image captured in real time by the camera can be equivalent to the real environmental image seen by the user through the left and right lenses. There can be one or more cameras. For example, when there is only one camera, it can be placed in the middle of the left and right lenses of the AR glasses. When there are two cameras, they can be placed corresponding to the left and right lenses respectively. This embodiment does not limit the number and position of the cameras.

[0070] In step 102, the environmental image is matched with the virtual image to determine the display area of ​​the virtual image on the electrochromic substrate.

[0071] For electrochromic substrates, on the one hand, light from the external environment can pass through the electrochromic substrate, allowing users to see a realistic image of the environment; on the other hand, virtual images can also be displayed through the electrochromic substrate. In other words, through this electrochromic substrate, users can see both a real image of the external environment and a virtual image.

[0072] Electrochromic substrates can seamlessly integrate virtual and real-world environmental images through a "layering" process. This requires matching the current environmental image with the virtual image to determine the display area of ​​the virtual image on the electrochromic substrate. This allows the virtual image to blend perfectly with the real-world image, achieving a complementary and enhancing effect. For example, if the environmental image contains a target building, and the virtual image explains or describes that building, the display area of ​​the virtual image on the electrochromic substrate can be determined based on the environmental image. This ensures that the user can see the virtual image displayed to the left or right of the target building without obscuring it.

[0073] For example, the display device could be AR glasses. The AR glasses could include a light engine that projects a virtual image to be displayed onto the lenses of the AR glasses. The lenses include a diffractive waveguide sheet that transmits the virtual image projected by the light engine to the corresponding display area on the lenses. The diffractive waveguide sheet is transparent, so the user can also see the real environment image through the lenses.

[0074] In step 103, the target image is determined from the environmental image, and the light from the target image is transmitted through the display area.

[0075] Understandably, the virtual image is displayed in the display area of ​​the electrochromic substrate, which is also used to transmit part of the light in the ambient image. In this embodiment, the target image is determined from the ambient image, and the light of the target image is also transmitted through the display area. That is, the human eye can see the target image and the virtual image displayed in an "overlay" form through the display area at the same time.

[0076] In 104, the transmittance of the display area is controlled according to the brightness of the target image.

[0077] Due to the low light utilization efficiency of current diffractive waveguides, the brightness of the virtual image projected by the light engine is limited when it is transmitted to the display area. For example, the maximum brightness of the virtual image coupled to the human eye is only 600 nits. Therefore, the viewing experience of the virtual image is greatly affected by the brightness of the target image. For instance, when the brightness of the target image is greater than that of the virtual image, the virtual image will be dim and unclear, and cannot be clearly blended with the surrounding image.

[0078] This embodiment defines a display area for displaying a virtual image on an electrochromic substrate and a target image within an environmental image. The human eye can simultaneously see both the target image and the virtual image through the display area. The transmittance of the display area is controlled based on the brightness of the target image. For example, when the brightness of the target image is greater than that of the virtual image, the transmittance of the display area is reduced, decreasing the amount of light transmitted from the target image into the display area, thus reducing the brightness of the target image entering the human eye. This allows the virtual image to be clearly displayed in the display area. Furthermore, this embodiment adjusts the transmittance of the display area of ​​the electrochromic substrate based on the brightness of the target image, while maintaining or slightly adjusting the transmittance of non-display areas within the electrochromic substrate as needed. This ensures that the brightness of areas other than the target image in the environmental image entering the human eye more closely approximates the brightness of the real environmental image. Consequently, the human eye can see a clear virtual image in the display area of ​​the electrochromic substrate and a more natural and realistic environmental image in the non-display areas, allowing for better integration and display of the virtual and environmental images.

[0079] Please refer to Figure 2 , Figure 2 This is a second flowchart illustrating the display method of the display device provided in the embodiments of this application.

[0080] In step 201, acquire an environmental image.

[0081] In this embodiment, the display device includes an electrochromic substrate, which is used to transmit light from an ambient image and display a virtual image, so that the human eye can see both the ambient image and the virtual image simultaneously through the electrochromic substrate.

[0082] In one embodiment, the display device includes a camera disposed adjacent to an electrochromic substrate. The camera is capable of acquiring environmental images, and the environmental images captured by the camera can be equivalent to the real environmental images that a user can see through the electrochromic substrate. For example, based on the visual correspondence between the two eyes and the camera, the camera can capture real environmental images within the user's field of vision.

[0083] The display device can be, for example, AR glasses, and the electrochromic substrate can be the lens of the AR glasses. The environmental image captured in real time by the camera can be equivalent to the real environmental image seen by the user through the left and right lenses. There can be one or more cameras. For example, when there is only one camera, it can be placed in the middle of the left and right lenses of the AR glasses. When there are two cameras, they can be placed corresponding to the left and right lenses respectively. This embodiment does not limit the number and position of the cameras.

[0084] In step 202, the environmental image is matched with the virtual image to determine the display area of ​​the virtual image on the electrochromic substrate.

[0085] For electrochromic substrates, on the one hand, light from the external environment can pass through the electrochromic substrate, allowing users to see a realistic image of the environment; on the other hand, virtual images can also be displayed through the electrochromic substrate. In other words, through this electrochromic substrate, users can see both a real image of the external environment and a virtual image.

[0086] Electrochromic substrates can seamlessly integrate virtual and real-world environmental images through a "layering" process. This requires matching the current environmental image with the virtual image to determine the display area of ​​the virtual image on the electrochromic substrate. This allows the virtual image to blend more closely with the real-world image, achieving a complementary and enhancing effect. For example, if the environmental image contains a target building, and the virtual image explains or describes that building, the display area of ​​the virtual image on the electrochromic substrate can be determined based on the environmental image. This ensures that the user can see the virtual image displayed to the left or right of the target building without obscuring it.

[0087] For example, the display device could be AR glasses. The AR glasses could include a light engine that projects a virtual image to be displayed onto the lenses of the AR glasses. The lenses include a diffractive waveguide sheet that transmits the virtual image projected by the light engine to the corresponding display area on the lenses. The diffractive waveguide sheet is transparent, so the user can also see the real environment image through the lenses.

[0088] In step 203, the target image is determined from the environmental image, and the light from the target image is transmitted through the display area.

[0089] Understandably, the virtual image is displayed in the display area of ​​the electrochromic substrate, which is also used to transmit part of the light in the ambient image. In this embodiment, the target image is determined from the ambient image, and the light of the target image is also transmitted through the display area. That is, the human eye can see the target image and the virtual image displayed in an "overlay" form through the display area at the same time.

[0090] In one embodiment, the maximum brightness of multiple sub-regions in an environmental image can be obtained; if the maximum brightness is less than a first threshold, a virtual image is displayed on an electrochromic substrate; if the maximum brightness is greater than the first threshold, a target image is determined from the environmental image, and the light transmission display area of ​​the target image is transmitted through it.

[0091] Specifically, the environmental image can be divided into multiple sub-regions. If the maximum brightness of multiple sub-regions in the environmental image is less than the first threshold, it means that the brightness of each sub-region in the environmental image is not high. In this case, the virtual image and any part of the environmental image can be clearly displayed on the electrochromic substrate in a "stacked" form. Therefore, the virtual image can be directly displayed on the electrochromic substrate without performing the step of determining the target image from the environmental image.

[0092] If the maximum brightness of multiple sub-regions in the environmental image is greater than the first threshold, it indicates that some sub-regions in the environmental image have high brightness. If the virtual image and the sub-regions with high brightness are displayed in a "stacked" form on the electrochromic substrate, the virtual image may not be clearly displayed. In this case, the step of determining the target image from the environmental image is performed.

[0093] In step 204, the brightness of multiple first sub-regions in the target image is obtained.

[0094] In this embodiment, the display device includes a processor that can divide the determined target image into multiple first sub-regions. It is understood that the target image is a portion of a real-world image, and the brightness of each first sub-region within the target image may differ. Please refer to... Figure 3 and Figure 4 , Figure 3 This is a schematic diagram illustrating a scene where a virtual image and an environmental image are fused and displayed as seen by the human eye through an electrochromic substrate, according to an embodiment of this application. Figure 4 This is a schematic diagram showing the distribution of different regions in the electrochromic substrate provided in an embodiment of this application. Figure 3 and Figure 4 They correspond to each other.

[0095] For example, if an environmental image contains a corner that is illuminated by sunlight, or if the environmental image includes objects in shadow, then the environmental image will have a clear distinction between bright and dark areas. If the target image happens to be located at the intersection of bright and dark areas in the environmental image, then the target image will also have a clear distinction between bright and dark areas. Figure 3 The human eye can see both the virtual image area and the target image, which has distinct bright and dark areas.

[0096] This embodiment divides the target image into multiple first sub-regions. The processor uses an AI algorithm to obtain the brightness of each first sub-region. The maximum brightness value of each sub-region can be used as its brightness value, or the average brightness value can be used. The number of first sub-regions can be set as needed; more first sub-regions allow for finer segmentation of the target image. This embodiment does not limit the number or segmentation method of the first sub-regions.

[0097] In step 205, the first sub-regions with brightness greater than a first threshold among multiple first sub-regions are identified as the first target sub-regions.

[0098] In step 206, a first display area is determined from the display area based on a first target sub-region, wherein light from the first target sub-region is transmitted through the first display area.

[0099] The human eye can simultaneously see the target image and the virtual image displayed in an "overlay" form through the display area. If the brightness of the target image is large, such as close to or greater than the brightness of the virtual image, then the display of the virtual image will be very unclear and dim, and it will not be able to be clearly blended with the target image.

[0100] In this embodiment, the target image is divided into multiple first sub-regions. The brightness of each first sub-region of the target image may be different. The first sub-region whose brightness is greater than a first threshold is determined as the first target sub-region. The first threshold can be set as needed. For example, the first threshold can be close to or less than the brightness of the virtual image. If the brightness of each first sub-region in the target image is less than the first threshold, then the virtual image can be clearly displayed in the display area and can be well integrated with the target image.

[0101] If the brightness of some first sub-regions in the target image is greater than the first threshold, and the brightness of some first sub-regions is less than the first threshold, then the target image can be considered to have bright and dark areas. For example, the first sub-regions with brightness greater than the first threshold in multiple first sub-regions can be identified as the first target sub-regions, and the first sub-regions with brightness not greater than the first threshold in multiple first sub-regions can be identified as the second target sub-regions. Then the first target sub-regions can be considered as bright areas, and the second target sub-regions as dark areas.

[0102] In this embodiment, a first display area is determined from the display area based on a first target sub-region, wherein light from the first target sub-region is transmitted through the first display area. The virtual image can be divided into a first part of the virtual image and a second part of the virtual image. The human eye can simultaneously see the first target sub-region and the first part of the virtual image displayed in an "overlapping" form through the first display area.

[0103] In this embodiment, the second display area can also be determined from the display area based on the second target sub-region. The light from the second target sub-region is transmitted through the second display area. That is, the human eye can see the second target sub-region and the second part of the virtual image displayed in an "overlay" form through the second display area.

[0104] Understandably, the first target sub-region is a bright area, and the second target sub-region is a dark area. For example, if the brightness of the first target sub-region is close to or greater than the brightness of the virtual image, and the brightness of the second target sub-region is lower than the brightness of the virtual image, the first part of the virtual image displayed in the first display area will be dim and unclear, while the second part of the virtual image displayed in the second display area will be clearly displayed.

[0105] If the brightness of all the first sub-regions in the target image is greater than the first threshold, then the target image can be considered to be entirely bright, and all virtual images displayed in the display area will be dim and unclear. Alternatively, the display area can be considered to be the first display area.

[0106] In 207, the average brightness of the virtual image is obtained.

[0107] Due to the low light utilization efficiency of current diffraction waveguides, the brightness of the virtual image projected by the light engine is limited when the virtual image is transmitted to the display area through the diffraction waveguide. The display device can obtain the average brightness of the current virtual image. For example, if the average brightness of the virtual image is 600 nits, and the brightness of the first target sub-region is close to or greater than 600 nits, the virtual image of the first part displayed in the first display area will be dim and unclear.

[0108] In step 208, the transmittance of the first display area is reduced so that the brightness of the light from the first target sub-region after passing through the first display area is less than the average brightness of the virtual image.

[0109] Since the brightness of the target image is greater than the first threshold, such as being close to or greater than the brightness of the virtual image, the first part of the virtual image displayed in the first display area is not clear. Therefore, the transmittance of the first display area can be reduced to reduce the light transmitted into the first target sub-region of the first display area, thereby reducing the brightness of the first target sub-region entering the human eye. This makes the brightness of the light from the first target sub-region after passing through the first display area less than the average brightness of the virtual image, so that the first part of the virtual image can also be clearly displayed in the first display area.

[0110] In one embodiment, if there are multiple virtual images, an environmental image is matched with the multiple virtual images to determine multiple display areas corresponding to the multiple virtual images on an electrochromic substrate; multiple target images are determined from the environmental image, and the light from the multiple target images is transmitted through the display areas; the transmittance of the multiple display areas is controlled according to the brightness of the multiple target images.

[0111] Specifically, for some environmental images, there may be multiple virtual images. For example, in a car head-up display system, multiple virtual images such as speed and navigation can be displayed on the electrochromic substrate. Therefore, multiple display areas corresponding to these virtual images need to be defined on the electrochromic substrate. Multiple target images are then determined from the environmental image. The light from these target images is transmitted through the display areas, and the transmittance of these display areas is controlled based on the brightness of the target images. The transmittance control method for each display area can refer to the above embodiments and will not be repeated here.

[0112] In one embodiment, since the virtual image of the second part can be clearly displayed in the second display area, the transmittance of the second display area does not need to be adjusted.

[0113] In one embodiment, although the second part of the virtual image can be clearly displayed in the second display area, the brightness of the second part of the virtual image can be adjusted according to the AI ​​algorithm to make the overall display of the first part of the virtual image and the second part of the virtual image more harmonious. For example, if the clarity of the first part of the virtual image seen by the human eye through the display area is significantly different from that of the second part of the virtual image, the brightness of the virtual image displayed in the second display area can be adjusted. For example, the brightness of the second part of the virtual image projected by the light engine can be appropriately reduced to reduce the difference in clarity between the first part of the virtual image and the second part of the virtual image seen by the human eye.

[0114] In one embodiment, the brightness of multiple second sub-regions other than the target image in the environmental image can also be obtained; the second sub-regions with brightness greater than a first threshold among the multiple second sub-regions can be determined as third target sub-regions; a third display area can be determined from the electrochromic substrate based on the third target sub-regions, wherein the light from the third target sub-regions is transmitted through the third display area; and the transmittance of the third display area can be controlled so that the transmittance of the third display area is positively correlated with the distance from the first display area.

[0115] It is understandable that the environmental image contains other images besides the target image. These other images, like the target image, may also have bright and dark areas. In this embodiment, these other images can also be divided into multiple second sub-regions. The processor can obtain the brightness of each second sub-region through an AI algorithm. The maximum brightness value of each sub-region can be used as the brightness value of that second sub-region, or the average brightness value of each sub-region can be used as the brightness value of that second sub-region. It should be noted that this embodiment does not limit the number or division method of the second sub-regions. The division method of the first sub-region can be the same as or different from that of the second sub-region. For example, the entire environmental image can be divided into regions, with the sub-regions within the target image designated as the first sub-regions and the sub-regions within the other images designated as the second sub-regions. Alternatively, sub-regions can be divided separately for the target image and the other images.

[0116] For example, a third target sub-region is defined as a second sub-region whose brightness is greater than a first threshold. That is, the third target sub-region in other images is also a bright area. A third display area is determined from the electrochromic substrate based on the third target sub-region, meaning the third target sub-region is visible to the human eye through the third display area. In the environmental image, both the first and third target sub-regions are bright areas. By reducing the transmittance of the first display area corresponding to the first target sub-region, the brightness of the first target sub-region entering the human eye is reduced, resulting in a lower perceived brightness of the first target sub-region in the first display area. To prevent the first target sub-region from forming a noticeable dark spot, the transmittance of the third display area is controlled so that it is positively correlated with the distance from the first display area. That is, the farther a region in the third display area is from the first display area, the higher its transmittance can be; conversely, the closer a region in the third display area is to the first display area, the lower its transmittance can be. In other words, the human eye can see that regions of the third target sub-region close to the first target sub-region do not form a significant difference in brightness compared to the first target sub-region. It should be noted that in this embodiment, the second sub-regions with brightness greater than the first threshold are defined as the third target sub-regions. Alternatively, if the brightness of multiple second sub-regions is greater than the first threshold, there can also be multiple corresponding third target sub-regions. In this case, there can also be multiple third display regions corresponding to the third target sub-regions. The transmittance of multiple third display regions can be controlled separately so that the transmittance of multiple third display regions is positively correlated with the distance from the first display region. The closer the third display region is to the first display region, the lower its transmittance, and the farther the third display region is from the first display region, the higher its transmittance. This results in the environmental image seen by the human eye having a gradual brightness effect with the first target sub-region as the center.

[0117] It should be noted that the transmittance adjustment range of the third display area is lower than that of the first display area. In other words, the transmittance of the third display area is higher than that of the first display area. This ensures that the first target sub-area seen by the human eye will not form an obvious dark spot, and the overall environmental image can be more harmonious. It also makes the brightness of the third target sub-area seen by the human eye closer to the brightness of the real environmental image.

[0118] In one embodiment, the electrochromic substrate, in addition to the display area, also has other non-display areas. These non-display areas may include a third display area and a fourth display area. Specifically, second sub-regions with brightness greater than a first threshold among multiple second sub-regions are identified as third target sub-regions; that is, the third target sub-region in other images is also a bright area. The third display area is determined from the electrochromic substrate based on the third target sub-region, meaning the third target sub-region is visible to the human eye through the third display area. Similarly, second sub-regions with brightness less than the first threshold among multiple second sub-regions are identified as fourth target sub-regions; that is, the fourth target sub-region in other images is a dark area. The fourth display area is determined from the electrochromic substrate based on the fourth target sub-region, meaning the fourth target sub-region is visible to the human eye through the fourth display area. The third and fourth display areas are not used to display virtual images, but AI algorithms can be used to calculate whether the transmittance of the non-display areas needs adjustment to make the overall display of the environmental image more harmonious.

[0119] Specifically, AI algorithms can be trained on machines, for example, by feeding the machine with a large number of different environmental images and virtual images, performing neural self-learning to obtain the optimal fusion parameters for each pixel in the environmental and virtual images, and simultaneously outputting the environmental and virtual images for display. Specifically, by acquiring environmental images with varying brightness levels, and designing corresponding virtual images based on these images, different parameters are adjusted for the bright and dark pixels in different environmental images. When integrating the virtual image into the environmental image, the brightness of each pixel in the environmental image needs to be read, and the grayscale of the projected virtual image is adjusted accordingly, thus achieving complete fusion of the environmental and virtual images.

[0120] Please refer to Figure 5 , Figure 5 This is a schematic diagram of a first structural embodiment of the display device provided in this application. The display device 500 in this embodiment is a virtual reality fusion display device, such as AR / MR glasses, an AR / MR headset, or a car head-up display system. In this document, AR glasses are used as an example for description. The display device includes an electrochromic substrate 510, a camera 520, and a processor 530. Those skilled in the art will understand that... Figure 5 The structure of the display device 500 shown does not constitute a limitation on the display device 500. It may include more or fewer components than shown, or combine certain components, or have different component arrangements.

[0121] The electrochromic substrate 510 can transmit light from the ambient image and display a virtual image; the camera 520 is disposed adjacent to the electrochromic substrate and can acquire the ambient image; the processor 530 is electrically connected to the electrochromic substrate 510 and the camera 520, and the processor 530 is used to execute:

[0122] Acquire environmental images;

[0123] The environmental image is matched with the virtual image to determine the display area of ​​the virtual image on the electrochromic substrate;

[0124] The target image is determined from the environmental image, and the light from the target image is transmitted through the display area;

[0125] The transmittance of the display area is controlled based on the brightness of the target image.

[0126] In one embodiment, when controlling the transmittance of the display area based on the brightness of the target image, the processor 530 executes: if the brightness of the target image is greater than a first threshold, then reduce the transmittance of the display area.

[0127] In one implementation, when reducing the transmittance of the display area if the brightness of the target image is greater than a first threshold, the processor 530 performs the following: acquiring the brightness of a plurality of first sub-regions in the target image;

[0128] The first sub-region with a brightness greater than a first threshold among multiple first sub-regions is identified as the first target sub-region;

[0129] A first display area is determined from the display area based on a first target sub-region, wherein light from the first target sub-region is transmitted through the first display area;

[0130] Reduce the transmittance of the first display area.

[0131] In one implementation, in reducing the transmittance of the first display area, the processor 530 performs the following: acquiring the average brightness of the virtual image;

[0132] Reduce the transmittance of the first display area so that the brightness of the light from the first target sub-region after passing through the first display area is less than the average brightness of the virtual image.

[0133] In one implementation, after reducing the transmittance of the first display area, the processor 530 executes:

[0134] The first sub-regions whose brightness is not greater than a first threshold among multiple first sub-regions are identified as second target sub-regions;

[0135] A second display area is determined from the display area based on a second target sub-region, wherein light from the second target sub-region is transmitted through the second display area;

[0136] Adjust the brightness of the virtual image displayed in the second display area.

[0137] In one implementation, after reducing the transmittance of the first display area, the processor 530 performs the following: acquiring the brightness of a plurality of second sub-regions in the ambient image other than the target image;

[0138] The second sub-regions whose brightness is greater than the first threshold among multiple second sub-regions are identified as the third target sub-regions;

[0139] A third display area is determined from an electrochromic substrate based on a third target sub-region, wherein light from the third target sub-region is transmitted through the third display area;

[0140] The transmittance of the third display area is controlled so that the transmittance of the third display area is positively correlated with the distance from the first display area.

[0141] In one implementation, when determining a target image from an ambient image, in a light transmission display area of ​​the target image, the processor 530 is configured to perform: acquiring the maximum brightness of multiple sub-regions in the ambient image;

[0142] If the maximum brightness is less than the first threshold, a virtual image is displayed on the electrochromic substrate;

[0143] If the maximum brightness is greater than the first threshold, the target image is determined from the environmental image, and the light from the target image is transmitted to the display area.

[0144] In one embodiment, when matching an ambient image with a virtual image to determine a display area of ​​the virtual image on an electrochromic substrate, the processor 530 is configured to perform: if there are multiple virtual images, matching the ambient image with the multiple virtual images to determine multiple display areas corresponding to the multiple virtual images on the electrochromic substrate.

[0145] In determining a target image from an ambient image, and the light transmission display area of ​​the target image, the processor 530 is used to perform: determining multiple target images from the ambient image, and the light transmission display areas of the multiple target images;

[0146] In controlling the transmittance of the display area based on the brightness of the target image, the processor 530 performs the following: controlling the transmittance of multiple display areas based on the brightness of multiple target images.

[0147] In one embodiment, the electrochromic substrate includes an electrochromic layer, a plurality of first electrodes 517 and a plurality of second electrodes 518. The electrochromic layer is disposed between the plurality of first electrodes 517 and the plurality of second electrodes 518, and the electrochromic layer connects the plurality of first electrodes 517 and the plurality of second electrodes 518. The plurality of first electrodes 517 are arranged along a first direction, and the plurality of second electrodes 518 are arranged along a second direction, the first direction being perpendicular to the second direction. The processor 530 is further configured to perform: determining the transmittance of the display area based on the brightness of the target image, and providing a first voltage signal to the first electrode 517 corresponding to the display area, and providing a second voltage signal to the corresponding second electrode 518.

[0148] In one embodiment, the processor 530 is further configured to perform: if there are multiple target images, determine the transmittance of multiple display areas based on the brightness of the multiple target images, and sequentially provide a first voltage signal to the first electrode 517 corresponding to the multiple display areas, and provide a second voltage signal to the corresponding second electrode 518.

[0149] The following explains the principle of transmittance adjustment of the electrochromic substrate in this embodiment. Please refer to [link / reference]. Figure 6 , Figure 7 and Figure 8 , Figure 6 This is a schematic diagram of a first structure of an electrochromic substrate provided in an embodiment of this application. Figure 7 A schematic diagram of a second structure of the electrochromic substrate provided in this application embodiment. Figure 8 This is a schematic diagram of a third structure of the electrochromic substrate provided in an embodiment of this application.

[0150] The electrochromic substrate 510 includes an electrochromic layer 512 and two transparent conductors 516. The two transparent conductors 516 can be sandwiched between two glass layers 519. The transparent conductors 516 are, for example, ITO transparent conductors 516. The electrochromic layer 512 can be sandwiched between the two ITO transparent conductors 516. The ITO transparent conductors 516 on one side of the electrochromic layer 512 are cut into a plurality of first electrodes 517 arranged along a first direction, and the ITO transparent conductors 516 on the other side of the electrochromic layer 512 are cut into a plurality of second electrodes 518 arranged along a second direction. The electrochromic layer 512 connects the plurality of first electrodes 517 and the plurality of second electrodes 518. For example, the plurality of first electrodes 517 are arranged along the first direction, and the plurality of second electrodes 518 are arranged along the second direction. The first direction is perpendicular to the second direction. By providing a first voltage signal to a first electrode 517 and a second voltage signal to a second electrode 518, a potential difference is formed at the intersection of the electrochromic layer 512, thereby changing the light transmittance at the intersection of the electrochromic layer 512. By simultaneously providing a first voltage signal to n first electrodes 517 and a second voltage signal to n second electrodes 518, a potential difference can be formed at multiple intersections of the electrochromic layer 512, thereby changing the light transmittance at multiple intersections of the electrochromic layer 512, so as to adjust the transmittance of the electrochromic substrate 510 at the corresponding multiple intersections.

[0151] The electrochromic layer 512 may include a cation storage material layer 513, an electrolyte layer 514, and an electrochromic material layer 515. The cation storage material layer 513 may be nickel oxide (NiO), the electrochromic material layer 515 may be tungsten oxide (WO3), and the electrolyte layer 514 is composed of cations, such as lithium ions. Lithium ions can react with nickel oxide to change its color, causing the nickel oxide to appear colored or transparent. Specifically, when a first voltage is applied to the first electrode 517 and a second voltage is applied to the second electrode 518, a potential difference exists at the intersection of the first electrode 517 and the second electrode 518. Lithium ions are transported under voltage drive, and the color deepens when lithium ions accumulate at the nickel oxide end. The longer the duration of the first voltage signal applied to the first electrode 517 and the second voltage signal applied to the second electrode 518, the longer the potential difference between the first electrode 517 and the second electrode 518, resulting in a deeper concentration of lithium ions accumulated at the nickel oxide end, and thus a darker electrochromic layer. The darker the color of 512, the lower the transmittance of the electrochromic substrate 510. The shorter the duration of the first voltage signal supplied to the first electrode 517 and the second voltage signal supplied to the second electrode 518, the shorter the duration of the potential difference between the first electrode 517 and the second electrode 518. Therefore, the concentration of lithium ions accumulated at the nickel oxide end is lighter, resulting in a lighter color of the electrochromic layer 512 and a higher transmittance of the electrochromic substrate 510. In other words, the duration of the potential difference between the first electrode 517 and the second electrode 518 is inversely proportional to the transmittance of the electrochromic substrate 510. When the voltage of the first electrode 517 and the second electrode 518 is removed, without the driving force of an external potential difference, the lithium ions accumulated at the nickel oxide end at the intersection will remain for a period of time. This characteristic can be used to randomly drive the potential difference at any intersection point, causing that intersection point to change color and maintain the color for a period of time.

[0152] Based on this, this embodiment determines the transmittance of the display area according to the brightness of the target image, and provides a first voltage signal to the first electrode 517 corresponding to the display area and a second voltage signal to the corresponding second electrode 518, so that the display area of ​​the electrochromic substrate 510 can exhibit a transparent state or different degrees of coloring. If there are multiple virtual images and multiple corresponding target images, the transmittance of multiple display areas is determined according to the brightness of multiple target images, and the first voltage signal is sequentially provided to the first electrode 517 corresponding to the multiple display areas, and the second voltage signal is sequentially provided to the corresponding second electrode 518.

[0153] For example, please refer to Figure 9 and Figure 10 , Figure 9 This is a schematic diagram illustrating the colored state of a display area in an electrochromic substrate provided in an embodiment of this application. Figure 10This is a schematic diagram illustrating the colored state of multiple display areas in an electrochromic substrate provided in an embodiment of this application. For example, there are eight first electrodes 517 arranged along the row direction, and eight second electrodes 518 arranged along the column direction. If region a1 of the electrochromic substrate 510 is a display area, then by providing a first voltage signal to the first electrodes 517 in the second, third, and fourth rows, and simultaneously providing a second voltage signal to the second electrodes 518 in the fifth, sixth, and seventh columns, the first voltage signal and the second voltage signal have a potential difference, thereby causing region a1 in the corresponding electrochromic substrate 510 to exhibit a colored state.

[0154] For example, if the electrochromic substrate has multiple display areas, such as Figure 10 As shown, regions a1 and b1 are both display areas. Voltage signals are sequentially supplied to the first electrode 517 and the second electrode 518 corresponding to region a1, and to the first electrode 517 and the second electrode 518 corresponding to region b1. Specifically, the first step is to supply voltage signals to the first electrode 517 and the second electrode 518 corresponding to region a1, causing region a1 to display a colored state. The second step is to cancel the voltage supply to the first electrode 517 and the second electrode 518 corresponding to region a1. Region a1, now without an external potential difference, can maintain its colored state for a period of time. The third step is to supply voltage signals to the first electrode 517 and the second electrode 518 corresponding to region b1, causing region b1 to display a colored state. Figure 6 As shown, a first voltage signal is provided to the first electrode 517 in the sixth and seventh rows, and a second voltage signal is simultaneously provided to the second electrode 518 in the third, fourth, and fifth columns. The first voltage signal and the second voltage signal have a potential difference, thereby causing the b1 region in the corresponding electrochromic substrate to present a colored state. Fourth step: cancel the voltage of the first electrode 517 and the second electrode 518 corresponding to the b1 region. The b1 region is now a region without an external potential difference and can maintain a colored state for a period of time. The first to fourth steps are executed in sequence, so that multiple display areas at any position of the electrochromic substrate, such as the a1 region and the b1 region, can present a colored state at the same time.

[0155] In one implementation, please refer to Figure 11 , Figure 11This is a schematic diagram of a fourth structure of the electrochromic substrate provided in an embodiment of this application. The electrochromic substrate 510 includes an electrochromic layer 512, a plurality of first electrodes 517, and a plurality of second electrodes 518. The electrochromic layer 512 includes a plurality of electrochromic units, each electrochromic unit being correspondingly disposed with one first electrode 517 and one second electrode 518. The processor 530 is further configured to perform: determining the transmittance of the display area based on the brightness of the target image, and providing a first voltage signal to the first electrode 517 corresponding to the display area, and providing a second voltage signal to the corresponding second electrode 518. That is, each first electrode 517 and each second electrode 518 can be driven individually, such as... Figure 11 Each cell can represent a first electrode 517 or a second electrode 518, so that the electrochromic unit corresponding to each first electrode 517 and each second electrode 518 can be controlled independently, thereby allowing the transmittance of each electrochromic unit to be changed independently as needed.

[0156] In one embodiment, the processor 530 is further configured to: control the duration of providing a first voltage signal to a corresponding first electrode and control the duration of providing a second voltage signal to a corresponding second electrode, thereby controlling the transmittance of the display area. By selectively driving portions of the first electrode 517 and the second electrode 518 of the electrochromic substrate 510, and controlling the duration of the voltages provided to the first electrode 517 and the second electrode 518, different electrochromic units of the electrochromic substrate 510 can respectively exhibit a transparent state or a colored state of different degrees. It should be noted that... Figure 6 , Figure 7 , Figure 8 and Figure 11 The electrochromic substrate also includes other components, such as diffractive waveguides, which are not limited here.

[0157] For example, Figure 12This is a schematic diagram of the structure of the first electrode driving circuit provided in an embodiment of this application. Each first electrode 517 or each second electrode 518 can be controlled by an independent driving circuit 540. The driving circuit 540 of the first electrode 517 is described below as an example. The driving circuit 540 includes a first switch T1 and a second switch T2. The first switch T1 is located between the positive power supply terminal Vdd and the first electrode 517, and is used to control the conduction and disconnection of the first electrode 517 with the positive power supply terminal Vdd. The second switch T2 is located between the negative power supply terminal Vss and the first electrode 517, and is used to control the conduction and disconnection of the first electrode 517 with the negative power supply terminal Vss. When the first switch T1 is on, a positive voltage, such as 5V or 3V, is provided to the first electrode 517; when the second switch T2 is on, a negative voltage, such as -5V or -3V, is provided to the first electrode 517. The first switch T1 and the second switch T2 can be, for example, MOSFETs.

[0158] The first switch T1 receives the first drive signal Rx sent by the processor 530, and the second switch T2 receives the second drive signal Tx sent by the processor 530. When the first drive signal Rx is high and the second drive signal Tx is low, the first electrode 517 is connected to the positive power supply terminal Vdd to provide a positive voltage to the first electrode 517; when the first drive signal Rx is low and the second drive signal Tx is high, the first electrode 517 is connected to the negative power supply terminal to provide a negative voltage to either the first electrode 517 or the second electrode 518. It should be noted that the drive circuit 540 of the second electrode 518 can be the same as the drive circuit 540 of the first electrode 517, and will not be described further here.

[0159] For example, the positive power supply terminal Vdd and the negative power supply terminal Vss are variable voltages. By selectively driving portions of the first electrode 517 and the second electrode 518 of the electrochromic substrate 510, different positive or negative voltages are provided to the first electrode 517 or the second electrode 518, so that different potential differences can be generated between the first electrode 517 and the second electrode 518, so that the corresponding areas in the electrochromic substrate 510 can generate a transparent state or a colored state of different degrees.

[0160] For example, one of the first electrode 517 and the second electrode 518 can be connected to a common electrode, such as 0V. The other of the first electrode 517 and the second electrode 518 can be provided with a positive or negative voltage by a driving circuit, so that the first electrode 517 and the second electrode 518 generate a positive or negative potential difference, thereby controlling the transmittance of the electrochromic substrate.

[0161] For example, by controlling the duration of the first driving signal Rx and the second driving signal Tx, the voltage duration of the corresponding first electrode 517 and second electrode 518 can be controlled, thereby controlling the coloring degree of the electrochromic substrate 510, that is, controlling the transmittance of the electrochromic substrate 510.

[0162] Please refer to Figure 13 , Figure 13 The second structural schematic diagram of the display device provided in the embodiments of this application shows that the display device 500 may further include components such as a power supply 550, an audio circuit 560, a sensor 570, and a radio frequency circuit 580.

[0163] The power supply 550 supplies power to the various components of the electronic device 500. In some embodiments, the power supply 550 can be logically connected to the processor 530 through a power management system, thereby enabling functions such as charging, discharging, and power consumption management through the power management system.

[0164] Audio circuitry 560 provides an audio interface between the user and the electronic device via a speaker and a microphone. Audio circuitry 560 includes a microphone. The microphone is electrically connected to processor 530. The microphone is used to receive voice information input by the user.

[0165] Sensor 570 is used to collect information about the external environment. Sensor 570 may include one or more sensors such as an ambient light sensor, an accelerometer, and a gyroscope.

[0166] The light engine 580 is used to project the virtual image to be displayed onto the electrochromic substrate 510.

[0167] Although not shown in the figure, the display device 500 may also include other modules such as radio frequency circuits, control circuits, and input power supplies, which will not be described in detail here.

[0168] In the above embodiments, the descriptions of each embodiment have different focuses. For parts not described in detail in a certain embodiment, please refer to the detailed description of the display method of the display device above, which will not be repeated here.

[0169] It should be noted that, regarding the display method of the display device in the embodiments of this application, those skilled in the art will understand that all or part of the process of implementing the display method of the display device in the embodiments of this application can be accomplished by controlling related hardware through a computer program. The computer program can be stored in a computer-readable storage medium, such as a memory, and executed by at least one processor. During execution, it can include the process of the embodiment of the display method of the display device. The storage medium can be a magnetic disk, an optical disk, a read-only memory (ROM), a random access memory (RAM), etc.

[0170] The display method, display device, and storage medium of the display device provided in the embodiments of this application have been described in detail above. Specific examples have been used to illustrate the principles and implementation methods of this application. The description of the above embodiments is only for the purpose of helping to understand the method and core ideas of this application. At the same time, for those skilled in the art, there will be changes in the specific implementation methods and application scope based on the ideas of this application. Therefore, the content of this specification should not be construed as a limitation of this application.

Claims

1. A display method for a display device, characterized in that, The display device includes an electrochromic substrate, which is used to transmit light from an ambient image and display a virtual image. The display method includes: Acquire the environmental image; The environmental image is matched with the virtual image to determine the display area of ​​the virtual image on the electrochromic substrate; A target image is determined from the environmental image, wherein light from the target image is transmitted through the display area; Controlling the transmittance of the display area based on the brightness of the target image includes: acquiring the brightness of a plurality of first sub-regions in the target image; identifying a first sub-region among the plurality of first sub-regions whose brightness is greater than a first threshold as a first target sub-region; determining a first display area from the display area based on the first target sub-region, wherein the light from the first target sub-region is transmitted through the first display area; and reducing the transmittance of the first display area.

2. The display method of the display device according to claim 1, characterized in that, Controlling the transmittance of the display area based on the brightness of the target image includes: If the brightness of the target image is greater than a first threshold, the transmittance of the display area is reduced.

3. The display method of the display device according to claim 1, characterized in that, The reduction of the transmittance of the first display area includes: Obtain the average brightness of the virtual image; Reduce the transmittance of the first display area so that the brightness of the light from the first target sub-region after passing through the first display area is less than the average brightness of the virtual image.

4. The display method of the display device according to claim 1, characterized in that, After reducing the transmittance of the first display area, the method further includes: The first sub-regions whose brightness is not greater than the first threshold among the plurality of first sub-regions are determined as the second target sub-regions; A second display area is determined from the display area based on the second target sub-region, wherein light from the second target sub-region is transmitted through the second display area; Adjust the brightness of the virtual image displayed in the second display area.

5. The display method of the display device according to claim 1, characterized in that, After reducing the transmittance of the first display area, the method further includes: Obtain the brightness of multiple second sub-regions in the environmental image other than the target image; The second sub-regions whose brightness is greater than the first threshold among the plurality of second sub-regions are determined as the third target sub-regions; A third display area is determined from the electrochromic substrate based on the third target sub-region, wherein light from the third target sub-region is transmitted through the third display area; The transmittance of the third display area is controlled so that the transmittance of the third display area is positively correlated with the distance from the first display area.

6. The display method of the display device according to claim 1, characterized in that, Determining the target image from the environmental image, wherein light from the target image is transmitted through the display area, includes: Obtain the maximum brightness of multiple sub-regions in the environmental image; If the maximum brightness is less than the first threshold, the virtual image is displayed on the electrochromic substrate; If the maximum brightness is greater than a first threshold, a target image is determined from the environmental image, and the light from the target image is transmitted through the display area.

7. The display method of the display device according to claim 1, characterized in that, The step of matching the environmental image with the virtual image to determine the display area of ​​the virtual image on the electrochromic substrate includes: If there are multiple virtual images, the environmental image is matched with the multiple virtual images to determine multiple display areas corresponding to the multiple virtual images on the electrochromic substrate; Determining a target image from the environmental image, wherein light from the target image is transmitted through the display area includes: Multiple target images are determined from the environmental image, and light from the multiple target images is transmitted through the display area; The step of controlling the transmittance of the display area based on the brightness of the target image includes: The transmittance of the multiple display areas is controlled based on the brightness of the multiple target images.

8. A display device, characterized in that, include: Electrochromic substrates can transmit light from ambient images and display virtual images; A camera, disposed adjacent to the electrochromic substrate, is capable of acquiring images of the environment; A processor, electrically connected to the electrochromic substrate and the camera, is configured to perform the method as described in any one of claims 1 to 7.

9. The display device according to claim 8, characterized in that, The electrochromic substrate includes an electrochromic layer, a plurality of first electrodes and a plurality of second electrodes. The electrochromic layer is disposed between the plurality of first electrodes and the plurality of second electrodes, and the electrochromic layer connects the plurality of first electrodes and the plurality of second electrodes. The plurality of first electrodes are arranged along a first direction, and the plurality of second electrodes are arranged along a second direction. The first direction is perpendicular to the second direction. The processor is further configured to: determine the transmittance of the display area based on the brightness of the target image, and provide a first voltage signal to the first electrode corresponding to the display area, and provide a second voltage signal to the corresponding second electrode.

10. The display device according to claim 9, characterized in that, The processor is further configured to perform the following: if there are multiple target images, determine the transmittance of multiple display areas based on the brightness of the multiple target images, and sequentially provide a first voltage signal to the first electrode corresponding to the multiple display areas, and provide a second voltage signal to the corresponding second electrode.

11. The display device according to claim 8, characterized in that, The electrochromic substrate includes an electrochromic layer, a plurality of first electrodes and a plurality of second electrodes. The electrochromic layer includes a plurality of electrochromic units, and each electrochromic unit is disposed corresponding to one of the first electrodes and one of the second electrodes. The processor is further configured to: determine the transmittance of the display area based on the brightness of the target image, and provide a first voltage signal to the first electrode corresponding to the display area, and provide a second voltage signal to the corresponding second electrode.

12. The display device according to any one of claims 9 to 11, characterized in that, The processor is further configured to: control the duration of providing the first voltage signal corresponding to the first electrode and control the duration of providing the second voltage signal corresponding to the second electrode, so as to control the transmittance of the display area.

13. A storage medium having a computer program stored thereon, characterized in that, When the computer program is executed on a computer, it causes the computer to perform the method as described in any one of claims 1 to 7.

Images