A display method and related device

Abstract

The embodiments of the present application disclose a display method and related devices, which are at least related to machine learning in artificial intelligence. The display component of the AR device includes a projection layer and a shielding layer that are overlapped in the display direction, and the shielding layer is behind the projection layer. The AR device projects a virtual object onto the projection layer. To avoid the visual effect of the virtual object being difficult to match the real environment due to the overlap of ambient light and the light and shadow on the virtual object, the projection area of the virtual object on the projection layer is determined. According to the positional correspondence between the projection layer and the shielding layer, a first area corresponding to the projection area is determined in the shielding layer. When the augmented display device projects the virtual object, the state of the first area is switched from a light-transmitting state to a shielding state, and a second area other than the first area in the shielding layer remains in a light-transmitting state. Thus, without affecting the user's view of the objects in the real scene, the display effect and realism of the virtual object are improved, and the user experience is enhanced.

Description

Technical Field

[0001] The present application relates to the field of augmented reality, and in particular to a display method and related devices. Background Art

[0002] Augmented Reality (AR) technology is a technology that cleverly integrates virtual information with the real world. Through AR devices, users can observe virtual objects projected by AR technology in real scenes, such as virtual animated images, virtual signs, etc. From the perspective of users through AR devices, virtual objects projected by AR technology should be like being in real scenes, thus bringing users a new visual and interactive experience.

[0003] However, the virtual object is actually a projection of the AR device on its own display interface. When the user observes it through the AR device, the virtual object will overlap with the real scene in light and shadow, making the virtual object observed by the user through the AR device not highly integrated with the real scene and lacking a sense of reality. Summary of the invention

[0004] In order to solve the above technical problems, the present application provides a display method and related devices, which are used to improve the degree of integration between real scenes and virtual objects and enhance the sense of reality when users observe through AR devices.

[0005] The embodiments of the present application disclose the following technical solutions:

[0006] In one aspect, the present application provides a display method, the method comprising:

[0007] Determine a projection area of a virtual object on a projection layer, wherein the projection layer is provided in a display component of an augmented reality device, wherein the display component further comprises a shielding layer provided to overlap with the projection layer in a display direction, and wherein the shielding layer is located behind the projection layer in the display direction;

[0008] Determining a first area of the shielding layer corresponding to the projection area according to a position correspondence between the projection layer and the shielding layer;

[0009] The state of the first area is switched from a light-transmitting state to a shielding state, and a second area in the shielding layer except the first area is maintained in the light-transmitting state, the area in the shielding layer in the light-transmitting state does not hinder the passage of ambient light, and the area in the shielding layer in the shielding state hinders the passage of ambient light.

[0010] On the other hand, the present application provides an augmented reality device, which includes a display component, a projection component, and a processing component. The display component includes a projection layer and a shielding layer that are overlapped and arranged in the display direction. In the display direction, the shielding layer is behind the projection layer;

[0011] The projection component is configured to project a virtual object on the projection layer;

[0012] When the processing component determines the projection area of the virtual object on the projection layer, according to the positional correspondence between the projection layer and the shielding layer, it determines a first area of the shielding layer corresponding to the projection area; switches the state of the first area from a light-transmitting state to a shielding state, and keeps a second area of the shielding layer other than the first area in the light-transmitting state. The area of the shielding layer in the light-transmitting state does not obstruct the transmission of ambient light, and the area of the shielding layer in the shielding state obstructs the transmission of ambient light.

[0013] On the other hand, the present application provides a computer device, which includes a processor and a memory:

[0014] The memory is used to store program code and transmit the program code to the processor;

[0015] The processor is configured to execute the method described in the above aspect according to the instructions in the program code.

[0016] On the other hand, an embodiment of the present application provides a computer-readable storage medium, which is used to store a computer program, and the computer program is used to execute the method described in the above aspect.

[0017] On the other hand, an embodiment of the present application provides a computer program product or a computer program. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method described in the above aspect.

[0018] As can be seen from the above technical solutions, the display component of the AR device includes a projection layer and a shielding layer that are overlapped and arranged in the display direction. In this display direction, the shielding layer is behind the projection layer. The AR device projects a virtual object onto the projection layer to achieve the visual effect that the virtual object is in the real scene. To avoid the visual effect of the virtual object being difficult to match the real environment due to the overlap of ambient light and the light and shadow on the virtual object, it is necessary to determine the projection area of the virtual object on the projection layer. According to the position correspondence between the projection layer and the shielding layer, a first area corresponding to the projection area is determined in the shielding layer. When the augmented display device projects the virtual object, the state of the first area is switched from a light-transmitting state to a shielding state, and the second area other than the first area in the shielding layer remains in a light-transmitting state. Thus, when the user uses the AR device, since the shielding layer is farther from the user than the projection layer, when the virtual object is projected, the first area in the shielding layer that is switched to the shielding state will block the ambient light from passing through the projection area, without affecting the normal display of the virtual object to the user. Therefore, the display quality of the virtual object observed by the user is more realistic and is not easily superimposed and affected by the ambient light as the background in the real scene, resulting in abnormal transparency and distortion. And the second area in the shielding layer remains in a light-transmitting state when the virtual object is projected, and does not block the passage of ambient light. Thus, the user can still normally observe the real environment around the virtual object and obtain an AR visual experience that the virtual object is in the real environment. BRIEF DESCRIPTION OF THE DRAWINGS

[0019] In order to more clearly illustrate the technical solutions in the embodiments of the present application or the prior art, the following will briefly introduce the drawings required for use in the description of the embodiments or the prior art. Obviously, the drawings in the following description are only some embodiments of the present application. For those of ordinary skill in the art, without creative efforts, other drawings can also be obtained based on these drawings.

[0020] Figure 1 Schematic diagram of an application scenario of a display method provided by an embodiment of the present application;

[0021] Figure 2 Schematic diagram of an AR device provided by an embodiment of the present application;

[0022] Figure 3 Schematic diagram of an AR glasses provided by an embodiment of the present application;

[0023] Figure 4 Flowchart of a display method provided by an embodiment of the present application;

[0024] Figure 5 Schematic diagram of a display link for an AR device to display a virtual object;

[0025] Figure 6Schematic diagram for a user to observe virtual objects using an AR device in related technologies;

[0026] Figure 7 Schematic diagram of the display link for an AR device to display virtual objects;

[0027] Figure 8a An optical display architecture solution provided by an embodiment of the present application;

[0028] Figure 8b An optical display architecture solution provided by an embodiment of the present application;

[0029] Figure 8c An optical display architecture solution provided by an embodiment of the present application;

[0030] Figure 8d An optical display architecture solution provided by an embodiment of the present application;

[0031] Figure 8e An optical display architecture solution provided by an embodiment of the present application;

[0032] Figure 9 Schematic diagram of the display link for an AR device to display virtual objects provided by an embodiment of the present application;

[0033] Figure 10 Schematic diagram of an electrochromic layer provided by an embodiment of the present application;

[0034] Figure 11 Schematic diagram of the working principle of an electrochromic grating module provided by an embodiment of the present application;

[0035] Figure 12 Schematic diagram of the working principle of an electrochromic grating module provided by an embodiment of the present application;

[0036] Figure 13 Schematic diagram of the working principle of an electrochromic grating module provided by an embodiment of the present application;

[0037] Figure 14 Equivalent circuit diagram of an electrochromic grating module corresponding to a display pixel provided by an embodiment of the present application;

[0038] Figure 15 Equivalent circuit diagram of an electrochromic grating module corresponding to a display pixel set by an embodiment of the present application;

[0039] Figure 16 Schematic diagram of an electrochromic layer provided by an embodiment of the present application;

[0040] Figure 17 Schematic diagram of the structure of a server provided by an embodiment of the present application;

[0041] Figure 18 The structural schematic diagram of the terminal device provided by the embodiment of the present application. Detailed implementation manners

[0042] The embodiments of the present application will be described below with reference to the accompanying drawings.

[0043] With the development of science and technology, AR devices are becoming more and more popular and gradually appear in people's actual work and life. However, compared with virtual reality (VR) devices, the display effect of AR devices is poor. For example, the display effects of virtual objects in terms of color contrast and color saturation are not ideal. At the same time, in the actual use environment, due to the changes and complexities of the use scenarios, the display effect of virtual objects inevitably has a color deviation problem, resulting in a low degree of integration between virtual objects and the real scene, lack of realism, and affecting the user experience.

[0044] Based on this, the embodiments of the present application provide a display method and related device for improving the realism of virtual objects in the real scene and enhancing the user experience.

[0045] The display method provided by the embodiments of the present application is implemented based on artificial intelligence. Artificial intelligence (AI) is to use a digital computer or a machine controlled by a digital computer to simulate, extend, and expand human intelligence, perceive the environment, acquire knowledge, and use the knowledge to obtain the best results in terms of theory, method, technology, and application system. In other words, artificial intelligence is a comprehensive technology in computer science. It attempts to understand the essence of intelligence and produce a new intelligent machine that can react in a way similar to human intelligence. Artificial intelligence also studies the design principles and implementation methods of various intelligent machines to enable the machines to have the functions of perception, reasoning, and decision-making.

[0046] Artificial intelligence technology is an interdisciplinary subject, involving a wide range of fields, including both hardware-level technologies and software-level technologies. The basic technologies of artificial intelligence generally include technologies such as sensors, dedicated artificial intelligence chips, cloud computing, distributed storage, big data processing technology, operation / interaction systems, and mechatronics. The software technologies of artificial intelligence mainly include several major directions such as computer vision technology, speech processing technology, natural language processing technology, and machine learning / deep learning.

[0047] In the embodiments of the present application, the artificial intelligence software technologies mainly involved include the above-mentioned computer vision technology and machine learning / deep learning and other directions.

[0048] The display method provided in this application can be applied to display devices with data processing capabilities, such as terminal devices and servers. Among them, the terminal device can specifically be a smart phone, a desktop computer, a laptop computer, a tablet computer, a smart speaker, a smart watch, an AR device, etc., but is not limited thereto; the server can be an independent physical server, or a server cluster or distributed system composed of multiple physical servers, or a cloud server providing cloud computing services. The terminal device and the server can be directly or indirectly connected through wired or wireless communication methods, and this application does not limit this here.

[0049] The display device can have the ability of computer vision technology. Computer Vision (CV) is a science that studies how to make machines "see". Further speaking, it refers to using cameras and computers to replace human eyes for object recognition and measurement and other machine vision, and further performing graphic processing to make the computer process into an image that is more suitable for human eyes to observe or be transmitted to an instrument for detection. As a scientific discipline, computer vision studies related theories and technologies and attempts to establish an artificial intelligence system that can obtain information from images or multi-dimensional data. Computer vision technology usually includes image processing, image recognition, image semantic understanding, image retrieval, OCR, video processing, video semantic understanding, video content / behavior recognition, three-dimensional object reconstruction, 3D technology, virtual reality, augmented reality, simultaneous localization and mapping, etc.

[0050] The display device can have the ability of machine learning. Machine Learning (ML) is an interdisciplinary subject involving multiple fields such as probability theory, statistics, approximation theory, convex analysis, and algorithm complexity theory. It specifically studies how computers simulate or implement human learning behaviors to acquire new knowledge or skills and reorganize the existing knowledge structure to continuously improve their own performance. Machine learning is the core of artificial intelligence and the fundamental way to make computers intelligent, and its applications cover all fields of artificial intelligence. Machine learning and deep learning usually include technologies such as artificial neural networks, belief networks, reinforcement learning, transfer learning, inductive learning, and rote learning.

[0051] In the display method provided in the embodiments of this application, the artificial intelligence model adopted mainly involves the application of computer vision technology, and realizes the fusion of virtual objects and real scenes through related technologies such as 3D, VR, and AR in computer vision technology.

[0052] To facilitate the understanding of the technical solution of this application, the following will introduce the display method provided in the embodiments of this application with the terminal as the display device in combination with an actual application scenario.

[0053] See Figure 1, This figure is a schematic diagram of an application scenario of a display method provided by an embodiment of this application. In Figure 1 In the application scenario shown, the terminal device 100 is an AR glasses (an AR device), and the user can see virtual objects integrated with the real scene by wearing the AR glasses.

[0054] Among them, the display component of the AR glasses is the lens, and the lens includes a projection layer 110 and a shielding layer 120. In the display direction, the projection layer 110 and the shielding layer 120 are overlapped, and in the display direction, the shielding layer 120 is behind the projection layer 110. As Figure 1 shown, both the projection layer 110 and the shielding layer 120 are located on the lens. Compared with the shielding layer 120, the projection layer 110 is closer to the user.

[0055] The AR glasses project the virtual object onto the projection layer 110. Through the AR glasses, the user can not only view the virtual object, but also view the real environment, achieving the visual effect that the virtual object is in the real scene.

[0056] The virtual object in the real scene is affected by the ambient light. For example, when the background of the virtual object is dark, the color of the virtual object will deepen. In order to avoid the visual effect of the virtual object being difficult to match the real environment due to the overlap of the ambient light and the light and shadow on the virtual object, it is necessary to determine the projection area of the virtual object on the projection layer 110, and according to the positional correspondence between the projection layer 110 and the shielding layer 120, determine the first area corresponding to the projection area in the shielding layer 120.

[0057] In Figure 1 the application scenario shown, the virtual object is a "cross" pattern. The projection area of the virtual object projected onto the projection layer 110 is a "cross" pattern, and in the shielding layer 120, the first area corresponding to the projection area is also a "cross" pattern.

[0058] When the AR glasses project the virtual object, the state of the first area is switched from a light-transmitting state to a shielding state, and the second area other than the first area in the shielding layer remains in a light-transmitting state. As Figure 1 shown, in the shielding layer 120, the first area does not allow ambient light to pass through, and the second area allows ambient light to pass through. At this time, the ambient light will not enter the projection layer 110 through the shielding layer 120. For the virtual object projected on the projection area, it is not affected by the ambient light. For example, it is not easily superimposed and affected by the ambient light as the background in the real scene and does not show abnormal transparency, distortion, etc., so it will not affect the normal display of the virtual object to the user, and the display quality of the virtual object observed by the user is more real.

[0059] Meanwhile, the second region in the shielding layer 120 remains in a light-transmitting state during the projection of the virtual object, without obstructing the transmission of ambient light. Thus, the user can still normally observe the real environment around the virtual object, obtaining an AR visual experience of the virtual object in the real environment, better integrating the virtual object with the real environment, enhancing the realism of the virtual object in the real scene, and improving the user experience.

[0060] Next, with reference to the accompanying drawings, taking a terminal device as the display device, a display method provided by an embodiment of the present application will be introduced.

[0061] See Figure 2 , which is a schematic diagram of an AR device provided by an embodiment of the present application. The AR device 200 includes a display component 210, a projection component 220, and a processing component 230. Among them, the display component includes a projection layer 211 and a shielding layer 212 that are overlapped in the display direction, and in the display direction, the shielding layer 212 is behind the projection layer 211, and the shielding layer 212 can cover the display range of the virtual object on the projection layer.

[0062] Next, taking an AR glasses as an example, see Figure 3 , which is a schematic diagram of an AR glasses provided by an embodiment of the present application. The AR glasses 200 belong to an AR device. The display component 210 of the AR glasses 200 is the lens part. The projection component 220 can be a part of the component located on the glasses frame, and the processing component 230 can be a part of the component located on the glasses frame. The projection component 220 can be integrated with the processing component 230 or set independently. The present application does not make specific limitations on the composition of the projection component and the processing component. Both the projection layer 211 and the shielding layer 212 cover the lens. Compared with the shielding layer 212, the projection layer 211 is closer to the user.

[0063] Among them, the projection component 220 is used to project a virtual object on the projection layer 211, such as projecting the virtual object on the lens. The processing component 230 is used to determine the projection area of the virtual object on the projection layer 211, so as to control the shielding layer 212 to adjust the state of the first region of the corresponding projection area to the shielding state when projecting the virtual object. Next, with reference to the accompanying drawings Figure 4 the processing component 230 will be described.

[0064] See Figure 4 , which is a flowchart of a display method provided by an embodiment of the present application. As Figure 4 shown, the display method includes the following steps:

[0065] S401: Determine the projection area of the virtual object on the projection layer.

[0066] In related technologies, AR devices are affected by ambient light when projecting virtual objects. The reasons for the influence of ambient light on virtual objects will be introduced from the principle below.

[0067] See Figure 5 , which is a schematic diagram of the display link of an AR device showing a virtual object. When a user uses an AR device, the real environment must be superimposed. The ambient light in the real environment will be superimposed with the light rays projected by the AR device to display the virtual object and then emitted to the human eye together. Therefore, it is inevitable that the ambient light in the real environment affects the virtual object, and the ambient light in the real environment will have an adverse effect on the imaging of the virtual object.

[0068] For example, see Figure 6 , which is a schematic diagram of a user using an AR device in related technologies to observe a virtual object. In Figure 6 , the user uses AR glasses. The virtual object projected by the AR glasses is a cuboid little person. The color of the cuboid little person itself is white, and the background environment it is in is a triangular background with uneven colors. Affected by the ambient light of the triangular background, the cuboid little person observed by the human eye will be affected by the ambient light of the dark-colored background. For example, the cuboid little person in Figure 6 is divided into multiple colors with different shades. Some areas have a darker color, and even the degree of darkening in different areas is different, making the display effect of the cuboid little person very "fake", lacking a sense of reality and affecting the user experience.

[0069] Based on this, in order to reduce the influence of ambient light on virtual objects, related technologies have proposed a solution to increase the display brightness of AR devices and a solution to reduce the light transmittance of AR devices. They will be introduced separately below.

[0070] Solution 1: Increase the display brightness of the AR device.

[0071] To bring better color contrast and color saturation to the user, the intensity of the light emitted by the display device can be increased. See Figure 7 , which is a schematic diagram of the display link of an AR device showing a virtual object. The intensity of the ambient light is measured in real time through an ambient light intensity sensor, or according to the intensity of the ambient light under normal usage conditions, the intensity of the light required for the AR device to display the virtual object is appropriately increased, and the brightness ratio of the virtual object in the light reaching the user's eyes is enhanced. By highlighting the virtual object in the real scene, the user can have a better visual experience.

[0072] Solution 2: Reduce the light transmittance of the AR device.

[0073] To reduce the influence of ambient light on the display effect of virtual objects, the light transmittance of the ambient light of the lenses in the AR device can be reduced. When the incoming ambient light is minimized, the influence of the ambient light on the virtual object is weakened, giving the user a better visual experience.

[0074] However, in Solution 1, by increasing the display brightness of the AR device, the power consumption of the AR device will increase significantly, and corresponding battery capacity and heat dissipation solutions need to be added. Moreover, the volume of the AR device also needs to be further increased, and the weight of the AR device worn by the user is relatively large, resulting in a significant reduction in the user experience of using the AR device. In Solution 2, by reducing the light transmittance of the lens in the AR device, although the display effect is improved well, due to the low overall light transmittance, it is difficult for the user to clearly see the real environment, which greatly affects the user experience of real interaction operations. Moreover, whether it is Solution 1 or Solution 2, the sense of unreality of the virtual object is aggravated, and a good user experience cannot be brought to the user.

[0075] Based on this, the present application realizes dynamically adjusting the light transmittance corresponding to the area where the virtual object is displayed by reducing the light transmittance corresponding to the area where the virtual object is displayed and maintaining the light transmittance corresponding to other areas where the virtual object is not displayed. Thus, on the premise of not affecting the user's view of the objects in the real scene, the display effect of the virtual object is improved, the sense of reality of the virtual object is enhanced, and the user experience is improved.

[0076] Therefore, in order to adjust the light transmittance corresponding to the area where the virtual object is displayed, the projection area of the virtual object on the projection layer is determined.

[0077] The projection component can project the virtual object on the projection layer by adopting different optical display architecture solutions. The optical display architecture solutions can be, for example, the prism solution as shown in Figure 8a , the birdbath solution as shown in Figure 8b , the free-form surface solution as shown in Figure 8c , the off-axis holographic lens solution as shown in Figure 8d and the Lightguide solution as shown in Figure 8e . The projection area of the virtual object on the projection layer can be determined according to different optical display architecture solutions.

[0078] S402: Determine the first area corresponding to the projection area of the shielding layer according to the positional correspondence between the projection layer and the shielding layer.

[0079] As can be seen from the foregoing, the projection layer and the shielding layer are different layers in the display component. The projection layer is used to display the virtual object, and the shielding layer is used to control the light transmittance of the ambient light. In order to reduce the influence of the ambient light on the virtual object, the light transmittance corresponding to the projection area where the virtual object is located in the projection layer is reduced. Thus, the first area corresponding to the projection area can be determined in the shielding layer according to the positional correspondence between the projection layer and the shielding layer, so as to reduce the light transmittance of the first area.

[0080] S403: Switch the state of the first region from the light-transmitting state to the light-blocking state, and keep the second region other than the first region in the light-blocking layer in the light-transmitting state.

[0081] In the light-blocking layer, the region in the light-transmitting state does not obstruct the ambient light from passing through, and the region in the light-blocking state obstructs the ambient light from passing through. After determining the first region, switch the state of the first region from the light-transmitting state to the light-blocking state, so as to obstruct the ambient light from passing through the light-blocking layer, thereby reducing the light transmittance of the first region. In the display direction, the first region is located behind the projection region. Reducing the light transmittance of the first region can reduce the ambient light entering the projection layer, thereby reducing the abnormal transparency, distortion, etc. of the virtual object caused by the superposition effect of the ambient light. The contrast and color saturation of the virtual object can be significantly improved, making the display quality of the virtual object observed by the user more realistic. Moreover, it will not significantly increase the volume and power consumption of the AR device, and there is a greater improvement in terms of the portability and user-friendliness of the AR device compared to the aforementioned first solution.

[0082] The embodiments of the present application do not specifically limit the degree of obstruction. For example, the light transmittance of the first region can be appropriately reduced, so that the proportion of the ambient light entering the first region is reduced, and the intensity of the ambient light is reduced, thereby reducing the influence of the ambient light on the virtual object. For another example, the light transmittance of the first region is changed to 0, and the ambient light is not allowed to enter the first region, so that the ambient light will not affect the virtual object.

[0083] The following takes the case where the light transmittance of the first region is changed to 0 as an example for illustration. Refer to Figure 9 , which is a schematic diagram of the display link of the AR device for displaying virtual objects provided by the embodiments of the present application. In the first region, the light-blocking layer will block all ambient light from entering, so that the virtual object in the projection region will not be superimposed with the ambient light in the real environment, and the human eye can only observe the light projected by the AR device for the virtual object. Thus, the influence of the ambient light in the real environment on the virtual object is avoided, and the display of the virtual object is more substantial, more like an object existing in the real environment, making the virtual object better integrated with the real environment and improving the user's interaction experience.

[0084] In the light-blocking layer, not only is the state of the first region switched to the light-blocking state, but also the second region other than the first region in the light-blocking layer is kept in the light-transmitting state, so as not to affect the ambient light from entering the second region, enabling the user to clearly observe the real environment. Compared with the aforementioned second solution, instead of reducing the light transmittance as a whole in the present application, only the light transmittance of the first region is reduced, maximizing the light transmittance corresponding to the region where the virtual object is not displayed, and well ensuring the interaction experience and ability of the AR device with the user in the real environment, which can meet both the display effect of the virtual object and the dual requirements that the user can see the real environment more clearly.

[0085] As can be seen from the above technical solution, the display component of the AR device includes a projection layer and a shielding layer that are overlapped in the display direction. In this display direction, the shielding layer is behind the projection layer. The AR device projects a virtual object onto the projection layer to achieve the visual effect that the virtual object is in the real scene. To avoid the visual effect of the virtual object being difficult to match the real environment due to the overlap of ambient light and the light and shadow on the virtual object, it is necessary to determine the projection area of the virtual object on the projection layer. According to the positional correspondence between the projection layer and the shielding layer, a first area corresponding to the projection area is determined in the shielding layer. When the augmented display device projects the virtual object, the state of the first area is switched from a light-transmitting state to a shielding state, and the second area other than the first area in the shielding layer remains in the light-transmitting state. Thus, when the user uses the AR device, since the shielding layer is farther from the user than the projection layer, when the virtual object is projected, the first area in the shielding layer that is switched to the shielding state will block the ambient light from passing through the projection area, without affecting the normal display of the virtual object to the user. Therefore, the display quality of the virtual object observed by the user is more realistic and is not easily superimposed and affected by the ambient light as the background in the real scene, resulting in abnormal transparency and distortion. And the second area in the shielding layer remains in the light-transmitting state during the projection of the virtual object, without blocking the passage of ambient light. Thus, the user can still normally observe the real environment around the virtual object and obtain the AR visual experience that the virtual object is in the real environment.

[0086] It should be noted that the projection component projects a series of multiple still solid images (frames) of the virtual object at regular intervals and projects the virtual object onto the projection layer at a certain frequency with continuous change and movement (playback) speed (such as 16 frames per second). The rate at which the projection component projects the virtual object at regular intervals is the refresh frequency of the virtual object.

[0087] The determination frequency of the projection area of the virtual object on the projection layer is consistent with the refresh frequency of the virtual object, so that at the same time point, the corresponding first area of the projection area is shielded correspondingly. That is, when the virtual object changes the projection area on the projection layer, the shielding layer correspondingly changes the first area, thereby realizing dynamic control of the light transmittance corresponding to the projection area where the virtual object is located in the projection layer. That is, the refresh frequency of the virtual object matches the switching of the first area from the light-transmitting state to the shielding state. When the virtual object undergoes dynamic changes, such as moving, rotating, expanding or shrinking, materializing or becoming transparent, etc., the shielding state and area of the shielding layer will change synchronously with the changes of the virtual object on the projection layer, and the first area is adjusted at any time with the change of the projection area, which not only improves the display effect of the virtual object, but also does not destroy the user's immersion in use.

[0088] The embodiments of the present application do not specifically limit the shielding layer that can locally change the light transmittance. Here, the shielding layer is taken as an electrochromic layer as an example for illustration.

[0089] The electrochromic layer uses electrochromic materials, which have electrochromic properties. Electrochromism is an optical property of materials (such as reflectivity, transmittance, absorptance, etc.), and it is a phenomenon in which stable and reversible color changes occur under the action of an external electric field, manifested as reversible changes in color and transparency in appearance.

[0090] Therefore, the shielding layer can be an electrochromic layer. The processing component switches the state of the first region from a light-transmitting state to a shielding state by changing the electric field strength of the first region, and keeps the second region in a light-transmitting state by maintaining the electric field strength of the second region, that is, the transmittance of ambient light is controlled by changing the electric field strength of the electrochromic layer.

[0091] Thus, when the projection area of the virtual object on the projection layer changes dynamically, the electric field strength of the first region in the shielding layer is adjusted accordingly, and the electric field strength of the second region is maintained. Without complex control logic, only by simple electric field strength control, the transmittance of ambient light in the first region can be reduced, or even ambient light is not allowed to pass through, so that the display quality of the virtual object observed by the user is more realistic. And the second region in the shielding layer remains in a light-transmitting state when the virtual object is projected, and does not block the passage of ambient light. Therefore, the user can still normally observe the real environment around the virtual object and obtain an AR visual experience of the virtual object in the real environment, meeting the dual requirements of not only improving the display effect of the virtual object but also not destroying the user's immersion experience.

[0092] The following takes the electrochromic grating module of the electrochromic layer as an example for illustration.

[0093] Refer to Figure 10 , which is a schematic diagram of an electrochromic layer provided by an embodiment of the present application. The electrochromic grating module includes a first electrode layer 1001, a second electrode layer 1003, and a liquid crystal layer 1002. The liquid crystal layer 1002 is between the first electrode layer 1001 and the second electrode layer 1003, and a plurality of liquid crystals are filled as shielding substances. The liquid crystals in the liquid crystal layer can be light-blocking dark colors, such as black, etc. The darker the light-blocking color, the better the effect of reducing the transmittance of ambient light, so as to minimize the influence of ambient light on the virtual object as much as possible.

[0094] Refer to Figure 11 , which is a schematic diagram of the working principle of an electrochromic grating module provided by an embodiment of the present application. In the natural state of the liquid crystal, that is, when the electric field strength between the first electrode layer 1001 and the second electrode layer 1003 is small or the electric field strength is 0, the liquid crystals are randomly and freely arranged. There are no gaps or the gaps are small between the freely arranged liquid crystals, thus blocking the passage of ambient light through the liquid crystal layer.

[0095] Refer to Figure 12, This figure is a schematic diagram of the working principle of an electrochromic grating module provided by an embodiment of the present application. When the electric field strength between the first electrode layer 1001 and the second electrode layer 1003 changes, the liquid crystal will be arranged orderly along the vertical direction of the first electrode layer 1001 or the second electrode layer 1003, so that light can pass through, thereby realizing light transmission.

[0096] Thus, in order to control the light transmittance of the first region, the processing component can control the first electrode layer 1001, and can change the voltage V of the first electrode layer 1001 in the first region. data from the first voltage to the second voltage. If the difference between the second voltage and the voltage V of the second electrode layer 1003 com is less than the threshold V lc , that is, |V data -V com |<V lc , since the distance between the first electrode layer 1001 and the second electrode layer 1003 generally does not change, that is, the electric field strength where the liquid crystal layer 1002 is located is less than the field strength required to maintain the orderly posture of the liquid crystal, the liquid crystal in the first region of the liquid crystal layer 1002 is adjusted from the orderly posture to the free posture, hindering the ambient light from passing through the liquid crystal layer 1002, and realizing the switching of the state of the first region from the light transmission state to the shielding state.

[0097] By controlling the first electrode layer 1001, the voltage of the first electrode layer 1001 in the second region is maintained at the first voltage. If the difference between the first voltage and the field strength V of the second electrode layer 1003 com is greater than or equal to the threshold V lc , that is, |V data -V com |≥V lc , since the distance between the first electrode layer 1001 and the second electrode layer 1003 generally does not change, that is, the electric field strength where the liquid crystal layer 1002 is located is greater than or equal to the field strength required to maintain the orderly posture of the liquid crystal, the liquid crystal in the second region of the liquid crystal layer remains in the orderly posture, realizing that the second region is maintained in the light transmission state.

[0098] Thus, by changing the electric field strength between the first electrode layer 1001 and the second electrode layer 1003, the liquid crystal layer 1002 can be switched between the shielding state and the light transmission state, realizing the control of the light transmittance of the ambient light by changing the electric field strength of the electrochromic grating module, reducing the influence of the ambient light in the first region on the virtual object, not affecting the normal display of the virtual object to the user, and not hindering the transmission of the ambient light in the second region, not affecting the user's observation of the real environment other than the virtual object, and enabling the user to obtain an AR visual experience that the virtual object is in the real environment.

[0099] It should be noted that the embodiments of the present application do not specifically limit the first electrode layer and the second electrode layer. For example, both the first electrode layer and the second electrode layer can be indium tin oxides (ITO) electrodes.

[0100] As a possible implementation, the processing component can control the state switching of the shielding layer through a switching tube. Taking the switching tube as a field-effect transistor (FET) as an example, refer to Figure 13 , which is a schematic diagram of the working principle of an electrochromic grating module provided by an embodiment of the present application. By controlling the voltages of the gate line and the source line, the on and off of the FET are achieved, thereby controlling the voltage V of the first electrode layer 1001 data , and further controlling the electric field strength between the first electrode layer 1001 and the second electrode layer 1003, so that the liquid crystal layer 1002 can be switched between the shielding state and the light-transmitting state.

[0101] The following will be described by taking the voltage of the second electrode layer as a high level and a low level as examples respectively.

[0102] Method 1: The voltage of the second electrode layer is a high level.

[0103] The source of the switching tube is connected to the source line, so that the source of the switching tube has a voltage. The gate of the switching tube is connected to the gate line. The processing component controls the gate of the switching tube in the first electrode layer 1001 in the first region, such as energizing the gate line, so that the gate of the switching tube has a voltage, and the source and drain of the switching tube are turned on, so that the voltage V of the first electrode layer 1001 in the first region data changes from a low level to a high level, thereby realizing the change of the voltage V of the first electrode layer 1001 in the first region data from the first voltage to the second voltage. At this time, the voltage V of the first electrode layer 1001 data and the voltage V of the second electrode layer 1003 com are both high levels. If |V data -V com |<V lc , the liquid crystal in the first region of the liquid crystal layer 1002 is adjusted from an ordered posture to a free posture, realizing the switching of the state of the first region from the light-transmitting state to the shielding state.

[0104] The processing component controls the gate of the switching tube in the first electrode layer 1001 in the second region, such as de-energizing the gate line, so that the gate of the switching tube does not have a voltage, and the source and drain of the switching tube are cut off, so that the voltage V of the first electrode layer 1001 in the second region dataRemain at a low level, so as to keep the voltage of the first electrode layer 1001 in the second region at the first voltage. At this time, the voltage V of the first electrode layer 1001 data is at a low level, and the voltage V of the second electrode layer 1003 com is at a high level. If |V data - V com | ≥ V lc , the electric field strength in the liquid crystal layer 1002 is greater than the required field strength, and the liquid crystal in the second region of the liquid crystal layer remains in an ordered state, so as to keep the second region in a light-transmitting state.

[0105] Method 2: The voltage of the second electrode layer is at a low level.

[0106] The source electrode of the switching transistor is connected to the source line, so that the source electrode of the switching transistor has a voltage. The gate electrode of the switching transistor is connected to the gate line. The processing component controls the gate electrode of the switching transistor in the first electrode layer 1001 in the first region. For example, by cutting off the power supply of the gate line, the gate electrode of the switching transistor does not have a voltage, and the source electrode and the drain electrode of the switching transistor are cut off, so that the voltage of the first electrode layer 1001 in the first region changes from a high level to a low level, so as to realize changing the voltage V of the first electrode layer 1001 in the first region data from the first voltage to the second voltage. At this time, the voltage V of the first electrode layer 1001 data and the voltage V of the second electrode layer 1003 com are both at a low level. If |V data - V com | < V lc , the liquid crystal in the first region of the liquid crystal layer 1002 is adjusted from an ordered state to a free state, so as to realize the switching of the state of the first region from a light-transmitting state to a shielding state.

[0107] The processing component controls the gate electrode of the switching transistor in the first electrode layer 1001 in the second region. For example, by energizing the gate line, the gate electrode of the switching transistor has a voltage, and the source electrode and the drain electrode of the switching transistor are turned on, so that the voltage of the first electrode layer in the first region remains at a high level. At this time, the voltage V of the first electrode layer 1001 data is at a high level, and the voltage V of the second electrode layer 1003 com is at a low level. If |V data - V com | ≥ V lc , the electric field strength in the liquid crystal layer 1002 is greater than the required field strength, and the liquid crystal in the second region of the liquid crystal layer remains in an ordered state, so as to keep the second region in a light-transmitting state.

[0108] Compared with the high level voltage of the second electrode layer in the first mode, the voltage of the second electrode layer in the second mode is at a low level. The AR device is more power-saving, with reduced power consumption, and its battery capacity can also be reduced, so that the volume of the AR device can be smaller, improving the convenience and user-friendliness of the AR device.

[0109] As a possible implementation, the switching transistors provided in the first electrode layer 1001 correspond to the display pixels of the virtual object. The second electrode layer 1003 includes electrodes arranged opposite to the switching transistors. After the first electrode layer and the second electrode layer are energized, an electric field can be formed to change the state of the first region from a light-transmitting state to a shielding state by changing the electric field strength of the first region, and the second region is maintained in the light-transmitting state by maintaining the electric field strength of the second region.

[0110] Thus, the ability to change the display pixel dot matrix can be achieved through the electrochromic grating, that is, the transmittance of the shielding layer can be globally or locally changed, thereby ensuring better display effects of the AR device. The embodiments of the present application do not specifically limit the number of switching transistors corresponding to each pixel. For example, an equivalent circuit diagram as shown in Figure 13 can be provided for each pixel, or multiple equivalent circuit diagrams as shown in Figure 13 can be provided. Hereinafter, an example will be given in which an equivalent circuit diagram as shown in Figure 13 is provided for each pixel.

[0111] As shown in Figure 14 and 15 , an equivalent circuit diagram of an electrochromic grating module corresponding to a display pixel provided by an embodiment of the present application is shown. In Figure 14 and Figure 15 , two gate lines are included, corresponding to the gate lines where the voltages V even and V odd are located respectively. Among them, the display pixels corresponding to the switching transistors controlled by the gate line where the voltage V even is located are in the first region, and the display pixels corresponding to the switching transistors controlled by the gate line where the voltage V odd is located are in the second region.

[0112] By controlling the gate lines where the voltages V even and V odd are located, the transmittance control of the light in the first region and the second region is achieved. In Figure 14 , if the gate line where the voltage V even is located is energized and the gate line where the voltage V odd is located is de-energized, the difference between the voltage V even and the voltage V com of the second electrode layer 1003 is less than the threshold V lc, the state of the first region is switched from the light-transmitting state to the light-blocking state, and the second region is maintained in the light-transmitting state. In Figure 15 , such as when the gate line where the voltage V even is located is powered off, and the gate line where the voltage V odd is located is powered off, so that by controlling the voltage V even and the voltage V com of the second electrode layer 1003 is greater than or equal to the threshold value V lc , the state of the first region is switched from the light-blocking state to the light-transmitting state, and the second region is maintained in the light-transmitting state.

[0113] It should be noted that when the light-blocking layer is an electrochromic grating module, the optical display architecture scheme of the projection component in the AR device using the optical waveguide scheme has relatively better effects, is more convenient for the electrochromic grating module to be closely attached to the display component during manufacturing, and better realizes the alignment of display pixels.

[0114] As a possible implementation manner, refer to Figure 16 , this figure is a schematic diagram of an electrochromic layer provided by an embodiment of the present application. The electrochromic grating module may further include a polarizer layer 1004, an upper glass layer 1005, and a lower glass layer 1006. In the display direction, from front to back, there are a polarizer layer 1004, an upper glass layer 1005, a first electrode layer 1001, a liquid crystal layer 1002, a second electrode layer 1003, and a lower glass layer 1006 in sequence.

[0115] Next, taking the AR glasses shown in Figure 3 as an example for description.

[0116] The processing component of the AR glasses can first extract or separate the virtual object to be displayed, determine the projection area of the virtual object in the projection layer. While the projection component projects the virtual object onto the projection layer of the display component, the processing component drives the electrochromic grating module in the light-blocking layer, so that the liquid crystal in the electrochromic grating module in the first region in the light-blocking layer corresponding to the projection area is adjusted from the ordered posture to the free posture, realizing the blocking of the ambient light in the first region, and the liquid crystal in the second region maintains the ordered posture, allowing the ambient light to pass through normally. And at any time, according to the change of the projection area where the projection component projects the virtual object, the area that needs to be blocked by the electrochromic grating module is changed accordingly, so as to realize synchronous adjustment by changing the area that needs to be blocked by the electrochromic grating module to cooperate with various changes such as the movement, rotation, materialization, or transparency of the virtual object in the visible area.

[0117] Accordingly, based on the electrochromic grating module being able to cooperate with virtual objects for dynamic light shielding, preventing ambient light outside the AR device from passing through the lens and overlapping with the light of the virtual objects displayed by the AR device, resulting in color deviation in the display and display defects in a complex background environment, enabling users to see images with a more consistent display effect, and the virtual object being a more realistic object closer to what is seen in real life, rather than the translucent images often seen on general AR devices, with a higher sense of reality. At the same time, there is still a good light transmittance in the non-display area of the virtual object, allowing users to complete actual interaction operations normally, thus enhancing the user experience.

[0118] The aforementioned display device can be a computer device, which can be a server or a terminal device. Below, the computer device provided in the embodiments of the present application will be introduced from the perspective of hardware implementation. Among them, Figure 17 Shown is a schematic structural diagram of a server. Figure 18 Shown is a schematic structural diagram of a terminal device.

[0119] See Figure 17 , Figure 17 is a schematic structural diagram of a server provided in the embodiments of the present application. The server 1400 may vary significantly due to different configurations or performances, and may include one or more central processing units (CPUs) 1422 (for example, one or more processors) and a memory 1432, and one or more storage media 1430 for storing application programs 1442 or data 1444 (for example, one or more mass storage devices). Among them, the memory 1432 and the storage media 1430 can be transient storage or persistent storage. The program stored in the storage media 1430 may include one or more modules (not shown in the figure), and each module may include a series of instruction operations on the server. Further, the central processor 1422 can be configured to communicate with the storage media 1430 and execute a series of instruction operations in the storage media 1430 on the server 1400.

[0120] The server 1400 may further include one or more power supplies 1426, one or more wired or wireless network interfaces 1450, one or more input / output interfaces 1458, and / or one or more operating systems 1441, such as Windows ServerTM, Mac OS XTM, UnixTM, LinuxTM, FreeBSDTM, etc.

[0121] The steps performed by the server in the above embodiments can be based on the Figure 17 shown server structure.

[0122] Among them, the CPU 1422 is used to execute the following steps:

[0123] Determine the projection area of the virtual object on the projection layer, where the projection layer is provided in the display component of the augmented reality device, and the display component further includes an occlusion layer that is overlapped with the projection layer in the display direction. In the display direction, the occlusion layer is behind the projection layer;

[0124] Determine the first area of the occlusion layer corresponding to the projection area according to the positional correspondence between the projection layer and the occlusion layer;

[0125] Switch the state of the first area from a light-transmitting state to an occluding state, and keep the second area other than the first area in the occlusion layer in the light-transmitting state. The area of the occlusion layer in the light-transmitting state does not obstruct the transmission of ambient light, and the area of the occlusion layer in the occluding state obstructs the transmission of the ambient light.

[0126] Optionally, the CPU 1422 may also execute the method steps of any specific implementation manner of the display method in the embodiments of the present application.

[0127] See Figure 18 , Figure 18 which is a schematic structural diagram of a terminal device provided in the embodiments of the present application. Figure 18 Shown is a block diagram of a part of the structure of a smart phone related to the terminal device provided in the embodiments of the present application. The smart phone includes: a Radio Frequency (RF) circuit 1510, a memory 1520, an input unit 1530, a display unit 1540, a sensor 1550, an audio circuit 1560, a wireless fidelity (WiFi) module 1570, a processor 1580, and a power supply 1590 and other components. Those skilled in the art can understand that Figure 18 the structure of the smart phone shown in

[0128] does not limit the smart phone, and may include more or fewer components than shown in the figure, or combine some components, or have different component arrangements. Figure 18 The following specifically introduces each component of the smart phone:

[0129] The RF circuit 1510 can be used for receiving and sending information or signals during communication. Specifically, after receiving the downlink information from the base station, it is sent to the processor 1580 for processing. Additionally, the uplink data designed is sent to the base station. Generally, the RF circuit 1510 includes, but is not limited to, an antenna, at least one amplifier, a transceiver, a coupler, a low noise amplifier (LNA), a duplexer, etc. In addition, the RF circuit 1510 can also communicate with the network and other devices through wireless communication. The above wireless communication can use any communication standard or protocol, including but not limited to the Global System of Mobile communication (GSM), General Packet Radio Service (GPRS), Code Division Multiple Access (CDMA), Wideband Code Division Multiple Access (WCDMA), Long Term Evolution (LTE), email, Short Messaging Service (SMS), etc.

[0130] The memory 1520 can be used to store software programs and modules. The processor 1580 realizes various functional applications and data processing of the smart phone by running the software programs and modules stored in the memory 1520. The memory 1520 mainly includes a program storage area and a data storage area. Among them, the program storage area can store the operating system, application programs required for at least one function (such as the sound playback function, the image playback function, etc.); the data storage area can store the data created according to the use of the smart phone (such as audio data, phone book, etc.). In addition, the memory 1520 can include high-speed random access memory, and can also include non-volatile memory, such as at least one magnetic disk storage device, a flash memory device, or other non-volatile solid-state storage devices.

[0131] The input unit 1530 can be used to receive input numeric or character information and generate key signal inputs related to the user settings and function controls of the smart phone. Specifically, the input unit 1530 can include a touch panel 1531 and other input devices 1532. The touch panel 1531, also known as a touch screen, can collect touch operations of the user thereon or nearby (such as operations of the user using any suitable object or accessory such as a finger, a stylus, etc. on or near the touch panel 1531), and drive corresponding connection devices according to a preset program. Optionally, the touch panel 1531 can include two parts: a touch detection device and a touch controller. Among them, the touch detection device detects the touch orientation of the user, detects the signal brought by the touch operation, and transmits the signal to the touch controller; the touch controller receives the touch information from the touch detection device, converts it into contact coordinates, then sends it to the processor 1580, and can receive and execute the commands sent by the processor 1580. In addition, various types such as resistive, capacitive, infrared, and surface acoustic wave can be used to implement the touch panel 1531. In addition to the touch panel 1531, the input unit 1530 can also include other input devices 1532. Specifically, the other input devices 1532 can include, but are not limited to, one or more of a physical keyboard, function keys (such as volume control keys, power on / off keys, etc.), a trackball, a mouse, a joystick, etc.

[0132] The display unit 1540 can be used to display the information input by the user or the information provided to the user and various menus of the smart phone. The display unit 1540 can include a display panel 1541. Optionally, the display panel 1541 can be configured in the form of a liquid crystal display (LCD for short), an organic light-emitting diode (OLED for short), etc. Further, the touch panel 1531 can cover the display panel 1541. When the touch panel 1531 detects a touch operation thereon or nearby, it is transmitted to the processor 1580 to determine the type of touch event. Subsequently, the processor 1580 provides a corresponding visual output on the display panel 1541 according to the type of touch event. Although in Figure 18 the touch panel 1531 and the display panel 1541 are implemented as two independent components to realize the input and input functions of the smart phone, in some embodiments, the touch panel 1531 and the display panel 1541 can be integrated to realize the input and output functions of the smart phone.

[0133] The smart phone may also include at least one sensor 1550, such as a light sensor, a motion sensor, and other sensors. Specifically, the light sensor may include an ambient light sensor and a proximity sensor. Among them, the ambient light sensor can adjust the brightness of the display panel 1541 according to the brightness of the ambient light, and the proximity sensor can turn off the display panel 1541 and / or the backlight when the smart phone is moved to the ear. As a kind of motion sensor, the accelerometer sensor can detect the magnitude of acceleration in all directions (generally three axes). When stationary, it can detect the magnitude and direction of gravity, and can be used for applications that identify the posture of the smart phone (such as horizontal and vertical screen switching, related games, magnetometer posture calibration), vibration recognition related functions (such as pedometer, tapping), etc. As for other sensors that the smart phone can also be configured with, such as gyroscopes, barometers, hygrometers, thermometers, infrared sensors, etc., they will not be elaborated here.

[0134] The audio circuit 1560, the speaker 1561, and the microphone 1562 can provide an audio interface between the user and the smart phone. The audio circuit 1560 can transmit the electrical signal converted from the received audio data to the speaker 1561, and the speaker 1561 converts it into a sound signal for output. On the other hand, the microphone 1562 converts the collected sound signal into an electrical signal, which is received by the audio circuit 1560 and then converted into audio data. After the audio data is output to the processor 1580 for processing, it is sent through the RF circuit 1510 to, for example, another smart phone, or the audio data is output to the memory 1520 for further processing.

[0135] WiFi belongs to short - range wireless transmission technology. The smart phone can help users send and receive emails, browse the web, and access streaming media through the WiFi module 1570, which provides users with wireless broadband Internet access. Although Figure 18 the WiFi module 1570 is shown, it can be understood that it does not belong to the essential components of the smart phone and can be omitted completely within the scope of not changing the essence of the invention according to needs.

[0136] The processor 1580 is the control center of the smart phone. It connects various parts of the entire smart phone using various interfaces and lines. By running or executing software programs and / or modules stored in the memory 1520, and by calling the data stored in the memory 1520, it executes various functions of the smart phone and processes data. Optionally, the processor 1580 may include one or more processing units; preferably, the processor 1580 may integrate an application processor and a modem processor. Among them, the application processor mainly processes the operating system, user interface, and application programs, etc., and the modem processor mainly processes wireless communication. It can be understood that the above - mentioned modem processor may not be integrated into the processor 1580 either.

[0137] The smart phone further includes a power source 1590 (such as a battery) for powering each component. Preferably, the power source can be logically connected to the processor 1580 through a power management system, so as to implement functions such as management of charging, discharging, and power consumption management through the power management system.

[0138] Although not shown, the smart phone may further include a camera, a Bluetooth module, etc., which will not be elaborated herein.

[0139] In the embodiment of the present application, the memory 1520 included in the smart phone can store program codes and transmit the program codes to the processor.

[0140] The processor 1580 included in the smart phone can execute the display method provided in the above embodiment according to the instructions in the program codes.

[0141] The embodiment of the present application further provides a computer-readable storage medium for storing a computer program, and the computer program is used to execute the display method provided in the above embodiment.

[0142] The embodiment of the present application further provides a computer program product or a computer program. The computer program product or the computer program includes computer instructions, and the computer instructions are stored in a computer-readable storage medium. The processor of the computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the display method provided in various optional implementation manners of the above aspects.

[0143] Those of ordinary skill in the art can understand that all or part of the steps for implementing the above method embodiment can be completed by hardware related to program instructions. The foregoing program can be stored in a computer-readable storage medium. When the program is executed, it executes the steps including the above method embodiment; and the foregoing storage medium can be at least one of the following media: read-only memory (English: read-only memory, abbreviation: ROM), RAM, magnetic disk, or optical disc, etc., which can store program codes.

[0144] It should be noted that the various embodiments in this specification are described in a progressive manner. For the identical or similar parts among the embodiments, reference can be made to each other, and the differences between each embodiment and other embodiments are emphasized. In particular, for the embodiments of the device and system, since they are basically similar to the method embodiments, they are described relatively simply, and for the relevant parts, reference can be made to the description of the method embodiments. The device and system embodiments described above are merely illustrative. The units described as separate components may or may not be physically separated, and the components shown as units may or may not be physical units, that is, they may be located in one place or distributed to multiple network units. Some or all of the modules can be selected according to actual needs to achieve the purpose of the solution of this embodiment. A person of ordinary skill in the art can understand and implement it without creative efforts.

[0145] As described above, this is only a specific implementation manner of the present application, but the protection scope of the present application is not limited thereto. Any changes or substitutions that can be easily thought of by those skilled in the art within the technical scope disclosed in the present application should be covered by the protection scope of the present application. Therefore, the protection scope of the present application should be subject to the protection scope of the claims.

Claims

1. A display method, characterized in that, The method includes: Determining a projection area of a virtual object on a projection layer, where the projection layer is disposed in a display component of an augmented reality device, and the display component further includes an occlusion layer that is overlapped with the projection layer in a display direction, and in the display direction, the occlusion layer is behind the projection layer; the occlusion layer is an electrochromic grating module; the electrochromic grating module is closely attached to the display component; the electrochromic grating module includes a first electrode layer, a second electrode layer, and a liquid crystal layer, the first electrode layer is provided with switching tubes corresponding to display pixels, and the second electrode layer includes electrodes disposed opposite to the switching tubes; the voltage of the second electrode layer is at a low level; Determining a first area of the occlusion layer corresponding to the projection area according to a positional correspondence between the projection layer and the occlusion layer; By controlling the gates of the switching tubes in the first electrode layer in the first area to be powered off, the source and drain of the switching tubes are cut off, so that the voltage of the first electrode layer in the first area changes from a high level to a low level; If the difference between the voltage of the first electrode layer and the voltage of the second electrode layer is less than a threshold value, the liquid crystal in the first area in the liquid crystal layer is adjusted from an ordered posture to a free posture, realizing the switching of the state of the first area from a light-transmitting state to an occlusion state; By controlling the gates of the switching tubes in the first electrode layer in a second area outside the first area to be powered on, the source and drain of the switching tubes are turned on, so that the voltage of the first electrode layer in the second area remains at a high level; If the difference between the voltage of the first electrode layer and the voltage of the second electrode layer is greater than or equal to the threshold value, the liquid crystal in the second area in the liquid crystal layer remains in an ordered posture, realizing keeping the second area in a light-transmitting state, and the area in the occlusion layer in the light-transmitting state does not block the ambient light from passing through, and the area in the occlusion layer in the occlusion state blocks the ambient light from passing through; Wherein, the determination frequency for determining the projection area of the virtual object on the projection layer is consistent with the refresh frequency of the virtual object, so that when the projection area of the virtual object on the projection layer changes dynamically, the first area and the occlusion state of the occlusion layer corresponding to the projection area will change synchronously with the change of the virtual object on the projection layer, so that the first area corresponding to the projection area at the same time point is in an occlusion state.

2. The method according to claim 1, wherein In the display direction, the electrochromic grating module sequentially includes a polarizer layer, an upper glass layer, the first electrode layer, the liquid crystal layer, the second electrode layer, and a lower glass layer from front to back.

3. The method according to claim 1, characterized in that The liquid crystal in the liquid crystal layer is a light-blocking dark color.

4. An augmented reality device, characterized in that, The device includes a display component, a projection component, and a processing component. The display component includes a projection layer and a shielding layer that are overlapped in the display direction. In the display direction, the shielding layer is behind the projection layer; the shielding layer is an electrochromic grating module; the electrochromic grating module is closely attached to the display component; the electrochromic grating module includes a first electrode layer, a second electrode layer, and a liquid crystal layer. The first electrode layer is provided with switching tubes corresponding to display pixels, and the second electrode layer includes electrodes arranged opposite to the switching tubes; the voltage of the second electrode layer is at a low level; The projection component is used to project a virtual object on the projection layer; When the processing component determines the projection area of the virtual object on the projection layer, it determines a first area of the shielding layer corresponding to the projection area according to the positional correspondence between the projection layer and the shielding layer; By controlling the gate of the switching tube in the first electrode layer in the first area to be powered off, the source and drain of the switching tube are cut off, so that the voltage of the first electrode layer in the first area changes from a high level to a low level; if the difference between the voltage of the first electrode layer and the voltage of the second electrode layer is less than a threshold value, the liquid crystal in the first area of the liquid crystal layer is adjusted from an ordered state to a free state, realizing the switching of the state of the first area from a light-transmitting state to a shielding state; by controlling the gate of the switching tube in the first electrode layer in a second area outside the first area to be powered on, the source and drain of the switching tube are turned on, so that the voltage of the first electrode layer in the first area remains at a high level; if the difference between the voltage of the first electrode layer and the voltage of the second electrode layer is greater than or equal to the threshold value, the liquid crystal in the second area of the liquid crystal layer remains in an ordered state, realizing the second area remaining in the light-transmitting state. The area of the shielding layer in the light-transmitting state does not block the transmission of ambient light, and the area of the shielding layer in the shielding state blocks the transmission of the ambient light; Among them, the determination frequency for determining the projection area of the virtual object on the projection layer is consistent with the refresh frequency of the virtual object, so that when the projection area of the virtual object on the projection layer changes dynamically, the first area and the shielding state of the shielding layer corresponding to the projection area will change synchronously with the change of the virtual object on the projection layer, so that the first area corresponding to the projection area at the same time point is in a shielding state.

5. The augmented reality device according to claim 4, wherein In the display direction, the electrochromic grating module sequentially includes a polarizer layer, an upper glass layer, the first electrode layer, the liquid crystal layer, the second electrode layer, and a lower glass layer from front to back.

6. The augmented reality device according to claim 4, characterized in that, The liquid crystal in the liquid crystal layer is a light-blocking dark color.

7. A computer device, characterized in that, The device includes a processor and a memory: The memory is used to store program code and transmit the program code to the processor; The processor is used to execute the method according to any one of claims 1-3 according to the instructions in the program code.

8. A computer-readable storage medium, characterized in that, The computer-readable storage medium is used to store a computer program, and the computer program is used to be executed by a processor to implement the method according to any one of claims 1-3.

9. A computer program product, characterized in that, The computer program product includes computer instructions, and the computer instructions are stored in a computer-readable storage medium; a processor of a computer device reads the computer instructions from the computer-readable storage medium, and the processor executes the computer instructions, so that the computer device executes the method according to any one of claims 1-3.

Images