Virtual-real fusion display system

Abstract

The utility model relates to the technical field of display, and particularly discloses a virtual-real fusion display system which comprises a transparent display screen, a light generation module, an interaction module and a main control module. The transparent display screen comprises a transparent waveguide substrate, a coupling-in structure and a coupling-out structure, and the coupling-in structure is configured to receive the input light generated by the light generation module and couple the input light to the transparent waveguide substrate so that the input light can be totally reflected and conducted in the transparent waveguide substrate. The coupling-out structure is configured to couple at least part of light conducted in the transparent waveguide substrate out of the transparent waveguide substrate through diffraction; the light generation module and the interaction module are electrically connected with the main control module. Compared with a traditional flat panel display technology, an observer can observe a huge screen image at a farther position through the transparent display screen, a virtual image and a real object can be interactively fused and displayed, and man-machine interaction can be achieved.

Description

Technical Field

[0001] The present application relates to the field of display technology, and in particular to a virtual-reality fusion display system. Background Art

[0002] With the increasing development of display technology, display characteristics are no longer satisfied with ordinary LCD or LED displays. Various new display technologies are constantly emerging. Transparent display technology has received widespread attention due to its transparent display panel characteristics and its unique applications. Transparent displays have many possible applications, such as building or car windows and multi-scene display windows.

[0003] Transparent displays can be divided into many types, among which transparent LCD and transparent OLED are truly transparent displays. However, transparent displays have the disadvantage of low contrast, which is much lower than that of ordinary displays. The reason is that since transparent displays have a certain degree of light transmittance, the background behind the transparent display will interfere with the image displayed by the transparent display. For example, when the pattern of the background behind overlaps with the image displayed by the transparent display or presents a similar color, it is easy to cause the image displayed by the transparent display to have poor clarity and negative effects such as visual fatigue of the human eye.

[0004] At the same time, the existing transparent displays can only display image information on the display surface, and have not deviated from the application scenarios of traditional flat panel displays, nor can they fundamentally replace or transform existing traditional panel flat displays. Summary of the invention

[0005] Based on this, it is necessary to provide a virtual-reality fusion display system to address the above problems.

[0006] According to a first aspect of an embodiment of the present application, a virtual-reality fusion display system is provided, including a transparent display screen, a light generating module, an interaction module, and a main control module;

[0007] The transparent display screen comprises a transparent waveguide substrate and an in-coupling structure and an out-coupling structure arranged on the surface or inside of the transparent waveguide substrate, wherein the in-coupling structure is configured to receive input light generated by the light generating module and couple the input light to the transparent waveguide substrate so that the input light is totally reflected and conducted in the transparent waveguide substrate, and the out-coupling structure is configured to couple at least part of the light conducted in the transparent waveguide substrate out of the transparent waveguide substrate through diffraction to form an observation window;

[0008] The light generating module and the interaction module are electrically connected to the main control module respectively.

[0009] In one embodiment, both the coupling-in structure and the coupling-out structure include nanostructures, and the nanostructures have diffraction properties.

[0010] In one embodiment, the coupling-in structure and the coupling-out structure are disposed on the same side surface of the transparent waveguide substrate.

[0011] In one embodiment, the material of the transparent waveguide substrate includes any one or more of glass, PC, PMMA, and PET.

[0012] In one of the embodiments, the interaction module includes a voice interaction module, and the voice interaction module collects voice information and generates the voice control signal.

[0013] In one of the embodiments, the voice information at least includes target content of the target object.

[0014] In one of the embodiments, the interaction module includes a gesture interaction module, and the gesture interaction module collects gesture information and generates the gesture control signal.

[0015] In one embodiment, the gesture information at least includes zooming in, zooming out, and rotating a currently displayed image.

[0016] The virtual-reality fusion display system provided by the embodiment of the present application includes a transparent display screen, a light generating module, an interaction module and a main control module, wherein the light generating module can generate corresponding input light according to the image information sent by the main control module, and the input light is coupled to the transparent waveguide substrate through the coupling structure in the transparent display screen and is totally reflected and transmitted in the transparent waveguide substrate. The coupling structure in the transparent display screen can couple at least part of the light transmitted in the transparent waveguide substrate out of the transparent waveguide substrate through diffraction to form an observation window, and the user can receive the light at the observation window and observe the virtual image in the reverse extension line direction, wherein the virtual image is located on the other side of the transparent display screen and the imaging position is far away from the transparent display screen. At the same time, due to the transparent property of the transparent display screen, the ambient light can pass through the transparent display screen with a higher transmittance and be received by the human eye, so that the virtual image and the real object can be interactively fused. Compared with the traditional flat display technology, the observer can observe the giant screen image at a farther position through the transparent display screen, breaking through the observation limitation of the physical screen size, and the virtual image can be interactively fused with the real object for display, which improves the observer's visual experience. In addition, an interactive module is also provided, which can collect the interactive information of the observer and generate an interactive control signal. The main control module can output the corresponding image information to the light generating module according to the interactive control signal, and then control the light generating module to generate the corresponding input light, thereby realizing human-computer interaction and improving the intelligence level of the virtual-reality fusion display system. BRIEF DESCRIPTION OF THE DRAWINGS

[0017] Figure 1 A schematic diagram of the structure of a virtual-reality fusion display system provided in one embodiment of the present application;

[0018] Figure 2 A schematic diagram of the structure of a virtual-reality fusion display system provided in one embodiment of the present application;

[0019] Figure 3 A schematic diagram of the structure of a virtual-reality fusion display system provided in one embodiment of the present application;

[0020] Figure 4 A schematic diagram of the structure of a virtual-reality fusion display system provided by another embodiment of the present application;

[0021] Figure 5 A flowchart of a control method for a virtual-reality fusion display system provided in one embodiment of the present application.

[0022] Description of reference numerals:

[0023] 100, transparent display screen; 110, transparent waveguide substrate; 120, coupling structure; 130, coupling structure; 200, light generating module; 300, interaction module; 310, voice interaction module; 320, gesture interaction module; 400, main control module. DETAILED DESCRIPTION

[0024] In order to facilitate the understanding of the present application, the present application will be described more fully below with reference to the relevant drawings. The preferred embodiments of the present application are given in the drawings. However, the present application can be implemented in many different forms and is not limited to the embodiments described herein. On the contrary, the purpose of providing these embodiments is to understand the disclosure of the present application more thoroughly and comprehensively.

[0025] In this application, unless otherwise clearly specified and limited, the terms "installed", "connected", "connected", "fixed" and the like should be understood in a broad sense, for example, it can be a fixed connection, a detachable connection, or an integral connection; it can be a mechanical connection or an electrical connection; it can be a direct connection or an indirect connection through an intermediate medium, it can be the internal connection of two elements or the interaction relationship between two elements, unless otherwise clearly defined. For ordinary technicians in this field, the specific meanings of the above terms in this application can be understood according to specific circumstances.

[0026] The terms "first" and "second" are used for descriptive purposes only and should not be understood as indicating or implying relative importance or implicitly indicating the number of the indicated technical features. Therefore, a feature defined as "first" or "second" may explicitly or implicitly include at least one of the features. In the description of this application, the meaning of "plurality" is at least two, such as two, three, etc., unless otherwise clearly and specifically defined.

[0027] Unless otherwise defined, all technical and scientific terms used herein have the same meaning as those commonly understood by those skilled in the art to which this application belongs. The terms used herein in the specification of this application are only for the purpose of describing specific embodiments and are not intended to limit this application. The term "and / or" used herein includes any and all combinations of one or more of the related listed items.

[0028] With the development of display technology, various new display technologies are constantly emerging, and display characteristics are no longer limited to ordinary LCD or LED displays. Among them, transparent display technology has attracted widespread attention due to its use of transparent display panels and its unique applications. Transparent display screens have many application scenarios, such as building or car windows or multi-scene display windows. In addition to applications on these large devices, small devices such as tablets can also use transparent display screens. Users can view image information through the transparent display screen and can see the scenery in front through the screen.

[0029] However, the transparent display screen in the traditional technology can only display image information on the surface of the display screen, that is, it does not break away from the traditional flat display technology, nor can it fundamentally replace or change the traditional flat display technology.

[0030] In order to solve the above problems, the embodiments of the present application provide a virtual-reality fusion display system and a control method thereof. On the one hand, it can break through the traditional flat display technology, and the observer can see the giant screen image at a farther distance through the screen, breaking through the observation limitation of the physical screen size and realizing virtual-reality fusion display. On the other hand, it can also realize human-computer interaction and enhance the user experience.

[0031] In one embodiment, a virtual-reality fusion display system is provided. Figure 1 to Figure 3 The virtual-reality fusion display system provided in this embodiment includes a transparent display screen 100, a light generating module 200, an interaction module 300 and a main control module 400.

[0032] Reference Figure 1-2 The transparent display screen 100 includes a transparent waveguide substrate 110 and a coupling-in structure 120 and a coupling-out structure 130 arranged on the surface or inside of the transparent waveguide substrate 110. The coupling-in structure 120 is configured to receive the input light generated by the light generating module 200 and couple the input light to the transparent waveguide substrate 110 so that the input light is totally reflected and conducted in the transparent waveguide substrate 110. The coupling-out structure 130 is configured to couple at least part of the light conducted in the transparent waveguide substrate 110 out of the transparent waveguide substrate 110 by diffraction to form an observation window.

[0033] The transparent waveguide substrate 110 can be made of any one or more materials selected from glass, PC (Polycarbonate), PMMA (polymethyl methacrylate), and PET (Polyethylene Terephthalate). In this embodiment, the transparent waveguide substrate 110 has a high visible light transmittance, and its transmittance is not less than 70%.

[0034] The transparent waveguide substrate 110 includes a coupling-in region and a coupling-out region, wherein the coupling-in region is provided with a coupling-in structure 120, and the coupling-out region is provided with a coupling-out structure 130. The coupling-in structure 120 and the coupling-out structure 130 can be provided on the surface or inside of the transparent waveguide substrate 110. Preferably, the coupling-in structure 120 and the coupling-out structure 130 are provided on the surface of the transparent waveguide substrate 110 and are located on the same side of the transparent waveguide substrate 110.

[0035] The coupling-in structure 120 and the coupling-out structure 130 may be nanostructures with diffraction characteristics.

[0036] The light generating module 200 is electrically connected to the main control module 400. The main control module 400 can send image information to the light generating module 200. The light generating module 200 can generate corresponding input light according to the image information sent by the main control module 400. The input light can be coupled to the transparent waveguide substrate 110 through the coupling structure 120 in the transparent display screen 100 and fully reflected and conducted in the transparent waveguide substrate 110. The coupling structure 130 in the transparent display screen 100 can couple at least part of the light conducted in the transparent waveguide substrate 110 out of the transparent waveguide substrate 110 through diffraction to form an observation window. The user can receive the light at the observation window and observe the virtual image in the direction of the reverse extension line, wherein the virtual image is located on the other side of the transparent display screen 100 and the imaging position is far away from the transparent display screen 100. Compared with the traditional flat display technology, the observer can observe the giant screen image at a farther position through the transparent display screen 100, breaking through the observation limitation of the physical screen size.

[0037] In this embodiment, the size of the observation window and the size of the observation distance are positively correlated with the size of the display window of the transparent display screen 100, that is, the larger the display window of the transparent display screen 100 is, the larger the observation distance can be, and the larger the observation window can be. The observation distance refers to the distance from the observation window to the transparent display screen 100.

[0038] At the same time, due to the transparent property of the transparent display screen 100, ambient light can pass through the transparent display screen 100 with a high transmittance and be received by the human eye, so the human eye can clearly see real objects, so that virtual images and real objects can be interactively integrated and displayed, thereby improving the visual experience of the observer.

[0039] In this embodiment, the interaction module 300 is electrically connected to the main control module 400 , the interaction module 300 is configured to generate an interaction control signal, and the main control module 400 is configured to output corresponding image information to the light generating module 200 in response to the interaction control signal.

[0040] In practical applications, the observer can control the display content of the transparent display screen 100 through the interactive module 300. Specifically, the interactive module 300 can collect the observer's interactive information in real time and generate an interactive control signal that can be recognized and processed by the main control module 400. The main control module 400 can output the image information corresponding to the interactive control signal to the light generating module 200 according to the interactive control signal, thereby causing the light generating module 200 to generate the corresponding input light, so that the transparent display screen 100 displays the image required by the observer.

[0041] Among them, refer to Figure 4 The interaction module 300 may include a voice interaction module 310, the interaction control signal may include a voice control signal, and the voice interaction module 310 collects voice information and generates a voice control signal.

[0042] The voice information may include the target content of the target object. For example, in an antique display scene, the displayed object is an antique, and the observer can issue a voice command "show a brief introduction to the antique". At this time, the main control module 400 can respond to the voice control signal generated by the voice interaction module 310 to retrieve the relevant information of the antique and display it on the transparent display screen 100. For another example, in a display scene of damaged cultural relics, the displayed object is a damaged cultural relic, and the observer can issue a voice command "show the complete shape of the cultural relic". At this time, the main control module 400 can respond to the voice control signal generated by the voice interaction module 310 to retrieve the image information of the complete shape of the cultural relic and display it on the transparent display screen 100.

[0043] Among them, refer to Figure 4 The interaction module 300 may further include a gesture interaction module 320, the interaction control signal includes a gesture control signal, and the gesture interaction module 320 is used to collect gesture information and generate a gesture control signal.

[0044] In addition to the aforementioned voice control of the display content of the transparent display screen 100, the observer can also control the display content of the transparent display screen 100 through gestures. Specifically, the gesture interaction module 320 can collect the observer's gesture information in real time and generate a gesture control signal that can be recognized and processed by the main control module 400. The main control module 400 adjusts the display content on the current transparent display screen 100 according to the gesture control signal, and outputs the adjusted display content to the light generating module 200, so that the transparent display screen 100 displays the image required by the observer.

[0045] The gesture information at least includes zooming in, zooming out, and rotating the currently displayed image. For example, the observer can make a gesture to zoom in on the currently displayed image. After the gesture interaction module 320 collects the zoom gesture, it generates a corresponding zoom control signal to the main control module 400, and the main control module 400 zooms in on the currently displayed image and then outputs it to the light generating module 200.

[0046] Through the mutual cooperation among the voice interaction module 310, the gesture interaction module 320, the light generating module 200 and the main control module 400, the intelligence level of the virtual-reality fusion display system can be improved and the user experience can be enhanced.

[0047] In actual applications, in addition to voice interaction modules and gesture interaction modules, the interaction module can also use human-computer interaction devices such as physical buttons and touch screens.

[0048] In one embodiment, a control method for a virtual-reality fusion display system is provided. Figure 1 to Figure 3 The virtual-reality fusion display system includes a transparent display screen 100, a light generating module 200, and an interactive module 300. The transparent display screen 100 includes a transparent waveguide substrate 110 and a coupling-in structure 120 and a coupling-out structure 130 disposed on the surface or inside of the transparent waveguide substrate 110. The coupling-in structure 120 is configured to receive the input light generated by the light generating module 200 and couple the input light to the transparent waveguide substrate 110 so that the input light is fully reflected and conducted in the transparent waveguide substrate 110. The coupling-out structure 130 is configured to couple at least part of the light conducted in the transparent waveguide substrate 110 out of the transparent waveguide substrate 110 by diffraction to form an observation window. The interactive module 300 is configured to generate an interactive control signal.

[0049] For the specific structure of the virtual-reality fusion display system, reference may be made to the specific description of the virtual-reality fusion display system provided in the aforementioned embodiment, which will not be repeated here.

[0050] Reference Figure 5 The control method of the virtual-reality fusion display system provided in this embodiment includes the following steps:

[0051] Step S100, obtaining an interactive control signal sent by the interactive module 300;

[0052] Step S200: In response to the interactive control signal, output corresponding image information to the light generating module 200, so that the light generating module 200 generates corresponding input light.

[0053] In practical applications, the observer can control the display content of the transparent display screen 100 through the interactive module 300. Specifically, the interactive module 300 can collect the observer's interactive information in real time and generate an interactive control signal. After the interactive control signal is obtained, the image information corresponding to the interactive control signal can be output to the light generating module 200 according to the interactive control signal, so that the light generating module 200 generates the corresponding input light, so that the transparent display screen 100 displays the image required by the observer.

[0054] The interaction module 300 may include a voice interaction module 310 , the interaction control signal includes a voice control signal, and the voice interaction module 310 collects voice information and generates a voice control signal.

[0055] The voice information may include the target content of the target object. For example, in an antique display scene, the object on display is an antique, and the observer can issue a voice command "show a brief introduction to the antique", and the relevant information of the antique can be retrieved in response to the voice control signal generated by the voice interaction module 310 and displayed on the transparent display screen 100. For another example, in a display scene of damaged cultural relics, the object on display is a damaged cultural relic, and the observer can issue a voice command "show the complete shape of the cultural relic", and the image information of the complete shape of the cultural relic can be retrieved in response to the voice control signal generated by the voice interaction module 310 and displayed on the transparent display screen 100.

[0056] The interaction module may further include a gesture interaction module 320 , and the interaction control signal includes a gesture control signal. The gesture interaction module 320 is used to collect gesture information and generate a gesture control signal.

[0057] In addition to the aforementioned voice control of the display content of the transparent display screen 100, the observer can also control the display content of the transparent display screen 100 through gestures. Specifically, the gesture interaction module 320 can collect the observer's gesture information in real time and generate a gesture control signal. After the gesture control signal is obtained, the display content on the current transparent display screen 100 can be adjusted according to the gesture control signal, and the adjusted display content is output to the light generating module 200, so that the transparent display screen 100 displays the image required by the observer.

[0058] The gesture information at least includes zooming in, zooming out, and rotating the currently displayed image. For example, the observer can make a gesture to zoom in on the currently displayed image. After the gesture interaction module 320 collects the zoom gesture, it generates a corresponding zoom control signal. After the zoom control signal is obtained, the currently displayed image can be zoomed in and then output to the light generating module 200.

[0059] The technical features of the above-described embodiments may be arbitrarily combined. To make the description concise, not all possible combinations of the technical features in the above-described embodiments are described. However, as long as there is no contradiction in the combination of these technical features, they should be considered to be within the scope of this specification.

[0060] The above-described embodiments only express several implementation methods of the present application, and the descriptions thereof are relatively specific and detailed, but they cannot be construed as limiting the scope of the patent. It should be noted that, for a person of ordinary skill in the art, several modifications and improvements can be made without departing from the concept of the present application, and these all belong to the protection scope of the present application. Therefore, the protection scope of the present application shall be subject to the attached claims.

Claims

1. A virtual-reality fusion display system, characterized in that: It includes a transparent display screen, a light generating module, an interactive module and a main control module; The transparent display screen comprises a transparent waveguide substrate and an in-coupling structure and an out-coupling structure arranged on the surface or inside of the transparent waveguide substrate, wherein the in-coupling structure is configured to receive input light generated by the light generating module and couple the input light to the transparent waveguide substrate so that the input light is totally reflected and conducted in the transparent waveguide substrate, and the out-coupling structure is configured to couple at least part of the light conducted in the transparent waveguide substrate out of the transparent waveguide substrate through diffraction to form an observation window; The light generating module and the interaction module are electrically connected to the main control module respectively.

2. The virtual-reality fusion display system according to claim 1, characterized in that: The coupling-in structure and the coupling-out structure both include nanostructures, and the nanostructures have diffraction properties.

3. The virtual-reality fusion display system according to claim 1, characterized in that: The coupling-in structure and the coupling-out structure are arranged on the same side surface of the transparent waveguide substrate.

4. The virtual-reality fusion display system according to claim 1, characterized in that: The material of the transparent waveguide substrate includes any one or more of glass, PC, PMMA, and PET.

5. The virtual-reality fusion display system according to claim 1, characterized in that: The interaction module includes a voice interaction module, which collects voice information and generates a voice control signal.

6. The virtual-reality fusion display system according to claim 5, characterized in that: The voice information at least includes target content of the display target object.

7. The virtual-reality fusion display system according to claim 1, characterized in that: The interaction module includes a gesture interaction module, and the gesture interaction module collects gesture information and generates a gesture control signal.

8. The virtual-reality fusion display system according to claim 7, characterized in that: The gesture information at least includes zooming in, zooming out, and rotating the currently displayed image.

Images