A transparent imaging device based on optical waveguide and augmented reality equipment

Abstract

The present disclosure relates to a kind of transparent imaging device based on optical waveguide and augmented reality equipment.The device includes: optical waveguide, focusing module and photoelectric sensor;The optical waveguide is used to transmit first light beam to human eye position, and second light beam is transmitted to the focusing module;The focusing module is used to focus the second light beam, to control the second light beam incident to the photoelectric sensor;The photoelectric sensor is used to image the second light beam, and obtain acquisition image.By the embodiment of the present disclosure, the integration of multiple light paths can be realized without blocking the line of sight or light of human eye observation, and the acquisition image is determined by imaging, which simplifies the overall structure of the device.

Description

Technical Field

[0001] This disclosure relates to the field of image processing technology, and in particular to a transparent imaging device and augmented reality device based on optical waveguides. Background Technology

[0002] In related technologies, optical waveguides are core components in augmented reality (AR) displays, used for the coupling, transmission, and coupling out of optical paths. When AR devices generate virtual content, they need to match real-world scene information; therefore, imaging devices that acquire high-quality scene information are crucial in AR devices. However, in related technologies, imaging devices often obstruct the line of sight, making it difficult to integrate multiple different optical paths and miniaturize AR devices. Summary of the Invention

[0003] In view of this, this disclosure proposes a technical solution for a transparent imaging device and an augmented reality device based on optical waveguides.

[0004] According to one aspect of this disclosure, a transparent imaging device based on an optical waveguide is provided, comprising: an optical waveguide, a focusing module, and a photoelectric sensor; the optical waveguide is used to transmit a first light beam to a human eye position and to transmit a second light beam to the focusing module; the focusing module is used to focus the second light beam to control the second light beam to be incident on the photoelectric sensor; the photoelectric sensor is used to image the second light beam to obtain a acquired image.

[0005] In one possible implementation, the optical waveguide includes: a first coupling device, a transparent substrate, and a second coupling device; the first coupling device is used to control the coupling of the first beam and the second beam into the optical waveguide; the transparent substrate is used to adjust the propagation directions of the first beam and the second beam respectively; the second coupling device is used to control the coupling of the first beam and the second beam out of the optical waveguide, and to transmit the first beam to the human eye position, and to transmit the second beam to the focusing module.

[0006] In one possible implementation, the photoelectric sensor is used to convert the optical analog signal of the second beam into a corresponding electrical digital signal, and to obtain the acquired image based on the electrical digital signal.

[0007] In one possible implementation, the second beam includes target scene information; the device further includes an image reconstruction module; the image reconstruction module is used to perform image reconstruction based on the acquired image to obtain a reconstructed image, wherein the image quality of the reconstructed image is higher than that of the acquired image, and the reconstructed image includes clear target scene information.

[0008] In one possible implementation, the image reconstruction module is configured to: construct an imaging model corresponding to the optical waveguide based on the imaging characteristics of the optical waveguide; determine an optimization function based on the acquired image and the imaging model; and obtain the reconstructed image by optimizing and solving the optimization function.

[0009] In one possible implementation, the image reconstruction module is configured to: calibrate the optical waveguide based on its imaging characteristics to determine the propagation matrix of the optical waveguide; and determine the imaging model based on the propagation matrix of the optical waveguide.

[0010] In one possible implementation, the image reconstruction module is used to: optimize the optimization function according to an iterative algorithm or a deep learning algorithm to obtain the reconstructed image.

[0011] In one possible implementation, the first beam includes a virtual image to be displayed corresponding to the augmented reality scene.

[0012] In one possible implementation, the device further includes: a collimation device; the collimation device is used to collimate the first beam to control the first beam transmitted to the human eye position as parallel light.

[0013] According to another aspect of this disclosure, an augmented reality device is provided, comprising: a first input unit, a second input unit, a display unit, and the aforementioned transparent imaging device based on an optical waveguide; the first input unit is configured to input a first light beam into the transparent imaging device based on the optical waveguide, wherein the first light beam includes a virtual image to be displayed corresponding to an augmented reality scene; the second input unit is configured to input a second light beam into the transparent imaging device based on the optical waveguide, wherein the second light beam includes target scene information; the transparent imaging device based on the optical waveguide is configured to transmit the first light beam to a human eye position and determine a corresponding acquired image and / or reconstructed image based on the second light beam; the display unit is configured to display the acquired image and / or the reconstructed image output by the transparent imaging device based on the optical waveguide.

[0014] According to the transparent imaging device based on optical waveguides in this disclosure, an optical waveguide is used to transmit a first light beam to the position of the human eye and a second light beam to a focusing module, which can integrate the imaging optical path and the display optical path, thereby simplifying the overall structure of the device. The second light beam is focused by the focusing module to control the second light beam to be incident on the photoelectric sensor, and then the photoelectric sensor is used to image the second light beam to obtain the acquired image. Thus, it is possible to achieve imaging based on the second light beam without obstructing the human eye's line of sight.

[0015] It should be understood that the foregoing general description and the following detailed description are exemplary and explanatory only, and are not intended to limit this disclosure. Other features and aspects of this disclosure will become clear from the following detailed description of exemplary embodiments with reference to the accompanying drawings. Attached Figure Description

[0016] The accompanying drawings, which are included in and form part of this specification, illustrate exemplary embodiments, features, and aspects of this disclosure together with the specification and serve to explain the principles of this disclosure.

[0017] Figure 1 A schematic diagram of a transparent imaging device based on an optical waveguide according to an embodiment of the present disclosure is shown.

[0018] Figure 2 A schematic diagram of the structure of a transparent imaging device based on an optical waveguide for internal imaging according to an embodiment of the present disclosure is shown.

[0019] Figure 3 A schematic diagram of the structure of a transparent imaging device based on an optical waveguide for external imaging according to an embodiment of the present disclosure is shown.

[0020] Figure 4 A block diagram of an enhanced display device according to an embodiment of the present disclosure is shown. Detailed Implementation

[0021] Various exemplary embodiments, features, and aspects of this disclosure will now be described in detail with reference to the accompanying drawings. The same reference numerals in the drawings denote elements that have the same or similar functions. Although various aspects of the embodiments are shown in the drawings, they are not necessarily drawn to scale unless specifically indicated otherwise.

[0022] The term “exemplary” as used herein means “serving as an example, embodiment, or illustration.” Any embodiment illustrated herein as “exemplary” is not necessarily to be construed as superior to or better than other embodiments.

[0023] In this document, the term "and / or" is merely a description of the relationship between related objects, indicating that three relationships can exist. For example, A and / or B can represent three cases: A alone, A and B simultaneously, and B alone. Furthermore, the term "at least one" in this document means any combination of at least two of any one or more elements. For example, including at least one of A, B, and C can mean including any one or more elements selected from the set consisting of A, B, and C.

[0024] Furthermore, to better illustrate this disclosure, numerous specific details are set forth in the following detailed description. Those skilled in the art will understand that this disclosure can be practiced without certain specific details. In some instances, methods, means, components, and circuits well known to those skilled in the art have not been described in detail in order to highlight the main points of this disclosure.

[0025] AR (Augmented Reality) technology provides a means to integrate computer-generated virtual images with the real world, and it has wide applications in healthcare, industrial inspection, education and entertainment, and automotive head-up displays (HUDs). Among related technologies, the optical waveguide is a core component in the AR display solution, used for the coupling, transmission, and coupling of optical paths. Based on the optical waveguide, the virtual image to be displayed can be controlled to be incident on the user's eye, allowing the user to observe a virtual image focused on a distant location, while simultaneously ensuring that the real-world scene information behind the optical waveguide can also be observed by the user.

[0026] When AR devices generate virtual images to be displayed, they need to be based on or matched with real-world scene information. Therefore, obtaining high-quality scene information is crucial for AR devices. However, in related technologies, imaging devices often obstruct the user's line of sight, making it difficult to integrate multiple different display and imaging optical paths, as well as miniaturize AR devices.

[0027] This disclosure provides a transparent imaging device based on an optical waveguide, which can be used to acquire and image real-world scene information without obstructing the user's view. The following is a detailed description of an embodiment of this transparent imaging device based on an optical waveguide.

[0028] Figure 1 A schematic diagram of a transparent imaging device based on an optical waveguide according to an embodiment of the present disclosure is shown. Figure 1 As shown, along the direction of light propagation, the device 100 includes: an optical waveguide 101, a focusing module 102, and a photoelectric sensor 103.

[0029] Optical waveguide 101 is used to transmit a first beam to the position of the human eye and to transmit a second beam to the focusing module 102.

[0030] The focusing module 102 is used to focus the second beam to control the second beam to be incident on the photoelectric sensor 103.

[0031] The photoelectric sensor 103 is used to image the second beam to obtain the acquired image.

[0032] The optical waveguide 101, made of transparent material, can be used to integrate multiple optical paths, including imaging and display optical paths. Specifically, the optical waveguide 101 can control a first light beam to travel along the display optical path and be incident on the human eye, so that the human eye can observe the corresponding information to be displayed. The first light beam can be a beam containing different information to be displayed. The specific content of the information to be displayed can be set according to actual usage requirements; it can be virtual content, real-world content directly transmitted through the optical waveguide 101, or other content. This disclosure does not specifically limit this. The incident position of the first light beam can be set according to actual usage requirements, as long as it allows the first light beam to pass through the optical waveguide 101 and be incident on the human eye. This disclosure does not specifically limit this.

[0033] The optical waveguide 101 can also control the second beam to travel along the imaging optical path and be incident on the focusing module 102. The second beam can be a beam containing information about the target scene in the real world. The incident position and direction of the second beam can be set according to actual usage requirements; it can be incident on the optical waveguide 101 from a position close to the human eye or from a position far from the human eye, depending on the specific content of the target scene information. This disclosure does not impose specific limitations on this.

[0034] Based on the above Figure 1 For example, Figure 1 As shown, an incident beam from the real world is incident on the optical waveguide 101, which can split the incident beam into two parts. The first part of the incident beam can be used as the first beam, which can be directly transmitted through the optical waveguide 101 and incident on the human eye, allowing the user to observe real-world scene information. The second part of the incident beam can be used as the second beam, which can change its propagation direction under the control of the optical waveguide 101 and be transmitted to the focusing module 102, and then incident on the photoelectric sensor 103 for imaging. This allows the acquisition of real-world scene information observed by the human eye without obstructing the human eye.

[0035] Figure 2 A schematic diagram of a transparent imaging device based on an optical waveguide for internal imaging, according to an embodiment of the present disclosure, is shown. Figure 2 As shown, with the human eye position as the inner side, the second beam 202 is incident on the optical waveguide 101A from the position close to the human eye. The scene information included in the second beam 202 can be information representing the human eye's motion state.

[0036] Figure 3 A schematic diagram of a transparent imaging device based on an optical waveguide for external imaging, according to an embodiment of the present disclosure, is shown. Figure 3As shown, with the human eye position as the inner side, the second beam 302 is incident on the optical waveguide 101B from a position away from the human eye. The scene information included in the second beam 302 can be scene information representing the real world observed through the optical waveguide 101B.

[0037] The specific form of the optical waveguide 101 can be found in related technologies, such as reflective, mirror array, or diffractive types, and this disclosure does not impose any specific limitations on it. The optical waveguide 101 will be described in detail later in conjunction with possible implementations of this disclosure, and will not be repeated here.

[0038] After the second beam is incident on the focusing module 102, the focusing module 102 can focus the second beam and control the focused second beam to be incident on the photoelectric sensor 103. The specific form of the focusing module 102 can refer to the implementation methods in related technologies, such as lenses, lens groups, mirrors or diffractive optical elements, etc., and this disclosure does not make specific limitations in this regard.

[0039] The photoelectric sensor 103 can image the focused second beam to obtain a corresponding acquired image. The acquired image may include real-world scene information. The specific form of the photoelectric sensor 103 can be found in related technologies, such as CCD image sensors or CMOS image sensors; this disclosure does not specifically limit its implementation. The photoelectric sensor 103 will be described in detail later in conjunction with possible implementations of this disclosure, and will not be repeated here.

[0040] According to the transparent imaging device based on optical waveguides in this disclosure, an optical waveguide is used to transmit a first light beam to the position of the human eye and a second light beam to a focusing module, which can integrate the imaging optical path and the display optical path, thereby simplifying the overall structure of the device. The second light beam is focused by the focusing module to control the second light beam to be incident on the photoelectric sensor, and then the photoelectric sensor is used to image the second light beam to obtain the acquired image. Thus, it is possible to achieve imaging based on the second light beam without obstructing the human eye's line of sight.

[0041] In one possible implementation, the optical waveguide 101 includes: a first coupling device, a transparent substrate, and a second coupling device; the first coupling device is used to control the coupling of a first beam and a second beam into the optical waveguide 101; the transparent substrate is used to adjust the propagation directions of the first beam and the second beam respectively; the second coupling device is used to control the coupling of the first beam and the second beam out of the optical waveguide 101, and to transmit the first beam to the position of the human eye, and to transmit the second beam to the focusing module 102.

[0042] Based on the above Figure 1 For example, Figure 1As shown, along the direction of light propagation, the optical waveguide 101 includes: a first coupling device 1011, a transparent substrate 1012, and a second coupling device 1013.

[0043] The first coupling device 1011 can be used to control the coupling of the first beam and the second beam into the interior of the optical waveguide 101, so that the first beam and the second beam propagate in the transparent substrate 1012. The specific form of the first coupling device 1011 can be found in embodiments in related art, and this disclosure does not specifically limit it.

[0044] The transparent substrate 1012 can be used to adjust the propagation direction of the first beam and the second beam. Specifically, the transparent substrate 1012 can adjust the propagation direction of the first beam, controlling it to propagate along the display optical path and be incident on the human eye; and adjust the propagation direction of the second beam, controlling it to propagate along the imaging optical path and be incident on the second coupling device 1013. The material of the transparent substrate 1012 can be referred to in the embodiments of related technologies, and this disclosure does not specifically limit it.

[0045] The second coupling device 1013 can be disposed at the exit position of the display optical path and / or imaging optical path. The second coupling device 1013 can control the first beam and the second beam to couple out respectively, control the first beam to be transmitted to the human eye position, and control the second beam to be transmitted to the focusing module 102. The specific form of the second coupling device 1013 can be referred to in related art embodiments, and this disclosure does not specifically limit it. The second coupling device 1013 and the first coupling device 1011 can be the same or different, and this disclosure does not specifically limit them.

[0046] In some application scenarios, a coupling device can serve as both a first coupling device and a second coupling device, depending on the type of light beam incident on the coupling device. This disclosure does not specifically limit this.

[0047] Based on the above Figure 2 For example, Figure 2 As shown, the first light beam 201 from the display 205 is incident on the coupling device 204 after passing through the beam splitter 206. At this time, the coupling device 204 can act as a first coupling device, controlling the first light beam 201 to couple into the optical waveguide 101A. The first light beam 201 can propagate through the transparent substrate of the optical waveguide 101A to the coupling device 203. At this time, the coupling device 203 can act as a second coupling device, controlling the first light beam 201 to couple out to the position of the human eye.

[0048] A second beam 202 from the location of the human eye is incident on the coupling device 203. At this time, the coupling device 203 can act as a first coupling device, controlling the coupling of the second beam 202 to the optical waveguide 101A. The second beam 202 can propagate through the transparent substrate of the optical waveguide 101A to the coupling device 204. At this time, the coupling device 204 can act as a second coupling device, controlling the coupling of the second beam 202 to the focusing module 102A.

[0049] The number of the first coupling device 1011 and the second coupling device 1013 can be set according to actual usage requirements, depending on the number of the incident first beam and the second beam. This disclosure does not make any specific limitation in this regard.

[0050] Based on the above Figure 3 For example, Figure 3 As shown, coupling devices 305 and 306 are two first coupling devices, and coupling devices 307 and 308 are two second coupling devices. After the first light beam 301 from the display 303 is incident on coupling device 305, coupling device 305 can control the coupling of the first light beam 301 to the optical waveguide 101B. The first light beam 301 can propagate through the transparent substrate to coupling device 307, and coupling device 307 can control the coupling of the first light beam 301 to the position of the human eye.

[0051] A second beam 302 from the real world is incident on a coupling device 306. The coupling device 306 can control the second beam 302 to couple to the incident waveguide 101B and split the second beam 302 into two parts. The two parts of the split second beam 302 can propagate through a transparent substrate to coupling devices 307 and 308, respectively. The coupling device 307 can control the first part of the second beam 302 to couple to the position of the human eye, and the coupling device 308 can control the second part of the second beam 302 to couple out to the focusing module 102B.

[0052] In one possible implementation, the photoelectric sensor 103 is used to convert the optical analog signal of the second beam into a corresponding electrical digital signal, and to obtain the acquired image based on the electrical digital signal.

[0053] After being focused by the focusing module 102, the second light beam is incident on the photoelectric sensor 103. The photoelectric sensor 103 can convert the analog optical signal of the second light beam into a corresponding digital electrical signal. Based on the digital electrical signal, the photoelectric sensor 103 can determine the corresponding acquired image. In addition, the photoelectric sensor 103 can also store and retrieve the digital electrical signal for further processing.

[0054] In one possible implementation, the second beam includes target scene information; the device 100 also includes an image reconstruction module; the image reconstruction module is used to perform image reconstruction based on the acquired image to obtain a reconstructed image, wherein the image quality of the reconstructed image is higher than that of the acquired image, and the reconstructed image includes clear target scene information.

[0055] During the coupling and incident process of the first coupling device 1011, the propagation process in the transparent substrate 1012, and the coupling and emission process of the second coupling device 1013, the light signal of the second beam may be affected, resulting in distortions such as blurring and artifacts in the acquired image obtained by the photoelectric sensor 103, thus making it impossible to obtain clear target scene information.

[0056] To obtain clear target scene information, the device 100 may further include an image reconstruction module connected to the photoelectric sensor 103. The image reconstruction module can be used to reconstruct the image based on the acquired image, obtaining a reconstructed image. The image quality of the reconstructed image is higher than that of the acquired image; for example, the resolution, color, and other parameters of the reconstructed image are higher than those of the acquired image, and the reconstructed image includes clear target scene information.

[0057] By using the image reconstruction module to determine a reconstructed image with higher quality than the acquired image, additional design requirements can be avoided for the optical waveguide 101, ensuring reduced cost, compact structure, and light weight for the device 100. The image reconstruction module will be described in detail later in conjunction with possible implementations of this disclosure; therefore, it will not be repeated here.

[0058] In one possible implementation, the image reconstruction module is used to: construct an imaging model corresponding to the optical waveguide 101 based on its imaging characteristics; determine an optimization function based on the acquired image and the imaging model; and obtain the reconstructed image by optimizing and solving the optimization function.

[0059] Based on the imaging characteristics of the optical waveguide 101, the image reconstruction module can construct an imaging model corresponding to the optical waveguide 101. The imaging model can represent the process of determining the acquired image based on real-world target scene information. Therefore, based on the acquired image and the imaging model, an optimization function for solving for the target scene information can be determined. The image reconstruction module can then optimize and solve this optimization function to determine the corresponding reconstructed image.

[0060] The imaging model and optimization function will be described in detail later in conjunction with the possible implementation methods of this disclosure, and will not be repeated here.

[0061] In one possible implementation, the image reconstruction module is used to: calibrate the optical waveguide 101 based on its imaging characteristics and determine the propagation matrix of the optical waveguide 101; and determine the imaging model based on the propagation matrix of the optical waveguide 101.

[0062] Based on the imaging characteristics of the optical waveguide 101, the image reconstruction module can calibrate the optical waveguide 101 to determine the corresponding propagation matrix. The propagation matrix of the optical waveguide 101 can represent the encoding effect of the optical waveguide 101 on the target scene information included in the second beam. The calibration method of the optical waveguide 101 can refer to the implementation methods in related technologies, such as calibration methods based on point spread functions or calibration methods based on orthogonal matrices, etc., and this disclosure does not specifically limit it in this way.

[0063] Based on the propagation matrix of optical waveguide 101 and using geometrical and physical optics theories, an imaging model for the forward encoding of the second beam by optical waveguide 101 can be determined. This imaging model satisfies a linear mapping relationship. The imaging model can be expressed as the following formula (1):

[0064] Wherein, represents the image acquired by the photoelectric sensor 103; represents the propagation matrix of the optical waveguide 101; and represents clear target scene information in the real world.

[0065] In addition to the above methods, other implementation methods in related technologies can also be used to construct the imaging model of the optical waveguide 101, and this disclosure does not make specific limitations in this regard.

[0066] In one possible implementation, the image reconstruction module is used to: optimize the optimization function according to an iterative algorithm or a deep learning algorithm to obtain the reconstructed image.

[0067] Based on the imaging model shown in formula (1) above, the image reconstruction module can determine the corresponding optimization function.

[0068] For example, the optimization function can be expressed as the following formula (2):

[0069] Wherein, represents the reconstructed image; represents the L2 fidelity term, used to describe the similarity between the reconstructed image after forward encoding by the optical waveguide 101 and the acquired original image; represents the total variation regularization term, used to suppress noise in the image reconstruction process and increase the well-posedness of the optimization problem; and represents the regularization parameter, used to adjust the weight of the regularization term.

[0070] Using iterative algorithms or deep learning algorithms, the optimization function of the above formula (2) can be optimized and solved to determine the reconstructed image.

[0071] In addition to the above methods, the structure of the optimization function, the form of the fidelity term and the regularization term, and the solution method of the optimization function can also be found in other implementation methods in related technologies, and this disclosure does not specifically limit them.

[0072] In one possible implementation, the first beam includes a virtual image to be displayed corresponding to the augmented reality scene.

[0073] In augmented reality (AR) applications, it's necessary to fuse computer-generated virtual images with the real world, allowing the human eye to simultaneously observe both. Therefore, the first beam can include the virtual image to be displayed corresponding to the augmented reality scene. After the first beam passes through the optical waveguide 101 and reaches the user's eye, the user can observe the virtual image to be displayed.

[0074] Based on the above Figure 2 For example, Figure 2 As shown, the display 205 can be used to upload virtual images corresponding to augmented reality scenes. The first beam 201 emitted by the display 205 can be incident on the optical waveguide 101A through the beam splitter 206, and then incident on the human eye under the control of the waveguide 101A. After receiving the first beam 201, the human eye can observe the corresponding virtual image to be displayed.

[0075] In one possible implementation, the device 100 further includes a collimation device for collimating the first beam to control the first beam transmitted to the human eye position as parallel light.

[0076] To improve the display effect of the virtual image to be displayed, the device 100 may further include a collimation device. The collimation device can be used to collimate the first beam to control the first beam transmitted to the position of the human eye to be parallel light, thereby enabling the virtual image to be displayed to form an infinity virtual image in the human eye.

[0077] The specific form of the collimation device can be referred to in the implementation methods in related technologies, such as lenses, lens groups, mirrors and diffractive optical elements, etc., and the embodiments disclosed herein do not specifically limit it.

[0078] Based on the above Figure 3 For example, Figure 3 As shown, the first light beam 301 emitted by the display 303 is incident on the collimating device 304. The collimating device 304 can collimate the first light beam 301, thereby controlling the first light beam 301 incident on the optical waveguide 101B to be parallel light. The first light beam 301 in the form of parallel light can be incident on the position of the human eye under the control of the optical waveguide 101B, so that the virtual image to be displayed forms an infinity virtual image in the human eye.

[0079] According to the transparent imaging device based on optical waveguides of this disclosure, an optical waveguide is used to transmit a first light beam to the human eye position and a second light beam to a focusing module, thereby integrating the imaging optical path and the display optical path and simplifying the overall structure of the device. The focusing module focuses the second light beam to control its incidence on a photoelectric sensor, and the photoelectric sensor then images the second light beam to obtain a captured image. This allows imaging based on the second light beam without obstructing the human eye's view. Based on the imaging characteristics of the optical waveguide, a corresponding imaging model can be determined, leading to an optimization problem for obtaining clear target scene information. An image reconstruction module can optimize the solution to this optimization problem, resulting in a reconstructed image with higher quality than the captured image. This improves imaging quality, reduces device cost, and makes the device compact, lightweight, and easily integrated and expandable while lowering the design requirements of the optical waveguide.

[0080] In addition, this disclosure also provides an augmented reality device that can realize augmented reality display and imaging based on any of the transparent imaging devices based on optical waveguides provided in this disclosure.

[0081] Figure 4 A block diagram of an enhanced display device according to an embodiment of the present disclosure is shown. Figure 4 As shown, the device 400 includes: a first input unit 401, a second input unit 402, a display unit 404, and the aforementioned transparent imaging device 403 based on optical waveguides.

[0082] The first input unit 401 is used to input a first beam into a transparent imaging device based on an optical waveguide, wherein the first beam includes a virtual image to be displayed corresponding to an augmented reality scene;

[0083] The second input unit 402 is used to input the second beam into the transparent imaging device based on the optical waveguide, wherein the second beam includes target scene information;

[0084] The transparent imaging device 403 based on optical waveguide is used to transmit a first beam to the position of the human eye and to determine the corresponding acquired image and / or reconstructed image based on the second beam.

[0085] Display unit 404 is used to display the acquired and / or reconstructed images output by the transparent imaging device based on optical waveguide.

[0086] In addition to displaying content related to the target scene information, the display unit 404 can also be used to display any content to be displayed that is unrelated to the target scene information. This disclosure does not make any specific limitations on this, depending on the actual usage requirements.

[0087] In some embodiments, the functions or modules of the device provided in this disclosure can be used to perform the methods described in the above embodiments of the transparent imaging device based on optical waveguides. The specific implementation can be referred to the description of the above method embodiments, and for the sake of brevity, it will not be repeated here.

[0088] It should be noted that, although... Figure 1 , Figure 2 and Figure 3 The above description illustrates the structure of a transparent imaging device based on optical waveguides, but those skilled in the art will understand that this disclosure is not limited thereto. In fact, users can flexibly set the specific structure of the transparent imaging device based on optical waveguides according to their personal preferences and / or actual application scenarios, and adaptively add or remove optical components, as long as imaging can be achieved without obstructing the viewer's line of sight based on the above process.

[0089] The various embodiments of this disclosure have been described above. These descriptions are exemplary and not exhaustive, nor are they limited to the disclosed embodiments. Many modifications and variations will be apparent to those skilled in the art without departing from the scope and spirit of the described embodiments. The terminology used herein is chosen to best explain the principles, practical application, or technical improvements to the embodiments in the market, or to enable others skilled in the art to understand the embodiments disclosed herein.

Claims

1. A transparent imaging device based on an optical waveguide, characterized in that, include: Optical waveguides, focusing modules, and photoelectric sensors; The optical waveguide is used to transmit the first beam to the position of the human eye and the second beam to the focusing module; The focusing module is used to focus the second beam to control the second beam to be incident on the photoelectric sensor; The photoelectric sensor is used to image the second beam to obtain a acquired image; The second beam includes target scene information; The device further includes: an image reconstruction module; The image reconstruction module is used for: Based on the imaging characteristics of the optical waveguide, the optical waveguide is calibrated to determine the propagation matrix of the optical waveguide. The propagation matrix is ​​used to represent the encoding effect of the optical waveguide on the target scene information. The acquired image contains distortion caused by the encoding effect. Based on the propagation matrix of the optical waveguide, construct the imaging model corresponding to the optical waveguide; Based on the acquired images and the imaging model, determine the optimization function; By optimizing the optimization function, a reconstructed image is obtained, wherein the image quality of the reconstructed image is higher than that of the acquired image, and the reconstructed image includes clear information about the target scene.

2. The apparatus according to claim 1, characterized in that, The optical waveguide includes: a first coupling device, a transparent substrate, and a second coupling device; The first coupling device is used to control the coupling of the first beam and the second beam into the optical waveguide; The transparent substrate is used to adjust the propagation directions of the first beam and the second beam, respectively. The second coupling device is used to control the first beam and the second beam to couple out from the optical waveguide, and to transmit the first beam to the human eye position, and to transmit the second beam to the focusing module.

3. The apparatus according to claim 1, characterized in that, The photoelectric sensor is used to convert the optical analog signal of the second beam into a corresponding electrical digital signal, and to obtain the acquired image based on the electrical digital signal.

4. The apparatus according to claim 1, characterized in that, The image reconstruction module is used for: The optimization function is optimized and solved using an iterative algorithm or a deep learning algorithm to obtain the reconstructed image.

5. The apparatus according to any one of claims 1 to 3, characterized in that, The first beam includes a virtual image to be displayed corresponding to the augmented reality scene.

6. The apparatus according to claim 5, characterized in that, The device further includes: a collimation device; The collimation device is used to collimate the first beam so as to control the first beam transmitted to the human eye position to be parallel light.

7. An augmented reality device, characterized in that, include: The first input unit, the second input unit, the display unit, and the transparent imaging device based on optical waveguide as described in any one of claims 1 to 6; The first input unit is used to input a first light beam into the transparent imaging device based on optical waveguide, wherein the first light beam includes a virtual image to be displayed corresponding to an augmented reality scene; The second input unit is used to input a second beam into the transparent imaging device based on optical waveguide, wherein the second beam includes target scene information; The transparent imaging device based on optical waveguide is used to transmit the first beam to the position of the human eye, and to determine the corresponding acquired image and / or reconstructed image based on the second beam; The display unit is used to display the acquired image and / or the reconstructed image output by the transparent imaging device based on the optical waveguide.

Images