Device and method for displaying images and computer program thereof
By using a focusable lens and a display engine in the image display device to control the depth of the virtual image, the problem of poor depth control of the virtual image on the real world image is solved, thus improving the effect of the AR experience.
Patent Information
- Application Number
- CN201980082392.1
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- Priority Date
- 2018-12-18
- Filing Date
- 2019-12-11
- Publication Date
- 2024-11-08
- Estimated Expiration
- 2039-12-11
AI Technical Summary
Existing technologies struggle to effectively control the position and depth of virtual images when overlaid on real-world images, resulting in a poor AR experience.
An image display device is used, including a first waveguide, a second waveguide, a focusable lens, and a display engine. The depth of the virtual image is adjusted by controlling the focal length of the focusable lens. The display engine outputs the light of the first and second virtual images and forms a clear virtual image on the user's retina through optical elements.
It enables precise depth control of virtual images on real-world images, enhancing the effect of augmented reality experiences and user interactivity.
Smart Images

Figure CN113196137B_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure relate to an apparatus for displaying an image, a method for displaying an image, and a computer program product including a recording medium storing a program for executing the method for displaying an image. Background Art
[0002] Augmented reality (AR) technology is a technology that combines virtual objects or information with the real environment so that the virtual objects or information appear to exist in the real environment. Modern computing and display technology has enabled the development of systems for AR experiences, in which a digitally reconstructed image or part of it is presented to the user so that it can be considered or perceived by the user as reality.
[0003] As AR technology has received more and more attention, various technologies for implementing AR are being actively developed. Specifically, research has been conducted on near-eye display technology for displaying images so that the images are projected directly onto the user's retina. Summary of the invention
[0004] Technical issues
[0005] The disclosed embodiments relate to a method and apparatus for displaying an image to more effectively control the depth of a location where a virtual image is displayed when the virtual image is superimposed on a real-world image.
[0006] Technical Solutions
[0007] An image display device includes a first waveguide, a second waveguide, an adjustable focus lens located between the first waveguide and the second waveguide, a display engine and a processor, wherein the processor is configured to control the focal length of the adjustable focus lens and control the display engine to output a first light forming a first virtual image and a second light forming a second virtual image, wherein at least a portion of the first light is diffracted from the first waveguide, and at least a portion of the second light diffracted from the second waveguide is incident on the first waveguide through the adjustable focus lens. BRIEF DESCRIPTION OF THE DRAWINGS
[0008] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:
[0009] Figure 1 is a conceptual diagram illustrating an image display method according to an embodiment of the present disclosure;
[0010] Figure 2 is a diagram showing a structure of an image display device according to an embodiment of the present disclosure;
[0011] Figure 3 is a flowchart of an image display method according to an embodiment of the present disclosure;
[0012] Figure 4 is a diagram showing a structure of an image display device according to another embodiment of the present disclosure;
[0013] Figure 5 is a diagram illustrating a method performed by an image display device for displaying a three-dimensional virtual image according to an embodiment of the present disclosure;
[0014] Figure 6 is a diagram illustrating a method performed by an image display device of displaying a plurality of virtual images during execution of a navigation application according to an embodiment of the present disclosure;
[0015] Figure 7 is a diagram illustrating a method performed by an image display device for displaying a plurality of virtual images during execution of a game application according to an embodiment of the present disclosure;
[0016] Figure 8 is a diagram illustrating a method performed by an image display device for displaying a plurality of virtual images during execution of a remote presentation application according to an embodiment of the present disclosure;
[0017] Fig. 9 is a diagram illustrating a method performed by an image display device for displaying a plurality of virtual images during execution of a plurality of applications according to an embodiment of the present disclosure;
[0018] Fig.10 is a diagram showing a structure of an image display device according to another embodiment of the present disclosure; and
[0019] Fig.11 is a diagram illustrating a structure of an image display device according to another embodiment of the present disclosure. DETAILED DESCRIPTION
[0020] Provided are an image display method and apparatus for more effectively controlling the depth of a position where a virtual image is displayed when the virtual image is displayed as being superimposed on a real-world image.
[0021] Additional aspects will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments of the disclosure.
[0022] According to an embodiment of the present disclosure, an image display device includes: a first waveguide; a second waveguide; a first adjustable focus lens located between the first waveguide and the second waveguide; and a display engine, the display engine being configured to control the focal length of the adjustable focus lens, controlling the display engine to output a first light forming a first virtual image and a second light forming a second virtual image, wherein at least a portion of the first light is diffracted from the first waveguide, and at least a portion of the second light diffracted from the second waveguide is incident on the first waveguide through the adjustable focus lens.
[0023] In one embodiment of the present disclosure, the display engine may be further configured to determine a focal length of the adjustable focus lens based on distance information between the first virtual image and the second virtual image, and provide an electrical signal to the adjustable focus lens based on the determined focal length.
[0024] In one embodiment of the present disclosure, the image display device may further include another adjustable focus lens located between the display engine and the first waveguide, wherein at least a portion of the first light diffracted from the first waveguide passes through the another adjustable focus lens.
[0025] In one embodiment of the present disclosure, the display engine may also be configured to determine a focal length of a first adjustable focus lens located between the first waveguide and the second waveguide and a focal length of another adjustable focus lens located between the first waveguide, and provide electrical signals to the adjustable focus lens and the other adjustable focus lens based on each of the focal lengths.
[0026] In one embodiment of the present disclosure, the image display device may further include a sensor configured to track a user's line of sight, and the display engine may determine a focal length of the first adjustable focus lens based on the user's line of sight.
[0027] In one embodiment of the present disclosure, the image display device may further include an optical compensation element on one side of the second waveguide, and the display engine may determine the focal length of the optical compensation element based on the focal length of the adjustable focus lens, and provide an electrical signal corresponding to the determined focal length to the optical compensation element.
[0028] In one embodiment of the present disclosure, the first tunable focus lens may include at least one of a liquid crystal (LC) panel, an LC lens, a liquid lens, or an active diffraction element.
[0029] According to another embodiment of the present disclosure, an image display method includes: obtaining a first virtual image and a second virtual image; controlling the focal length of an adjustable-focus lens provided between a first waveguide and the second waveguide; and outputting a first light forming the first virtual image and a second light forming the second virtual image, wherein at least a portion of the first light is diffracted from the first waveguide, and at least a portion of the second light diffracted from the second waveguide is incident on the first waveguide through the adjustable-focus lens.
[0030] According to another embodiment of the present disclosure, a computer program product includes a recording medium storing a program, which executes: obtaining a first virtual image and a second virtual image; controlling a focal length of an adjustable-focus lens located between a first waveguide and the second waveguide; and outputting a first light forming the first virtual image and a second light forming the second virtual image, wherein at least a portion of the first light is diffracted from the first waveguide, and at least a portion of the second light diffracted from the second waveguide is incident on the first waveguide through the adjustable-focus lens.
[0031] Invention Mode
[0032] The terms used herein will be briefly described, and then the present disclosure will be described in detail.
[0033] In the present disclosure, where possible, common terms that are now widely used are selected in consideration of the functions of the present disclosure, but non-common terms may be selected based on the intentions of those skilled in the art, precedents, or new technologies, etc. Some terms may be selected arbitrarily by the applicant. In this case, the meanings of these terms will be explained in detail in the corresponding parts of the present disclosure. Therefore, the terms used herein should be defined not based on their names but based on their meanings and the entire context of the present disclosure.
[0034] It should be understood that although the terms first, second, etc. can be used to describe various elements in this article, these elements should not be limited by these terms. These terms are only used to distinguish one element from another element. For example, without departing from the scope of the present disclosure, the first element can be referred to as the second element. Similarly, the second element can be referred to as the first element. As used herein, the term "and / or" includes any and all combinations of one or more associated listed items.
[0035] It should be understood that when an element is referred to as "comprising" another element, the element may also include other elements, unless otherwise specified. The term "unit" used herein should be understood as a software or hardware component that performs certain functions, such as a field programmable gate array (FPGA) or an application specific integrated circuit (ASIC). However, the term "unit" is not limited to software or hardware. The term "unit" may be configured to be stored in an addressable storage medium or to reproduce one or more processors. Therefore, for example, the term "unit" may include components (such as software components, object-oriented software components, class components and / or task components), functions, attributes, processes, subroutines, program code segments, drivers, firmware, microcodes, circuits, data, databases, data structures, tables, arrays and parameters. The functions provided in components and "units" may be combined to obtain a small amount of components and "units", or may be divided into subcomponents and "subunits".
[0036] Embodiments of the present disclosure will be described in detail below with reference to the accompanying drawings so that those of ordinary skill in the art can easily implement them. However, the present disclosure can be embodied in many different forms and is not limited to the embodiments set forth herein. In the accompanying drawings, for the sake of clarity, parts irrelevant to the description of the present disclosure are omitted. Throughout the specification, the same reference numerals are assigned to the same elements. Throughout the disclosure, the expression "at least one of a, b or c" indicates only a, only b, only c, both a and b, both a and c, both b and c, all of a, b and c, or variations thereof.
[0037] Figure 1 is a conceptual diagram illustrating an image display method according to an embodiment of the present disclosure.
[0038] In an embodiment of the present disclosure, the image display device 100 may output, for example, a first virtual image 110 superimposed on the real world, so that the user can experience augmented reality (AR). When the image display device 100 displays a plurality of first virtual images 110 and a second virtual image 120, the plurality of first virtual images 110 and the second virtual image 120 need to be displayed at appropriate positions on the real world space according to the needs of the user.
[0039] For example, refer to Figure 1 , in the image display device 100, a home screen image 112 in which icons for executing applications are displayed and a notification screen image 122 in which messages sent to the user, etc. are displayed may be displayed at positions with different depth values. In this case, the notification screen image 122 may be displayed at a position closer to the user than the home screen image 112, so that the user can quickly view the notification.
[0040] In one embodiment of the present disclosure, in order to adjust the depth value of the position of the plurality of first virtual images 110 and the second virtual image 120, the image display device 100 may display the first virtual image 110 among the plurality of first virtual images 110 and the second virtual image 120 at a position having a fixed depth value, and change the depth value of the position where the second virtual image 120 is to be displayed. To this end, in one embodiment of the present disclosure, the image display device 100 may include an optical element between a first waveguide to which light forming the first virtual image 110 is incident and a second waveguide to which light forming the second virtual image 120 is incident. In this case, the optical element is an active element, and the image display device 100 may more easily control the focal length by providing an electrical signal to the optical element.
[0041] Specifically, the image display device 100 can provide an interface through which a user can experience AR more conveniently by fixing the depth value of the first virtual image 110 including information to be displayed at a fixed position among multiple first virtual images 110 and second virtual images 120 and changing the depth value of the second virtual image 120 when the position of the second virtual image 120 including information to be displayed is changed through a focus tunable lens.
[0042] The following will refer to Figure 2 A method of controlling the focal length by the image display device 100 is described in detail.
[0043] In one embodiment of the present disclosure, the image display device 100 may be smart glasses, a wearable display, a near-eye display, a three-dimensional (3D) display, etc., but is not limited thereto.
[0044] Figure 2 2 is a diagram showing a structure of an image display device 200 according to an embodiment of the present disclosure.
[0045] refer to Figure 2 , the image display device 200 may include a first waveguide 210, a second waveguide 220, a focus-adjustable lens 230, and a display engine 240. However, these elements are merely examples, and the image display device 200 may further include other elements or may include only some of the elements.
[0046] The first waveguide 210 may receive light forming a first virtual image from the display engine 240. At least a portion of the light incident on the first waveguide 210 may be diffracted and perceived by a user's retina.
[0047] The second waveguide 220 may receive light forming a second virtual image from the display engine 240. At least a portion of the light incident on the second waveguide 220 may be diffracted. In this case, the diffracted light may pass through the adjustable focus lens 230 and then be perceived by the user's retina.
[0048] The light diffracted by the first waveguide 210 may be perceived by the user's retina without passing through the adjustable focus lens 230. In this case, it is assumed that the depth information of the first virtual image perceived by the user's retina is d1. In contrast, the light diffracted by the second waveguide 220 passes through the adjustable focus lens 230, so its depth information may vary according to the focal length of the adjustable focus lens 230. For example, the depth information of the second virtual image may be d2.
[0049] In one embodiment of the present disclosure, when the light diffracted by the first waveguide 210 has fixed depth information, the display engine 240 may output a virtual image whose depth information is to be fixedly displayed to the first waveguide 210. When the depth information of the light diffracted by the second waveguide 220 varies according to the focal length, the display engine 240 may change the focal length of the adjustable focus lens 230 to control the depth information of the light diffracted by the second waveguide 220.
[0050] For example, when the depth information of the second waveguide 220 is to be set to d2, the display engine 240 may determine the focal length of the adjustable focus lens 230 as x to correspond to the depth information d2. In addition, the display engine 240 may provide an electrical signal corresponding to the determined focal length. The adjustable focus lens 230 according to the current embodiment of the present disclosure may be an active element and may have a focal length determined when an electrical signal is applied thereto. The adjustable focus lens 230 may include, for example, at least one of an LC plate, a liquid crystal lens, a liquid lens, or an active diffraction element. However, these elements are merely examples, and the adjustable focus lens 230 is not limited thereto.
[0051] The above elements are described for only one of the user's eyes, so combinations thereof may be provided for each of the user's left and right eyes. The display engine 240 may output different images to the left and right eyes to reduce distortion and / or provide a stereoscopic effect.
[0052] Figure 3 is a flowchart of an image display method according to an embodiment of the present disclosure.
[0053] In operation S310, the image processing device may obtain a first virtual image and a second virtual image. To implement AR, the image processing device may obtain the first virtual image and the second virtual image to be displayed as superimposed on the real world scenery, such as by providing a real world background image (where the device is a video transmission display device) or via a perspective display (e.g., perspective glasses).
[0054] In operation S320, the image processing apparatus may control a focal length of an adjustable focus lens provided between the first waveguide and the second waveguide to project light transmitted through the second waveguide based on information about the distance between the first virtual image and the second virtual image.
[0055] In one embodiment of the present disclosure, in the image processing device, an adjustable focus lens may be provided between the first waveguide and the second waveguide. The adjustable focus lens may be an active element whose focal length is changed by an electrical signal. The image processing device may provide the adjustable focus lens with an electrical signal corresponding to the focal length to be changed.
[0056] In operation S330, the image processing apparatus may output light forming the first virtual image and light forming the second virtual image to the first waveguide and the second waveguide, respectively.
[0057] In one embodiment of the present disclosure, according to the output of the image processing device, the light forming the first virtual image can be displayed at a point on the user's retina at a depth of d1. The light forming the second virtual image can pass through the adjustable focus lens and thus be displayed at a point on the user's retina at a depth of d2.
[0058] When the second virtual image is to be displayed at a distance closer or farther than the point at the depth d2, the image processing device may provide an electrical signal to the adjustable focus lens to change the focal length. For example, when the adjustable focus lens includes a liquid crystal lens, the image processing device may change the focal length by applying a voltage to an electrode having a Fresnel zone pattern to change the orientation of liquid crystal molecules of the liquid crystal lens. However, the liquid crystal lens is only an example, and the adjustable focus lens is not limited thereto.
[0059] Figure 4 is a diagram illustrating a structure of an image display device 400 according to another embodiment of the present disclosure.
[0060] refer to Figure 4 , the image display device 400 may include a first waveguide 410, a second waveguide 420, a first adjustable focus lens 430, a display engine 440, and a second adjustable focus lens 450. However, these elements are only examples, and the image display device 400 may also include other elements or may include only some of the elements.
[0061] The first waveguide 410, the second waveguide 420 and the first adjustable focus lens 430 according to the present embodiment of the present disclosure may correspond to the above reference numerals. Figure 2 The first waveguide 210, the second waveguide 220 and the adjustable focus lens 230 described above are omitted here. Figure 2 The part described is the same as the part described.
[0062] In one embodiment of the present disclosure, the display engine 440 may output light forming a first virtual image and light forming a second virtual image. The light forming the first virtual image and the light forming the second virtual image may pass through the second adjustable focus lens 450 and then be incident on the first waveguide 410 and the second waveguide 420, respectively.
[0063] When light incident on the first waveguide 410 passes through the second adjustable focus lens 450 having a focal length of OP2, the first virtual image may be displayed at a depth of d'1. When light incident on the second waveguide 420 passes through the second adjustable focus lens 450 having a focal length of OP2 and the first adjustable focus lens 430 having a focal length of OP1, the second virtual image may be displayed at a depth of d'2.
[0064] The display engine 440 may output a virtual image by changing the focal length OP1 and the focal length OP2 to provide a three-dimensional (3D) virtual image to the user, as will be described below with reference to FIG. Figure 5 Described in more detail.
[0065] When determining the focal length to be changed, the display engine 440 may change the focal length by providing an electrical signal corresponding to the focal length to the first and second adjustable focus lenses 430 and 450 .
[0066] Figure 5 is a diagram illustrating a method performed by an image display device of displaying a 3D virtual image according to an embodiment of the present disclosure.
[0067] In one embodiment of the present disclosure, the image display device may periodically output a plurality of virtual images at different distances to represent an object in three dimensions. In this case, in order to change the value of the distance at which the plurality of virtual images are displayed, the image display device may refer to the above reference Figure 4 The depicted first and second adjustable focus lenses 430 and 450 provide electrical signals.
[0068] For example, the display device may periodically and separately display a plurality of two-dimensional (2D) virtual images. For example, the display device may display one or more of two-dimensional virtual images 510, 512, 514, 516, and 518 representing a portion of the 3D shape of the apple 500 at depths d1, d2, d3, d4, and d5, respectively, so that the user can perceive the 3D shape of the apple 500. In this case, in order to display a plurality of 2D virtual images 510, 512, 514, 516, and 518 at depths d1, d2, d3, d4, and d5, respectively, the image display device may change the focal length by providing electrical signals corresponding to these depths to the first adjustable focus lens 430 and the second adjustable focus lens 450. Figure 5 Five 2D virtual images are shown, but embodiments of the present disclosure may have more or less than five 2D virtual images.
[0069] Figure 6 is a diagram illustrating a method performed by the image display device 600 of displaying a plurality of first virtual images 610 and second virtual images 620 during execution of a navigation application according to an embodiment of the present disclosure.
[0070] refer to Figure 6 , when executing a navigation application, the image display device 600 may display one or more of the following: fuel quantity information 611, stability information 613, time information 615, communication status information 617, and speed information 619 of a vehicle that a user is using (e.g., driving). The image display device may also display one or more of the following: facility information 621 about facilities outside the vehicle, building information 623 about buildings outside the vehicle, road information 625, etc. The displayed information may be superimposed on a real-world landscape, such as Figure 6 As shown. In this case, the state information (e.g., one or more of the following: fuel quantity information 611, stability information 613, time information 615, communication state information 617, and / or speed information 619 of the vehicle being used / driven by the user) is preferably displayed at one or more fixed positions, so the image display device 600 can display the first virtual image 610 containing the state information at a position with a fixed depth value. To this end, the image display device 600 can output the light of the first virtual image 610 to the first waveguide. At least a portion of the light incident on the first waveguide can be diffracted and perceived by the user's retina. In this case, the depth value of the position where the first virtual image 610 (e.g., state information) is displayed can be fixed to d1.
[0071] The location where the AR information (e.g., one or more of the following: facility information 621 about facilities outside the vehicle, building information 623 about buildings outside the vehicle, and / or road information 625, etc.) is to be displayed may vary as the user moves. Therefore, the image display device 600 can display the second virtual image 620 containing the AR information by variably setting the depth value of the second virtual image 620. To this end, the image display device 600 may output the light of the second virtual image 620 to the second waveguide. At least a portion of the light incident on the second waveguide may be diffracted, pass through the adjustable focus lens, and then be perceived by the user's retina. The depth value of the second virtual image 620 may be variably set according to the focal length of the adjustable focus lens.
[0072] In one embodiment of the present disclosure, in order to set the depth value of the position where the second virtual image 620 is to be displayed to d2, the image display device 600 may provide an electrical signal to the adjustable focus lens so that the adjustable focus lens has a focal length corresponding to the depth value d2.
[0073] Figure 7 is a diagram illustrating a method performed by an image display device of displaying a plurality of first virtual images 710 and second virtual images 720 during execution of a game application (eg, an AR type game) according to an embodiment of the present disclosure.
[0074] refer to Figure 7 , when executing a game application, the image display device may display one or more of the following: game environment information 712, characters 722, and / or items 724, etc., about the game environment of the user to be imposed on the real world scenery. In this case, the game environment information 712 is preferably displayed at a fixed position, so the image display device may display a first virtual image 710 containing the game environment information 712 at a fixed value position. To this end, the image display device may output the light of the first virtual image 710 to the first waveguide. At least a portion of the light incident on the first waveguide may be diffracted and perceived by the user's retina. In this case, the depth value of the position where the first virtual image 710 is displayed may be fixed to d1.
[0075] The position where one or more of the character 722 and the item 724 are to be displayed may vary according to the progress of the game application. Therefore, the image display device may display the second virtual image 720 by variably setting the depth value of the second virtual image 720 including one or more of the character 722 and the item 724. To this end, the image display device may output the light of the second virtual image 720 to the second waveguide. At least a portion of the light incident on the second waveguide may be diffracted, pass through the adjustable focus lens, and then be perceived by the user's retina. The depth value of the second virtual image 720 may be variably set according to the focal length of the adjustable focus lens.
[0076] In one embodiment of the present disclosure, in order to set the depth value of the position where the second virtual image 720 is to be displayed to d2, the image display device may provide an electrical signal to the adjustable focus lens so that the focal length of the adjustable focus lens may correspond to the depth value d2.
[0077] Figure 8 is a diagram illustrating a method performed by an image display device 800 of displaying a plurality of first virtual images 810 and second virtual images 820 during execution of a remote presentation application according to an embodiment of the present disclosure.
[0078] refer to Figure 8 , the image display device 800 may display one or more of the conference data 812 and / or (multiple) conference participants 822, etc., superimposed on the real world scenery when the conference is conducted through the execution of the telepresence application. In this case, the conference data 812 is preferably displayed at a fixed position, so the image display device 800 may display a first virtual image 810 including the conference data 812 at a position of a fixed depth value. To this end, the image display device 800 may output the light of the first virtual image 810 to the first waveguide. At least a portion of the light incident on the first waveguide may be diffracted and perceived by the user's retina. In this case, the depth value of the position where the first virtual image 810 is displayed may be fixed to d1.
[0079] The position of (multiple) meeting participants 822 may change as the meeting proceeds. Therefore, the image display device 800 may display the second virtual image 820 by variably setting the depth value of the second virtual image 820 including the meeting participants 822. To this end, the image display device 800 may output the light of the second virtual image 820 to the second waveguide. At least a portion of the light incident on the second waveguide may be diffracted, pass through the adjustable focus lens, and then be perceived by the user's retina. In this case, the depth value of the second virtual image 820 may be variably set according to the focal length of the adjustable focus lens.
[0080] In one embodiment of the present disclosure, in order to set the depth value of the position where the second virtual image 820 is displayed to d2, the image display device 800 may provide an electrical signal to the adjustable focus lens so that the focal length of the adjustable focus lens corresponds to d2.
[0081] Fig. 9 is a diagram illustrating a method performed by the image display device 900 of displaying a plurality of first virtual images 910 and second virtual images 920 during execution of a plurality of applications according to an embodiment of the present disclosure.
[0082] refer to Fig. 9 , when two different types of applications (e.g., a photo album application and a calendar application) are executed simultaneously, the image display device 900 may display the execution screens of these applications to be superimposed on the real-world scenery. In this case, when the user selects one of the applications through a touch input or the like, the image display device 900 may display the execution screen of the selected application closer to the user in response to the user's touch input.
[0083] In the current embodiment of the present disclosure, it is assumed that the calendar application is selected by the user. When the album application is not selected, the execution screen of the album application is preferably displayed at a fixed position, so the image display device 900 can display the first virtual image 910 including the execution screen of the album application at the position of the fixed depth value. To this end, the image display device 900 can output the light of the first virtual image 910 to the first waveguide. At least a portion of the light incident on the first waveguide can be diffracted and perceived by the user's retina.
[0084] The position of the screen of the calendar application selected by the user may change in response to the user's input. Therefore, the image display device 900 may display the second virtual image 920 by variably setting the depth value of the second virtual image 920 including the execution screen of the calendar application. To this end, the image display device 900 may output the light of the second virtual image 920 to the second waveguide. At least a portion of the light incident on the second waveguide may be diffracted, pass through the adjustable focus lens, and then be perceived by the user's retina. The depth value of the second virtual image 920 may be variably set according to the focal length of the adjustable focus lens.
[0085] Fig.10 is a diagram illustrating a structure of an image display device 1000 according to another embodiment of the present disclosure.
[0086] refer to Fig.10 , the image display device 1000 may include a first waveguide 1010, a second waveguide 1020, a focus-adjustable lens 1030, a display engine 1040, and a sensor 1050. However, these elements are merely examples, and the image display device 1000 may also include other elements or only some of the elements.
[0087] The first waveguide 1010, the second waveguide 1020 and the adjustable focus lens 1030 according to the present embodiment of the present disclosure may correspond to the above reference numerals. Figure 2 The first waveguide 210, the second waveguide 220 and the adjustable focus lens 230 described above are omitted here. Figure 2 The part described is the same as the part described.
[0088] In one embodiment of the present disclosure, the display engine 1040 may provide an electrical signal to the adjustable focus lens 1030 to change the focal length of the adjustable focus lens 1030 .
[0089] For example, when the user's line of sight may be sensed by the sensor 1050, the display engine 1040 may change the focal length of the adjustable focus lens 1030 so that the focal length corresponds to the user's line of sight.
[0090] The sensor 1050, which may be a camera or the like, may track the position of the user's pupil or the like to sense the user's line of sight, but this method is only an example, and the method of sensing the user's line of sight by the sensor 1050 is not limited thereto. The sensor 1050 is not limited to a camera.
[0091] Fig.11 is a diagram illustrating a structure of an image display device 1100 according to another embodiment of the present disclosure.
[0092] refer to Fig.11, the image display device 1100 may include a first waveguide 1110, a second waveguide 1120, an adjustable focus lens 1130, a display engine 1140, and an optical compensation element 1150. However, these elements are merely examples, and the image display device 1100 may also include other elements or only some of the elements.
[0093] The first waveguide 1110, the second waveguide 1120 and the adjustable focus lens 1130 according to the present embodiment of the present disclosure may correspond to the above reference numerals. Figure 2 The first waveguide 210, the second waveguide 220 and the adjustable focus lens 230 described above are omitted here. Figure 2 The part described is the same as the part described.
[0094] In one embodiment of the present disclosure, the optical compensation element 1150 may compensate for the focal length of the real-world image. For example, when the real-world image is projected onto the adjustable focus lens 1130 without the optical compensation element 1150, the real-world image may be perceived as distorted.
[0095] Therefore, the optical compensation element 1150 may be set to have a focal length for compensating for distortion caused by the focal length of the adjustable focus lens 1130. For example, when the focal length of the adjustable focus lens 1130 is OP2, the focal length of the optical compensation element 1150 may be set to 1 / OP2. The optical compensation element 1150 is an active element, and the display engine 1140 may apply an electrical signal corresponding to the focal length 1 / OP2 to the optical compensation element 1150 to change the focal length of the adjustable focus lens 1130. Therefore, the real-world image is corrected in advance by the optical compensation element 1150, and is not distorted even when the real-world image is projected onto the adjustable focus lens 1130.
[0096] The method according to an embodiment of the present disclosure can be implemented in the form of program commands that can be executed by various computer devices and recorded on a computer-readable medium. The computer-readable medium may include program commands, data files, data structures, etc., alone or in combination. The program commands recorded on the computer-readable medium may be specially designed and configured for the present disclosure, or may be well known and used by those of ordinary skill in the field of computer software. Examples of computer-readable media include magnetic media (e.g., hard disks, floppy disks, and tapes), optical media (e.g., CD-ROMs and DVDs), magneto-optical media (e.g., optical magnetic disks), and hardware devices (e.g., ROMs, RAMs, and flash memory) that are specially configured to store and execute program commands. Examples of program commands include not only machine language codes prepared by a compiler, but also high-level language codes that can be executed by a computer using an interpreter.
[0097] Reference numerals are used in the embodiments shown in the drawings, and specific terms are used to describe the embodiments of the present disclosure, but the present disclosure is not limited by the specific terms. The embodiments of the present disclosure should be understood to include all elements that are obvious to those of ordinary skill in the art.
[0098] The embodiments of the present disclosure can be represented using functional block components and various operations. Such functional blocks can be implemented by any number of hardware and / or software components configured to perform certain functions. For example, the embodiments of the present disclosure can use various integrated circuit components (e.g., memory, processing element, logic element, lookup table, etc.) to perform various functions under the control of at least one microprocessor or other control device. In addition, the embodiments of the present disclosure can use the same or different types of cores, different types of CPUs, etc. Since the elements of the present disclosure are implemented using software programming or software elements, the embodiments can be implemented with any programming or scripting language (such as C, C++, Java, assembler, etc.) including various algorithms of any combination as data structures, processes, routines or other programming elements. Functional aspects can be implemented as algorithms executed by at least one processor. In addition, the present disclosure can use the prior art of electronic configuration, signal processing and / or data processing. The terms "mechanism", "element", "device", "configuration", etc. can be widely used and are not limited to mechanical or physical components. These terms should be understood to include software routines combined with processors, etc.
[0099] The specific implementations described in the embodiments of the present disclosure are merely examples, and are not intended to limit the scope of the embodiments of the present disclosure in any way. For the sake of brevity, other functional aspects of electronic components, control systems, software and systems according to related technologies may not be described in detail. The lines or connecting elements shown in the accompanying drawings are intended to represent exemplary functional relationships and / or physical or logical couplings between various elements. It should be noted that many alternative or additional functional relationships, physical connections or logical connections may exist in actual equipment. In addition, unless specifically described as "necessary" or "critical", no item or component is necessary for the practice of the present disclosure.
[0100] The term "the" and similar references used to describe embodiments of the present disclosure (particularly in the appended claims) should be interpreted as covering the singular and plural. The description of the value range herein is intended only to be used as a shortcut method for independently referring to each individual value falling within the range, unless otherwise indicated herein, and each individual value is incorporated into the specification as if it is independently described herein. Finally, the operation of all methods described herein can be performed in an appropriate order, unless otherwise indicated herein or clearly contradictory to the context. The embodiments of the present disclosure are not limited by the order of the operations described herein. The use of any and all examples or exemplary terms provided herein (for example, "such as") is only intended to clearly describe the embodiments of the present disclosure, and does not limit the scope of the embodiments of the present disclosure, unless otherwise stated. Without departing from the spirit and scope of the present disclosure, many modifications and adaptations will be apparent to those of ordinary skill in the art. It is apparent to those of ordinary skill in the art that, without departing from the scope of the appended claims and their equivalents, various modifications and changes can be made in the embodiments of the present disclosure by changing design conditions and factors.
Claims
1. An image display device, include: First Waveguide; Second waveguide; a first adjustable focus lens disposed between the first waveguide and the second waveguide; A display engine configured to output a first light forming a first virtual image and a second light forming a second virtual image; as well as a second adjustable focus lens, located between the display engine and the first waveguide, wherein the first light output from the display engine passes through the second adjustable focus lens and is incident on the first waveguide, wherein at least a portion of the first light incident on the first waveguide is diffracted from the first waveguide, wherein the second light output from the display engine passes through the second adjustable focus lens and is incident on the second waveguide, and Wherein, at least a portion of the second light incident on the second waveguide is diffracted from the second waveguide, passes through the first adjustable-focus lens, and is incident on the first waveguide.
2. The image display device according to claim 1, in, The focal length of the first adjustable focus lens is determined based on distance information between the first virtual image and the second virtual image.
3. The image display device according to claim 1, in, Electrical signals are provided to the first adjustable focus lens and the second adjustable focus lens based on the focal length of the first adjustable focus lens and the focal length of the second adjustable focus lens.
4. The image display device according to claim 1, further comprising a sensor configured to track a user's line of sight, in, The focal length of the first adjustable focus lens is determined based on the line of sight of the user.
5. The image display device according to claim 1, further comprising an optical compensation element, wherein the optical compensation element is provided on one side of the second waveguide. in, The focal length of the optical compensation element is determined based on the focal length of the first adjustable focus lens.
6. The image display device according to claim 1, in, Each of the first adjustable focus lens and the second adjustable focus lens includes at least one of a liquid crystal LC panel, an LC lens, a liquid lens, or an active diffraction element.
7. An image display method of an image display device, the image display device comprising a first waveguide, a second waveguide, a first adjustable focus lens located between the first waveguide and the second waveguide, a display engine, and a second adjustable focus lens located between the display engine and the first waveguide, include: The display engine outputs a first light forming a first virtual image and a second light forming a second virtual image; Controlling the focal length of the first focus-adjustable lens; as well as controlling the focal length of the second focus-adjustable lens, wherein the first light output from the display engine passes through the second adjustable focus lens and is incident on the first waveguide, wherein at least a portion of the first light incident on the first waveguide is diffracted from the first waveguide, wherein the second light output from the display engine passes through the second adjustable focus lens and is incident on the second waveguide, and Wherein, at least a portion of the second light incident on the second waveguide is diffracted from the second waveguide, passes through the first adjustable-focus lens, and is incident on the first waveguide.
8. The image display method according to claim 7, in, Controlling the focal length of the first focus-adjustable lens includes: Determining a focal length of the first adjustable focus lens based on distance information between the first virtual image and the second virtual image; and Based on the determined focal length, an electrical signal is provided to the first adjustable focus lens.
9. The image display method according to claim 7, in, Controlling the focal length of the first focus-adjustable lens includes: determining a focal length of the first adjustable focus lens; and An electrical signal is provided to the first adjustable focus lens based on a focal length of the first adjustable focus lens.
10. The image display method according to claim 7, further comprising tracking the user's line of sight, in, Determining a focal length of the first adjustable focus lens includes determining a focal length of the first adjustable focus lens based on a line of sight of the user.
11. The image display method according to claim 7, further comprising: include: determining a focal length of an optical compensation element provided on one side of the second waveguide based on the focal length of the first adjustable-focus lens; as well as An electrical signal corresponding to the determined focal length of the optical compensation element is provided to the optical compensation element.
12. The image display method according to claim 8, in, Each of the first adjustable focus lens and the second adjustable focus lens includes at least one of a liquid crystal LC panel, an LC lens, a liquid lens, or an active diffraction element.
