Image display device capable of expressing multiple depths

By using shape to change materials and processors in the image display device to calculate depth information and adjust the position and light direction of the display device, the problem of visual fatigue in virtual reality and augmented reality is solved, and a more natural depth feeling and image display comfort is achieved. .

CN112241068BActive Publication Date: 2024-12-03SAMSUNG ELECTRONICS CO LTD
View PDF 0 Cites 0 Cited by

Patent Information

Application Number
CN202010079696.7
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2019-07-18
Filing Date
2020-02-04
Publication Date
2024-12-03
Estimated Expiration
2040-02-04

AI Technical Summary

Technical Problem

Existing 3D image display technology is prone to visual fatigue in virtual reality and augmented reality applications, mainly due to mismatch in gathering and dispersion adjustments.

Method used

A multi-deep expression image display device is designed to adjust the position of the display device and the direction of light according to the image information by combining the light emitter and the driver using shape to change materials such as shape memory alloys or electroactive polymers. The signal controls the position change of the display device, and calculates the depth information and scale factors through the processor to generate optical modulated signals to reduce visual fatigue.

Benefits of technology

It effectively reduces visual fatigue, provides a more natural depth feeling, and improves the comfort and stability of image display, suitable for virtual reality and augmented reality applications.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN112241068B_ABST
    Figure CN112241068B_ABST
Patent Text Reader

Abstract

An image display device includes: a display device configured to modulate light to form an image; a driver configured to adjust the position of the display device; a light emitter including a focusing member and configured to change the direction of light incident on the light emitter to transmit the image to a preset position; and a processor configured to generate a drive signal based on image information and control the driver based on the drive signal to adjust the position of the display device relative to the focusing member based on the drive signal.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] CROSS-REFERENCE TO RELATED APPLICATIONS

[0002] This application claims the priority of Korean Patent Application No. 10-2019-0087098 filed on July 18, 2019, in the Korean Intellectual Property Office, the disclosure of which is incorporated herein by reference in its entirety. Technical Field

[0003] Devices and methods consistent with example embodiments relate to an image display device capable of multi-depth expression. Background Art

[0004] Three-dimensional (3D) image display technology has been applied to various fields, and has recently been applied to image display devices related to virtual reality (VR) display and augmented reality (AR) display.

[0005] As VR head-mounted displays become more commercially available, they have been widely used in the media and entertainment industries. In addition, head-mounted displays are being developed in a form that can be applied to medical, educational, and industrial fields.

[0006] The AR head mounted display is an advanced form of the VR display, and combines the real world and VR to provide a feature of interaction between reality and VR. The interaction between reality and VR is based on the function of providing information about the real situation in real time, and the effect of reality can be further increased by superimposing virtual objects or information on the real world environment.

[0007] In such devices, stereoscopy technology is generally used for 3D image display, which may be accompanied by visual fatigue due to vergence-accommodation mismatch. Accordingly, a 3D image display method capable of reducing visual fatigue has been sought. Summary of the invention

[0008] Example embodiments address at least the above problems and / or disadvantages and other disadvantages not described above. Also, example embodiments are not required to overcome the above disadvantages, and may not overcome any of the above problems.

[0009] One or more example embodiments provide an image display device capable of multi-depth expression.

[0010] According to one aspect of an example embodiment, there is provided an image display apparatus comprising: a display device configured to modulate light to form an image; a driver configured to adjust a position of the display device; a light emitter including a focusing member and configured to change a direction of light incident on the light emitter to transmit the image to a preset position; and a processor configured to generate a drive signal according to image information and control the driver according to the drive signal to adjust the position of the display device relative to the focusing member according to the drive signal.

[0011] The driver may be further configured to move the display device in parallel such that a distance between the display device and the focusing member varies.

[0012] The driver may include a shape change portion that is deformable according to an applied signal to provide a driving force to the display device.

[0013] The shape changing portion may include a material having a shape that changes due to heat.

[0014] The shape changing portion may include a shape memory alloy or an electroactive polymer.

[0015] The light emitter may be further configured to transmit the image as a magnified image onto a virtual image plane at a predetermined position.

[0016] The image information may include depth information regarding a predetermined position of a virtual image plane relative to each of the images of the plurality of frames, and the processor may be further configured to generate a driving signal according to the depth information.

[0017] The depth information may be information previously set according to a saliency map with respect to each of images of a plurality of frames.

[0018] The processor may be further configured to generate a scale factor to be applied to any one of images of two consecutive frames having different depth information; generate a light modulation signal by reflecting the scale factor to the image information; and control the display device according to the light modulation signal.

[0019] The processor may be further configured to calculate magnifications at which images of two consecutive frames are respectively imaged, and set the scale factor to 1 when a change value between the magnifications is equal to or less than a predetermined reference value.

[0020] The processor may be further configured to calculate magnifications at which images of two consecutive frames are respectively imaged, and determine the similarity of the images of the two frames when a change value between the magnifications is greater than a predetermined reference value.

[0021] The processor may be further configured to set the scale factor to 1 when the similarity of the images of the two consecutive frames is equal to or less than a predetermined reference value, and to set the scale factor to an offset value that offsets the change value when the similarity of the images of the two consecutive frames is greater than the predetermined reference value.

[0022] The processor may be further configured to transmit the driving signal when a predetermined time has elapsed since the light modulation signal was transmitted, with respect to the image of the same frame.

[0023] The predetermined time may be set to be equal to or greater than a predetermined vergence-accommodation time of the eye.

[0024] The light emitter may be further configured to combine first light including a first image from the display device with second light including a second image of the real environment, and transmit the combination of the first light and the second light to a preset position.

[0025] The light emitter may include a beam splitter and a focusing member disposed obliquely with respect to a travel path of the first light and a travel path of the second light.

[0026] The beam splitter can be a half mirror.

[0027] The display device may include a first display device and a second display device, the driver may include a first driver and a second driver, the first driver and the second driver are respectively configured to drive the first display device and the second display device so that the positions of the first display device and the second display device change, and the light emitter may include a first light emitter and a second light emitter, the first light emitter and the second light emitter are respectively configured to transmit images formed by the first display device and the second display device to a preset left eye position and a preset right eye position, respectively.

[0028] The image information may include information about a pair of left-eye images and right-eye images to be perceived as a three-dimensional (3D) image of one frame, and the processor may be further configured to control the first display device and the second display device so that the left-eye image is formed by the first display device and the right-eye image is formed by the second display device.

[0029] The image information may further include depth information related to a position of a virtual image plane on which the left-eye image and the right-eye image are to be imaged, and the processor may be further configured to control the first driver and the second driver according to the depth information.

[0030] The image display device may be a wearable device. BRIEF DESCRIPTION OF THE DRAWINGS

[0031] The above and / or other aspects will become more apparent by describing certain example embodiments with reference to the accompanying drawings, in which:

[0032] Figure 1 is a diagram showing a configuration and an optical arrangement of an image display device according to an example embodiment;

[0033] Figure 2 It shows that it can be Figure 1 A block diagram of an example of a configuration of a processor employed in an image display device;

[0034] Figure 3 It shows that it can be Figure 1 A block diagram of another example of the configuration of a processor employed in an image display device;

[0035] Figure 4 It shows that it can be Figure 1 A block diagram of another example of the configuration of a processor employed in an image display device;

[0036] Figure 5 It is shown that the Figure 4 A flowchart of an example of the operation of a scale factor generator in a processor;

[0037] Figure 6 and Figure 7 shows an example where the position of the display device and the image plane changes according to the deformation of the actuator, and Figure 1 An example of a structure of a driver in an image display device.

[0038] Figure 8 It is shown Figure 6 and Figure 7 A perspective view of the detailed shape of the drive.

[0039] Fig. 9 It shows that it can be Figure 1 An example of a configuration of a driver employed in an image display device;

[0040] Fig.10 It shows that it can be Figure 1 Another example of a configuration of a driver employed in an image display device;

[0041] Fig.11 It shows that it can be Figure 1 Another example of a configuration of a driver employed in an image display device;

[0042] Fig.12 A configuration and an optical arrangement of an image display device according to another example embodiment are shown.

[0043] Fig.13 It is shown that the Fig.12 A block diagram of an example of a configuration of a processor in an image display device. DETAILED DESCRIPTION

[0044] Example embodiments are described in more detail below with reference to the accompanying drawings.

[0045] In the following description, the same reference numerals are used for the same elements even in different drawings. Matters defined in the specification, such as detailed construction and elements, are provided to assist in a comprehensive understanding of the exemplary embodiments. However, it is apparent that the exemplary embodiments can be practiced without those specifically defined matters. Moreover, well-known functions or structures are not described in detail because they would obscure the description with unnecessary detail.

[0046] As used herein, the term "and / or" includes any and all combinations of one or more of the associated listed items. An expression such as "at least one" when preceding a list of elements modifies the entire list of elements without modifying the individual elements in the list. For example, the expression "at least one of a, b, and c" should be understood to include only a, only b, only c, both a and b, both a and c, both b and c, both a, b, and c, all of a, b, and c, or any variation of the above examples.

[0047] Hereinafter, when a constituent element is disposed “on” or “over” another constituent element, the constituent element may be merely directly on or over the other constituent element in a non-contact manner.

[0048] Unless otherwise clearly stated in the context, singular expressions in this specification include plural expressions. Moreover, terms such as "include" and / or "comprising" may be interpreted as indicating a constituent element, but may not be interpreted as excluding the presence of another constituent element or the possibility of adding another constituent element.

[0049] The use of the terms "a" and "an" and "the" and similar referents in the context of describing the disclosure (especially in the context of the following claims) are to be construed to cover both the singular and the plural.

[0050] Moreover, the operations of all methods described herein can be performed in any suitable order, unless otherwise specified herein or clearly contradictory to the context. The present disclosure is not limited to the described order of operations. The use of any and all examples or language (e.g., "such as") provided herein is only to better illustrate the present disclosure, rather than to limit the scope of the present disclosure, unless otherwise stated.

[0051] Figure 1 is a diagram showing a configuration and an optical arrangement of an image display device 1000 according to an example embodiment, and Figure 2 It shows that it can be Figure 11 is a block diagram of an example of a configuration of a processor 400 employed in an image display device 1000.

[0052] The image display apparatus 1000 includes: a display device 100 that modulates light to form an image; a driver 200 that drives the display device 100 so that the position of the display device 100 changes; a light emitter 300 that transmits the image formed by the display device 100 to the eyes of an observer (for example, by changing the direction of light incident from the display device 100 to a preset position (for example, a preset position of the observer's eyes); and a processor 400 that controls the display device 100 and the driver 200 according to image information.

[0053] The display device 100 modulates light according to image information of an image to be provided to an observer to form an image. The image formed by the display device 100 may be provided to both eyes of the observer, and for convenience, in Figure 1 Only an optical system toward one eye is shown in FIG. The image formed by the display device 100 may be, for example, a stereoscopic image, a holographic image, a light field image, an integrated photography (IP) image, etc. provided to the left and right eyes of the observer, and may include a multi-view image or a super multi-view image. In addition, the image is not limited thereto, and may be a general two-dimensional (2D) image.

[0054] The display device 100 may include, for example, a liquid crystal on silicon (LCoS) device, a liquid crystal display (LCD) device, an organic light emitting diode (OLED) display device, and a digital micromirror device (DMD), and may also include next-generation display devices such as micro LEDs, quantum dot LEDs, and the like.

[0055] Although not shown in the image display device 1000, a light source for forming an image may be provided in the display device 100, and configurations such as a beam splitter for adjusting an optical path, a relay lens for magnifying or reducing an image, a spatial filter for removing noise, etc. may be provided.

[0056] The light emitter 300 changes the path of the image formed by the display device 100, forms an image having a size suitable for the viewer's field of view, and transmits the image to the viewer's eyes. The light emitter 300 may include a focusing member 310, and may further include a beam splitter 330 as a member for diverting light to change the path.

[0057] The focusing member 310 may include an image forming member having a refractive power and may magnify or reduce an image formed by the display device 100. The focusing member 310 is shown as a concave mirror, but is not limited thereto. The focusing member 310 may have a combined shape of a concave mirror, a convex lens, a concave lens, etc.

[0058] The beam splitter 330 may include a half mirror that transmits half of the incident light and reflects the other half of the incident light. However, the beam splitter 330 is not limited thereto and may include a polarization beam splitter that transmits or reflects the incident light according to polarization. When the beam splitter 330 may include a polarization beam splitter, an additional optical element for polarization conversion may be further provided in the light transmitter 300.

[0059] As shown in the figure, the focusing member 310 and the beam splitter 330 are fixed by the transparent light guide member 350, so that the light emitter 300 can have an integral structure. However, this is only an example and is not limited thereto.

[0060] The light emitter 300 may transmit light including an image formed by the display device 100 to the eyes of the observer, and may also transmit light including a real environment image in front of the observer. Therefore, the image display apparatus 1000 may be used as a see-through display.

[0061] The light emitter 300 is not limited to the shape and configuration shown. Additional optical elements may be further provided to transmit the image formed by the display device 100 together with the real environment image in front of the observer to the pupil of the observer, and optical windows having various shapes and structures may be used.

[0062] The light of the image formed by the display device 100 reaches the eyes of the observer along a path such that the light passes through the beam splitter 330 and is reflected by the focusing member 310, and then is reflected by the beam splitter 330. In this path, the observer recognizes a virtual image formed on a virtual image plane VP at a predetermined position behind the beam splitter 330, and the depth sense sensed by the observer varies according to the position of the virtual image plane VP. Figure 1 , light reflected from the focusing member 310 is shown as a dotted line positioned separately from a solid line indicating light incident on the focusing member 310, but the reflected light can travel to the beam splitter 330 along the same path as the light incident on the focusing member 310 from the display device 100, and the dotted line and the solid line can be considered to be positioned to overlap each other.

[0063] The image display device 1000 according to the exemplary embodiment may not fix the position of the virtual image plane VP to a fixed position, but may change the position of the virtual image plane VP by reflecting the depth sense of the image to be displayed. To this end, the image display device 1000 includes a driver 200 for driving the position of the display device 100. The driver 200 may move the display device 100 in parallel so that the distance between the driver 200 and the focusing member 310 changes. When the position of the display device 100 changes in the A1 direction, the position of the virtual image plane VP changes in the A2 direction.

[0064] The driver 200 may include a shape-changing material so as to widen the position driving range of the display device 100 with as small a volume as possible. In particular, the driver 200 may be deformed according to an applied signal (e.g., a voltage or heat applied to the driver 200) and provide a driving force to the display device 100. For such a shape change, a material whose shape changes due to heat may be used in the driver 200. The driver 200 may include a shape memory alloy (SMA) or an electroactive polymer (EAP). This will be referred to later. Figures 6 to 11 An example of a detailed configuration in which the position of the display device 100 is changed by driving the driver 200 is described. The driver 200 may be implemented as an actuator.

[0065] The processor 400 may generate a light modulation signal SG1 and transmit it to the display device 100, and may generate a drive signal SG2 according to image information related to an image to be perceived by an observer and transmit it to the driver 200. The display device 100 and the driver 200 are controlled by the generated light modulation signal SG1 and the drive signal SG2, respectively. That is, an image is formed on the display device 100 by the light modulation signal SG1, and the position of the display device 100 is driven so that the virtual image plane VP appropriately set according to the image is positioned.

[0066] The image display device 1000 may further include a memory 500 , and various data and codes of a program required to drive the image display device 1000 may be stored in the memory 500 including image information.

[0067] The processor 400 may include a light modulation signal generator 410 and a driving signal generator 480. The light modulation signal SG1 and the driving signal SG2 are generated by the light modulation signal generator 410 and the driving signal generator 480, respectively, with reference to image information.

[0068] The image information may include data for each pixel associated with color values ​​of a plurality of pixels with respect to each of images of a plurality of frames to be provided to an observer, and include depth information associated with the position of a virtual image plane VP on which each image is imaged.

[0069] The depth information included in the image information may be a representative depth value previously determined relative to each of the images of the plurality of frames. The depth value may be set to one or more values. For example, when the image includes a plurality of objects (e.g., object 1, object 2, and object 3), the depth information of each of the plurality of objects (e.g., a first depth value of object 1, a second depth value of object 2, and a third depth value of object 3) may be stored in the memory 500.

[0070] The representative depth may be previously set based on a saliency map. A saliency map analysis may be performed to select an area that is highly likely to be viewed by an observer, i.e., an area with high visual concentration. Brightness, color, outline, object size, etc. may be considered to select an area with high visual concentration. For example, an area with a large difference in brightness or color compared to the surroundings, an area with strong outline features, and an area with larger-sized objects may be an area with high visual concentration. A depth value corresponding to the area may be selected as a representative depth. Alternatively, a location with high visual concentration may be selected based on the content included in the image.

[0071] Furthermore, the representative depth may be set according to, for example, the frequency of each depth by analyzing the depth map and the color map of the image. Alternatively, the representative depth may be set by zone of comfort (ZOC) analysis in consideration of human visual perception characteristics.

[0072] The representative depth set as described above may be a continuous value or may be a plurality of discrete values. That is, not all values ​​required for depth representation are used, but the representative depth may be set among discrete values ​​obtained by quantizing these values ​​at predetermined intervals. In the case of quantized depth values, when a representative depth value is selected for each frame of a moving image representation, the variation of the representative depth value selected in consecutive frames may be reduced. Therefore, the position variation of the display device 100 caused by the driver 200 may be reduced, and when the position of the virtual image plane VP varies corresponding to the representative depth, the drive signal SG2 applied to the driver 200 may also be quantized and may be easily driven. When the same representative depth value is selected in consecutive frames, position driving of the display device 100 is not necessary, and therefore, the driving of the image display device 1000 may be further simplified.

[0073] The light modulation signal generator 410 may generate an electrical signal indicating a color value determined with reference to data of each pixel included in the image information as the light modulation signal SG1 .

[0074] The drive signal generator 480 may generate a drive signal SG2 for moving the position of the display device 100 so that the virtual image plane VP is formed at a position corresponding to the representative depth value set by the reference depth information. The drive signal SG2 may be, for example, an electrical signal that generates heat suitable for deformation of the variable material of the driver 200.

[0075] The light modulation signal SG1 and the driving signal SG2 may be transmitted to the display device 100 and the driver 200 , respectively, so that an observer may perceive a corresponding image from a changed position of the virtual image plane VP.

[0076] The processor 400 may transmit the light modulation signal SG1 and the drive signal SG2 at different times. For example, the processor 400 may transmit the drive signal SG2 to the driver 200 at a first time point, which is after the processor 400 transmits the light modulation signal SG1 to the display device 100 at a second time point. The time interval between the first time point and the second time point may be a predetermined time interval and may be set to be equal to or greater than the vergence-accommodation time of the observer's eyes. This takes into account the time it takes for the human eye to perceive an image of a changed depth position.

[0077] Figure 3 It shows that it can be Figure 1 A block diagram of another example of the configuration of the processor 401 employed in the image display device 1000;

[0078] The processor 401 may further include a representative depth extractor 430 as well as the light modulation signal generator 410 and the driving signal generator 480 .

[0079] exist Figure 2 In the description of , the image information is described as including previously set depth information, but is not limited thereto. The processor 401 may include a representative depth extractor 430. That is, the processor 401 extracts a representative depth of each image with reference to the data of each pixel included in the image information, and reflects the representative depth to the image information again. With reference to this, the drive signal generator 480 may generate the drive signal SG2.

[0080] Figure 4 It shows that it can be Figure 1 A block diagram of another example of the configuration of the processor 402 employed in the image display device 1000, and Figure 5 It is shown that the Figure 4Flowchart of an example of the operation of the scale factor generator 450 in the processor 402.

[0081] In addition to the light modulation signal generator 410 , the driving signal generator 480 , and the representative depth extractor 430 , the processor 402 may further include a scale factor generator 450 .

[0082] The scale factor generator 450 generates a scale factor to be applied to any one of images of two consecutive frames having different depth information.

[0083] When the images of two consecutive frames have different virtual image planes VP, the processor 402 may operate the scale factor generator 450 to generate a scale factor, and thus the images of the two consecutive frames may exhibit different magnifications.

[0084] The magnification m is defined as follows.

[0085]

[0086] Among them, d o represents the distance from the image display surface of the display device 100 to the focusing member 310, d i represents the distance from the focusing member 310 to the virtual image plane VP. i represents the distance along the virtual light path, and the indicated distance d i and d i ' includes the distance from the center of the focusing member 310 to the center of the beam splitter 330 and the distance from the center of the beam splitter 330 to the virtual image plane VP (VP').

[0087] When d is determined according to the position of the display device 100 and the position of the virtual image plane VP o and d i When the magnification at this time is m, the magnification m' corresponding to the changed position of the virtual image plane VP is d i ' / d o ', which is different from m. Such changes in magnification in consecutive frame images may feel awkward to the observer. In order to form a more natural sense of depth, the processor 402 may form an image on the display device 100 by reflecting a scale factor that can compensate for the change in magnification to the image information.

[0088] The scaling factor does not have to be applied to all consecutive frame images with different magnifications, and may be applied when the magnification change value is greater than a predetermined reference value. In addition, even when the magnification change value is large, the scaling factor may not need to be applied to images of other scenes that are not related to each other. In consideration of this situation, the scaling factor may be set and applied.

[0089] refer to Figure 5 In operation S451, in order to generate a scale factor, the scale factor generator 450 determines a change in the magnification of the images of two consecutive frames. That is, the scale factor generator 450 calculates the magnifications m1 and m2 of the images of the two consecutive frames, respectively, and calculates a change value. The change value may be defined as, for example, a ratio m2 / m1 or a difference m2-m1.

[0090] Next, in operation S452 , the scale factor generator 450 compares the calculated change value between the two magnifications m1 and m2 with a predetermined reference value.

[0091] If the change value between the two magnifications m1 and m2 is less than or equal to the predetermined reference value, the scale factor generator 450 sets the scale factor to 1 in operation S456.

[0092] Otherwise, in operation S453, when the change value between the two magnifications m1 and m2 is greater than a predetermined reference value, the scale factor generator 450 determines the similarity of the images of the two frames. In order to determine the similarity of the images, numerical values ​​defined according to a predetermined determination reference may be compared. The numerical values ​​are referred to as similarity. Similarity may be defined based on pixel values, or may be defined by other references suitable for image comparison.

[0093] Even when the change in magnification is large, the scale factor cannot be applied with respect to an unrelated scene. This is because an observer may naturally perceive the change in magnification as part of a scene change. In operation S456, when the similarity of the comparison images of the two frames is equal to or less than a predetermined reference value, the scale factor generator 450 may set the scale factor to 1.

[0094] In operation S455, when the similarity of the comparison images of the two frames is greater than a predetermined reference value, the scale factor generator 450 may generate a scale factor compensating the magnification change value. For example, when the change value is set as a ratio, the scale factor may be set to a value inversely proportional to the magnification change value.

[0095] Thereby, the scale factor set by the scale factor generator 450 is reflected to the image information again, and the light modulation signal generator 410 generates a light modulation signal with reference thereto.

[0096] As reference Figure 3 As described above, the representative depth extractor 430 may set a representative depth according to the image information and reflect the representative depth into the image information as depth information. Referring to the representative depth, the driving signal generator 480 may generate the driving signal SG2.

[0097] Figure 4The processor 402 shown in FIG. 4 includes a representative depth extractor 430 and a scale factor generator 450, but this is only an example. However, the processor 402 may omit the representative depth extractor 430 and the scale factor generator 450 together. For example, a representative depth set by another processor or the like may be previously included in the image information as depth information. In addition, the scale factor may be set by another processor or the like and previously included in the image information.

[0098] Figure 6 and Figure 7 shows an example in which the display device 100 and the image plane position change according to the deformation of the driver 200, and Figure 1 An example of the structure of the driver 200 in the image display device 1000 is shown in FIG. Figure 8 It is shown Figure 6 and Figure 7 A perspective view of the detailed shape of the driver 200.

[0099] Reference Figure 6 and Figure 7 , the driver 200 may include a deformation portion 210, a bridge portion 220, and a drive controller 230. The deformation portion 210 may have a linear shape. The length of the deformation portion 210 may vary according to the temperature of the deformation portion 210 or the electric field formed in the deformation portion 210. For example, the deformation portion 210 may include a shape memory alloy (SMA), an electroactive polymer (EAP), and a combination thereof. When the deformation portion 210 includes an SMA, the deformation portion 210 may have a relatively short length at a relatively high temperature, and may have a relatively long length at a relatively low temperature. For example, the length of the deformation portion 210 may increase as the temperature of the deformation portion 210 decreases, and the length of the deformation portion 210 may decrease as the temperature of the deformation portion 210 increases. When the deformation portion 210 includes an EAP and when an electric field is applied to the deformation portion 210, the length of the deformation portion 210 may increase in a direction perpendicular to the applied electric field. Hereinafter, an example in which the deformation portion 210 is deformed by temperature will be described.

[0100] like Figure 8As shown, the bridging portion 220 includes a plate-shaped member extending in one direction, and is provided at both ends to have recessed areas facing each other. The recessed areas may be used to fix the deformation portion 210 at the ends of the bridging portion 220, and may also be referred to as the terms "recessed portion" or "groove". The bridging portion 220 may have elasticity, and may be bent by the deformation portion 210 to have an arc shape. The deformation portion 210 may be assembled into the recessed areas of the bridging portion 220, and may have a shape surrounding the ends of the bridging portion 220. When the deformation portion 210 is wrapped around the recessed areas at both ends of the bridging portion 220, the recessed areas of the bridging portion 220 fix the deformation portion 210, and therefore, the positions of the deformation portion 210 and the bridging portion 220 may be aligned.

[0101] The temperature of the deformed portion 210 can be adjusted by an electrical signal applied to the deformed portion 210. The electrical signal can be applied by the drive controller 230. The drive controller 230 may include a voltage source, a current source, or a power source for generating the electrical signal. The drive controller 230 may apply an electrical signal to the deformed portion 210 according to the drive signal SG2 transmitted from the processor 400. The electrical signal may be a current signal or a voltage signal. The temperature of the deformed portion 210 may vary according to the value of the voltage signal or the current signal applied to the deformed portion 210. For example, the drive controller 230 applies a current to the deformed portion 210 to increase the temperature of the deformed portion 210. When the drive controller 230 stops applying the current to the deformed portion 210, the temperature of the deformed portion 210 may be reduced. Thus, the drive controller 230 may apply heat to the deformed portion 210 using the electrical signal so that the temperature of the deformed portion 210 may change due to the heat supply.

[0102] The degree of curvature of the bridge portion 220 may vary according to the length of the deformation portion 210. When the length of the deformation portion 210 decreases, the degree of curvature of the bridge portion 220 may increase. Therefore, the distance between the display device 100 and the focusing member 310 may decrease. When the length of the deformation portion 210 increases, the degree of curvature of the bridge portion 220 may decrease. Therefore, the distance between the display device 100 and the focusing member 310 may increase. Here, the term "degree of curvature" may also be referred to as "degree of curvature" or "curvature".

[0103] Reference Figure 6 , the driving controller 230 may not apply current to the deformation portion 210. In this state, the display device 100 may be spaced apart from the focusing member 310 by a distance d o ', and the distance on the optical path from the focusing member 310 to the virtual image plane VP may be d i '.

[0104] Reference Figure 7 , current may be applied to the deformed portion 210 to increase the temperature of the deformed portion 210. The current may be applied by the drive controller 230. Thus, the length of the deformed portion 210 may be reduced. The temperature of the deformed portion 210 may be controlled so that the degree of change in the length of the deformed portion 210 may be adjusted.

[0105] When the length of the deformed portion 210 decreases, the degree of curvature of the bridge portion 220 may increase. During the deformation, the bridge portion 220 may push the display device 100 toward the light emitter 300 to place the display device 100 close to the light emitter 300. The distance between the display device 100 and the focusing member 310 may be reduced to d o , and the distance between the virtual image plane VP and the focusing member 310 can be increased to d i .

[0106] Back to Figure 6 When the driving controller 230 stops applying current to the deformation portion 210 again, the temperature of the deformation portion 210 may be reduced and its length may be increased again. The degree of bending of the bridge portion 220 may be reduced. The distance between the display device 100 and the focusing member 310 may be increased to d again. o ', and the distance between the virtual image plane VP and the focusing member 310 can be reduced to d again. i '.

[0107] Figures 9 to 11 It shows that it can be Figure 1 1 is an example of a configuration of drivers 201, 202, and 203 employed in the image display device 1000.

[0108] Reference Fig. 9 , the driver 201 may include a deformation portion 212, a support portion 240, and a drive controller 230. In addition to the position and shape, each of the deformation portions 212 may be different from the reference Figure 8 The deformation portion 210 described is substantially the same.

[0109] The deformation portion 212 may be provided between the support portion 240 and the display device 100. Both ends of each of the deformation portions 212 may be in contact with the support portion 240 and the display device 100, respectively. A pair of deformation portions 212 is shown, but this is an example. In other example embodiments, one deformation portion 212 or three or more deformation portions 212 may be provided.

[0110] The driving controller 230 may be electrically connected to the deformation portions 212 to apply an electrical signal to each of the deformation portions 212. For example, the driving controller 230 may apply a current to the deformation portions 212.

[0111] When an electrical signal is applied to the deformation portion 212 and the temperature of each of the deformation portions 212 increases, the length of each of the deformation portions 212 may decrease. In this case, the display device 100 is closer to the support portion 240, that is, the distance from the display device 100 to the focusing member 310 increases.

[0112] By controlling the temperature of each of the deformed portions 212, the degree of change in the length of each of the deformed portions 212 may be adjusted, and the distance between the display device 100 and the focusing member 310 may be controlled.

[0113] Reference Fig.10 , the driver 202 may include a deformation portion 212, a support portion 240, a restoration portion 252, and a drive controller 230. The deformation portion 212, the support portion 240, and the drive controller 230 may be connected to the reference Fig. 9 Those described are essentially the same.

[0114] The restoration portion 252 may be provided between the support portion 240 and the display device 100. The restoration portion 252 may extend in a direction from the support portion 240 to the display device 100. The restoration portions 252 may extend to cross each other. Both ends of each of the restoration portions 252 may contact the support portion 240 and the display device 100, respectively. The restoration portion 252 may have elasticity. For example, each of the restoration portions 252 may include a rod containing carbon. When the restoration portion 252 is bent, the restoration portion 252 may have a restoring force to be restored to a state before being bent again.

[0115] When an electrical signal is applied to the deformation portion 212, the temperature of each of the deformation portions 212 increases, the length of each of the deformation portions 212 decreases, and the restoration portion 252 is bent. Therefore, the display device 100 receives a driving force to move toward the support portion 240, and the distance between the display device 100 and the focusing member 310 increases. The temperature of the deformation portion 212 can be controlled so that the degree of change in the length of each of the deformation portions 212 can be adjusted, and the distance between the display device 100 and the focusing member 310 can be controlled.

[0116] The restoring portion 252 has a restoring force, and thus, when the application of the electrical signal stops, the restoring portion 252 may be restored to the original state according to the increase in length of each of the deformation portions 212. The restoring force may act in a direction in which the distance between the display device 100 and the supporting portion 240 increases, and thus, the distance between the display device 100 and the focusing member 310 may be reduced.

[0117] Reference Fig.11, the driver 203 may include a deformation portion 212, a support portion 240, a restoration portion 254, and a drive controller 230. The deformation portion 212, the support portion 240, and the drive controller 230 may be connected to the reference Fig. 9 Those described are essentially the same.

[0118] The restoring portion 254 may be disposed between the supporting portion 240 and the display device 100. The restoring portion 254 may include a torsion spring. When the restoring portion 254 is twisted, the restoring portion 254 may have a restoring force to be restored to a state before the twisting. Both ends of each of the restoring portions 254 may contact the supporting portion 240 and the display device 100, respectively.

[0119] When an electrical signal is applied to the deformation portion 212, the temperature of each of the deformation portions 212 may increase, the length of each of the deformation portions 212 may decrease, and the display device 100 and the support portion 240 may approach each other. When the display device 100 and the support portion 240 approach each other, the restoration portion 254 may be twisted. Therefore, the display device 100 is away from the focusing member 310. For example, the display device 100 may be positioned to be separated from the focusing member 310 by a distance greater than a predetermined minimum distance. By controlling the temperature of each of the deformation portions 212, the degree of change in the length of each of the deformation portions 212 may be adjusted, and the distance between the display device 100 and the focusing member 310 may be controlled.

[0120] The restoring portion 254 has a restoring force that returns the restoring portion 254 to an initial state, and therefore, when application of the electrical signal stops, the restoring portion 254 may be restored to the original state according to the increase in length of the deformation portion 212. The restoring force may act in a direction in which the distance between the display device 100 and the supporting portion 240 increases. Therefore, the distance between the display device 100 and the focusing member 310 may be reduced.

[0121] As described above, the drivers 200, 201, 202, and 203 that may be provided in the image display device 1000 according to the exemplary embodiment may adopt a shape-changing material to have a small volume and increase the position driving range of the display device 100. The driving range of the display device 100 may be within about 1 mm. When the driving range is implemented by, for example, a voice coil motor, a piezoelectric actuator, etc., the volume increase is very large, and in the exemplary embodiment, the driving range may be implemented using a volume smaller than these.

[0122] Fig.12 A configuration and an optical arrangement of an image display device 2000 according to another example embodiment are shown. Fig.13 It is shown that the Fig.12FIG. 1 is a block diagram of an example of a configuration of the processor 800 in the image display device 2000 .

[0123] The image display apparatus 2000 may include a first display device 160 , a first driver 260 , a first light emitter 360 , a second display device 170 , a second driver 270 , and a second light emitter 370 .

[0124] The first driver 260 and the second driver 270 drive the positions of the first display device 160 and the second display device 170, respectively, and the first light emitter 360 and the second light emitter 370 transmit images formed by the first display device 160 and the second display device 170 to the left eye and the right eye of the observer, respectively.

[0125] The image display apparatus 2000 further includes a processor 800 and a memory 700. The processor 800 controls the first display device 160, the second display device 170, the first driver 260, and the second driver 270 according to the image information stored in the memory 700. The processor 800 may include a light modulation signal generator 810 and a drive signal generator 880. Program codes for operating the light modulation signal generator 810 and the drive signal generator 880 may be stored in the memory 700.

[0126] The image information stored in the memory 700 may include information about a pair of left-eye and right-eye images that can be perceived as a 3D image of one frame. The left-eye image and the right-eye image have a predetermined difference. The processor 800 generates light modulation signals SG1_L and SG1_R so that the left-eye image is formed on the first display device 160 and the right-eye image is formed on the second display device 170, and thus controls the first display device 160 and the second display device 170.

[0127] The image information may further include depth information related to the position of a virtual image plane VP on which the left eye image and the right eye image are to be imaged, and the processor 800 generates drive signals SG2_L and SG2_R so that the virtual image plane VP is formed according to the depth information, i.e., at a set depth position, and controls the first driver 260 and the second driver 270.

[0128] The depth information may be previously set with respect to the image of each frame and stored in the memory 700 , or the set depth information may be reflected to the image information according to execution of the representative depth extractor 830 included in the processor 800 .

[0129] The processor 800 may further include a scale factor generator 850 in addition to the light modulation signal generator 810 , the representative depth extractor 830 , and the driving signal generator 880 .

[0130] The scale factor generator 850 is different only in that the scale factor is generated according to the change in magnification between consecutive frame images with respect to the left eye image information and the right eye image information provided for the two eyes respectively, and is different from the reference image generator 850. Figure 4 and Figure 5 The scale factor generator 450 described is essentially the same.

[0131] The image display device 2000 according to an example embodiment can express a 3D image by combining a binocular disparity method and a depth expression. For an image including an object at a predetermined depth position, a vergence accommodation conflict (VAC) can be reduced by adjusting the position of a virtual image plane VP on which the image is imaged. In addition, an image in which an object exists at various depth positions can be formed on the virtual image plane VP, for example, using the depth position of a main object determined according to a saliency map as a representative depth position, and the remaining depth sense can be expressed as a binocular disparity, so that a 3D image can be perceived.

[0132] The above-mentioned image display devices 1000 and 2000 may be configured in a wearable form. All or some components of the image display devices 1000 and 2000 may be configured in a wearable form.

[0133] For example, the image display devices 1000 and 2000 may be applied in the form of a head mounted display (HMD). In addition, the image display devices 1000 and 2000 are not limited thereto, and may be applied to a glasses type display or a goggle type display.

[0134] The above-described image display apparatuses 1000 and 2000 may be applied to implement augmented reality (AR) because both an image formed on a display device and an image of a real world may be shown to an observer.

[0135] AR can further enhance the effect of reality by showing virtual objects or information combined in the real world environment. For example, at the observer's position, the image forming unit can form additional information about the environment provided by the real world and provide the additional information to the observer. AR displays can be applied to ubiquitous environments or Internet of Things (IoT) environments.

[0136] The image of the real world is not limited to the real environment, and may be, for example, an image formed by another image device. Therefore, the above-described image display apparatuses 1000 and 2000 may be applied to a multi-image display apparatus that displays two images together.

[0137] The image display devices 1000 and 2000 described above may be synchronized with or operated in conjunction with other electronic devices such as smart phones. For example, a processor for driving the image display devices 1000 and 2000 may be provided in a smart phone. In addition, the image display devices 1000 and 2000 described above may be provided in a smart phone.

[0138] The image display device can express a wide range of depth with a compact structure.

[0139] The above-mentioned image display device can provide a 3D image combining a binocular disparity method and depth expression.

[0140] The above-described image display device can be easily applied to wearable devices, and can be applied to, for example, a glasses-type AR display device or the like.

[0141] Although not limited thereto, the example embodiments may be implemented as computer-readable code on a computer-readable recording medium. A computer-readable recording medium is any data storage device capable of storing data that can thereafter be read by a computer system. Examples of computer-readable recording media include read-only memory (ROM), random-access memory (RAM), CD-ROM, magnetic tape, floppy disk, and optical data storage devices. The computer-readable recording medium may also be distributed on a network-coupled computer system so that the computer-readable code is stored and executed in a distributed manner. Furthermore, the example embodiments may be written as a computer program transmitted via a computer-readable transmission medium such as a carrier wave, and received and implemented in a general-purpose or special-purpose digital computer that executes the program. Furthermore, it should be understood that in the example embodiments, one or more units of the above-mentioned apparatus and device may include circuits, processors, microprocessors, etc., and may execute a computer program stored in a computer-readable medium.

[0142] The foregoing example embodiments are merely exemplary and should not be construed as limiting. This teaching can be easily applied to other types of devices. In addition, the description of the example embodiments is intended to be illustrative, rather than limiting the scope of the claims, and many alternatives, modifications, and variations will be apparent to those skilled in the art.

Claims

1. An image display device, include: a display device configured to modulate light to form an image; a light emitter including a focusing member and configured to change a direction of light incident on the light emitter to transmit the image to a preset position; a driver including a shape changing portion that contacts the display device and is configured to adjust a position of the display device disposed between the driver and the light emitter; as well as a processor configured to generate a drive signal according to image information and control the driver according to the drive signal to adjust a position of the display device relative to the focusing member according to the drive signal, Wherein, the processor is further configured to: generating a scaling factor to be applied to either of the images of two consecutive frames having different depth information, generating a light modulation signal by reflecting the scale factor to the image information, and controlling the display device according to the light modulation signal, Wherein, the processor is further configured to: Calculate the magnifications at which the images of the two consecutive frames are respectively imaged, and When the change value between the magnifications is equal to or less than a predetermined reference value, the scale factor is set to 1, and when the change value between the magnifications is greater than a predetermined reference value, the similarity of the images of the two consecutive frames is determined.

2. The image display device according to claim 1, in, The driver is further configured to move the display device in parallel such that a distance between the display device and the focusing member changes.

3. The image display device according to claim 1, in, The shape change portion may be deformed according to an applied signal to provide a driving force to the display device.

4. The image display device according to claim 3, in, The shape changing portion includes a material having a shape that changes due to heat.

5. The image display device according to claim 3, in, The shape changing portion includes a shape memory alloy or an electroactive polymer.

6. The image display device according to claim 1, in, The light transmitter is further configured to transmit the image as a magnified image onto a virtual image plane at a predetermined position.

7. The image display device according to claim 6, in, The image information includes depth information associated with a predetermined position of a virtual image plane relative to each of the images of the plurality of frames, and The processor is further configured to generate the driving signal according to the depth information.

8. The image display device according to claim 7, in, The depth information includes information previously set according to a saliency map with respect to each of the images of the plurality of frames.

9. The image display device according to claim 8, in, The processor is further configured to: When the similarity between the images of the two consecutive frames is equal to or less than the predetermined reference value, the scaling factor is set to 1, and When the similarity between the images of the two consecutive frames is greater than the predetermined reference value, the scale factor is set to a compensation value for compensating the change value.

10. The image display device according to claim 1, in, The processor is further configured to transmit the driving signal when a predetermined time has elapsed since the transmission of the light modulation signal with respect to an image of the same frame.

11. The image display device according to claim 10, in, The predetermined time is set to be equal to or greater than a predetermined vergence-accommodation time of the eye.

12. The image display device according to claim 1, in, The light emitter is further configured to combine first light including a first image from the display device with second light including a second image of a real environment, and transmit the combination of the first light and the second light to the preset position.

13. The image display device according to claim 12, in, The optical transmitter comprises: a beam splitter disposed obliquely with respect to a travel path of the first light and a travel path of the second light, and The focusing member.

14. The image display device according to claim 13, in, The beam splitter includes a half mirror.

15. The image display device according to claim 1, in, The display device includes a first display device and a second display device, The driver includes a first driver and a second driver, wherein the first driver and the second driver are respectively configured to drive the first display device and the second display device so that the positions of the first display device and the second display device change, and The light emitter includes a first light emitter and a second light emitter, and the first light emitter and the second light emitter are configured to transmit images formed by the first display device and the second display device to a preset left eye position and a preset right eye position, respectively.

16. The image display device according to claim 15, in, The image information includes information about a pair of left-eye and right-eye images to be perceived as a three-dimensional (3D) image of one frame, and Wherein the processor is further configured to control the first display device and the second display device so that the left-eye image is formed by the first display device and the right-eye image is formed by the second display device.

17. The image display device according to claim 16, in, The image information further includes: depth information related to the position of a virtual image plane on which the left-eye image and the right-eye image are to be imaged, and The processor is further configured to control the first driver and the second driver according to the depth information.

18. The image display device according to claim 15, in, The image display device is a wearable device.