Display device, and control method of display device
Patent Information
- Application Number
- KR1020210041720
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Filing Date
- 2021-03-31
- Publication Date
- 2026-09-15
- Estimated Expiration
- 2041-03-31
Smart Images

Figure 112021037712894-PAT00002_ABST
Abstract
Description
Technology Field
[0001] The present invention relates to a display device and a method for controlling a display device. Background Technology
[0002] Among display devices, there are electronic devices provided in a form that can be worn on the body. These electronic devices are commonly referred to as wearable devices. Wearable electronic devices are worn directly on the body, which can improve portability and user accessibility.
[0003] As an example of the above-mentioned wearable electronic device, there is a head-mounted display (head-mounted electronic device) that can be mounted on the wearer's head. HMDs can be broadly classified into see-through types that provide augmented reality (AR) and see-closed types that provide virtual reality (VR). The problem to be solved
[0004] The problem that the present invention aims to solve is to provide a compact display device.
[0005] The problems of the present invention are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below. means of solving the problem
[0006] A display device according to one embodiment for solving the above problem comprises: a display member for displaying an image; a camera mounting member disposed on the display member; a camera disposed on the camera mounting member; and a multi-channel lens disposed on the camera to cover the camera and the camera mounting member, wherein the camera includes an image sensor and detects the position of a user's pupil based on an image acquired from the camera.
[0007] The camera mounting member may include a support ring, a plurality of leg portions connected to the support ring, and a camera mounting portion connected to the plurality of leg portions.
[0008] The plurality of leg portions and the camera mounting portion may be arranged on a flat surface inside the support ring.
[0009] One side of each of the plurality of leg portions is connected to the support ring, and the other side of each of the plurality of leg portions can be connected to the camera mounting portion.
[0010] The plurality of leg portions and the camera mounting portion may protrude from the support ring in the direction where the user's pupil is located.
[0011] It may further include a camera connection wiring that is positioned on any one of the plurality of leg portions and connected to the camera.
[0012] The above camera mounting part can overlap with the center of the multi-channel lens on a plane.
[0013] The above camera can be positioned between the camera mounting part and the multi-channel lens.
[0014] The multi-channel lens includes a concave back surface facing the display member, and the camera can be accommodated in the space between the back surface of the multi-channel lens and the camera mounting part.
[0015] The multi-channel lens includes a plurality of sub-lenses, each providing a plurality of channels, and the plurality of leg portions may be arranged to overlap each of the boundaries between the plurality of sub-lenses.
[0016] Each of the above multiple sub-lenses can refract and reflect light emitted from different regions of the display member to provide VR images to the user.
[0017] The number of the plurality of leg portions may be less than or equal to the number of the plurality of sub-lenses.
[0018] The light emitted from the above-mentioned display member can pass between the plurality of leg portions.
[0019] The above camera may include a light source that emits light.
[0020] The above camera can receive light emitted from the light source and reflected from the user's pupil.
[0021] It further includes a light source that emits light, and said light source may be positioned on the outer surface of said multichannel lens.
[0022] The position of the user's pupil can be detected based on the light received by the camera.
[0023] A display device according to another embodiment for solving the above problem includes: a display member for displaying an image; a multi-channel lens disposed on the display member and comprising a front surface facing the user's eyeball and a concave back surface facing the display member; a camera mounting member in which at least a portion is accommodated in an internal space between the back surface of the multi-channel lens and the display member; and a camera disposed on the camera mounting member so as to face the back surface of the multi-channel lens.
[0024] The camera mounting member may include a support ring, a plurality of leg portions connected to the support ring, and a camera mounting portion connected to the plurality of leg portions.
[0025] The multi-channel lens includes a plurality of sub-lenses, each providing a plurality of channels, and the plurality of leg portions may be arranged to overlap each of the boundaries between the plurality of sub-lenses.
[0026] Specific details of other embodiments are included in the detailed description and drawings. Effects of the invention
[0027] A display device according to one embodiment can reduce the volume of the device and efficiently utilize the internal space of the device.
[0028] The effects according to the embodiments are not limited to those exemplified above, and a wider variety of effects are included in this specification. Brief explanation of the drawing
[0029] FIG. 1 is a perspective view of a display device according to one embodiment. FIG. 2 is an exploded view of a display device according to one embodiment. FIG. 3 is a plan view of a display device according to one embodiment. FIG. 4 is a perspective view of a first multi-channel lens according to one embodiment. FIG. 5 is a perspective view of a first camera mounting member according to one embodiment. FIG. 6 is a plan view of a first multi-channel lens according to one embodiment. FIG. 7 is a plan view of a first camera mounting member according to one embodiment. FIG. 8 is a cross-sectional view taken along A-A' of FIG. 3. FIG. 9 is a cross-sectional view of a display device according to another embodiment. FIG. 10 is a cross-sectional view of a first leg portion according to various embodiments. Figure 11 is a photograph showing the results of a visibility test of a camera mounting member according to the width of the leg portion. Figure 12 is a graph showing the visibility test results of a camera mounting member according to the width of the leg portion. Figure 13 is a photograph showing the results of a visibility test of a camera mounting member according to the width of the leg portion when the user rotates their eyeball. Figure 14 is a graph showing the results of a visibility test of a camera mounting member according to the width of the leg portion when the user rotates their eyeball. Specific details for implementing the invention
[0030] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various different forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims.
[0031] When elements or layers are referred to as being "on" another element or layer, this includes cases where another layer or element is interposed directly on or in the middle of another element. Throughout the specification, the same reference numerals refer to the same components. Shapes, sizes, ratios, angles, numbers, etc., disclosed in the drawings for describing embodiments are exemplary and therefore the invention is not limited to the depicted details.
[0032] Although terms such as "first," "second," etc., are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are used merely to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may also be the second component within the technical scope of the present invention.
[0033] Specific embodiments will be described below with reference to the attached drawings.
[0034] FIG. 1 is a perspective view of a display device according to one embodiment. FIG. 2 is an exploded perspective view of a display device according to one embodiment.
[0035] In the following description, the first direction (X), the second direction (Y), and the third direction (Z) intersect each other in different directions. For example, the first direction (X) may be the length direction, the second direction (Y) the width direction, and the third direction (Z) the thickness direction. The third direction (Z) may be the direction in which the user's eyeball is positioned or the direction in which the images of the first display member (DP1) and the second display member (DP2) described below are displayed. However, the above directions and names should be understood as relative and are not limited to the above examples.
[0036] The following display device (1) may include a head-mounted display device mounted on the user's head to provide a screen that displays images or video to the user.
[0037] A head-mounted display device may include a see-through type that provides augmented reality based on actual external objects and a see-closed type that provides virtual reality to the user through a screen independent of external objects. In the following description, a see-closed type head-mounted display device is exemplified but is not limited thereto.
[0038] Referring to FIGS. 1 and 2, the display device (1) may include a main frame (MF), a first display member (DP1), a second display member (DP2), a first multi-channel lens (LS1), a second multi-channel lens (LS2), a first camera mounting member (CS1), a second camera mounting member (CS2), a first camera (CMR1), and a second camera (CMR2).
[0039] The main frame (MF) can be worn on the user's face. The main frame (MF) may have a shape corresponding to the shape of the user's head (face). In one embodiment, the main frame (MF) may have a shape similar to glasses, but is not limited thereto.
[0040] The main frame (MF) can mount a first display member (DP1), a second display member (DP2), a first multi-channel lens (LS1) and a second multi-channel lens (LS2), a second first multi-channel lens (LS1) and a second multi-channel lens (LS2), a first camera mounting member (CS1), a second camera mounting member (CS2), a first camera (CMR1) and a second camera (CMR2). In some embodiments, the main frame (MF) may further include a structure such as a strap or band to facilitate mounting. In some embodiments, the main frame (MF) may further mount a control unit, an image processing unit, a lens housing unit, etc.
[0041] The first display member (DP1) and the second display member (DP2) display an image and / or video. Light for providing an image and / or video may be emitted from the first display member (DP1) and the second display member (DP2).
[0042] The first display member (DP1) and the second display member (DP2) may be provided in a fixed state on the main frame (MF) or may be provided detachably. The first display member (DP1) and the second display member (DP2) may be configured to be opaque, transparent, or translucent depending on the design of the display device (1), for example, the type of the display device (1). The first display member (DP1) and the second display member (DP2) may include electronic components such as a display module including a display panel described below, or a display device (1) such as a mobile terminal including a display panel, but are not limited thereto.
[0043] The first display member (DP1) and the second display member (DP2) may each include a display panel for displaying an image or video.
[0044] The display panel may be a light-emitting display panel comprising a light-emitting element. For example, the display panel may include, but is not limited to, an organic light-emitting display panel using an organic light-emitting diode including an organic light-emitting layer, a micro light-emitting diode display panel using a micro LED, a quantum dot light-emitting display panel using a quantum dot light-emitting diode including a quantum dot light-emitting layer, or an inorganic light-emitting display panel using an inorganic light-emitting element including an inorganic semiconductor.
[0045] In one embodiment, the display device (1) is provided with two mutually spaced display members corresponding to each of the user's two eyes, but is not limited thereto. In some embodiments, the first display member (DP1) and the second display member (DP2) may be replaced with a single display member positioned to overlap the first multi-channel lens (LS1) and the second multi-channel lens (LS2) and the second multi-channel lens (LS1) and the second multi-channel lens (LS2).
[0046] The first multi-channel lens (LS1), the second multi-channel lens (LS2), and the second multi-channel lens (LS2) can each pass light emitted from the first display member (DP1) or the second display member (DP2) to provide it to the user.
[0047] The first multi-channel lens (LS1) and the second multi-channel lens (LS2) can reflect and / or refract light emitted from the first display member (DP1) and the second display member (DP2) to provide it to the user. The first multi-channel lens (LS1) and the second multi-channel lens (LS2) can provide a plurality of channels that pass light emitted from the first display member (DP1) and the second display member (DP2). The plurality of channels can pass light emitted from the first display member (DP1) and the second display member (DP2) through different paths to provide it to the user. The light emitted from the first display member (DP1) and the second display member (DP2) is incident on each channel, and an enlarged image can be focused on the user's eye. The above plurality of channels can be implemented by a plurality of sub-lenses described later (see 'LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24' in FIG. 3).
[0048] The first multi-channel lens (LS1) may be placed on the first display member (DP1), and the second multi-channel lens (LS2) may be placed on the second display member (DP2). The first multi-channel lens (LS1) and the second multi-channel lens (LS2) may be placed at positions corresponding to the user's left and right eyes.
[0049] The first multi-channel lens (LS1) may be positioned to cover the first camera (CMR1) and the first camera mounting member (CS1). The second multi-channel lens (LS2) may be positioned to cover the second camera (CMR2) and the second camera mounting member (CS2). The detailed configuration of the first multi-channel lens (LS1) and the second multi-channel lens (LS2) will be described later in FIGS. 3 to 8.
[0050] The first camera mounting member (CS1) and the second camera mounting member (CS2) may be placed on the first display member (DP1) and the second display member (DP2), respectively. The first camera mounting member (CS1) may be placed between the first display member (DP1) and the first multi-channel lens (LS1), and the second camera mounting member (CS2) may be placed between the second display member (DP2) and the second multi-channel lens (LS2). The first camera mounting member (CS1) may mount the first camera (CMR1), and the second camera mounting member (CS2) may mount the second camera (CMR2). As the first camera (CMR1) and the second camera (CMR2) are arranged to overlap the first multi-channel lens (LS1) and the second multi-channel lens (LS2), respectively, by means of the first camera mounting member (CS1) and the second camera mounting member (CS2), the internal space of the display device (1) is efficiently utilized and the overall volume of the display device (1) can be reduced.
[0051] The first camera (CMR1) and the second camera (CMR2) may be placed on the first camera mounting member (CS1) and the second camera mounting member (CS2), respectively. The first camera (CMR1) may be placed between the first camera mounting member (CS1) and the first multi-channel lens (LS1), and the second camera (CMR2) may be placed between the second camera mounting member (CS2) and the second multi-channel lens (LS2).
[0052] The first display member (DP1), the first camera mounting member (CS1), the first camera (CMR1), and the first multi-channel lens (LS1) may be arranged to overlap in the third direction (Z). The second display member (DP2), the second camera mounting member (CS2), the second camera (CMR2), and the second multi-channel lens (LS2) may be arranged to overlap in the third direction (Z). The third direction (Z) may be the direction in which the user's eyeball is located.
[0053] The first camera (CMR1) and the second camera (CMR2) can capture images to detect the position of the user's pupil. The first camera (CMR1) and the second camera (CMR2) may include various types of cameras capable of detecting light reflected from the user's pupil, such as infrared cameras or visible light cameras, or photoelectric conversion elements such as image sensors that detect light and generate an electric charge. In one embodiment, the first camera (CMR1) and the second camera (CMR2) may include infrared cameras, but are not limited thereto.
[0054] In one embodiment, the first camera (CMR1) and the second camera (CMR2) may further include a light source that emits light for detecting the position of the user's pupil. The light may include visible light or infrared light. In one embodiment, the light source is integrally mounted in the first camera (CMR1) and the second camera (CMR2), but is not limited thereto.
[0055] In some embodiments, the light source may be mounted separately from the first camera (CMR1) and the second camera (CMR2) on the display device (1). In this case, although not illustrated, the light sources may be located adjacent to the first camera (CMR1) or the second camera (CMR2) on the first camera (CMR1) mounting portion or the second camera (CMR2) mounting portion described later, but are not limited thereto.
[0056] Although not illustrated, the display device (1) may further include a control unit that controls the overall operation of the display device (1).
[0057] The control unit can control the operation of the first camera (CMR1), the second camera (CMR2), and light sources. The control unit can calculate the position of the user's pupil by analyzing images captured by the first camera (CMR1) and the second camera (CMR2). Based on the calculated position of the user's pupil, the control unit can display a corresponding image on the first display member (DP1) and the second display member (DP2). The control unit may be implemented, for example, as a dedicated processor including an embedded processor, / or a general-purpose processor including a central processing unit or an application processor, but is not limited thereto.
[0058] FIG. 3 is a plan view of a display device according to one embodiment. FIG. 4 is a perspective view of a first multi-channel lens according to one embodiment. FIG. 5 is a perspective view of a first camera mounting member according to one embodiment. FIG. 6 is a plan view of a first multi-channel lens according to one embodiment. FIG. 7 is a plan view of a first camera mounting member according to one embodiment.
[0059] Referring to FIGS. 1 to 3, the first multi-channel lens (LS1) and the second multi-channel lens (LS2) may each be positioned at locations corresponding to the user's eyes. For example, the first multi-channel lens (LS1) and the second multi-channel lens (LS2) may be arranged symmetrically with respect to a virtual axis of the second direction (Y) passing between them. The first multi-channel lens (LS1) and the second multi-channel lens (LS2) may have substantially the same or similar shape and structure. The first multi-channel lens (LS1) and the second multi-channel lens (LS2) may have an approximate circular planar shape, but the planar shape of the first multi-channel lens (LS1) and the second multi-channel lens (LS2) is not limited thereto.
[0060] The first multi-channel lens (LS1) and the second multi-channel lens (LS2) may each include a plurality of sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24). The plurality of sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) may each provide a plurality of channels through which light emitted from the first display member (DP1) or the second display member (DP2) passes.
[0061] In one embodiment, the first multi-channel lens (LS1) and the second multi-channel lens (LS2) may each be composed of four sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24), but the number of sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) constituting one multi-channel lens (LS1, LS1) is not limited thereto. In some embodiments, the first multi-channel lens (LS1) and the second multi-channel lens (LS2) may be composed of three or fewer sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) or five or more sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24).
[0062] For convenience of explanation, the sub-lenses (LS11, LS12, LS13, LS14) constituting the first multi-channel lens (LS1) will be referred to as the first sub-lens (LS11), the second sub-lens (LS12), the third sub-lens (LS13), and the fourth sub-lens (LS14) located at the upper right, lower right, and lower left, respectively, with respect to the center of the first multi-channel lens (LS1). In addition, among the sub-lenses (LS21, LS22, LS23, LS24) constituting the second multi-channel lens (LS2), the sub-lens (LS21) located at the upper right, the sub-lens (LS22) located at the lower right, the sub-lens (LS23) located at the lower left, and the sub-lens (LS24) located at the upper left are respectively referred to as the fifth sub-lens (LS21), the sixth sub-lens (LS22), the seventh sub-lens (LS23), and the eighth sub-lens (LS24).
[0063] Referring to FIGS. 1 to 4, a plurality of sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) constituting the first multi-channel lens (LS1) or the second multi-channel lens (LS2) may have a shape symmetric with respect to the center of the first multi-channel lens (LS1) or the center of the second multi-channel lens (LS2). Specifically, the first sub-lens (LS11), the second sub-lens (LS12), the third sub-lens (LS13), and the fourth sub-lens (LS14) may have a shape symmetric with respect to the center of the first multi-channel lens (LS1). The fifth sub-lens (LS21), the sixth sub-lens (LS22), the seventh sub-lens (LS23), and the eighth sub-lens (LS24) may have a shape symmetric with respect to the center of the second multi-channel lens (LS2).
[0064] A plurality of sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) constituting the first multi-channel lens (LS1) or the second multi-channel lens (LS2) may be connected to one another integrally. Specifically, the first sub-lens (LS11), the second sub-lens (LS12), the third sub-lens (LS13), and the fourth sub-lens (LS14) may be processed to be connected integrally to form a single first multi-channel lens (LS1), and the fifth sub-lens (LS21), the sixth sub-lens (LS22), the seventh sub-lens (LS23), and the eighth sub-lens (LS24) may be processed to be connected integrally to form a single second multi-channel lens (LS2). That is, a single sub-lens may refer to a specific part or a specific area that provides one of the channels of the first multi-channel lens (LS1) or the second multi-channel lens (LS2). However, not limited thereto, in some embodiments, the first multi-channel lens (LS1) or the second multi-channel lens (LS2) may be a lens assembly comprising a plurality of mutually separated sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24).
[0065] Each of the multiple sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) may include at least one outer surface facing the user's eye.
[0066] Specifically, the first sub-lens (LS11) may include a first outer surface (LS11_NS) and a second outer surface (LS11_CS), the second sub-lens (LS12) may include a third outer surface (LS12_NS) and a fourth outer surface (LS12_CS), the third sub-lens (LS13) may include a fifth outer surface (LS13_NS) and a sixth outer surface (LS13_CS), and the fourth sub-lens (LS14) may include a seventh outer surface (LS14_NS) and an eighth outer surface (LS14_CS). The fifth sub-lens (LS21) may include a ninth outer surface (LS21_NS) and a tenth outer surface (LS21_CS), the sixth sub-lens (LS22) may include a eleventh outer surface (LS22_NS) and a twelfth outer surface (LS22_CS), the seventh sub-lens (LS23) may include a thirteenth outer surface (LS23_NS) and a fourteenth outer surface (LS23_CS), and the eighth sub-lens (LS24) may include a fifteenth outer surface (LS24_NS) and a sixteenth outer surface (LS24_CS).
[0067] As described above, the second multi-channel lens (LS2) may be substantially identical or similar to the first multi-channel lens (LS1). In one embodiment, the first outer surface (LS11_NS), the second outer surface (LS11_CS), the third outer surface (LS12_NS), the fourth outer surface (LS12_CS), the fifth outer surface (LS13_NS), the sixth outer surface (LS13_CS), the seventh outer surface (LS14_NS), and the eighth outer surface (LS14_CS) are substantially identical or similar to the ninth outer surface (LS21_NS), the tenth outer surface (LS21_CS), the eleventh outer surface (LS22_NS), the twelfth outer surface (LS22_CS), the thirteenth outer surface (LS23_NS), the fourteenth outer surface (LS23_CS), the fifteenth outer surface (LS24_NS), and the sixteenth outer surface (LS24_CS), respectively; therefore, the first outer surface (LS11_NS), the second outer surface (LS11_CS), and the third The explanation will focus on the outer surface (LS12_NS), the fourth outer surface (LS12_CS), the fifth outer surface (LS13_NS), the sixth outer surface (LS13_CS), the seventh outer surface (LS14_NS), and the eighth outer surface (LS14_CS).
[0068] The first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS) may extend from the edge of the first multichannel lens (LS1) toward the center of the first sub-lens (LS11). The first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS) may extend at an angle with respect to the third direction (Z). The first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS) may extend such that the width of the first multichannel lens (LS1) in the first direction (X) or the second direction (Y) narrows. In one embodiment, the first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS) may each be a flat inclined surface, but are not limited thereto. In some embodiments, the first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS) may each include a curved surface.
[0069] The second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS) may each extend toward the center of the first multichannel lens (LS1) from the first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS). In a plane, the second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS) may be arranged to surround the center of the first multichannel lens (LS1). The second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS) can be arranged to be interconnected along a counterclockwise direction with respect to the center of the first multichannel lens (LS1).
[0070] The second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS) may be positioned obliquely in the third direction (Z). The second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS) may be positioned obliquely to the first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS), respectively. As illustrated in FIG. 4, the corners of the portion connecting the first outer surface (LS11_NS) and the second outer surface (LS11_CS), the corners of the portion connecting the third outer surface (LS12_NS) and the fourth outer surface (LS12_CS), the corners of the portion connecting the fifth outer surface (LS13_NS) and the sixth outer surface (LS13_CS), and the corners of the portion connecting the seventh outer surface (LS14_NS) and the eighth outer surface (LS14_CS) may protrude in the third direction (Z) or the outer direction, but are not limited thereto.
[0071] The second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS) may be positioned to face the third direction (Z). The second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS) may each be referred to as an eye surface or a front surface facing the user's eyeball. The first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS) may each be connected to the second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), or the eighth outer surface (LS14_CS) and may be referred to as sides that do not face the user's eyeball.
[0072] In one embodiment, the second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS) may each be a convex surface protruding convexly in the third direction (Z), but are not limited thereto. In some embodiments, the second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS) may each include a flat surface.
[0073] At least one lens boundary may be defined between a plurality of sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) constituting the first multi-channel lens (LS1) or the second multi-channel lens (LS2). For example, if the first multi-channel lens (LS1) and the second multi-channel lens (LS2) each have four sub-lenses (four channels), a lens boundary having a cross shape in a plane may be defined on the first multi-channel lens (LS1) and the second multi-channel lens (LS2). However, the shape of the lens boundary is not limited thereto, and the shape of the lens boundary may vary in various ways depending on the design of the display device (1).
[0074] Referring to FIGS. 3 and 4, the lens boundary of the first multi-channel lens (LS1) may include a first lens boundary (BD1), a second lens boundary (BD2), a third lens boundary (BD3), and a fourth lens boundary (BD4), and the lens boundary of the second multi-channel lens (LS2) may include a fifth lens boundary (BD5), a sixth lens boundary (BD6), a seventh lens boundary (BD7), and an eighth lens boundary (BD8).
[0075] In the case of the first multi-channel lens (LS1), a first lens boundary (BD1) is defined between the second outer surface (LS11_CS) and the fourth outer surface (LS12_CS), a second lens boundary (BD2) is defined between the fourth outer surface (LS12_CS) and the sixth outer surface (LS13_CS), a third lens boundary (BD3) is defined between the sixth outer surface (LS13_CS) and the eighth outer surface (LS14_CS), and a fourth lens boundary (BD4) can be defined between the eighth outer surface (LS14_CS) and the second outer surface (LS11_CS). As illustrated in FIG. 4, the first lens boundary (BD1), the second lens boundary (BD2), the third lens boundary (BD3), and the fourth lens boundary (BD4) may be, but are not limited to, the valley portion between the second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS). Although not illustrated, in some embodiments, when the first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS) are arranged to be interconnected, the lens boundary may further include boundaries between the first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS).
[0076] Likewise, for the second multi-channel lens (LS2), a fifth lens boundary (BD5) may be defined between the tenth outer surface (LS21_CS) and the twelfth outer surface (LS22_CS), a sixth lens boundary (BD6) may be defined between the twelfth outer surface (LS22_CS) and the fourteenth outer surface (LS23_CS), a seventh lens boundary (BD7) may be defined between the fourteenth outer surface (LS23_CS) and the sixteenth outer surface (LS24_CS), and an eighth lens boundary (BD8) may be defined between the sixteenth outer surface (LS24_CS) and the tenth outer surface (LS21_CS). The fifth lens boundary (BD5), the sixth lens boundary (BD6), the seventh lens boundary (BD7), and the eighth lens boundary (BD8) may be substantially identical or similar to the first lens boundary (BD1), the second lens boundary (BD2), the third lens boundary (BD3), and the fourth lens boundary (BD4), respectively.
[0077] Referring to FIGS. 1, 2, 4 and 5, the first camera mounting member (CS1) may include a support ring (CS1_SP), a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) and a camera mounting portion (CS1_CP).
[0078] In one embodiment, the support ring (CS1_SP), the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4), and the camera mounting portion (CS1_CP) may be integrally molded. That is, the support ring (CS1_SP), the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4), and the camera mounting portion (CS1_CP) may represent a specific part or specific area of the first camera mounting member (CS1). However, this is not limited thereto, and the support ring (CS1_SP), the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4), and the camera mounting portion (CS1_CP) may be composed of separate members that are mutually distinguishable.
[0079] The support ring (CS1_SP) is connected to a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) and can support the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4). In one embodiment, the support ring (CS1_SP) is composed of a ring-shaped member corresponding to the edge shape of the first multi-channel lens (LS1), and the edge of the first multi-channel lens (LS1) can be mounted and supported on the support ring (CS1_SP). However, it is not limited thereto, and the support ring (CS1_SP) may have various planar shapes for supporting the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) and the first multi-channel lens (LS1), such as a rectangle, a square, or an ellipse. In some embodiments, the support ring (CS1_SP) may be replaced with a plurality of members that are positioned at each of the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) and support each of them.
[0080] Multiple leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be disposed inside the support ring (CS1_SP). One side of each of the multiple leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be connected to the support ring (CS1_SP), and the other side of each of the multiple leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be connected to the camera mounting portion (CS1_CP). The multiple leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be extended obliquely in the third direction (Z). Each other side of a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) and the camera mounting portion (CS1_CP) connected thereto may protrude in a third direction (Z) from the support ring (CS1_SP).
[0081] The camera mounting portion (CS1_CP) can be positioned on the inner side of the support ring (CS1_SP) to support the first camera (CMR1). The camera mounting portion (CS1_CP) can be positioned to overlap with the center of the first multi-channel lens (LS1). The camera mounting portion (CS1_CP) can be supported by a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4).
[0082] Referring further to FIG. 6, the support ring (CS1_SP), the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4), and the camera mounting portion (CS1_CP) may be arranged so as to overlap the edge portions of the plurality of sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) in a plane so as to allow most of the light passing through the plurality of sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) to pass through without being visible to the user. Light passing through the center portion of each of the multiple sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) is incident on the user's pupil, but light passing through the edge portions of the multiple sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24) can be blocked or refracted so as not to be incident on the user's pupil.
[0083] Multiple leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be arranged to overlap each of the multiple lens boundaries in a third direction (Z). Since light passing through the multiple lens boundaries is hardly incident on the user's eyeball due to refraction by the multiple sub-lenses (LS11, LS12, LS13, LS14, LS21, LS22, LS23, LS24), the multiple leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may not be visible to the user. The multiple lens boundaries may refer to specific parts or specific regions adjacent to the edges of each sub-lens, where light passing through them is not visible to the user due to refraction of light by the multi-channel lenses.
[0084] Light emitted from the first display member (DP1) can pass between the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) of the first camera mounting member (CS1) and be incident on the plurality of sub-lenses (LS11, LS12, LS13, LS14) of the first multi-channel lens (LS1). Between the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4), a plurality of holes (spaces) may be formed so as not to block the light passing through each of the sub-lenses. As shown in FIG. 6, the plurality of holes are arranged to overlap with the middle portions of the plurality of sub-lenses (LS11, LS12, LS13, LS14), and the area of the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) on a plane may be smaller than the area of the plurality of holes between them. Likewise, light emitted from the second display member (DP2) can pass between the multiple leg portions (CS2_LP1, CS2_LP2, CS2_LP3, CS2_LP4) of the second camera mounting member (CS2) and be incident on the multiple sub-lenses (LS21, LS22, LS23, LS24) of the second multi-channel lens (LS2).
[0085] A plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be arranged in a number corresponding to the number of sub-lenses (channels) of the first multi-channel lens (LS1). The number of the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be less than or equal to the number of sub-lenses (channels) of the first multi-channel lens (LS1). The number of the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be less than or equal to the number of boundaries between the sub-lenses of the first multi-channel lens (LS1). For example, if the first multi-channel lens (LS1) has n sub-lenses, the first camera mounting member (CS1) may have n or fewer leg portions. In one embodiment, the first multi-channel lens (LS1) may have four sub-lenses (channels) and the first camera mounting member (CS1) may have four leg portions, but is not limited thereto.
[0086] The first camera (CMR1) mounting portion may include a first leg portion (CS1_LP1) overlapping the first lens boundary (BD1), a second leg portion (CS1_LP2) overlapping the second lens boundary (BD2), a third leg portion (CS1_LP3) overlapping the third lens boundary (BD3), and a fourth leg portion (CS1_LP4) overlapping the fourth lens boundary (BD4).
[0087] The camera mounting portion (CS1_CP) and the first camera (CMR1) may be positioned to overlap with the center of the first multi-channel lens (LS1) and the third direction (Z). The camera mounting portion (CS1_CP) and the first camera (CMR1) may be positioned to overlap with the contact points or intersection points of a plurality of lens boundaries on a plane. For example, as shown in FIG. 6, the camera mounting portion (CS1_CP) and the first camera (CMR1) may be positioned to overlap with the intersection points of a cross shape formed by a plurality of lens boundaries on a plane.
[0088] Referring further to FIG. 7, a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may each have a first width (W1) of a fine size so as not to be visible to the user. The first width (W1) may be a width measured in a direction that intersects or is perpendicular to the extension direction from the support ring (CS1_SP) of each leg portion toward the camera mounting portion (CS1_CP).
[0089] For example, the first width (W1) may be about 3.0 mm or less. In this case, the diameter of the first multi-channel lens (LS1) may be about 30 mm to 60 mm. As another example, the first width (W1) may be about 1 / 13 to 1 / 20 of the diameter of the first multi-channel lens (LS1) in a planar plane. However, the size of the first width (W1) is not limited thereto and may vary depending on the design of the display device (1).
[0090] The camera mounting portion (CS1_CP) may have an approximate rhombus shape in a planar plane. However, it is not limited thereto, and the camera mounting portion (CS1_CP) may have various planar shapes such as a rectangle, square, circle, ellipse, or trapezoid.
[0091] The camera mounting portion (CS1_CP) may have a second width (W2) that is larger than the first width (W1) on a plane.
[0092] The second width (W2) may be a width measured in a diagonal direction intersecting the first direction (X) and the second direction (Y). The second width (W2) may be a width measured from the boundary between the first leg portion (CS1_LP1) and the second leg portion (CS1_LP2) to the boundary between the third leg portion (CS1_LP3) and the fourth leg portion (CS1_LP4), or a width measured from the boundary between the second leg portion (CS1_LP2) and the third leg portion (CS1_LP3) to the boundary between the first leg portion (CS1_LP1) and the fourth leg portion (CS1_LP4). The second width (W2) may be greater than or equal to the width of the first camera (CMR1).
[0093] For example, the second width (W2) may be approximately 6.0 mm. In this case, the planar size of the first camera (CMR1) may be approximately 5.0 mm x 5.0 mm, and the diameter of the first multi-channel lens (LS1) may be approximately 40 mm to 60 mm. As another example, the second width (W2) may be approximately twice the first width (W1). As yet another example, the second width (W2) may be approximately 1 / 6 to 1 / 10 of the diameter of the first multi-channel lens (LS1). However, the size of the second width (W2), the size of the first camera (CMR1), and the diameter of the first multi-channel lens (LS1) are not limited thereto and may vary in various ways depending on the design of the display device (1).
[0094] Referring to FIGS. 2 and 3, the second camera mounting member (CS2) may also include a support ring (CS2_SP), a plurality of leg portions (CS2_LP1, CS2_LP2, CS2_LP3, CS2_LP4), and a camera mounting portion (CS2_CP), just like the first camera mounting member (CS1).
[0095] Similar to what is shown in FIG. 6, the support ring (CS2_SP), a plurality of leg portions (CS2_LP1, CS2_LP2, CS2_LP3, CS2_LP4), the camera mounting portion (CS2_CP), and the second camera (CMR2) of the second camera mounting member (CS2) may be arranged in a manner substantially identical or similar to the support ring (CS1_SP), a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4), the camera mounting portion (CS1_CP), and the first camera (CMR1) of the first camera mounting member (CS1).
[0096] A plurality of leg portions (CS2_LP1, CS2_LP2, CS2_LP3, CS2_LP4) of the second camera mounting member (CS2) may be arranged to overlap each of the plurality of lens boundaries of the second multi-channel lens (LS2). The plurality of leg portions (CS2_LP1, CS2_LP2, CS2_LP3, CS2_LP4) of the second camera mounting member (CS2) may include a fifth leg portion (CS2_LP1), a sixth leg portion (CS2_LP2), a seventh leg portion (CS2_LP3), and an eighth leg portion (CS2_LP4) that overlap each of the fifth lens boundary (BD5), the sixth lens boundary (BD6), the seventh lens boundary (BD7), and the eighth lens boundary (BD8). The fifth leg section (CS2_LP1), the sixth leg section (CS2_LP2), the seventh leg section (CS2_LP3), and the eighth leg section (CS2_LP4) each have substantially the same or similar width as the first leg section (CS1_LP1), the second leg section (CS1_LP2), the third leg section (CS1_LP3), and the fourth leg section (CS1_LP4), so they may not be visible to the user.
[0097] Likewise, the support ring (CS2_SP) and the camera mounting portion (CS2_CP) of the second camera mounting member (CS2) can also be positioned to overlap with the edge portion of the second multi-channel lens (LS2) and the center of the second multi-channel lens (LS2), respectively, so as not to be visible to the user.
[0098] The display device (1) has a left-right symmetrical structure corresponding to the user's eyes, and since the second multi-channel lens (LS2), the second camera (CMR2) mounting member, and the second camera (CMR2) are substantially identical or similar to the first multi-channel lens (LS1), the first camera mounting member (CS1), and the first camera (CMR1), the following description will focus on the first multi-channel lens (LS1), the first camera mounting member (CS1), and the first camera (CMR1).
[0099] Figure 8 is a cross-sectional view taken along A-A' of Figure 3.
[0100] Referring to FIGS. 1 to 8, the first multi-channel lens (LS1) may include a back surface having a concave shape facing the first display member (DP1) and the first camera mounting member (CS1). Each back surface of a plurality of sub-lenses (LS11, LS12, LS13, LS14) constituting the first multi-channel lens (LS1) may form the back surface of the first multi-channel lens (LS1). The back surface of the first multi-channel lens (LS1) may be the opposite side of the eyepiece surface (the second outer surface (LS11_CS), the fourth outer surface (LS12_CS), the sixth outer surface (LS13_CS), and the eighth outer surface (LS14_CS)).
[0101] In cross-section, a concave internal space of an approximate triangular shape protruding toward the center of the first multi-channel lens (LS1) may be formed between the rear surface of the first multi-channel lens (LS1) and the support ring (CS1_SP) of the first camera mounting member (CS1). A plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) and a camera mounting portion (CS1_CP) may be accommodated in the internal space.
[0102] As described above, a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) of the first multi-channel lens (LS1) may be arranged to protrude in a third direction (Z) from the support ring (CS1_SP). Each leg portion (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be arranged to be spaced apart from the first multi-channel lens (LS1) at a constant distance. Each leg portion (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be arranged so as not to be in direct contact with the first multi-channel lens (LS1). However, this is not limited thereto, and a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may be arranged to be in contact with the first multi-channel lens (LS1).
[0103] As illustrated in FIG. 8, the second leg portion (CS1_LP2) and the fourth leg portion (CS1_LP4) may be positioned so as to be spaced apart from the back surface of the first multi-channel lens (LS1) at a constant distance in the third direction (Z). Although not illustrated, the first leg portion (CS1_LP1) and the third leg portion (CS1_LP3) may also be positioned so as to be spaced apart from the back surface of the first multi-channel lens (LS1) at a constant distance in the third direction (Z). For example, the first leg portion (CS1_LP1), the second leg portion (CS1_LP2), the third leg portion (CS1_LP3), and the fourth leg portion (CS1_LP4) may each be positioned so as to be spaced about 1.0 mm from the first multi-channel lens (LS1), but are not limited thereto.
[0104] The camera mounting portion (CS1_CP) overlaps with the center of the first multi-channel lens (LS1) in the third direction (Z) in cross-section and can extend in a direction parallel to the first display member (DP1). As the back surface of the first multi-channel lens (LS1) has a concave shape, a concave internal space can be formed between the camera mounting portion (CS1_CP) and the first multi-channel lens (LS1) to accommodate the first camera (CMR1).
[0105] The first camera (CMR1) overlaps with the center of the first multi-channel lens (LS1) in the third direction (Z) and can be accommodated in the concave space between the camera mounting part (CS1_CP) and the back surface of the first multi-channel lens (LS1).
[0106] The camera mounting portion (CS1_CP) may be positioned to form a space between the center and adjacent portion of the first multi-channel lens (LS1) and the camera mounting portion (CS1_CP) to accommodate the first camera (CMR1).
[0107] The camera mounting portion (CS1_CP) may be spaced apart from the back surface of the first multi-channel lens (LS1) in the third direction (Z) in cross-section. The distance in the third direction (Z) between the camera mounting portion (CS1_CP) and the back surface of the first multi-channel lens (LS1) may increase as it approaches the center of the first multi-channel lens (LS1). The distance between the camera mounting portion (CS1_CP) and the back surface of the first multi-channel lens (LS1) may have a maximum value at the center of the first multi-channel lens (LS1). The maximum distance between the camera mounting portion (CS1_CP) and the back surface of the first multi-channel lens (LS1) may be greater than or equal to the thickness in the third direction (Z) of the first camera (CMR1). For example, the maximum distance between the camera mounting portion (CS1_CP) and the back surface of the first multi-channel lens (LS1) may be approximately 5.0 mm, but is not limited thereto.
[0108] As described above, a plurality of sub-lenses (LS11, LS12, LS13, LS14) can each provide a plurality of channels through which light emitted from a first display member (DP1) or a second display member (DP2) passes. Each sub-lens can magnify the light emitted from a specific area of the first display member (DP1) or the second display member (DP2) to have the same magnification ratio or to have different magnification ratios. The light passing through each sub-lens includes a partial image for realizing a complete VR image, and said light can be focused on the user's pupil to provide a complete VR image to the user.
[0109] For example, as illustrated in FIG. 8, light emitted from different regions of the first display member (DP1) may pass through the first multi-channel lens (LS1) in different paths. The first sub-lens (LS11) may provide a channel through which light (IMG1) emitted from one region of the first display member (DP1) (e.g., the top of the first display member (DP1) in FIG. 8) passes, and the second sub-lens (LS12) may provide a channel through which light (IMG2) emitted from another region of the first display member (DP1) (e.g., the bottom of the first display member (DP1) in FIG. 8) passes. The first region of the first display member (DP1) may include a region in which at least a portion overlaps the first sub-lens (LS11) in the third direction (Z), and the other region of the second display member (DP2) may include a region in which at least a portion overlaps the second sub-lens (LS12) in the third direction (Z). Likewise, although not illustrated, a third sub-lens (LS13) and a fourth sub-lens (LS14) may each provide a channel through which light emitted from a specific area of the first display member (DP1) passes. In one embodiment, light passing through each sub-lens (LS11, LS12, LS13, LS14) may be provided to the user after undergoing two refractions and two reflections, but is not limited thereto.
[0110] In one embodiment, a light source for measuring the user's pupil may be integrally embedded in the first camera (CMR1). Light (IRL) emitted from the first camera (CMR1) may be reflected from the user's pupil and incident on the first camera (CMR1). The light (IRL) may include an image or pattern containing the user's pupil. Based on the light (IRL) received by the first camera (CMR1), the position of the user's pupil and the direction of the user's gaze may be calculated. As the light source is integrally embedded in the first camera (CMR1), the overall volume of the display device (1) is reduced, thereby enabling the implementation of a compact display device (1). In some embodiments, the light source may be configured separately from the first camera (CMR1) but may be mounted adjacent to the first camera (CMR1) on a camera mounting part (CS1_CP).
[0111] Referring to FIG. 8, the display device (1) may further include a camera connection wiring (CW) connected to the first camera (CMR1).
[0112] The camera connection wiring (CW) may be placed on the first camera mounting member (CS1). The camera connection wiring (CW) may be placed between the first camera mounting member (CS1) and the first multi-channel lens (LS1) in cross-section. The camera connection wiring (CW) may be placed on at least one of the camera mounting portion (CS1_CP) and a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4). For example, as shown in FIG. 8, the camera connection wiring (CW) may be placed on the second leg portion (CS1_LP2), but is not limited thereto. The camera connection wiring (CW) may also be placed on the first leg portion (CS1_LP1), the third leg portion (CS1_LP3), or the fourth leg portion (CS1_LP4).
[0113] The camera connection wiring (CW) may be disposed on one side of the camera mounting portion (CS1_CP) facing the first multi-channel lens (LS1) and on at least one side of a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4). In some embodiments, the camera connection wiring (CW) may be disposed on the other side of the camera mounting portion (CS1_CP) facing the first display member (DP1) and on at least one other side of a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4). The opposite side of the camera mounting part (CS1_CP) and at least one opposite side among the plurality of leg parts (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) may each be the opposite side of one side of the camera mounting part (CS1_CP) and the opposite side of at least one side of the plurality of leg parts (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4).
[0114] As described above, since the second multi-channel lens (LS2), the second camera (CMR2) mounting member, and the second camera (CMR2) are substantially identical or similar to the first multi-channel lens (LS1), the first camera mounting member (CS1), and the first camera (CMR1), respectively, redundant descriptions below will be omitted.
[0115] FIG. 9 is a cross-sectional view of a display device according to another embodiment.
[0116] The embodiment of FIG. 9 is mainly different from the embodiments of FIG. 1 to 8 in that the light source (L1, L2) is positioned on the outer surface of the first multi-channel lens (LS1).
[0117] Referring to FIG. 9, the display device (1) may include a first light source (L1) that is positioned on the outer surface of a first multi-channel lens (LS1) and emits light toward the user's pupil. In this case, the light source embedded in the first camera (CMR1) and the second camera (CMR2) may be omitted, but is not limited thereto.
[0118] Referring to FIGS. 3 and 4, the first light source (L1) may be placed on any one of the first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS). For example, as shown in FIG. 9, the first light source (L1) may be placed on the first outer surface (LS11_NS) of the first sub-lens (LS11), but is not limited thereto. As the first light source (L1) is placed on the first outer surface (LS11_NS), it may not block light passing through the second outer surface (LS11_CS) and may not obstruct the user's gaze.
[0119] The display device (1) may further include a second light source (L2) placed on a sub-lens (LS11, LS12, LS13, LS14) on which a first light source (L1) is placed, and another sub-lens (LS11, LS12, LS13, LS14) on which a first light source (L1) is placed. That is, the display device (1) may include a plurality of light sources (L1, L2).
[0120] The second light source (L2) may be placed on any one of the first outer surface (LS11_NS), the third outer surface (LS12_NS), the fifth outer surface (LS13_NS), and the seventh outer surface (LS14_NS). For example, as shown in FIG. 9, the second light source (L2) may be placed on the third outer surface (LS12_NS) of the second sub-lens (LS12), but is not limited thereto. As the second light source (L2) is further placed, the position of the user's pupil can be detected more accurately.
[0121] Unlike the embodiments of FIGS. 1 to 8, as the first light source (L1) and the second light source (L2) are placed on the first multi-channel lens (LS1), the distortion of light (IRL) by the first multi-channel lens (LS1) is reduced, and the size of the first camera (CMR1) and the camera mounting part (CS1_CP) can be reduced.
[0122] The first light source (L1) and the second light source (L2) may emit light (IRL) to detect the position of the user's pupil. The light (IRL) emitted from the first light source (L1) and the second light source (L2) may be reflected from the user's pupil and incident on the first camera (CMR1). The light (IRL) may be infrared or visible light, but is not limited thereto. Based on the light (IRL) received by the camera, the position of the user's pupil and the direction of the user's gaze may be calculated.
[0123] In FIG. 9, two light sources (L1, L2) are exemplified as a plurality of light sources (L1, L2), but the number of light sources (L1, L2) is not limited thereto. In some embodiments, three or more light sources (L1, L2) may be placed in the first multi-channel lens (LS1). In some embodiments, the second light source (L2) may be omitted, and only one first light source (L1) may be placed in the first multi-channel lens (LS1).
[0124] The embodiment of FIG. 9 is substantially identical or similar to the embodiments of FIG. 1 to 8 except that the light source (L1, L2) is positioned on the outer surface of the first multi-channel lens (LS1), so redundant descriptions below will be omitted.
[0125] FIG. 10 is a cross-sectional view of a first leg portion according to various embodiments.
[0126] Referring to FIGS. 1 to 10, the cross-sectional shape of a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) of the first camera mounting member (CS1) and the cross-sectional shape of a plurality of leg portions (CS2_LP1, CS2_LP2, CS2_LP3, CS2_LP4) of the second camera mounting member (CS2) may be substantially the same or similar. The following description will focus on the cross-sectional shape of the first leg portion (CS1_LP1).
[0127] Referring to FIG. 10(a), the first leg portion (CS1_LP1) may have a rectangular shape in cross-section. The first width (W1) of the first leg portion (CS1_LP1) may be greater than the first thickness (T1) in the third direction (Z) of the first leg portion (CS1_LP1). In some embodiments, the first width (W1) may be equal to the first thickness (T1). The first leg portion (CS1_LP1) may have a flat upper surface and a lower surface. This allows camera connection wiring (CW) to be easily placed on the upper or lower surface of the first leg portion (CS1_LP1). For example, the first thickness (T1) may be about 1.0 mm, but is not limited thereto.
[0128] Referring to Fig. 10(b), the first width (W1) may be smaller than the first thickness (T1). In this case, the second moment of area of the first leg portion (CS1_LP1) may increase compared to Fig. 10(a). The first leg portion (CS1_LP1) may have a flat upper surface and a convex lower surface. For example, the first thickness (T1) may be about 3.0 mm or more, but is not limited thereto.
[0129] Referring to FIG. 10(c), the first width (W1) is smaller than the first thickness (T1), and the first leg portion (CS1_LP1) may have a tapered cross-sectional shape in which the width in the horizontal direction decreases as it goes toward the lower surface. In this case, the first width (W1) may mean the maximum width of the first leg portion (CS1_LP1), that is, the width of the upper surface of the first leg portion (CS1_LP1). The side surface between the upper surface and the lower surface of the first leg portion (CS1_LP1) may be arranged to be inclined with respect to the third direction (Z). The width in the horizontal direction of the upper surface of the first leg portion (CS1_LP1) is substantially the same as the first width (W1), but the width in the horizontal direction of the lower surface of the first leg portion (CS1_LP1) may be smaller than the first width (W1).
[0130] A plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) of the first camera mounting member (CS1) and a plurality of leg portions (CS2_LP1, CS2_LP2, CS2_LP3, CS2_LP4) of the second camera mounting member (CS2) may each have a cross-sectional shape identical to any one of the cross-sectional shapes shown in FIGS. 10(a) to 10(c). However, the cross-sectional shape of the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) of the first camera mounting member (CS1) and the cross-sectional shape of the plurality of leg portions (CS2_LP1, CS2_LP2, CS2_LP3, CS2_LP4) of the second camera mounting member (CS2) are not limited thereto and may vary in various ways depending on the design of the display device (1). In some embodiments, at least one of the plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4, CS2_LP1, CS2_LP2, CS2_LP3, CS2_LP4) may have a cross-sectional shape different from the rest.
[0131] Figure 11 is a photograph showing the results of a visibility test of a camera mounting member according to the width of the leg portion. Figure 12 is a graph showing the results of a visibility test of a camera mounting member according to the width of the leg portion. Figure 13 is a photograph showing the results of a visibility test of a camera mounting member according to the width of the leg portion when the user rotates their eyeball. Figure 14 is a graph showing the results of a visibility test of a camera mounting member according to the width of the leg portion when the user rotates their eyeball.
[0132] FIG. 11 illustrates a test image taken under the assumption that the user's eyeball is gazing at the center of the first multi-channel lens (LS1). FIG. 12 illustrates the amount of light according to the position (distance) from the center of the first multi-channel lens (LS1).
[0133] The following test results were performed under conditions where the diameter of the first multi-channel lens (LS1) is about 45 mm, the first thickness (T1) is about 1.0 mm, and the dimensions of the camera are 5.0 mm x 5.0 mm.
[0134] Referring to FIG. 11, when the first width (W1) is approximately 1 mm to 7 mm, the first camera mounting member (CS1), for example, any of the multiple leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) of the first camera mounting member (CS1) are not visible in the test image. When the first width (W1) is approximately 8 mm to 9 mm, the first camera mounting member (CS1) is faintly visible in the test image. When the first width (W1) is approximately 10 mm, the first camera mounting member (CS1) is relatively clearly visible in the test image. That is, when the first width (W1) is 8 mm or more, the first camera mounting member (CS1) is visible to the user.
[0135] Referring to FIG. 12, the horizontal axis of the graph represents the position (distance) from the center of the first multi-channel lens (LS1), and the vertical axis of the graph represents the relative magnitude of the amount of light.
[0136] In the following, the specific position range (specific distance range) may be a range in which a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) of the first camera mounting member (CS1) are located relative to the center of the first multi-channel lens (LS1). For example, in the case of FIG. 12, the specific position range may be a position range spaced about 2.0mm to 3.0mm and -2.0mm to -3.0mm from the center of the first multi-channel lens (LS1).
[0137] When the first width (W1) is about 7 mm, the light intensity measured in a specific location range is about 8.625 to 8.875, which is similar to the light intensity measured in the surrounding area. When the first width (W1) is about 8 mm, the light intensity measured in a specific location range is roughly similar to the case where the first width (W1) is about 7 mm, but may be slightly smaller than the case where the first width (W1) is about 7 mm. When the first width (W1) is about 9 mm, the light intensity measured in a specific location range is about 8.3 to 8.8, which is significantly smaller than the case where the first width (W1) is about 7 mm or 8 mm. When the first width (W1) is about 10 mm, the light intensity measured in a specific location range is about 7.6 to 8.8, and the minimum value of the light intensity is much smaller than in other cases. That is, when the first width (W1) is about 7 mm or more, light is blocked by a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) of the first camera mounting member (CS1), and the user can see the first camera mounting member (CS1).
[0138] FIG. 13 illustrates a test image taken under the assumption that the user's eyeball is rotated approximately 15° relative to the center of the first multi-channel lens (LS1). FIG. 14 illustrates the amount of light according to the position (distance) from the center of the first multi-channel lens (LS1).
[0139] Referring to FIG. 13, when the first width (W1) is approximately 1.0 mm to 3.0 mm, the first camera mounting member (CS1) is barely visible in the test image. Similarly, when the first width (W1) is approximately 4.0 mm, the first camera mounting member (CS1) is barely visible or very faintly visible in the test image. When the first width (W1) is 6.0 mm or more, the first camera mounting member (CS1) is visible in the test image. When the first width (W1) is 8.0 mm or more, the first camera mounting member (CS1) is clearly visible in the test image. That is, unlike the case of FIG. 11, when the first width (W1) is approximately 4.0 mm or more, the user can confirm that the first camera (CMR1) mounting member is visible.
[0140] Referring to FIG. 14, the horizontal axis of the graph represents the position (distance) from the center of the first multi-channel lens (LS1), and the vertical axis of the graph represents the relative magnitude of the amount of light. In the case of FIG. 14, the specific position range described above may be a position range spaced about 2.5 mm to 7.5 mm from the center of the first multi-channel lens (LS1).
[0141] When the first width (W1) is about 3mm, the light intensity measured in a specific position range is about 7.0 to 7.5, which is similar to the light intensity measured in the surrounding area. On the other hand, when the first width (W1) is about 4mm or more, the light intensity measured in a specific position range is significantly lower than when the first width (W1) is about 3mm, and as the first width (W1) increases, the minimum value of the light intensity measured in a specific position range decreases. That is, when the first width (W1) is about 4mm or more, light is blocked by a plurality of leg portions (CS1_LP1, CS1_LP2, CS1_LP3, CS1_LP4) of the first camera mounting member (CS1), and the first camera mounting member (CS1) is visible to the user.
[0142] Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention may be implemented in other specific forms without changing the technical concept or essential features thereof. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. Explanation of the symbols
[0143] 1: Display device DP1: First indicator member DP2: Second indication member LS1: First multichannel lens LS2: Second multi-channel lens CS1: First camera mounting member CS2: Second camera mounting component CMR1: First camera CMR2: Second camera
Claims
Claim 1 A display device comprising: a display member for displaying an image; a camera mounting member disposed on the display member; a camera disposed on the camera mounting member; and a multi-channel lens disposed on the camera to cover the camera and the camera mounting member, wherein the camera includes an image sensor and detects the position of a user's pupil based on an image obtained from the camera, and the camera mounting member includes a support ring, a plurality of leg portions connected to the support ring, and a camera mounting portion connected to the plurality of leg portions. Claim 2 delete Claim 3 In claim 1, the plurality of leg portions and the camera mounting portion are arranged on a flat surface inside the support ring in a display device. Claim 4 A display device according to claim 3, wherein one side of each of the plurality of leg portions is connected to the support ring, and the other side of each of the plurality of leg portions is connected to the camera mounting portion. Claim 5 In claim 1, the plurality of leg portions and the camera mounting portion are a display device protruding from the support ring in the direction where the user's pupil is located. Claim 6 A display device according to claim 1, further comprising a camera connection wiring disposed on any one of the plurality of leg portions and connected to the camera. Claim 7 In claim 1, the camera mounting portion is a display device that overlaps with the center of the multi-channel lens on a plane. Claim 8 In claim 1, the camera is a display device disposed between the camera mounting part and the multi-channel lens. Claim 9 In claim 8, the multi-channel lens includes a concave back surface facing the display member, and the camera is a display device accommodated in the space between the back surface of the multi-channel lens and the camera mounting part. Claim 10 A display device according to claim 1, wherein the multi-channel lens comprises a plurality of sub-lenses each providing a plurality of channels, and the plurality of leg portions are arranged to overlap each of the boundaries between the plurality of sub-lenses. Claim 11 In claim 10, the plurality of sub-lenses each refract and reflect light emitted from different regions of the display member to provide a VR image to the user. Claim 12 A display device according to claim 11, wherein the number of the plurality of leg portions is less than or equal to the number of the plurality of sub-lenses. Claim 13 In claim 11, the light emitted from the display member passes between the plurality of leg portions in a display device. Claim 14 In claim 1, the camera is a display device comprising a light source that emits light. Claim 15 In claim 14, the camera is a display device that receives light emitted from the light source and reflected from the user's pupil. Claim 16 A display device according to claim 1, further comprising a light source that emits light, wherein the light source is disposed on the outer surface of the multi-channel lens. Claim 17 A display device according to claim 1 that detects the position of the user's pupil based on light received by the camera. Claim 18 A display device comprising: a display member for displaying an image; a multi-channel lens disposed on the display member and including a front surface facing the user's eyeball and a concave back surface facing the display member; a camera mounting member in which at least a portion is accommodated in an internal space between the back surface of the multi-channel lens and the display member; and a camera disposed on the camera mounting member so as to face the back surface of the multi-channel lens, wherein the camera mounting member comprises a support ring, a plurality of leg portions connected to the support ring, and a camera mounting portion connected to the plurality of leg portions. Claim 19 In claim 18, the camera mounting member comprises a support ring, a plurality of leg portions connected to the support ring, and a camera mounting portion connected to the plurality of leg portions, forming a display device. Claim 20 In claim 19, the multichannel lens comprises a plurality of sub-lenses each providing a plurality of channels, and the plurality of leg portions are arranged to overlap each of the boundaries between the plurality of sub-lenses.
Citation Information
Patent Citations
Head mounted display with full field of view and high resolution
US20020181115A1
Eye tracking device and virtual reality imaging apparatus
US20190293930A1
Head Mounted Display with Wide Field of View and Inset Display
US20200273426A1
Non-planar calculation display
KR1020200003890A
Display device with total internal reflection
US20180003862A1
