Device for providing augmented reality contents

Abstract

The present invention relates to an augmented reality content providing device capable of detecting a user's touch using a display light that displays an augmented reality content image. An augmented reality content providing device according to one embodiment of the present invention includes a display module that emits a display light that displays an augmented reality content image; an optical module that forms a path of the display light so that the augmented reality content image is displayed on a transparent lens and detects a change in the amount of light according to a user touch on the path of the display light to output light amount detection signals; and a control module that detects a user touch by analyzing the change in magnitude of the light amount detection signals and activates a user interface function according to the detection result.

Description

Technology Field

[0001] The present invention relates to an augmented reality content providing device. Background Technology

[0002] Recently, interest in virtual reality (VR) has been growing as electronic devices and display devices capable of implementing VR have been developed. Research is also being conducted on technologies that can realize augmented reality (AR) and mixed reality (MR) as the next steps after virtual reality.

[0003] Unlike virtual reality, which is based on a completely virtual world, augmented reality is a display technology that enhances the effect of reality by overlaying virtual objects or visual information onto a real-world environment.

[0004] While virtual reality has been applied restrictively to fields such as games and virtual experiences, augmented reality has the advantage of being applicable to various real-world environments. In particular, augmented reality is attracting attention as a next-generation display technology suitable for ubiquitous environments and the Internet of Things (IoT). This type of augmented reality can be considered an example of mixed reality in that it combines and displays additional information from the real and virtual worlds. The problem to be solved

[0005] The problem that the present invention aims to solve is to provide an augmented reality content providing device capable of detecting a user's touch and activating a user interface function using the display light of a display module that displays an augmented reality content image.

[0006] Another problem that the present invention aims to solve is to provide an augmented reality content providing device capable of preventing touch detection errors and interface malfunctions by displaying the touch detection status as an augmented reality content image in real time.

[0007] The problems of the present invention are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below. means of solving the problem

[0008] An augmented reality content providing device according to one embodiment for solving the above problem includes a display module that emits display light to display an augmented reality content image, an optical module that forms a path of the display light so that the augmented reality content image is displayed on a transparent lens and detects a change in the amount of light according to a user touch on the path of the display light and outputs light amount detection signals, and a control module that detects the user touch by analyzing the change in magnitude of the light amount detection signals and activates a user interface function according to the detection result.

[0009] The optical module includes a first reflective member that reflects the display light of the augmented reality content image displayed in the display module and supplies it to the transparency lens, and the first reflective member generates and outputs a light amount detection signal so as to correspond to the ambient light amount that varies according to the user touch, with the back surface or outer surface of the first reflective member being used as a touch surface.

[0010] The first reflective member includes a plurality of first light receiving sensing members that generate and output a light quantity detection signal whose size varies in response to a change in the amount of light incident from the display module and a change in the amount of ambient light.

[0011] The plurality of first light receiving sensing units includes a groove of a predetermined depth formed on the reflective surface of the first reflective member, and at least one light receiving sensor disposed in the groove in the frontal direction of the reflective surface. Here, the at least one light receiving sensor is an augmented reality content providing device that supplies a light quantity detection signal, the magnitude of which varies in response to changes in ambient light quantity and incident light quantity, to the control module.

[0012] The control module controls the operation of the display module so that the detection result of the user touch is displayed as the augmented reality content image, and can control the image display operation of the display module and the sensing operation of the sensing module in response to the user touch according to the activation of the user interface function.

[0013] The control module compares the average value of the light intensity detection signals with the magnitude value of each light intensity detection signal at least one frame period unit, extracts at least one first light receiving sensing unit that outputs a light intensity detection signal with a magnitude lower than a preset reference difference value relative to the average value of the light intensity detection signals, and the at least one first light receiving sensing unit that outputs a light intensity detection signal with a magnitude lower than the reference difference value relative to the average value determines that the user touch has occurred in the surroundings and can modulate video data for displaying the augmented reality content image.

[0014] The optical module includes a first reflective member that reflects the display light of the augmented reality content image displayed in the display module, and a second reflective member that reflects the display light reflected from the first reflective member again and supplies it to the transparency lens. The second reflective member may generate and output a light amount detection signal so as to correspond to the ambient light amount that varies according to the user touch, with the back surface or outer surface of the second reflective member being used as a touch surface.

[0015] The second reflective member includes a plurality of second light receiving sensing members that generate and output a light quantity detection signal whose magnitude varies in response to a change in the amount of light incident from the display module and a change in the amount of ambient light.

[0016] The plurality of second light receiving sensing units are disposed on the reflective surface of the second reflective member and may each be disposed in some of the outermost regions of the reflective surface, including the corner regions of the reflective surface.

[0017] The above display module is assembled on one or both sides of a support frame that supports the transparency lens, or is formed integrally with the support frame, so that the augmented reality content image can be displayed using at least one image display device. Effects of the invention

[0018] An augmented reality content providing device according to one embodiment of the present invention can activate user interface functions with a simpler and more efficient structure by detecting a user's touch using a display light that displays an augmented reality content image.

[0019] In addition, an augmented reality content providing device according to one embodiment of the present invention enables the touch detection status on the display light path of an augmented reality content image to be displayed in real time on the augmented reality content image. Accordingly, touch detection errors and interface malfunctions can be prevented, and user reliability can be improved.

[0020] The effects according to the embodiments are not limited to those exemplified above, and a wider variety of effects are included in this specification. Brief explanation of the drawing

[0021] FIG. 1 is a drawing showing an example of application of an augmented reality content providing device according to one embodiment of the present invention. FIG. 2 is a perspective view specifically showing an augmented reality content providing device applied in the form of glasses according to one embodiment of the present invention. FIG. 3 is an exploded perspective view of one side of the augmented reality content providing device shown in FIG. 2. FIG. 4 is a rear-facing exploded perspective view of the augmented reality content providing device shown in FIG. 2 and FIG. 3. Figure 5 is a top view showing the cross-section cut along the ZZ' line shown in Figure 4 in a top view. FIG. 6 is a diagram showing a structure that forms a display light path for an augmented reality content image displayed in the first display module shown in FIG. 5 in an optical module. FIG. 7 is a schematic diagram showing the first display module illustrated in FIG. 6. FIG. 8 is a layout diagram specifically showing the image display device illustrated in FIG. 7. Figure 9 is a layout diagram showing area A of Figure 8 in detail. FIG. 10 is a layout diagram showing in detail the pixels illustrated in area B of FIG. 9. FIG. 11 is a cross-sectional view showing an example of an image display device cut along line II' of FIG. 10. FIG. 12 is an enlarged cross-sectional view showing in detail an example of the light-emitting element of FIG. 11. FIG. 13 is a configuration diagram specifically showing the touch sensing structure of the first reflective member formed in the optical module of FIG. 6. Figure 14 is a diagram showing an example of displaying a user's touch detection area through an augmented reality content image. FIG. 15 is a configuration diagram of another embodiment specifically showing the touch sensing structure of the first reflective member illustrated in FIG. 13. FIG. 16 is a configuration diagram of another embodiment specifically showing the touch sensing structure of the first reflective member illustrated in FIG. 13. FIG. 17 is a drawing of another embodiment showing a structure forming a display light path for an augmented reality content image displayed in the first display module shown in FIG. 5 in an optical module. FIG. 18 is a configuration diagram of another embodiment specifically showing the touch sensing structure of the second reflective member illustrated in FIG. 17. FIG. 19 is a configuration diagram of another embodiment specifically showing the touch sensing structure of the second reflective member illustrated in FIG. 17. FIG. 20 is an exemplary drawing showing a watch-type smart device including a display module according to one embodiment of the present invention. FIG. 21 is an exemplary drawing showing an automobile instrument panel and a center fascia including a display module according to one embodiment of the present invention. FIG. 22 is an exemplary drawing showing a transparent display device including a display module according to one embodiment of the present invention. Specific details for implementing the invention

[0022] The advantages and features of the present invention and the methods for achieving them will become clear by referring to the embodiments described below in detail together with the accompanying drawings. However, the present invention is not limited to the embodiments disclosed below but may be implemented in various different forms. These embodiments are provided merely to ensure that the disclosure of the present invention is complete and to fully inform those skilled in the art of the scope of the invention, and the present invention is defined only by the scope of the claims.

[0023] When elements or layers are referred to as being "on" another element or layer, this includes cases where another layer or element is interposed directly on or in the middle of another element. Throughout the specification, the same reference numerals refer to the same components. Shapes, sizes, ratios, angles, numbers, etc., disclosed in the drawings for describing embodiments are exemplary and therefore the invention is not limited to the depicted details.

[0024] Although terms such as "first," "second," etc., are used to describe various components, it goes without saying that these components are not limited by these terms. These terms are used merely to distinguish one component from another. Therefore, it goes without saying that the first component mentioned below may also be the second component within the technical scope of the present invention.

[0025] The features of each of the various embodiments of the present invention may be combined or combined with one another, either partially or wholly, and may technically enable various interlocking and operation. Each embodiment may be implemented independently of one another or may be implemented together in an associated relationship.

[0026] Hereinafter, an augmented reality content providing device according to an embodiment of the present invention will be described in more detail with reference to the attached drawings.

[0027] FIG. 1 is a drawing showing an example of application of an augmented reality content providing device according to one embodiment of the present invention.

[0028] The augmented reality content providing device (200) illustrated in FIG. 1 may be formed integrally with a glasses-type frame that can be easily carried and attached or detached by the user, or formed in a form that is attached to or assembled to a glasses-type frame. The augmented reality content providing device (200) provides an augmented reality content image (MI) to the user's eyes through a transparent lens so that the augmented reality content image (MI) is superimposed on a real image seen through the user's eyes through a transparent lens. The augmented reality content displayed by the augmented reality content providing device (200) may include two-dimensional or three-dimensional image content, such as graphic images, captured images, text, etc., and sound content, etc.

[0029] An augmented reality content providing device (200) includes at least one display module for displaying an augmented reality content image (MI), and at least one optical module for forming a display path (or, light path) of the augmented reality content image (MI) so that the augmented reality content image (MI) displayed on the display module is perceived by the user's eye through a transparency lens.

[0030] The augmented reality content providing device (200) detects a user's touch by using the display light of an augmented reality content image (MI) displayed on a display module to touch an optical module or any surface adjacent to the optical module. To this end, the exterior of the optical module configured in the augmented reality content providing device (200) can be used as a touch surface where the user performs an interface.

[0031] To explain in more detail, the display module of the augmented reality content providing device (200) emits display light that displays an augmented reality content image (MI), and the optical module forms a display light path for the augmented reality content image (MI) so that the augmented reality content image (MI) is displayed on a transparent lens. Then, when a user touches the exterior of the optical module forming the light path, the optical module detects a change in the amount of light on the light path due to the user's touch, thereby detecting whether the user has touched the device and the location of the touch. In addition, the augmented reality content providing device (200) displays the touch detection status in real time on the augmented reality content image (MI) according to the change in the amount of light of the display light that displays the augmented reality content image (MI), and activates the user interface function. Accordingly, after touching the exterior of the optical module, the user can check the touch detection status and whether the user interface function is activated through the augmented reality content image (MI). The detailed components of the augmented reality content providing device (200) will be explained in more detail below with reference to the attached drawings.

[0032] FIG. 2 is a perspective view specifically showing an augmented reality content providing device applied in the form of glasses according to an embodiment of the present invention. FIG. 3 is an exploded perspective view of the augmented reality content providing device shown in FIG. 2 in a side direction, and FIG. 4 is an exploded perspective view of the augmented reality content providing device shown in FIG. 2 and FIG. 3 in a rear direction. FIG. 5 is a top view showing a cross-section cut along the ZZ' line shown in FIG. 4 in a top view.

[0033] Referring to FIGS. 2 to 5, the augmented reality content providing device (200) may be formed in the shape of glasses and may be integrally formed with at least one transparent lens (201) and a support frame (202) that supports at least one transparent lens (201).

[0034] The transparency lens (201) may be formed as a single unit for left and right, or it may be composed of first and second transparency lenses separated into left and right. The transparency lens (201), whether formed as a single unit for left and right or separated into first and second transparency lenses, may be formed as transparent or translucent using glass or plastic. As a result, the user can view an image of reality through the transparency lens (201), whether formed as a single unit for left and right or separated into first and second transparency lenses. Here, the transparency lens (201), that is, the single lens or the first and second transparency lenses, may have refractive power considering the user's eyesight.

[0035] The support frame (202) may be formed in the shape of eyeglasses, including an eyeglass frame and temples that support the rim of at least one transparent lens (201). The shape of the support frame (202) is not limited to the eyeglass shape and may be formed in the shape of goggles including the transparent lens (201) or in the shape of a head mountain.

[0036] The augmented reality content providing device (200) may be configured in a form assembled with a transparency lens (201) and a support frame (202). Such an augmented reality content providing device (200) includes at least one display module (210(a), 210(b)), at least one optical module (205, 206), a sensing module (240), and a control module (220).

[0037] Referring to FIG. 5, at least one display module (210(a), 210(b)) is integrally formed or assembled on one or both sides of a support frame (202) to display an augmented reality content image (MI) under the control of a control module (220). FIGS. 2 to 5 illustrate an example in which the first and second display modules (210(a), 210(b)) are each integrally formed on both sides of the support frame (202).

[0038] At least one display module (210(a), 210(b)) may include a micro-LED display, a nano-LED display, an organic light-emitting diode (OLED), an inorganic EL display, a quantum dot light-emitting diode (QED), a cathode ray tube (CRT), a liquid crystal display (LCD), etc. In the following, an example is described in which a micro-LED display is included in at least one display module (210(a), 210(b)), and unless a special distinction is required, the micro-LED display applied in the embodiment will be simply abbreviated as "display device." However, the embodiment is not limited to a micro-LED display device, and other display devices listed above or known in the art may be applied within the scope of sharing the technical concept.

[0039] At least one optical module (205, 206) forms an optical path so that display light of an augmented reality content image (MI) displayed in at least one display module (210(a), 210(b)) is transmitted to a transparency lens (201) and the augmented reality content image (MI) is displayed on the transparency lens (201). To this end, at least one optical module (205, 206) may be formed in a form that is integrally formed with or assembled with a left-right integrated transparency lens (201) or a first and second transparency lens separated into left and right. For example, at least one optical module (205, 206) may be formed integrally with a part of the transparency lens (201) by being embedded in the entire surface or a part of the transparency lens (201). FIGS. 2 to 5 illustrate an example in which the first and second optical modules (205, 206) are each integrally formed on both sides of a support frame (202).

[0040] For example, the first optical module (205) may include at least one reflective member (205(a), 205(b)) that reflects the display light of an augmented reality content image (MI) displayed in the first display module (210(a)) and supplies it to a transparency lens (201). Referring to the arrow in FIG. 5, the first optical module (205) may reflect the display light of an augmented reality content image (MI) displayed in the first display module (210(a)) to the first reflective member (205(a)), and reflect the display light reflected from the first reflective member (205(a)) to the second reflective member (205(b)) and supply it to a transparency lens (201).

[0041] The outer surface of the first optical module (205) can be used as a touch surface for a user to perform an interface. When a user's finger or writing instrument touches the outer surface of the first optical module (205), the amount of ambient light of the first optical module (205) is reduced. Accordingly, the amount of light incident on and reflected by at least one reflective member (205(a), 205(b)) that reflects the display light of the augmented reality content image (MI) is reduced. Accordingly, to detect the amount of light incident and reflected by at least one reflective member (205(a), 205(b)), at least one light receiving sensor is disposed on at least one reflective member (205(a), 205(b)). Accordingly, at least one light receiving sensor can supply a light amount detection signal that varies according to user touch to the control module (220).

[0042] In the case of the second optical module (206), it supplies display light of an augmented reality content image (MI) displayed in the second display module (210(b)) to a transparent lens (201). To this end, the second optical module (206) may also include at least one reflective member (206(a), 206(b)). Referring to the arrow in FIG. 5, the second optical module (206) may reflect the display light of an augmented reality content image (MI) displayed in the second display module (210(b)) to a third reflective member (206(a)), and reflect the display light reflected from the third reflective member (206(a)) to a fourth reflective member (206(b)) to supply it to the transparent lens (201).

[0043] The second optical module (206), like the first optical module (205), can also have its outer surface used as a touch surface for the user to perform an interface. That is, when a user's finger or writing instrument touches the outer surface of the second optical module (206), the amount of ambient light of the second optical module (206) is reduced. Accordingly, the amount of light incident on and reflected by at least one reflective member (206(a), 206(b)) is reduced. To detect the amount of light incident and reflected by at least one reflective member (206(a), 206(b)), at least one light receiving sensor is also placed on at least one reflective member (206(a), 206(b)). Accordingly, at least one light receiving sensor can supply a light amount detection signal that varies according to the user's touch to the control module (220). The detailed structure of the first and second optical modules (205, 206) will be described in more detail later with reference to the attached drawings.

[0044] Referring to FIG. 5, the transparency lens (201) may further include first and second optical panels (207, 208) that form a display light path for an augmented reality content image (MI) incident from the first and second optical modules (205, 206), respectively, and provide the display light of the augmented reality content image (MI) in the direction of the user's eyes. The first and second optical panels (207, 208) may be formed in the shape of a flat plate and may be arranged so that their respective planar directions face and correspond to the direction of the user's left and right eyes, respectively.

[0045] Each of the first and second optical panels (207, 208) is formed of transparent or translucent glass or acrylic, and may be formed in a circular, square, or polygonal planar shape. Each of the first and second optical panels (207, 208) may include a grating coupler formed on at least a portion of the front or back surface to form an optical waveguide that changes the display path of an augmented reality content image (MI). Each of the first and second optical panels (207, 208) is formed so that display light of an augmented reality content image (MI) incident from one direction and the other direction, respectively, is refracted in a direction predetermined by the surface of the first and second optical panels (207, 208) and the angle of the grating coupler and transmitted to the user's eye.

[0046] The sensing module (240) is assembled to or integrally formed with the exterior of the support frame (202) or the augmented reality content providing device (200) to sense the distance (or depth) to an object in the front direction of the support frame (202), illuminance, the direction of movement of the support frame (202), the distance traveled, the tilt, etc. To this end, the sensing module (240) may include a depth sensor such as an infrared sensor or a LiDAR sensor, and an image sensor such as a camera. Additionally, the sensing module (240) may further include first and second biosensors that detect movement information of the user's eyeball or pupil.

[0047] The control module (220) may be assembled on at least one side of the support frame (202) together with either of the first and second display modules (210(a), 210(b)) or formed integrally with the support frame (202).

[0048] The control module (220) modulates image data of augmented reality content, which is previously stored or received from an external source, to match image display characteristics such as resolution and driving frequency characteristics of the first and second display modules (210(a), 210(b)), and transmits it to the first and second display modules (210(a), 210(b)) respectively. Then, it simultaneously supplies driving control signals to the first and second display modules (210(a), 210(b)) to control the first and second display modules (210(a), 210(b)) so that they simultaneously display the augmented reality content image (MI).

[0049] While the control module (220) controls the display of an augmented reality content image (MI) in the first and second display modules (210(a), 210(b)), it receives a light intensity detection signal in real time through the first and second optical modules (205, 206). Then, based on the analysis result of the light intensity detection signal, it detects a user's touch on at least one of the first and second optical modules (205, 206). When a user's touch is detected, the control module (220) displays the user's touch detection result as an augmented reality content image (MI) and activates the user interface function. When the user interface function is activated, preset actions such as video display or motion detection may be performed according to the user's touch.

[0050] The detailed operation of the control module (220) is described more specifically as follows.

[0051] The control module (220) receives light intensity detection signals in real time from at least one light receiving sensor included in the first optical module (205) and at least one light receiving sensor included in the second optical module (206), respectively. Then, it performs digital conversion processing on the light intensity detection signals and compares the average value of the light intensity detection signals with the magnitude value of the light intensity detection signals of each light receiving sensor in a preset period of at least one frame. Then, it extracts at least one light receiving sensor that outputs a light intensity detection signal with a magnitude lower than a preset reference difference value relative to the average value. The control module (220) can determine that a user touch has occurred around the light receiving sensor that outputs a light intensity detection signal with a magnitude lower than the reference difference value relative to the average value. Accordingly, the control module (220) specifies the display area of ​​the augmented reality content image corresponding to the location information of the light receiving sensor where the user touch occurred, modulates the image data of the specified display area, and transmits it to the first and second display modules (210(a), 210(b)). Therefore, the touch detection status according to the change in the display light intensity of the augmented reality content image (MI) can be displayed in real time on the augmented reality content image (MI).

[0052] The function of performing a user interface by displaying the user touch detection location of the control module (220) as an augmented reality content image (MI) will be explained in detail later through the attached FIG. 14. In this way, after displaying the augmented reality content image (MI) for the touch detection state, the user interface function is activated so that pre-set actions such as video display or motion detection can be performed according to the user's touch.

[0053] FIG. 6 is a diagram showing a structure in which an optical module forms a display light path for an augmented reality content image displayed in the first display module shown in FIG. 5. FIG. 7 is a schematic diagram showing the first display module shown in FIG. 6.

[0054] Specifically, FIG. 6 illustrates a light path forming structure of a first optical module (205) that sequentially reflects display light of an augmented reality content image (MI) displayed in a first display module (210(a)) to first and second reflective members (205(a), 205(b)) and supplies it to a first optical panel (207) of a transparent lens (201). FIG. 6 illustrates an example of forming a light path using first and second reflective members (205(a), 205(b)), but the number of reflective members is not limited thereto and can be applied in a single or multiple number.

[0055] Referring to FIGS. 6 and 7, the first display module (210(a)) displays an augmented reality content image in the direction of the first reflective member (205(a)) so that the display light of the augmented reality content image is reflected from the first reflective member (205(a)). To this end, the first display module (210(a)) includes at least one image display device (110) for displaying the augmented reality content image, and an image transmission member (211) for applying the display light of the augmented reality content image in the direction of the first reflective member (205(a)). Here, the image transmission member (211) may include at least one optical member among an optical waveguide (e.g., a prism), a diffusion lens (112), and a focus forming lens (114). Accordingly, the augmented reality content image displayed through each video display device (110) can be provided in the direction of the first reflective member (205(a)) through an optical waveguide, a diffusion lens (112), and at least one focus forming lens (114), etc.

[0056] Display light of an augmented reality content image (MI) displayed in the first display module (210(a)) and reflected through the first reflective member (205(a)) is provided to the second reflective member (205(b)) according to the reflection angle of the first reflective member (205(a)). To this end, the incident angle and the exit angle of the first reflective member (205(a)) can be set so that the display light of the first display module (210(a)) is reflected to the second reflective member (205(b)).

[0057] The second reflective member (205(b)) reflects the display light of the augmented reality content image (MI) reflected from the first reflective member (205(a)) and supplies it to the first optical panel (207) of the transparency lens (201). To this end, the incident angle and the exit angle of the second reflective member (205(b)) can be set so that the display light reflected from the first reflective member (205(a)) is reflected to the first optical panel (207).

[0058] Meanwhile, the image display device (110) included in the first display module (210(a)) may include a micro-LED display device, a nano-LED display device, an organic light-emitting diode (OLED), an inorganic light-emitting diode (inorganic EL), a quantum dot light-emitting diode (QED), a cathode ray tube (CRT), a liquid crystal display (LCD), etc. In the following, an example is described in which the image display device (110) includes a micro-LED display device. However, the embodiment is not limited to a micro-LED display device, and other display devices listed above or known in the art field may be applied within the scope of sharing the technical concept.

[0059] As illustrated in FIGS. 7 and 8, touch detection display areas (IL1 to ILn) corresponding to the light receiving sensor forming area of ​​the first reflective member (205(a)) may be defined in the image display device (110). The control module (220) may define the touch detection display areas (IL1 to ILn) to correspond to the light receiving sensor forming area that outputs a light amount detection signal, and modulate the image data of the touch detection display areas (IL1 to ILn) according to the touch detection result.

[0060] For example, while the control module (220) controls the display of an augmented reality content image (MI) in the first and second display modules (210(a), 210(b)), it receives a light intensity detection signal in real time through the first and second optical modules (205, 206). Then, when a user's touch is detected, the image data of the touch detection display areas (IL1 to ILn) corresponding to the light receiving sensor formation area is modulated and displayed. For example, depending on the user's touch location, the image data of at least one of the touch detection display areas (IL1 to ILn) can be modulated into black gradation image data so that the touch detection display areas (IL1 to ILn) corresponding to the touch location are displayed in black. Then, the control module (220) activates the user interface function.

[0061] When the interface function is activated, the control module (220) can control augmented reality content display operations, such as adjusting the volume of audio or adjusting the brightness of the video according to the user's touch location. Additionally, it can modulate the object position of the augmented reality content image according to the user's touch location, or modulate the display color of the augmented reality content image through image data modulation. Additionally, it can control the sensing operation of the sensing module (240).

[0062] FIG. 8 is a layout diagram specifically showing the image display device illustrated in FIG. 7. FIG. 9 is a layout diagram showing area A of FIG. 8 in detail, and FIG. 10 is a layout diagram showing pixels illustrated in area B of FIG. 9 in detail.

[0063] In one embodiment according to FIGS. 8 to 10, the image display device (110) is described as having an LEDoS (Light Emitting Diode on Silicon) structure in which light-emitting diode elements are arranged on a semiconductor circuit board formed by a semiconductor process. However, it should be noted that the embodiments of this specification are not limited thereto. Furthermore, although the image display device (110) according to one embodiment of this specification is described primarily as being a micro-sized light-emitting diode display module (micro or nano light-emitting diode display module) that includes a micro-sized light-emitting diode (micro or nano light-emitting diode) as a light-emitting element, the embodiments of this specification are not limited thereto.

[0064] According to FIGS. 8 to 10, the first direction (DR1) indicates the horizontal direction of the image display device (110), the second direction (DR2) indicates the vertical direction of the image display device (110), and the third direction (DR3) indicates the thickness direction of the display panel (212) or the thickness direction of the semiconductor circuit board (215). Additionally, the fourth direction (DR4) indicates the diagonal direction of the display panel (212), and the fifth direction (DR5) indicates the diagonal direction intersecting the fourth direction (DR4). In this case, "left," "right," "up," and "down" indicate the direction when viewing the display panel (212) from a flat plane. For example, "right" indicates one side of the first direction (DR1), "left" indicates the other side of the first direction (DR1), "up" indicates one side of the second direction (DR2), and "down" indicates the other side of the second direction (DR2). Additionally, "upper" refers to one side of the third direction (DR3), and "lower" refers to the other side of the third direction (DR3).

[0065] Referring to FIGS. 8 to 10, the image display device (110) has a display panel (212) including a display area (DA) and a non-display area (NDA).

[0066] The display panel (212) of the image display device (110) may have a rectangular planar shape having a long side in the first direction (DR1) and a short side in the second direction (DR2). However, the planar shape of the display panel (212) is not limited to this, and may have a polygonal, circular, elliptical, or irregular planar shape other than a rectangle.

[0067] The display area (DA) is an area where an image is displayed, and the non-display area (NDA) may be an area where an image is not displayed. The planar shape of the display area (DA) may follow the planar shape of the display panel (212). FIG. 6 illustrates that the planar shape of the display area (DA) is rectangular. The display area (DA) may be placed in the central area of ​​the display panel (212). The non-display area (NDA) may be placed around the display area (DA). The non-display area (NDA) may be placed to surround the display area (DA).

[0068] In the display area (DA) of the display panel (212), touch detection display areas (IL1 to ILn) corresponding to the light receiving sensor forming area of ​​the first reflective member (205(a)) may be defined. Image data displayed through the touch detection display areas (IL1 to ILn) may be modulated and displayed by the control module (220) according to the user touch position.

[0069] The first pad section (PDA1) may be placed in the non-display area (NDA). The first pad section (PDA1) may be placed on the upper side of the display panel (212). The first pad section (PDA1) may include first pads (PD1) connected to an external circuit board. Meanwhile, the second pad section (PDA2) may be placed in the non-display area (NDA). The second pad section (PDA2) may be placed on the lower side of the semiconductor circuit board. The second pad section (PDA2) may include second pads for connecting to an external circuit board. Such a second pad section (PDA2) may be omitted.

[0070] The display area (DA) of the display panel (212) may include a plurality of pixels (PX). Each pixel (PX) may be defined as a minimum light-emitting unit capable of displaying white light in a defined pixel area (PX_d).

[0071] Pixels (PX) arranged as minimum units capable of displaying white light in each pixel area (PX_d) may include multiple light-emitting regions (EA1, EA2, EA3, EA4). In the embodiments of this specification, each pixel (PX) is exemplified as including four light-emitting regions (EA1, EA2, EA3, EA4) arranged in a PenTile matrix structure, but is not limited thereto. For example, each of the multiple pixels (PX) may include only three light-emitting regions (EA1, EA2, EA3).

[0072] Multiple light-emitting regions (EA1, EA2, EA3, EA4) for each pixel region (PX_d) may be partitioned by a partition (PW). The partition (PW) may be positioned to surround each of the first to fourth light-emitting elements (LE1 to LE4) placed in the light-emitting regions (EA1, EA2, EA3, EA4). The partition (PW) may be positioned apart from each of the first to fourth light-emitting elements (LE1 to LE4). Such a partition (PW) may have a planar shape in the form of a mesh, a net, or a grid.

[0073] In FIGS. 9 and 10, each of the plurality of light-emitting regions (EA1, EA2, EA3, EA4) defined by the partition (PW) is exemplified as having a rhombus-shaped planar form forming a pentile matrix structure, but the embodiments of this specification are not limited thereto. For example, each of the plurality of light-emitting regions (EA1, EA2, EA3, EA4) defined by the partition (PW) may have a polygonal shape other than a rhombus, such as a square or triangle, a circle, an ellipse, or an irregular shape.

[0074] Referring to FIG. 10, among a plurality of light-emitting regions (EA1, EA2, EA3, EA4), the first light-emitting region (EA1) may include a first light-emitting element (LE1) that emits a first light, the second light-emitting region (EA2) may include a second light-emitting element (LE2) that emits a second light, the third light-emitting region (EA3) may include a third light-emitting element (LE4) that emits a third light, and the fourth light-emitting region (EA4) may include a fourth light-emitting element (LE4) that emits a fourth light. The first light may be light of a wavelength band that embodies any one of red, green, or blue colors. The second light may be light of a wavelength band that embodies any one of red, green, or blue colors different from the first light. On the other hand, the third light may be light of a wavelength band that embodies any one of red, green, or blue colors different from the first and second lights. The fourth light may be light of a wavelength band identical to any one of the first to third lights.

[0075] Although the first to fourth light-emitting elements (LE1 to LE4) each included in the first to fourth light-emitting regions (EA1 to EA4) arranged in a pentile matrix structure have a planar shape in the shape of a rhombus, the embodiments of this specification are not limited thereto. For example, each of the first to fourth light-emitting elements (LE1 to LE4) may be formed in a shape other than a rhombus, such as a polygon or square, a circle, an ellipse, or an irregular shape.

[0076] Each of the first light-emitting regions (EA1) indicates a region that emits first light. Each of the first light-emitting regions (EA1) outputs first light emitted from the first light-emitting element (LE1). As described above, the first light may be light of a wavelength band that embodies any one of red, green, or blue colors. For example, the first light may be light of a red wavelength band. The red wavelength band may be approximately 600 nm to 750 nm, but the embodiments of the present specification are not limited thereto.

[0077] Each of the second light-emitting regions (EA2) indicates a region that emits second light. Each of the second light-emitting regions (EA2) outputs second light emitted from the second light-emitting element (LE2). The second light may be light of a wavelength band that embodies a color different from the first light among red, blue, and green. For example, the second light may be light of a blue wavelength band. The blue wavelength band may be approximately 370 nm to 460 nm, but the embodiments of the present specification are not limited thereto.

[0078] Each of the third light-emitting regions (EA3) indicates a region that emits third light. Each of the third light-emitting regions (EA3) outputs third light emitted from the third light-emitting element (LE3). The third light may be light of a wavelength band that embodies a color different from the first and second light among red, blue, and green. For example, the third light may be light of a green wavelength band. The green wavelength band may be approximately 480 nm to 560 nm, but the embodiments of the present specification are not limited thereto.

[0079] Each of the fourth light-emitting regions (EA4) indicates a region that emits the fourth light. Each of the fourth light-emitting regions (EA4) outputs the fourth light emitted from the fourth light-emitting element (LE4). Here, the fourth light may be light of a wavelength band that exhibits the same color as any one of the first to third lights. For example, the fourth light may be light of a blue wavelength band identical to the second light, and may be light of a green wavelength band identical to the third light. The embodiments of this specification are not limited thereto.

[0080] The second light-emitting regions (EA2) of each pixel (PX) can be alternately arranged with the fourth light-emitting regions (EA4) of adjacent pixels (PX) along the first direction (DR1), which is the horizontal (or row) direction. Also, the first light-emitting regions (EA1) and third light-emitting regions (EA3) of each pixel (PX) can be alternately arranged along the first direction (DR1), which is the horizontal (or row) direction. On the other hand, the fourth light-emitting regions (EA4) of each pixel (PX) can be alternately arranged with the second light-emitting regions (EA2) of adjacent pixels (PX) along the first direction (DR1), which is the horizontal (or row) direction.

[0081] The first light-emitting region (EA1) and the fourth light-emitting region (EA4) are alternately arranged in the fourth direction (DR4), which is the first diagonal direction, and the second light-emitting region (EA2) and the third light-emitting region (EA3) are also alternately arranged in the fourth direction (DR4), which is the first diagonal direction. Accordingly, the second light-emitting region (EA2) and the first light-emitting region (EA1) are alternately arranged in the fifth direction (DR5), which is the second diagonal direction intersecting the first diagonal direction, and the third light-emitting region (EA3) and the fourth light-emitting region (EA4) are also alternately arranged in the fifth direction (DR5), which is the second diagonal direction, so that each pixel (PX) can also be arranged and configured in a pen tile matrix structure overall.

[0082] The size or planar area of ​​each of the first to fourth light-emitting regions (EA1 to EA4) of each pixel (PX) may be formed to be the same or different from one another. Likewise, the size or planar area of ​​each of the first to fourth light-emitting elements (LE1 to LE4) formed in each of the first to fourth light-emitting regions (EA1 to EA4) may also be formed to be the same or different from one another.

[0083] Specifically, the area of ​​the first light-emitting region (EA1), the area of ​​the second light-emitting region (EA2), the area of ​​the third light-emitting region (EA3), and the area of ​​the fourth light-emitting region (EA4) may be substantially the same, but the embodiments of the present specification are not limited thereto. For example, the areas of the first and second light-emitting regions (EA1, EA2) may be different, the areas of the second and third light-emitting regions (EA2, EA3) may also be different, and the areas of the third and fourth light-emitting regions (EA3, EA4) may also be different. In this case, the areas of at least two of the first to fourth light-emitting regions (EA1 to EA4) may be the same.

[0084] The distance between the first and second light-emitting regions (EA1, EA2) adjacent to each other in the horizontal or diagonal direction, the distance between the second and third light-emitting regions (EA2, EA3), the distance between the third and fourth light-emitting regions (EA3, EA4), and the distance between the first and fourth light-emitting regions (EA1, EA4) may be the same, but may differ depending on the varying area. The embodiments of this specification are not limited thereto.

[0085] Examples in which a first light-emitting region (EA1) emits a first light, a second light-emitting region (EA2) emits a second light, a third light-emitting region (EA3) emits a third light, and a fourth light-emitting region (EA4) emits light identical to any one of the first to third lights are also not limited thereto. At least one light-emitting region among the first to fourth light-emitting regions (EA1 to EA4) may emit a fifth light. Here, the fifth light may be light in the yellow wavelength band. That is, the main peak wavelength of the fifth light may be located approximately 550 nm to 600 nm, but the embodiments of the present specification are not limited thereto.

[0086] FIG. 11 is a cross-sectional view showing an example of an image display device cut along line II' of FIG. 10. FIG. 12 is an enlarged cross-sectional view showing in detail an example of a light-emitting element of FIG. 11.

[0087] Referring to FIGS. 11 and 12, the display panel (212) may include a semiconductor circuit board (215), a conductive connection layer (216), and a light-emitting element layer (217).

[0088] The semiconductor circuit board (215) may include a plurality of pixel circuit sections (PXC) and pixel electrodes (214). The conductive connection layer (216) may include connection electrodes (213), first pads (PD1), a common connection electrode (CCE), a first insulating film (INS1), and a conductive pattern (213R).

[0089] The semiconductor circuit board (215) may be a silicon wafer substrate formed using a semiconductor process. A plurality of pixel circuit sections (PXCs) of the semiconductor circuit board (215) may be formed using a semiconductor process.

[0090] Multiple pixel circuits (PXCs) may be placed in a display area (DA in FIG. 6). Each of the multiple pixel circuits (PXCs) may be connected to a corresponding pixel electrode (214). That is, the multiple pixel circuits (PXCs) and the multiple pixel electrodes (214) may be connected in a one-to-one correspondence. Each of the multiple pixel circuits (PXCs) may be superimposed with one of the corresponding light-emitting elements (LE1 to LE4) in the third direction (DR3). Each of the pixel circuits (PXCs) may have various other modified circuit structures applied, such as a 3T1C structure, a 2T1C structure, a 7T1C structure, or a 6T1C structure.

[0091] Each of the pixel electrodes (214) may be disposed on the corresponding pixel circuit (PXC). Each of the pixel electrodes (214) may be an exposed electrode exposed from the pixel circuit (PXC). That is, each of the pixel electrodes (214) may protrude from the upper surface of the pixel circuit (PXC). Each of the pixel electrodes (214) may be formed integrally with the pixel circuit (PXC). Each of the pixel electrodes (214) may receive a pixel voltage or an anode voltage from the pixel circuit (PXC). The pixel electrodes (214) may be formed of aluminum (Al).

[0092] Each of the connecting electrodes (213) may be disposed on the corresponding pixel electrode (214). Each of the connecting electrodes (213) may be disposed on the pixel electrode (214). The connecting electrodes (213) may include a metal material for bonding the pixel electrodes (214) and each light-emitting element (LE1 to LE4).

[0093] The common connection electrode (CCE) may be positioned apart from the pixel electrode (214) and the connection electrode (213). The common connection electrode (CCE) may be positioned to surround the pixel electrode (214) and the connection electrode (213). The common connection electrode (CCE) may be connected to one of the first pads (PD1) of the first pad portion (PDA1) of the non-display area (NDA) to receive a common voltage. The common connection electrode (CCE) may contain the same material as the connection electrodes (213).

[0094] A first insulating film (INS1) may be disposed on the common connecting electrode (CCE). In the first direction (DR1) or the second direction (DR2), the width of the first insulating film (INS1) may be smaller than the width of the common connecting electrode (CCE). As a result, a portion of the upper surface of the common connecting electrode (CCE) may be exposed without being covered by the first insulating film (INS1). The portion of the upper surface of the common connecting electrode (CCE) exposed without being covered by the first insulating film (INS1) may come into contact with the common electrode (CE). Therefore, the common electrode (CE) may be connected to the common connecting electrode (CCE).

[0095] A conductive pattern (112R) may be disposed on the first insulating film (INS1). The conductive pattern (213R) may be disposed between the first insulating film (INS1) and the partition (PW). The width of the conductive pattern (213R) may be substantially the same as the width of the first insulating film (INS1) or the width of the partition (PW). The conductive pattern (213R) corresponds to a residue formed by the same process as the connecting electrodes (213) and the common connecting electrode (CCE).

[0096] The light-emitting element layer (217) may include each light-emitting element (LE1, LE2, LE3, LE4), a partition (PW), a second insulating film (INS2), a common electrode (CE), a reflective film (RF), a light-blocking member (BM), and an optical pattern (LP).

[0097] The light-emitting element layer (217) may include first to fourth light-emitting regions (EA1 to EA4) partitioned by a partition wall (PW). At least one component among a light-emitting element (LE) and an optical pattern (LP) may be disposed in each of the first to fourth light-emitting regions (EA1 to EA4).

[0098] The light-emitting elements (LE1, LE2, LE3) of FIG. 12 may be placed on a connecting electrode (213) in each light-emitting region (EA1 to EA3). The length (or height) of the third direction (DR3) of each light-emitting element (LE1, LE2, LE3) may be longer than the length in the horizontal direction. The length in the horizontal direction refers to the length in the first direction (DR1) or the length in the second direction (DR2). For example, the length of the third direction (DR3) of the first light-emitting element (LE1) may be approximately 1 μm to 5 μm.

[0099] Referring to FIG. 12, each light-emitting element (LE1, LE2, LE3, LE4) includes a first semiconductor layer (SEM1), an electron blocking layer (EBL), an active layer (MQW), a superlattice layer (SLT), and a second semiconductor layer (SEM2). The first semiconductor layer (SEM1), the electron blocking layer (EBL), the active layer (MQW), the superlattice layer (SLT), and the second semiconductor layer (SEM2) can be sequentially stacked in a third direction (DR3).

[0100] The first semiconductor layer (SEM1) may be disposed on the connecting electrode (213). The first semiconductor layer (SEM1) may be a semiconductor layer doped with a first conductivity type dopant such as Mg, Zn, Ca, Se, Ba, etc. For example, the first semiconductor layer (31) may be p-GaN doped with p-type Mg. The thickness of the first semiconductor layer (SEM1) may be approximately 30 to 200 nm.

[0101] An electron blocking layer (EBL) may be placed on the first semiconductor layer (SEM1). The electron blocking layer (EBL) may be a layer for suppressing or preventing too many electrons from flowing into the active layer (MQW). For example, the electron blocking layer (EBL) may be p-AlGaN doped with p-type Mg. The thickness of the electron blocking layer (EBL) may be approximately 10 to 50 nm. The electron blocking layer (EBL) may be omitted.

[0102] The active layer (MQW) may be divided into first to third active layers. Each of the first to third active layers may include a material having a single or multiple quantum well structure. When each of the first to third active layers includes a material having a multiple quantum well structure, the structure may be one in which multiple well layers and barrier layers are alternately stacked. In this case, the first active layer may include InGaN or GaAs, and the second and third active layers may include InGaN, but are not limited thereto. Here, the first active layer may emit light through the coupling of electron-hole pairs according to an electrical signal. The first active layer may emit first light, i.e., light in the red wavelength band, having a main peak wavelength in the range of approximately 600 nm to 750 nm. The second active layer may emit light through the coupling of electron-hole pairs according to an electrical signal. The second active layer can emit a third light, i.e., light in the green wavelength band, having a main peak wavelength in the range of approximately 480 nm to 560 nm. The third active layer can emit light by the coupling of electron-hole pairs according to an electrical signal. The third active layer can emit a second light, i.e., light in the blue wavelength band, having a main peak wavelength in the range of approximately 370 nm to 460 nm.

[0103] Each of the first to third active layers may have a different color of light emitted depending on the indium content. For example, as the indium content decreases, the wavelength band of the light emitted by each of the first to third active layers may shift to a red wavelength band, and as the indium content increases, the wavelength band of the emitted light may shift to a blue wavelength band. The indium (In) content of the first active layer may be higher than the indium (In) content of the second active layer, and the indium (In) content of the second active layer may be higher than the indium (In) content of the third active layer. For example, the indium (In) content of the third active layer may be 15%, the indium (In) content of the second active layer may be 25%, and the indium (In) content of the first active layer may be 35% or more.

[0104] Since the color of the emitted light may vary depending on the indium content of each of the first to third active layers, the light-emitting layer (217) of each light-emitting element (LE1, LE2, LE3) may emit light such as the first light, second light, and third light, which may be the same or different depending on the indium content. For example, if the indium (In) content in the first to third active layers of the first light-emitting element (LE1) is set to within 15%, the first light in the red wavelength band, with a main peak wavelength in the range of approximately 600 nm to 750 nm, can be emitted. And, if the indium (In) content in the first to third active layers of the second light-emitting element (LE2) is set to 25%, the second light in the green wavelength band, with a main peak wavelength in the range of approximately 480 nm to 560 nm, can be emitted. In addition, if the content of indium (In) in the first to third active layers of the third light-emitting element (LE3) is 35% or more, it can emit third light in a blue wavelength band having a main peak wavelength in the range of approximately 370 nm to 460 nm. By controlling and setting the content of indium (In) in the first to third active layers of the fourth light-emitting element (LE4), the fourth light-emitting element (LE4) can also emit first to third light or emit another fourth light.

[0105] A superlattice layer (SLT) may be disposed on the active layer (MQW). The superlattice layer (SLT) may be a layer for relieving stress between the second semiconductor layer (SEM2) and the active layer (MQW). For example, the superlattice layer (SLT) may be formed of InGaN or GaN. The thickness of the superlattice layer (SLT) may be approximately 50 to 200 nm. The superlattice layer (SLT) may be omitted.

[0106] The second semiconductor layer (SEM2) may be disposed on the superlattice layer (SLT). The second semiconductor layer (SEM2) may be doped with a second conductivity type dopant such as Si, Ge, Sn, etc. For example, the second semiconductor layer (32) may be n-GaN doped with n-type Si. The thickness of the second semiconductor layer (32) may be approximately 2 to 4 μm.

[0107] The partition (PW) may be positioned apart from each of the light-emitting elements (LE1 to LE4) positioned in each of the first to fourth light-emitting regions (EA1 to EA4). The partition (PW) may be positioned to surround the light-emitting elements (LE1 to LE4) positioned in each of the first to fourth light-emitting regions (EA1 to EA4).

[0108] A partition (PW) may be placed on common electrode connection electrodes (CCE). In the first direction (DR1) and the second direction (DR2), the width of the partition (PW) may be smaller than the width of the common connection electrode (CCE). The partition (PW) may be placed apart from the light-emitting elements (LE).

[0109] The partition (PW) may include a first partition (PW1), a second partition (PW2), and a third partition (PW3). The first partition (PW1) may be disposed on a first insulating film (INS1). Since the first partition (PW1) is formed by the same process as the light-emitting element (LE), at least a portion of the first partition (PW1) may include the same material as the light-emitting element (LE).

[0110] The second insulating film (INS2) may be disposed on the sides of the common connection electrode (CCE), the sides of the partition (PW), the sides of each of the pixel electrodes (214), the sides of each of the connection electrodes (213), and the sides of each of the light-emitting elements (LE1 to LE4). The second insulating film (INS2) may be formed of an inorganic film such as silicon oxide (SiO2). The thickness of the second insulating film (INS2) may be approximately 0.1 μm.

[0111] The common electrode (CE) can be placed on the upper and side surfaces of each light-emitting element (LE1 to LE4) and on the upper and side surfaces of the partition (PW). That is, the common electrode (CE) can be placed to cover the upper and side surfaces of each of the light-emitting elements (LE1 to LE4) and the upper and side surfaces of the partition (PW).

[0112] The common electrode (CE) can come into contact with a second insulating film (INS2) disposed on the sides of the common connection electrode (CCE), the sides of the partition (PW), the sides of each of the pixel electrodes (214), the sides of each of the connection electrodes (213), and the sides of each of the light-emitting elements (LE1 to LE4). Additionally, the common electrode (CE) can come into contact with the upper surface of the common connection electrode (CCE), the upper surface of each of the light-emitting elements (LE1 to LE4), and the upper surface of the partition (PW).

[0113] The common electrode (CE) can come into contact with the upper surface of the common connection electrode (CCE) and the upper surface of the light-emitting elements (LE1 to LE4), which are exposed and not covered by the second insulating film (INS2). Therefore, the common voltage supplied to the common connection electrode (CCE) can be applied to the light-emitting elements (LE1 to LE4). That is, one end of the light-emitting elements (LE1 to LE4) can receive the pixel voltage or anode voltage of the pixel electrode (214) through the connection electrode (213), and the other end can receive the common voltage through the common electrode (CE). The light-emitting element (LE) can emit light with a predetermined brightness according to the voltage difference between the pixel voltage and the common voltage.

[0114] A reflective film (RF) may be placed on the sides of the common connection electrode (CCE), the sides of the partition (PW), the sides of each pixel electrode (214), the sides of each connection electrode (213), and the sides of each light-emitting element (LE1 to LE4). The reflective film (RF) serves to reflect light emitted from the light-emitting elements (LE1 to LE4) that travels in the up, down, left, and right lateral directions, rather than in the upward direction. The reflective film (RF) may include a highly reflective metallic material such as aluminum (Al). The thickness of the reflective film (RF) may be approximately 0.1 μm.

[0115] A base resin (BRS) may be disposed on a protective film (PTF) in each of the light-emitting elements (LE1 to LE4). The base resin (BRS) may include a transparent organic material. The base resin (BRS) may further include a scatterer for scattering light from the light-emitting elements (LE1 to LE4) in random directions. In this case, the scatterer may include metal oxide particles or organic particles.

[0116] A light-blocking member (BM) may be disposed on the partition wall (PW). The light-blocking member (BM) may include a light-blocking material. The light-blocking member (BM) may be disposed between adjacent light-emitting regions (EA1, EA2, EA3, EA4) to prevent mixing of light of different wavelength bands emitted from light-emitting elements (LE1 to LE4) of each light-emitting region (EA1, EA2, EA3, EA4). Additionally, the light-blocking member (BM) may absorb at least a portion of external light incident on the light-emitting element layer (217) from the outside to reduce external light reflection. The light-blocking member (BM) may be located on the partition wall (PW) but may be disposed extending further into each light-emitting region (EA1, EA2, EA3, EA4). That is, the width of the light-blocking member (BM) may be greater than the width of the partition wall (PW).

[0117] Each optical pattern (LP) may be optionally placed on each light-emitting region (EA1, EA2, EA3, EA4). Each optical pattern (LP) may be placed directly on the base resin (BRS) of each light-emitting region (EA1, EA2, EA3, EA4). The optical pattern (LP) may have a shape protruding in an upward direction (e.g., a direction from the light-emitting elements (LE1 to LE4) toward each optical pattern (LP). For example, the cross-sectional shape of each optical pattern (LP) may include a lens shape that is convex upward. Each optical pattern (LP) may be placed on the lower base resin (BRS) and the light-blocking member (BM). The width of each optical pattern (LP) may be equal to, greater than, or smaller than the width of each light-emitting region (EA1, EA2, EA3, EA4). Each optical pattern (LP) can collect the first to third light or the fourth light transmitted through the base resin (BRS) in each light-emitting region (EA1, EA2, EA3, EA4).

[0118] FIG. 13 is a configuration diagram specifically showing the touch sensing structure of the first reflective member formed in the optical module of FIG. 6.

[0119] As described above, the display light of the augmented reality content image (MI) displayed in the first display module (210(a)) and reflected by the first reflective member (205(a)) is provided to the second reflective member (205(b)) according to the reflection angle of the first reflective member (205(a)). And, the display light of the augmented reality content image (MI) reflected by the second reflective member (205(b)) can be provided to the first optical panel (207) of the transparent lens (201) according to the reflection angle of the second reflective member (205(b)). To this end, as shown in FIG. 13, the first and second reflective members (205(a), 205(b)) can be formed such that they can reflect incident light by forming a reflective surface (Rp) of a reflective material on one side of a flat plate (Rf).

[0120] The outer surface of the first optical module (205) on which the first reflective member (205(a)) is disposed can be used as a touch surface for a user to perform an interface. As shown in FIG. 13, when a user's finger (OJP) or writing instrument, etc., touches the back surface or outer surface of the first reflective member (205(a)), the amount of light at the location where the finger (OJP) or writing instrument, etc., is touched is reduced. Accordingly, the amount of light at the touch location reflected from the first reflective member (205(a)) to the second reflective member (205(b)) is also reduced due to the influence of the reduction in the amount of light at the touch location.

[0121] The first reflective member (205(a)) includes a plurality of first light receiving sensing units (OL1 to OLn) as components for detecting changes in ambient light and incident light. Accordingly, when a finger (OJP) or a writing instrument, etc., touches a location corresponding to at least one of the plurality of first light receiving sensing units (OL1 to OLn), the amount of light around the touched light receiving sensing unit is reduced. Additionally, due to the structure of the light receiving sensing unit, light at the touch location may be diffusely reflected, and the amount of light at the touch location may be further lost. Accordingly, a dark spot where the amount of light is lost may occur on a part of the reflective surface of the first reflective member (205(a)) that corresponds to the touch location. And, the amount of light in the light loss area or the dark spot occurrence area of ​​the first reflective member (205(a)) is transmitted as is to the second reflective member (205(b)). Therefore, in the augmented reality content image (MI) perceived by the user's eyes through the transparency lens (201), areas of light loss or dark spots are displayed darkly as they are. Accordingly, the user can intuitively check whether touch and touch recognition have been performed normally.

[0122] Meanwhile, the detection of whether a touch occurs may be detected and the detection result may be displayed so that the user can check it. To this end, each of the first light receiving sensing units (OL1 to OLn) generates a light amount detection signal corresponding to a change in the amount of light incident from the first display module (210(a)) and a change in the amount of light in the surroundings, and supplies it to the control module (220).

[0123] Each of the first light receiving sensing units (OL1 to OLn) is disposed on the reflective surface (Rp) of the first reflective member (205(a)), and may be disposed in some of the outermost regions of the reflective surface (Rp), including the corner regions of the reflective surface (Rp).

[0124] Each of the first light receiving sensing units (OL1 to OLn) includes a groove (On) of a predetermined depth formed in the reflective surface (Rp) of the first reflective member (205(a)), and at least one light receiving sensor (Os) disposed in the groove (On) in the front direction of the reflective surface (Rp). Accordingly, each light receiving sensor (Os) included in the first light receiving sensing units (OL1 to OLn) supplies a light amount detection signal corresponding to a change in ambient light amount and a change in incident light amount to a control module (220).

[0125] As shown in FIG. 13, when a user's finger (OJP) or a writing instrument touches the back or periphery of at least one of the first light receiving sensing units (OL1 to OLn), for example, the first light receiving sensing unit (OL1), the amount of ambient light around the first light receiving sensing unit (OL1) is reduced. Accordingly, the amount of light detected by the first light receiving sensing unit (OL1) is reduced due to the influence of the reduction in ambient light. Meanwhile, the control module (220) receives light amount detection signals in real time from each light receiving sensor (Os) included in each light receiving sensing unit (OL1 to OLn). Then, the control module (220) compares the average value of the light amount detection signals with the magnitude value of the light amount detection signals of the light receiving sensors (Os) at least one frame period. Then, the first light receiving sensing unit (OL1) that outputs a light amount detection signal with a magnitude lower than a preset reference difference value relative to the average value is extracted. The control module (220) can determine that a user touch has occurred around the light receiving sensing unit (OL1) that outputs a light intensity detection signal of a size lower than the reference difference value relative to the average value.

[0126] Figure 14 is a diagram showing an example of displaying a user's touch detection area through an augmented reality content image.

[0127] Referring to FIG. 14 together with FIG. 7 and FIG. 8, touch detection display areas (IL1 to ILn) corresponding to the light receiving sensor formation area of ​​the first reflective member (205(a)) are defined in the image display device (110). Accordingly, the control module (220) can extract at least one light receiving sensing unit where a user touch has occurred by comparing the magnitude values ​​of the light amount detection signals received from each light receiving sensor (Os) with the average value. For example, the control module (220) can determine that a user touch has occurred around the first light receiving sensing unit (OL1) that outputs a light amount detection signal with a magnitude lower than the reference difference value relative to the average value.

[0128] As shown in FIG. 14, when a user's touch is detected, the control module (220) can modulate and display image data of detection display areas (IL1 to ILn) corresponding to the light receiving sensor formation area. For example, the control module (220) can modulate the image data of the first touch detection display area (IL1) among the touch detection display areas (IL1 to ILn) into black gradation image data according to the user's touch location, so that the first touch detection display area (IL1) is displayed in black. At this time, the control module (220) activates the user interface function. When the interface function is activated, the control module (220) can control augmented reality content display operations, such as adjusting the audio volume or adjusting the brightness of the image according to the user's touch location. Additionally, it can modulate the object position of the augmented reality content image according to the user's touch location, or modulate the display color of the augmented reality content image through image data modulation. Additionally, it can control the sensing operation of the sensing module (240).

[0129] FIG. 15 is a configuration diagram of another embodiment specifically showing the touch sensing structure of the first reflective member illustrated in FIG. 13.

[0130] Referring to FIG. 15, the reflective surface (Rp) of the first reflective member (205(a)) can be divided into a plurality of pre-set divided areas (Br1 to Brn), for example, divided areas (Br1 to Brn) of 2×2 blocks.

[0131] Each first light receiving sensing unit (OL1 to OLn) is formed in a plurality of preset divided areas (Br1 to Brn), and may be formed in the corner areas of each divided area (Br1 to Brn) or in the preset outer areas of each divided area (Br1 to Brn). On the other hand, each first light receiving sensing unit (OL1 to OLn) may be formed in the center area of ​​each divided area (Br1 to Brn), but it is preferable to form them in the corner areas of each divided area (Br1 to Brn) so that the display light reflection efficiency of the augmented reality content image is not reduced.

[0132] Each of the first light receiving sensing units (OL1 to OLn) can supply a light amount detection signal corresponding to a change in the amount of light incident from the first display module (210(a)) in each divided area (Br1 to Brn) and a change in the amount of light in the surroundings to the control module (220).

[0133] FIG. 16 is a configuration diagram of another embodiment specifically showing the touch sensing structure of the first reflective member illustrated in FIG. 13.

[0134] Referring to FIG. 16, the reflective surface (Rp) of the first reflective member (205(a)) can be divided into pre-set n×m block division areas (Br1 to Brn). Here, n and m are two or more natural numbers that are equal to or different from each other.

[0135] Each first light receiving sensing unit (OL1 to OLn) is formed in a divided area (Br1 to Brn) of an n×m block, and may be formed in the central areas of each divided area (Br1 to Brn). As the number of n×m blocks increases, the outer areas within the divided areas (Br1 to Brn) of the n×m block lose their positional significance, so each first light receiving sensing unit (OL1 to OLn) may be formed in the central area of ​​each divided area (Br1 to Brn).

[0136] The first light receiving sensing units (OL1 to OLn) formed in each of the divided areas (Br1 to Brn) of the n×m block supply a light amount detection signal corresponding to a change in the amount of light incident from the first display module (210(a)) in each divided area (Br1 to Brn) and a change in the amount of light in the surroundings to the control module (220).

[0137] FIG. 17 is a drawing of another embodiment showing a structure forming a display light path for an augmented reality content image displayed in the first display module shown in FIG. 5 in an optical module.

[0138] Specifically, FIG. 16 shows a light path forming structure of a first optical module (205) that sequentially reflects the display light of an augmented reality content image (MI) displayed in a first display module (210(a)) to first and second reflective members (205(a), 205(b)) and supplies it to a first optical panel (207) of a transparent lens (201).

[0139] The display light of the augmented reality content image (MI) reflected by the first reflective member (205(a)) can be reflected again by the second reflective member (205(b)) and provided to the first optical panel (207) of the transparency lens (201) according to the reflection angle of the second reflective member (205(b)).

[0140] Meanwhile, the outer surface of the second reflective member (205(b)) on which the second reflective member (205(b)) is disposed can be used as a touch surface for a user to perform an interface. When a user's finger or writing instrument touches the outer surface, such as the front or back surface, of the second reflective member (205(b)), the amount of ambient light of the second reflective member (205(b)) is reduced. Accordingly, the amount of light detected by the second reflective member (205(b)) may also be reduced due to the influence of the reduction in ambient light.

[0141] The second reflective member (205(b)) may include a plurality of second light receiving sensing units (OR1 to ORn) as components for detecting changes in ambient light intensity and changes in light intensity incident from the first reflective member (205(a)). Each of the second light receiving sensing units (OR1 to ORn) generates a light intensity detection signal corresponding to changes in light intensity reflected from the first reflective member (205(a)) and changes in ambient light intensity, and supplies it to the control module (220).

[0142] Each of the second light receiving sensing units (OR1 to ORn) is disposed on the reflective surface of the second reflective member (205(b)), and may be disposed in some of the outermost regions of the reflective surface, including the corner regions of the reflective surface. Each of the second light receiving sensing units (OR1 to ORn) includes a groove (On) of a predetermined depth formed on the reflective surface of the second reflective member (205(b)), and at least one light receiving sensor (Os) disposed in the front direction of the reflective surface inside the groove (On). Accordingly, each light receiving sensor (Os) included in the second light receiving sensing units (OR1 to ORn) supplies a light amount detection signal corresponding to a change in the amount of light incident from the first reflective member (205(a)) and a change in the amount of light in the surroundings to the control module (220).

[0143] Meanwhile, the control module (220) receives light intensity detection signals in real time from each light receiving sensor (Os) included in each of the second light receiving sensing units (OR1 to ORn). Then, the control module (220) compares the average value of the light intensity detection signals with the magnitude value of the light intensity detection signals of the light receiving sensors (Os) at least one frame period. Accordingly, the control module (220) can determine that a user touch has occurred around the light receiving sensor (Os) that outputs a light intensity detection signal with a magnitude lower than the reference difference value relative to the average value.

[0144] FIG. 18 is a configuration diagram of another embodiment specifically showing the touch sensing structure of the second reflective member illustrated in FIG. 17.

[0145] Referring to FIG. 18, the reflective surface of the second reflective member (205(b)) can be divided into a plurality of pre-set divided areas (Br1 to Brn), for example, divided areas (Br1 to Brn) of 2×2 blocks.

[0146] Each of the second light receiving and sensing units (OR1 to ORn) is formed in a plurality of preset divided areas (Br1 to Brn), and may be formed in the corner areas of each divided area (Br1 to Brn) or in the preset outer areas of each divided area (Br1 to Brn). It is preferable that each of the second light receiving and sensing units (OR1 to ORn) be formed in the corner and outer areas of each divided area (Br1 to Brn) so that the display light reflection efficiency of the augmented reality content image is not reduced.

[0147] Each of the second light receiving sensing units (OR1 to ORn) supplies a light amount detection signal corresponding to a change in the amount of light incident from the first reflective member (205(a)) in each divided area (Br1 to Brn) and a change in the amount of light in the surroundings to the control module (220).

[0148] FIG. 19 is a configuration diagram of another embodiment specifically showing the touch sensing structure of the second reflective member illustrated in FIG. 17.

[0149] Referring to FIG. 19, the reflective surface of the second reflective member (205(b)) can be divided into pre-set n×m block division areas (Br1 to Brn). Here, n and m are two or more natural numbers that are equal to or different from each other.

[0150] Each of the second light receiving and sensing units (OR1 to ORn) is formed in the divided regions (Br1 to Brn) of the n×m block, and may be formed in the central regions of each divided region (Br1 to Brn). As the number of n×m blocks increases, the outer regions within the divided regions (Br1 to Brn) of the n×m block lose their positional significance; therefore, each of the second light receiving and sensing units (OR1 to ORn) may be formed in the central regions of each divided region (Br1 to Brn).

[0151] The second light receiving sensing units (OR1 to ORn) formed in each of the divided areas (Br1 to Brn) of the n×m block can supply a light amount detection signal corresponding to a change in the amount of light incident from the first reflective member (205(a)) in each divided area (Br1 to Brn) and a change in the amount of light in the surroundings to the control module (220).

[0152] As described above, an augmented reality content providing device (200) according to one embodiment of the present invention detects a user's touch on the display light path of an augmented reality content image (MI). Accordingly, when a user's touch occurs, the amount of light in the area where the touch occurred and on the light path where the touch occurred may be reduced. Accordingly, the touch detection state on the display light path of the augmented reality content image (MI) can be displayed darkly in real time on the augmented reality content image (MI).

[0153] FIG. 20 is an exemplary drawing showing a watch-type smart device including a display module according to one embodiment of the present invention.

[0154] Referring to FIG. 20, the image display device (110) included in the augmented reality content providing device (200) of the present invention may be applied to a watch-type smart device (2), which is one of the smart devices. In addition, the watch-type smart device (2) according to one embodiment may be applied to a head-mounted display including a head-mounting band that can be mounted on the head. That is, the watch-type smart device (2) according to one embodiment is not limited to that shown in FIG. 20 and can be applied in various forms to various other electronic devices.

[0155] FIG. 21 is an exemplary drawing showing an automobile instrument panel and a center fascia including a display module according to one embodiment of the present invention.

[0156] Referring to FIG. 21, the image display device (110) included in the augmented reality content providing device (200) of the present invention may be applied to the instrument panel (10_a) of a vehicle, to the center fascia (10_b) of a vehicle, or to a CID (Center Information Display, 10_d, 10_e) placed on the dashboard of a vehicle. In addition, the image display device (110) according to one embodiment may be applied to a room mirror display (10_d, 10e) that replaces the side mirror of a vehicle, a navigation device, etc.

[0157] FIG. 22 is an exemplary drawing showing a transparent display device including a display module according to one embodiment of the present invention.

[0158] Referring to FIG. 22, the image display device (110) included in the augmented reality content providing device (200) of the present invention can be applied to a transparent display device. The transparent display device can display an image (IM) and transmit light simultaneously. Therefore, a user located in front of the transparent display device can not only view the image (IM) displayed on the image display device (110), but also see an object (RS) or background located on the back of the transparent display device. When the image display device (110) is applied to a transparent display device, the display panel (212) of the image display device (110) may include a light-transmitting portion capable of transmitting light, or be formed of a material capable of transmitting light.

[0159] Although embodiments of the present invention have been described above with reference to the attached drawings, those skilled in the art will understand that the present invention may be implemented in other specific forms without changing the technical concept or essential features thereof. Therefore, the embodiments described above should be understood as illustrative in all respects and not restrictive. Explanation of the symbols

[0160] 110: Video display device 200: Augmented reality content providing device 201: Transparency lens 210: Display module 211: Image transmission absence 212: Display panel 220: Control Module 240: Sensing Module EA1, EA2, EA3, EA4: 1st to 4th light-emitting regions LE1, LE2, LE3, LE4: First to fourth light-emitting elements

Claims

Claim 1 An augmented reality content providing device comprising: a display module that emits display light for displaying an augmented reality content image; an optical module that forms a path of the display light so that the augmented reality content image is displayed on a transparent lens, and outputs light intensity detection signals by detecting a change in light intensity according to a user touch on the path of the display light; and a control module that detects the user touch by analyzing a change in the magnitude of the light intensity detection signals and activates a user interface function according to the touch detection result, wherein the control module controls the operation of the display module so that the detection result of the user touch is displayed as the augmented reality content image according to the user touch detection result. Claim 2 In claim 1, the optical module includes a first reflective member that reflects the display light of the augmented reality content image displayed in the display module and supplies it to the transparency lens, and the first reflective member has a back surface or an outer surface that is used as a touch surface to generate and output a light amount detection signal corresponding to the ambient light amount that varies according to the user touch. Claim 3 In claim 2, the first reflective member comprises a plurality of first light receiving sensing units that generate and output a light quantity detection signal whose size varies in response to a change in the amount of light incident from the display module and a change in the amount of ambient light, thereby providing an augmented reality content. Claim 4 In claim 3, the plurality of first light receiving sensing units are disposed on the reflective surface of the first reflective member, and an augmented reality content providing device disposed in some of the outermost regions of the reflective surface, including the corner regions of the reflective surface. Claim 5 In claim 3, the plurality of first light receiving sensing units comprises a groove of a predetermined depth formed on the reflective surface of the first reflective member; and at least one light receiving sensor disposed in the groove in the front direction of the reflective surface, wherein the at least one light receiving sensor supplies the light amount detection signal, the magnitude of which varies in response to the change in ambient light amount and the change in incident light amount, to the control module, an augmented reality content providing device. Claim 6 In claim 3, the first reflective member is divided into a pre-set n×m block divided area where the reflective surface reflecting the display light is divided, and n and m are two or more natural numbers that are the same or different from each other, and the plurality of first light receiving sensing members are each formed in a corner area or a part of the outer area of ​​each n×m block divided area, an augmented reality content providing device. Claim 7 In claim 3, the control module controls the image display operation of the display module and the sensing operation of the sensing module in response to the user touch according to the activation of the user interface function, an augmented reality content providing device. Claim 8 In claim 7, the control module compares the average value of the light quantity detection signals with the magnitude value of each light quantity detection signal at least one frame period unit, extracts at least one first light receiving sensing unit that outputs a light quantity detection signal of a magnitude lower than a preset reference difference value relative to the average value of the light quantity detection signals, and the at least one first light receiving sensing unit that outputs a light quantity detection signal of a magnitude lower than the reference difference value relative to the average value determines that the user touch has occurred in the surroundings and modulates image data for displaying the augmented reality content image. Claim 9 An augmented reality content providing device according to claim 1, wherein the optical module includes a first reflective member that reflects display light of the augmented reality content image displayed in the display module; and a second reflective member that reflects the display light reflected from the first reflective member again and supplies it to the transparency lens, wherein the second reflective member has a back surface or an outer surface that is used as a touch surface and generates and outputs a light amount detection signal to correspond to the ambient light amount that varies according to the user touch. Claim 10 In claim 9, the augmented reality content providing device comprises a plurality of second light receiving sensing units that generate and output a light quantity detection signal whose size varies in response to a change in the amount of light incident from the display module and a change in the amount of ambient light. Claim 11 In claim 10, the plurality of second light receiving sensing units are disposed on the reflective surface of the second reflective member, and the augmented reality content providing device is disposed in some of the outermost regions of the reflective surface, including the corner regions of the reflective surface. Claim 12 In claim 10, the plurality of second light receiving sensing units comprises a groove of a predetermined depth formed on the reflective surface of the second reflective member; and at least one light receiving sensor disposed in the groove in the front direction of the reflective surface, wherein the at least one light receiving sensor supplies the light amount detection signal, the size of which varies in response to the change in ambient light amount and the change in incident light amount, to the control module, an augmented reality content providing device. Claim 13 In claim 10, the second reflective member is divided into a pre-set n×m block divided area where the reflective surface reflecting the display light is divided, and n and m are two or more natural numbers that are the same or different from each other, and the plurality of second light receiving sensing members are each formed in a corner area or a part of the outer area of ​​each n×m block divided area, an augmented reality content providing device. Claim 14 In claim 10, the control module controls the operation of the display module so that the detection result of the user touch is displayed as the augmented reality content image, and controls the image display operation of the display module and the sensing operation of the sensing module according to the user touch in accordance with the activation of the user interface function. Claim 15 In claim 1, the display module is assembled on one or both sides of a support frame supporting the transparency lens or is formed integrally with the support frame, thereby providing an augmented reality content device that displays the augmented reality content image using at least one image display device. Claim 16 In claim 15, the augmented reality content providing device comprises: a partition wall partitioned and arranged in a pentile matrix structure on a substrate; a plurality of light-emitting elements each arranged in a plurality of light-emitting regions arranged in the pentile matrix structure by the partition wall and extending in the thickness direction of the substrate; a base resin formed in the plurality of light-emitting regions including the plurality of light-emitting elements; and a plurality of optical patterns selectively arranged on at least one of the plurality of light-emitting regions. Claim 17 In claim 16, the augmented reality content providing device is formed such that the plurality of light-emitting regions are each pixel region such that the first to third light-emitting regions, or the first to fourth light-emitting regions, are arranged in the Pentile Matrix structure. Claim 18 An augmented reality content providing device according to claim 17, wherein the first light-emitting region comprises a first light-emitting element that emits a first light in a wavelength band that embodies any one of red, green, and blue; the second light-emitting region comprises a second light-emitting element that emits a second light in a wavelength band that embodies any one of red, green, and blue that is different from the first light; the third light-emitting region comprises a third light-emitting element that emits a third light in a wavelength band that embodies any one of red, green, and blue that is different from the first and second light; and the fourth light-emitting region comprises a fourth light-emitting element that emits a fourth light in a wavelength band identical to any one of the first to third light. Claim 19 An augmented reality content providing device according to claim 17, wherein the size or planar area of ​​each of the first to fourth light-emitting regions is formed to be the same as each other, and the distance between the first light-emitting region and the second light-emitting region, the distance between the second light-emitting region and the third light-emitting region, the distance between the first light-emitting region and the third light-emitting region, and the distance between the third light-emitting region and the fourth light-emitting region are arranged to be the same as each other according to the size or planar area of ​​each of the first to fourth light-emitting regions. Claim 20 An augmented reality content providing device according to claim 17, wherein the size or planar area of ​​each of the first to fourth light-emitting regions is optionally formed differently from one another, and the distance between the first light-emitting region and the second light-emitting region, the distance between the second light-emitting region and the third light-emitting region, the distance between the first light-emitting region and the third light-emitting region, and the distance between the third light-emitting region and the fourth light-emitting region are formed to be the same or different from one another depending on the size or planar area of ​​each of the first to fourth light-emitting regions.

Images