Electronic device comprising light engine that includes lens functioning as condensing lens and relay lens

Abstract

In this electronic device (for example, electronic device (101) in figure 1, wearable electronic device (200) in figure 2, and head mounted display device (300) in figure 3) comprising a light engine (for example, light engine (500) in figure 5A, light engine (900) in figure 9, and light engine (1000) in figure 10B), the light engines (500, 900) can include light sources (for example, light source (510) in figure 5A and light source (910) in figure 9) for emitting Illumination lights (for example, illumination light (501) in figure 5A and illumination light (901) in figure 9). The light engines (500, 900) are disposed in the light output direction of the light sources (510, 910), and can include: first condensing lenses (for example, first condensing lens (541) in figure 5A and first condensing lens (941) in figure 9) (collimator) that include first surfaces (5411, 9411) and second surfaces (5412, 9412) facing the light sources (510, 910); second condensing lenses (for example, second condensing lens (542) in figure 5A, and second condensing lens (942) in figure 9) that include third surfaces (5421, 9421) and fourth surfaces (5422, 9422); polarization beam splitters (PBSs) (for example, polarization beam splitter (520) in figure 5A and polarization beam splitter (920) in figure 9) disposed between the first condensing lenses (541, 941) and the second condensing lens (542); fly-eye lenses (FELs) (550, 950) that include fifth surfaces (5501, 9501) and sixth surfaces (5502, 9502) facing the fourth surfaces (5422, 9422) of the second condensing lenses (542, 942); reflective plates (551, 951) disposed on the sixth surfaces (5502, 9502) of the fly-eye lenses (550, 950); and displays (530, 930) for generating image lights on the basis of the illumination lights (501, 901). The third surfaces (5421, 9421) of the second condensing lenses (542, 942) face the polarization beam splitters (520, 920), and the illumination lights (501, 901) reflected by the reflective plates (551, 951) can be output onto the displays (530, 930) through the fly-eye lenses (550, 950) and the second condensing lenses.

Description

Electronic device including an optical engine including a lens that functions as a condensing lens and a relay lens

[0001] The present disclosure relates to an electronic device, and more specifically, to an electronic device comprising a light engine including a condensing lens and a lens that functions as a relay lens.

[0002] An electronic device (e.g., an augmented reality (AR) device) can generate image light that represents an image and transmit it to the user's eye. The electronic device can generate image light through any one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), a light emitting diode (LED) on silicon (LEDoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED). An electronic device including a display (e.g., LCoS) that generates image light through an external light source may include a light engine comprising a structure that controls illumination light emitted from the external light source to be incident on the display. The light engine may include an illumination system composed of at least one optical element that generates (or emits) illumination light and transmits it to the display, and a projection system that transmits the image light generated by the display to a predetermined area.

[0003] The information described above may be provided as related art for the purpose of aiding understanding of this document. None of the above is to be claimed as prior art related to this document, nor can it be used to determine prior art.

[0004] In an electronic device (e.g., electronic device (101) of FIG. 1, wearable electronic device (200) of FIG. 2, head-mounted display device (300) of FIG. 3) comprising a light engine (e.g., light engine (500) of FIG. 5A, light engine (900) of FIG. 9, light engine (1000) of FIG. 10B) according to one embodiment, the light engine (500, 900) may include a light source (e.g., light source (510) of FIG. 5A, e.g., light source (910) of FIG. 9) that emits illumination light (e.g., illumination light (501) of FIG. 5A, illumination light (901) of FIG. 9). The light engine (500, 900) may include a first condensing lens (e.g., the first condensing lens (541) of FIG. 5A, the first condensing lens (941) of FIG. 9) that is positioned in the light output direction of the light source (510, 910) and includes a first surface (5411, 9411) and a second surface (5412, 9412) facing the light source (510, 910). The light engine (500, 900) may include a second condensing lens (e.g., the second condensing lens (542) of FIG. 5A, the second condensing lens (942) of FIG. 9) that includes a third surface (5421, 9421) and a fourth surface (5422, 9422). The light engine (500, 900) may include a polarization beam splitter (PBS) disposed between the first condensing lens (541, 941) and the second condensing lens (542). The light engine (500, 900) may include a fly-eye lens (550, 950) comprising a fifth surface (5501, 9501) and a sixth surface (5502, 9502) facing the fourth surface (5422, 9422) of the second condensing lens (542, 942).The light engine (500, 900) may include a reflective plate (551, 951) disposed on the sixth surface (5502, 9502) of the fly-eye lens (550, 950). The light engine (500, 900) may include a display (530, 930) that generates image light based on the illumination light (501, 901). The third surface (5421, 9421) of the second condensing lens (542, 942) faces the polarizing beam splitter (520, 920), and the illumination light (501, 901) reflected by the reflecting plate (551, 951) can be output to the display (530, 930) through the fly eye lens (550, 950) and the second condensing lens.

[0005] In an electronic device (101, 200, 300) including a light engine (500, 900), the light engine (500, 900) may include a light source (510, 910) that emits illumination light (501, 901). The light engine (500, 900) may include a first condensing lens (541, 941) (collimator) that is positioned in the light output direction of the light source (510, 910) and includes a first surface (5411, 9411) and a second surface (5412, 9412) facing the light source (510, 910). The light engine (500, 900) may include a second condensing lens (542, 942) comprising a third surface (5421, 9421) and a fourth surface (5422, 9422). The light engine (500, 900) may include two prisms spaced apart from each other and a TIR prism (990) positioned between the first condensing lens (541, 941) and the second condensing lens (542, 942). The light engine (500, 900) may include a fly-eye lens (550, 950) (FEL) comprising a fifth surface (5501, 9501) and a sixth surface facing the fourth surface (5422, 9422) of the second condensing lens (542, 942). The light engine (500, 900) may include a reflective plate (551, 951) disposed on the sixth surface of the fly-eye lens (550, 950). The light engine (500, 900) may include a display (530, 930) that generates image light based on the illumination light (501, 901). The third surface (5421, 9421) of the second condensing lens (542, 942) may face the TIR prism. The fifth surface (5501, 9501) of the fly-eye lens (550, 950) may face the fourth surface (5422, 9422) of the second condensing lens (542, 942).The illumination light (501, 901) reflected by the reflection plate (551, 951) can be output to the display (530, 930) through the fly eye lens (550, 950) and the second condensing lens (5412, 9412).

[0006] FIG. 1 is a block diagram of an exemplary electronic device capable of performing the operations described in this document.

[0007] FIG. 2 is a perspective view schematically showing the configuration of an electronic device according to one embodiment.

[0008] FIG. 3A is a drawing showing the front view of a head-mounted display device (300) according to one embodiment of the present disclosure.

[0009] FIG. 3B is a drawing showing the back of a head-mounted display device (300) according to one embodiment of the present disclosure.

[0010] FIG. 4 is a drawing illustrating a light engine according to one embodiment.

[0011] FIG. 5A is a drawing illustrating a light engine included in an electronic device according to one embodiment.

[0012] FIG. 5B is a drawing illustrating a light engine included in an electronic device according to one embodiment.

[0013] FIG. 6 is a diagram illustrating the light path of illumination light on a light engine according to one embodiment.

[0014] FIG. 7 is a drawing illustrating illumination light passing through some of the optical elements included in a light engine according to one embodiment.

[0015] FIG. 8 is a drawing illustrating illumination light passing through some of the optical elements included in a light engine according to one embodiment.

[0016] FIG. 9 is a drawing illustrating a light engine included in an electronic device according to one embodiment.

[0017] FIG. 10A is a diagram illustrating the light path of illumination light on a light engine according to one embodiment.

[0018] FIG. 10B is a drawing illustrating a light engine included in an electronic device according to one embodiment.

[0019] FIG. 11 is a drawing illustrating an optical engine and an optical waveguide included in an electronic device according to one embodiment.

[0020] FIG. 12 is a drawing illustrating an electronic device according to one embodiment.

[0021] FIG. 1 is a block diagram of an exemplary electronic device capable of performing the operations described in this document.

[0022] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0023] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0024] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0025] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0026] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).

[0027] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0028] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0029] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0030] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0031] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0032] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0033] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0034] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0035] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0036] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0037] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0038] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a WAN (wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0039] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimization of terminal power and connection of multiple terminals (mMTC, massive machine type communications), or high reliability and low-latency (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0040] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0041] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0042] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0043] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0044] FIG. 2 is a perspective view schematically showing the configuration of an electronic device according to one embodiment.

[0045] The wearable electronic device (200) illustrated in FIG. 2 (e.g., the electronic device (101) of FIG. 1) may be at least partially similar to the electronic device (101) of FIG. 1 or may further include other embodiments of the electronic device (101). The wearable electronic device (200) may include augmented reality (AR) glasses in the form of glasses, smart glasses, and / or a video see-through (VST) device.

[0046] Referring to FIG. 2, the wearable electronic device (200) may include a bridge (201), a first rim (210), a second rim (220), a first end piece (230), a second end piece (240), a first temple (250) and / or a second temple (260).

[0047] According to one embodiment, the bridge (201) can connect the first rim (210) and the second rim (220). The bridge (201) can be positioned over the user's nose when the user wears the wearable electronic device (200). The bridge (201) can separate the first rim (210) and the second rim (220) based on the user's nose.

[0048] According to one embodiment, the bridge (201) may include a camera module (203), a first eye-tracking camera (205), a second eye-tracking camera (207) and / or an audio module (209).

[0049] According to one embodiment, the camera module (203) (e.g., the camera module (180) of FIG. 1) can capture the front (e.g., -y-axis direction) of a user (e.g., a user of a wearable electronic device (200)) and acquire image data. The camera module (203) can capture an image corresponding to the user's field of view (FoV) or measure the distance to a subject (e.g., an object). The camera module (203) may include an RGB camera, a high resolution (HR) camera, and / or a photo video (PV) camera. To acquire high-quality images, the camera module (203) may include a color camera that performs auto focus (AF) and optical image stabilization (OIS) functions.

[0050] According to one embodiment, the first eye-tracking camera (205) and the second eye-tracking camera (207) can track the gaze of a user. The first eye-tracking camera (205) and the second eye-tracking camera (207) can capture the user's pupils gazing in a direction opposite to the shooting direction of the camera module (203). For example, the first eye-tracking camera (205) can partially capture the user's left eye, and the second eye-tracking camera (207) can partially capture the user's right eye. The first eye-tracking camera (205) and the second eye-tracking camera (207) can detect the user's pupils (e.g., left eye and right eye) and track the gaze direction corresponding to the movement of the detected pupils. The tracked gaze direction can be utilized to move the center of a virtual image containing a virtual object in correspondence with the gaze direction. The first eye-tracking camera (205) and / or the second eye-tracking camera (207) can track the user's gaze using at least one of, for example, an EOG sensor (electro-oculography or electrooculogram), a coil system, a dual Purkinje system, bright pupil systems, or dark pupil systems.

[0051] According to one embodiment, the audio module (209) (e.g., the audio module (170) of FIG. 1) may be positioned between the first eye-tracking camera (205) and the second eye-tracking camera (207). The audio module (209) may convert the user's voice into an electrical signal or convert the electrical signal into sound (e.g., sound source data, audio signal). The audio module (209) may include a microphone.

[0052] According to one embodiment, the first rim (210) and the second rim (220) may form a frame (e.g., eyeglass frame) of a wearable electronic device (200) (e.g., AR glasses). The first rim (210) may be positioned in a first direction (e.g., x-axis direction) of the bridge (201). The first rim (210) may be positioned at a location corresponding to the user's left eye. The second rim (220) may be positioned in a second direction (e.g., -x-axis direction) of the bridge (201), which is opposite to the first direction (e.g., x-axis direction). The second rim (220) may be positioned at a location corresponding to the user's right eye. The first rim (210) and the second rim (220) may be formed of a metal material and / or a non-conductive material (e.g., a polymer).

[0053] According to one embodiment, the first rim (210) may surround and support at least a portion of the first glass (215) (e.g., the first display) positioned on the inner surface. The first glass (215) may be positioned in front of the user's left eye. The second rim (220) may surround and support at least a portion of the second glass (225) (e.g., the second display) positioned on the inner surface. The second glass (225) may be positioned in front of the user's right eye. The user of the wearable electronic device (200) can view the foreground (e.g., a real image) of an external object (e.g., a subject) through the first glass (215) and the second glass (225). The wearable electronic device (200) can implement augmented reality by displaying a virtual image superimposed on the foreground (e.g., a real image) of the external object. According to one embodiment, the wearable electronic device (200) may implement virtual reality and may represent virtual reality through the first glass (215) and the second glass (225).

[0054] According to one embodiment, the first glass (215) and the second glass (225) may include a projection-type transparent display. The first glass (215) and the second glass (225) may each form a reflective surface as a transparent plate (or transparent screen), and an image generated by the wearable electronic device (200) may be reflected (e.g., total internal reflection) through the reflective surface and incident on the user's left and right eyes. In one embodiment, the first glass (215) may include an optical waveguide that transmits light generated from a light source of the wearable electronic device (200) to the user's left eye. For example, the optical waveguide may be formed of glass, plastic, or polymer material and may include a nano pattern (e.g., a polygonal or curved grating structure or mesh structure) formed inside or on the surface of the first glass (215). The optical waveguide may include at least one diffractive element (e.g., DOE (diffractive optical element), HOE (holographic optical element)) or a reflective element (e.g., a reflective mirror). The optical waveguide may guide display light emitted from a light source to the user's eye using at least one diffractive element or reflective element included in the optical waveguide. In one embodiment, the diffractive element may include an input / output optical member, and the reflective element may include total internal reflection (TIR). For example, light emitted from a light source may be guided to a path through the input optical member to the optical waveguide, and light traveling inside the optical waveguide may be guided toward the user's eye through the output optical member. The second glass (225) may be implemented in substantially the same manner as the first glass (215).

[0055] According to one embodiment, the first glass (215) and the second glass (225) may include, for example, a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), a light emitting diode (LED) on silicon (LEDoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED). Although not illustrated, if the first glass (215) and the second glass (225) are made of one of a liquid crystal display, a digital mirror device, or a liquid crystal display, the wearable electronic device (200) may include a light source that irradiates light onto a screen output area of ​​the first glass (215) and the second glass (225). In one embodiment, if the first glass (215) and the second glass (225) can generate light themselves, for example, if they are made of one of an organic light-emitting diode or a micro LED, the wearable electronic device (200) can provide a good quality virtual image to the user without including a separate light source.

[0056] According to one embodiment, the first rim (210) may include a first microphone (211), a first recognition camera (213), a first light-emitting device (217) and / or a first display module (219). The second rim (220) may include a second microphone (221), a second recognition camera (223), a second light-emitting device (227) and / or a second display module (229).

[0057] In one embodiment, the first light-emitting device (217) and the first display module (219) may be included in the first end piece (230), and the second light-emitting device (227) and the second display module (229) may be included in the second end piece (240).

[0058] According to one embodiment, the first microphone (211) and / or the second microphone (221) can receive the voice (e.g., spoken voice, spoken sound source data) of a user wearing the wearable electronic device (200) on their head, and can convert the received voice of the user into an electrical signal.

[0059] According to one embodiment, the first recognition camera (213) and / or the second recognition camera (223) can recognize the surrounding space of the wearable electronic device (200). The first recognition camera (213) and / or the second recognition camera (223) can detect a user's gesture within a certain distance (e.g., a certain space) of the wearable electronic device (200). The first recognition camera (213) and / or the second recognition camera (223) may include a global shutter camera in which the rolling shutter phenomenon can be reduced in order to detect and track the user's rapid hand movements and / or fine movements of the fingers. A wearable electronic device (200) can detect the eye corresponding to the dominant eye and / or auxiliary eye among the user's left eye and / or right eye by using a first eye-tracking camera (205), a second eye-tracking camera (207), a first recognition camera (213) and / or a second recognition camera (223). For example, the wearable electronic device (200) can detect the eye corresponding to the dominant eye and / or auxiliary eye based on the user's gaze direction toward an external object or a virtual object.

[0060] According to one embodiment, the first light-emitting device (217) and / or the second light-emitting device (227) may emit light to increase the accuracy of the camera module (203), the first eye-tracking camera (205), the second eye-tracking camera (207), the first recognition camera (213) and / or the second recognition camera (223). The first light-emitting device (217) and / or the second light-emitting device (227) may be used as an auxiliary means to increase accuracy when photographing a user's pupil using the first eye-tracking camera (205) and / or the second eye-tracking camera (207). The first light-emitting device (217) and / or the second light-emitting device (227) may be used as an auxiliary means when detecting an object (e.g., a subject) to be photographed is not easy due to a dark environment or the mixing of multiple light sources and reflected light when capturing a user's gesture using the first recognition camera (213) and / or the second recognition camera (223). The first light-emitting device (217) and / or the second light-emitting device (227) may include, for example, at least one of an LED, an IR LED, and / or a xenon lamp.

[0061] According to one embodiment, the first display module (219) and / or the second display module (229) may emit light and transmit it to the user's left eye and / or right eye using the first glass (215) and / or the second glass (225). The first glass (215) and / or the second glass (225) may display various image information using the light emitted through the first display module (219) and / or the second display module (229). The first display module (219) and / or the second display module (229) may include the display module (160) of FIG. 1. The wearable electronic device (200) can superimpose an image (e.g., a real external environment) of an external object and an image (e.g., a virtual object, a 3D (3-dimensional) object) emitted through a first display module (219) and / or a second display module (229) through a first glass (215) and / or a second glass (225).

[0062] According to one embodiment, the first end piece (230) may be coupled to a part of the first rim (210) (e.g., in the x-axis direction). The second end piece (240) may be coupled to a part of the second rim (220) (e.g., in the -x-axis direction). In one embodiment, the first light-emitting device (217) and the first display module (219) may be included in the first end piece (230). The second light-emitting device (227) and the second display module (229) may be included in the second end piece (240).

[0063] According to one embodiment, the first end piece (230) can connect the first rim (210) and the first temple (250). The second end piece (240) can connect the second rim (220) and the second temple (260).

[0064] According to one embodiment, the first temple (250) may be operatively connected to the first end piece (230) using a first hinge portion (255). The first hinge portion (255) may be rotatably configured so that the first temple (250) folds or unfolds relative to the first rim (210). The first temple (250) may extend, for example, along the left side of the user's head. The end portion of the first temple (250) (e.g., in the y-axis direction) may be configured in a bent shape to be supported, for example, by the user's left ear when the user wears the wearable electronic device (200). The second temple (260) may be operatively connected to the second end piece (240) using a second hinge portion (265). The second hinge portion (265) may be rotatably configured so that the second temple (260) folds or unfolds relative to the second rim (220). The second temple (260) may extend, for example, along the right side of the user's head. The end portion of the second temple (260) (e.g., in the y-axis direction) may be configured in a bent shape to be supported, for example, by the user's right ear when the user wears the wearable electronic device (200).

[0065] According to one embodiment, the first temple (250) may include a first printed circuit board (251), a first acoustic output module (253) (e.g., acoustic output module (155) of FIG. 1) and / or a first battery (257) (e.g., battery (189) of FIG. 1). The second temple (260) may include a second printed circuit board (261), a second acoustic output module (263) (e.g., acoustic output module (155) of FIG. 1) and / or a second battery (267) (e.g., battery (189) of FIG. 1).

[0066] According to one embodiment, various electronic components (e.g., at least some of the components included in the electronic device (101) of FIG. 1), such as the processor (120), memory (130), interface (177), and / or wireless communication module (192) disclosed in FIG. 1, may be disposed on the first printed circuit board (251) and / or the second printed circuit board (261). The processor may include, for example, one or more of a central processing unit, an application processor, a graphics processing unit, an image signal processor, a sensor hub processor, or a communication processor. The first printed circuit board (251) and / or the second printed circuit board (261) may include, for example, a printed circuit board (PCB), a flexible PCB (FPCB), or a rigid-flexible PCB (RFPCB). In some embodiments, the first printed circuit board (251) and / or the second printed circuit board (261) may include a Main PCB, a secondary PCB disposed partially overlapping with the Main PCB, and / or an interposer substrate between the Main PCB and the secondary PCB. The first printed circuit board (251) and / or the second printed circuit board (261) may be electrically or operatively connected to other components (e.g., camera module (203), first eye-tracking camera (205), second eye-tracking camera (207), audio module (209), first microphone (211), first recognition camera (213), first light-emitting device (217), first display module (219), second microphone (221), second recognition camera (223), second light-emitting device (227), second display module (229), first sound output module (253) and / or second sound output module (263)) using an electrical path such as an FPCB and / or cable.For example, the FPCB and / or cable may be placed on at least a portion of the first rim (210), the bridge (201) and / or the second rim (220). In some embodiments, the wearable electronic device (200) may include only one of the first printed circuit board (251) or the second printed circuit board (261).

[0067] According to one embodiment, the first acoustic output module (253) and / or the second acoustic output module (263) may transmit an audio signal to the user's left and / or right ears. The first acoustic output module (253) and / or the second acoustic output module (263) may include, for example, a piezo speaker (e.g., a bone conduction speaker) that transmits an audio signal without a speaker hole. In some embodiments, the wearable electronic device (200) may include only one of the first acoustic output module (253) or the second acoustic output module (263).

[0068] According to one embodiment, the first battery (257) and / or the second battery (267) may supply power to the first printed circuit board (251) and / or the second printed circuit board (261) using a power management module (e.g., the power management module (188) of FIG. 1). The first battery (257) and / or the second battery (267) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell. In some embodiments, the wearable electronic device (200) may include only one of the first battery (257) or the second battery (267).

[0069] According to one embodiment, the wearable electronic device (200) may include a sensor module (e.g., the sensor module (176) of FIG. 1). The sensor module may generate an electrical signal or data value corresponding to an internal operating state of the wearable electronic device (200) or an external environmental state. The sensor module may further include at least one of, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biosensor (e.g., an HRM sensor), a temperature sensor, a humidity sensor, or an illuminance sensor. In some embodiments, the sensor module may recognize the user's biometric information using various biosensors (or biometric recognition sensors), such as an olfactory sensor (e-nose sensor), an EMG sensor (electromyography sensor), an EEG sensor (electroencephalogram sensor), an ECG sensor (electrocardiogram sensor), or an iris sensor.

[0070] According to one embodiment, although the above description describes the wearable electronic device (200) as a device that displays augmented reality using a first glass (215) and a second glass (225), it is not limited thereto and may also be a device that displays virtual reality (VR).

[0071] FIG. 3A is a drawing showing the front view of a head-mounted display device (300) according to one embodiment of the present disclosure.

[0072] FIG. 3B is a drawing showing the back of a head-mounted display device (300) according to one embodiment of the present disclosure.

[0073] Referring to FIGS. 3A and 3B, the head-mounted display device (300) can be worn on a part of the user's body to provide a user interface.

[0074] In one embodiment, the head-mounted display device (300) may output photos and / or images to the user. Alternatively, the head-mounted display device (300) may provide images related to augmented reality services and / or virtual reality services. For example, the head-mounted display device (300) may provide the user with an experience of augmented reality, virtual reality, mixed reality, and / or extended reality.

[0075] For example, a head-mounted display device (300) can provide augmented reality to a user. The head-mounted display device (300) can transmit virtual object images output from a display module (160) (e.g., a first display module (219), a second display module (229)) toward the user's eyes, and the virtual object images can utilize data on images of the real world captured through a plurality of cameras (330a, 330b, 330c).

[0076] In one embodiment, the head-mounted display device (300) may be, for example, a head-mounted display (HMD) or a face-mounted display (FMD), or may be a smart glass or headset that provides extended reality such as augmented reality (AR), virtual reality (VR), or mixed reality, but is not limited thereto.

[0077] In one embodiment, the head-mounted display device (300) may include at least some of a housing (310), a plurality of cameras (330a, 330b, 330c) and a display module (160).

[0078] In one embodiment, the head-mounted display device (300) may include a housing (310). The housing (310) may be configured to accommodate at least one component. The housing (310) may include a first surface (311a) (e.g., front), a second surface (311b) opposite to the first surface (311a) (e.g., rear or wearing surface), and a third surface (311c) (e.g., side surface) between the first surface (311a) and the second surface (311b).

[0079] In one embodiment, the housing (310) may include a bridge (314). The bridge (314) may be configured to face a part of the user's body (e.g., nose). For example, the bridge (314) may be supported by the user's nose.

[0080] In one embodiment, the housing (310) may correspond to the main body of the head-mounted display device (300). The housing (310) may be identical to the main body of the head-mounted display device (300).

[0081] In one embodiment, the housing (310) can be mounted on the user's head by means of a wearing structure such as a template or a strap.

[0082] In one embodiment, the head-mounted display device (300) may include a lens structure (320). The lens structure (320) may include a plurality of lenses configured to adjust the focus of an image provided to a user. For example, the plurality of lenses may be configured to adjust the focus of an image output by a display module (160). The plurality of lenses may be positioned at a location corresponding to the position of the display module (160). The plurality of lenses may include, for example, a Fresnel lens, a pancake lens, a multichannel lens, and / or any other suitable lens.

[0083] In one embodiment, the display module (160) may be positioned at a location corresponding to the lens structure (320).

[0084] In one embodiment, the head-mounted display device (300) may include a display module (160). The display module (160) may be configured to provide an image (e.g., a virtual image) to a user. For example, the display module (160) may include a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), a light emitting diode (LED) on silicon (LEDoS), an organic light emitting diode (OLED), and / or a micro light emitting diode (micro LED).

[0085] In one embodiment, if the display module (160) includes at least one of a liquid crystal display device, a digital mirror display device, or a silicon liquid crystal display device, the head-mounted display device (300) may include a light source that irradiates light to the screen output area of ​​the display module (160).

[0086] In one embodiment, if the display module (160) can generate light on its own, for example, if the display module (160) includes at least one of an organic light-emitting diode or a micro LED, the head-mounted display device (300) can provide a good quality virtual image to the user without including a separate light source.

[0087] In one embodiment, if the display module (160) includes an organic light-emitting diode or a micro LED, a light source is unnecessary, so the head-mounted display device (300) can be made lighter. The head-mounted display device (300) may include a display module (160) and at least one transparent member. A user may use the head-mounted display device (300) while wearing it on their face. At least one transparent member may be formed of a glass plate, a plastic plate, or a polymer, and may be made transparent or translucent.

[0088] In one embodiment, at least one transparent member may be positioned facing the user's right or left eye.

[0089] In one embodiment, the head-mounted display device (300) may include a screen display unit. The screen display unit may refer to a portion where an image generated by the display module (160) is output. The image output from the screen display unit may enter the user's eye through a lens structure (320).

[0090] In one embodiment, when the display module (160) is transparent, it may be positioned facing the user's eyes to form a screen display unit (320). In one embodiment, the display module (160) may include a light source (not shown) configured to transmit a light signal to an area where an image is output.

[0091] In one embodiment, the display module (160) can provide an image to the user by generating an optical signal itself.

[0092] In one embodiment, the display module (160) may be placed on the second surface (311b) of the housing (310). For example, one surface of a pair of lenses of the display module (160) may be positioned so as to be exposed to the outside through the second surface (311b).

[0093] In one embodiment, the display module (160) may be composed of organic light emitting diodes (OLEDs). For example, the OLED can express red (R), green (G), and blue (B) through the self-luminescence of the organic material. However, it is not limited thereto, and a single pixel may include R, G, and B, and a single chip may be implemented with multiple pixels including R, G, and B.

[0094] In one embodiment, the display module (160) can display various images. Here, the image is a concept that includes still images and video, and the display module (160) can display various images such as broadcast content, multimedia content, etc. Additionally, the display module (160) may display a user interface (UI) and icons.

[0095] In one embodiment, the display module (160) includes a separate IC chip, and the IC chip can display an image based on an image signal received from the processor (120). In one embodiment, the IC chip can display an image by generating a driving signal for a plurality of light-emitting elements based on an image signal received from the processor (120) and controlling the light emission of a plurality of pixels included in the display panel based on the driving signal.

[0096] In one embodiment, the display module (160) may include a plurality of pixels for displaying a virtual image. The display module (160) may further include infrared pixels that emit infrared light.

[0097] In one embodiment, the display module (160) may further include a light-receiving pixel (e.g., a photo sensor pixel) disposed between pixels, which receives light reflected from the user's eye, converts it into electrical energy, and outputs it. The light-receiving pixel may be referred to as an 'eye-tracking sensor'. The eye-tracking sensor can detect infrared light reflected by the user's eye, which is light emitted by an infrared pixel included in the display module (160).

[0098] In one embodiment, the head-mounted display device (300) can detect the direction of the user's gaze (e.g., eye movement) through light-receiving pixels. For example, the light-receiving pixels may be an image sensor (e.g., a third camera (330c)) or various types of sensors that track the user's gaze.

[0099] In one embodiment, the head-mounted display device (300) may determine the position of the center of the virtual image according to the gaze direction of the user's left and right eyes detected through one or more light-receiving pixels (e.g., the direction in which the pupils of the user's left and right eyes gaze).

[0100] In one embodiment, the head-mounted display device (300) may include at least one display. The head-mounted display device (300) may include a display module (160) as a main display and a 3D display as an auxiliary display or an external display.

[0101] In one embodiment, the display module (160) may include a light-collecting lens and / or a transparent waveguide. For example, the transparent waveguide may be located at least partially in a part of the glass.

[0102] In one embodiment, light emitted from the display module (160) can be received at one end of the glass, and the received light can be transmitted to the user through a waveguide and / or waveguide (e.g., waveguide) formed within the glass.

[0103] In one embodiment, the incoming light can be propagated or reflected inside the waveguide by the nano pattern and provided to the user.

[0104] In one embodiment, the waveguide may include at least one diffractive element (e.g., DOE (diffractive optical element), HOE (holographic optical element)) or a reflective element (e.g., a reflective mirror).

[0105] In one embodiment, the waveguide can guide display light emitted from the light source to the user's eye using at least one diffraction element or reflection element.

[0106] In one embodiment, the waveguide serves to transmit a light source generated by the display to the user's eye.

[0107] In one embodiment, the waveguide may be made of glass, plastic, or polymer and may include a nano pattern formed on some internal or external surface, for example, a polygonal or curved grating structure.

[0108] In one embodiment, light incident on one end of a waveguide can be propagated within the optical waveguide of a display module (160) by a nano-pattern and provided to a user. Additionally, an optical waveguide composed of a free-form prism can provide the incident light to a user through a reflective mirror. The optical waveguide may include at least one diffractive element (e.g., DOE (Diffractive Optical Element), HOE (Holographic Optical Element)) or a reflective element (e.g., a reflective mirror). The optical waveguide can guide display light emitted from a light source to the user's eyes using at least one diffractive element or reflective element included in the optical waveguide.

[0109] In one embodiment, the diffraction element may include an input optical member / an output optical member (not shown). For example, the input optical member may refer to an input grating area, and the output optical member (not shown) may refer to an output grating area. The input grating area may serve as an input terminal that diffracts (or reflects) light output from (e.g., Micro LED, light source) to transmit light to a transparent member of a screen display (e.g., first transparent member, second transparent member, first glass (215), second glass (225) of FIG. 2). The output grating area may serve as an output terminal that diffracts (or reflects) light transmitted to a transparent member of an optical waveguide (e.g., first transparent member, second transparent member, first glass (215), second glass (225) of FIG. 2) to the user's eye.

[0110] In one embodiment, the reflection element may include a total internal reflection optical element or a total internal reflection waveguide for total internal reflection (TIR). For example, total internal reflection is a method of inducing light, which may mean creating an angle of incidence such that light (e.g., a virtual image) entering through an input grating area is 100% reflected from one side (e.g., a specific side) of the optical waveguide and is transmitted 100% to an output grating area.

[0111] In one embodiment, light emitted from the display module (160) may be guided along an optical path to an optical waveguide through an input optical member. Light traveling within the optical waveguide may be guided toward the user's eye through an output optical member. The screen display may be determined based on the light emitted toward the eye.

[0112] In one embodiment, the head-mounted display device (300) may include a sensor (e.g., the sensor (176) of FIG. 1). The sensor (176) may be configured to detect the depth of a subject. The sensor (176) may be configured to transmit a signal toward the subject and / or receive a signal from the subject. For example, the transmitted signal may include near-infrared, ultrasonic, and / or laser. The sensor (176) may be configured to measure the time of flight (ToF) of the signal to measure the distance between the head-mounted display device (300) and the subject. The sensor (176) may be placed on a first surface (311a) of the housing (310).

[0113] In one embodiment, the sensor (176) may include a depth sensor. The depth sensor may be used to determine the distance to an object. The depth sensor (e.g., the depth sensor (335) of FIG. 3A) may include Time of Flight (ToF) technology. ToF technology may include a technology that measures the distance to an object using a signal (near-infrared, ultrasonic, laser, etc.). ToF technology may emit a signal from a transmitter and measure the signal from a receiver, and may measure the flight time of the signal.

[0114] In one embodiment, the camera (180) of FIG. 1 may include a plurality of cameras (330a, 330b, 330c).

[0115] In one embodiment, the plurality of cameras (330a, 330b, 330c) may include at least some of the first camera (330a), the second camera (330b), or the third camera (330c). The plurality of cameras (330a, 330b, 330c) may photograph the outside of the housing (310), for example, a user and / or other subjects. For example, the plurality of cameras (330a, 330b, 330c) may convert optical signals into input data and provide them to the processor (120). In one embodiment, the processor (120) may receive the input data and transmit output data to the display module (160). The processor (120) may combine the data received from each of the plurality of cameras (330a, 330b, 330c), process the combined data, and control the display module (160).

[0116] In one embodiment, a first camera (330a) including at least one camera for shooting and a second camera (330b) including at least one camera for recognition are spaced apart from the first surface (311a) of the housing (310) so as to be able to photograph the direction in which the first surface (311a) of the housing (310) faces.

[0117] In one embodiment, the first camera (330a) and the second camera (330b) may be spaced apart from each other on the first surface (311a) of the housing (310). The first camera (330a) and the second camera (330b) may be positioned to face different directions to capture various directions, such as the first surface (311a) or the third surface (311c).

[0118] In one embodiment, the first camera (330a) may be configured to acquire an image from a subject. The first camera (330a) may be formed in plurality, and one of the first cameras (330a) may be placed in a first area among the first surface (311a) of the housing (310), and another first camera (330a) may be placed in a second area of ​​the housing (310) that is different from the first area among the first surface (311a) of the housing (310).

[0119] In one embodiment, a plurality of first cameras (330a) may be positioned on each side of the depth sensor (335). The plurality of first cameras (330a) may include an image stabilizer actuator (not shown) and / or an auto focus actuator (not shown). For example, the plurality of first cameras (330a) may include at least one camera configured to acquire a color image, a global shutter (GS) camera, or a rolling shutter (RS) camera, or a combination thereof.

[0120] In one embodiment, the second camera (330b) may be configured to recognize a subject. The second camera (330b) may be formed in plurality, and the plurality of second cameras (330b) may be configured to detect and / or track objects (e.g., a human head or hand) or spaces with 3 degrees of freedom (DoF) or 6 degrees of freedom (DoF). For example, the plurality of second cameras (330b) may include a global shutter (GS) camera. The plurality of second cameras (330b) may be configured to perform simultaneous localization and mapping (SLAM) using depth information of the subject. The plurality of second cameras (330b) may be configured to recognize gestures of the subject.

[0121] In one embodiment, a plurality of second cameras (330b) may be placed on the first surface (311a) of the housing (310).

[0122] In one embodiment, the first camera (330a) and the second camera (330b) may be cameras for capturing images, may be referred to as HR (high resolution) or PV (photo video), and may include high-resolution cameras. The first camera (330a) and the second camera (330b) may include color cameras equipped with functions for obtaining high-quality images, such as AF (auto focus) and optical image stabilizer (OIS). Not limited thereto, the first camera (330a) and the second camera (330b) may include a global shutter (GS) camera or a rolling shutter (RS) camera.

[0123] In one embodiment, the head-mounted display device (300) may include a plurality of third cameras (330c). The plurality of third cameras (330c) may be configured to recognize a user's face. For example, the plurality of third cameras (330c) may be configured to detect and track a user's facial expression.

[0124] In one embodiment, the third camera (330c) may include at least one facial recognition camera or at least one eye tracking camera.

[0125] In one embodiment, the head-mounted display device (300) may further include an eye-tracking camera in at least some of the plurality of third cameras (330c). The eye-tracking camera may be used to detect and track the pupil.

[0126] In one embodiment, the third camera (330c) can detect and track the pupil. The third camera (330c) may include a plurality of cameras corresponding to the left eye and the right eye.

[0127] In one embodiment, at least one of the plurality of cameras (330a, 330b, 330c) may include a camera used for 3 degrees of freedom (DoF), 6 degrees of freedom (DoF) head tracking, hand detection and tracking, gesture and / or spatial recognition.

[0128] In one embodiment, at least one of the plurality of cameras (330a, 330b, 330c) may include a global shutter (GS) camera to detect and track the movement of the head and hand. For example, two global shutter (GS) cameras of the same specifications and performance may be used for head tracking and spatial recognition, and a rolling shutter (RS) camera may be used to detect and track fine movements such as fast hand movements and fingers.

[0129] In one embodiment, at least one of the plurality of cameras (330a, 330b, 330c) may primarily be a global shutter (GS) camera with superior performance relative to the camera (e.g., image drag), but is not necessarily limited thereto, and, for example, a rolling shutter (RS) camera may be used. At least one of the plurality of cameras (330a, 330b, 330c) may perform spatial recognition for 6 degrees of freedom (DoF) and simultaneous localization and mapping (SLAM) functions through depth capture. At least one of the plurality of cameras (330a, 330b, 330c) may also perform user gesture recognition functions.

[0130] In one embodiment, the head-mounted display device (300) may include an inertial measurement unit (IMU) sensor. The IMU sensor may include at least one of an accelerometer, a gyroscope, or a magnetometer. The head-mounted display device (300) may detect the user's movement based on the IMU sensor.

[0131] In one embodiment, although not shown in the drawings, the head-mounted display device (300) may include at least some of a sensor (not shown), a lighting unit (not shown), a plurality of microphones (not shown), a plurality of speakers (not shown), a battery (not shown), and a printed circuit board (not shown).

[0132] In one embodiment, the sensor (not shown) may exist as one or more for various purposes (e.g., gyroscope sensor, accelerometer sensor, geomagnetic sensor, and / or gesture sensor), and, for example, the sensor (not shown) may perform at least one of the following functions: head tracking for 6 degrees of freedom (DoF), pose estimation and prediction, gesture and / or spatial recognition, and / or simultaneous localization and mapping (SLAM) through depth capture.

[0133] In one embodiment, the lighting unit (not shown) may have various uses depending on the location where it is attached. For example, the lighting unit (not shown) may be attached around the second side (311b) of the head-mounted display device (300). The lighting unit (not shown) may be used as an auxiliary means to facilitate eye gaze detection when the eye-tracking camera (not shown) photographs the pupil. The lighting unit (not shown) may use an IR LED (infra-red light emitting device) of visible light wavelength or infrared wavelength.

[0134] For example, a lighting unit (not shown) may be attached to the front (311a) of the head-mounted display device (200) or around it. The lighting unit (not shown) may be used as a means to supplement ambient brightness when multiple front cameras (e.g., first camera (330a), second camera (330b)) are shooting. The lighting unit (not shown) may be used when it is not easy to detect the subject to be shot, especially in a dark environment or due to the mixing of multiple light sources and reflected light.

[0135] In one embodiment, a lighting unit (not shown) may be omitted. The lighting unit (not shown) may be replaced by an infrared pixel included in the display module (160). The lighting unit (not shown) may be included in the head-mounted display device (300) to assist the infrared pixel included in the display module (160).

[0136] In one embodiment, a plurality of microphones (not shown) can process external acoustic signals into electrical voice data. The processed voice data can be utilized in various ways depending on the function (or application running) being performed on the head-mounted display device (300).

[0137] In one embodiment, a plurality of speakers (not shown) can output audio data received from a communication circuit or stored in a memory (130).

[0138] In one embodiment, one or more batteries (not shown) may be included in the head-mounted display device (300) and may supply power to the components constituting the head-mounted display device (300).

[0139] In one embodiment, a printed circuit board (not shown) can transmit electrical signals to each circuit (e.g., camera (e.g., first camera (330a), second camera (330b)), display module (160), a plurality of speakers (e.g., audio module (170) of FIG. 1), sensor (e.g., sensor module of FIG. 1)) and other printed circuit boards through a flexible printed circuit board (FPCB).

[0140] In one embodiment, a printed circuit board (not shown) may have a control circuit (not shown) on which controls a component constituting a head-mounted display device (300).

[0141] FIG. 4 is a drawing illustrating a light engine according to one embodiment.

[0142] An electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2, and the head-mounted display device (300) of FIG. 3A and FIG. 3B) may include an optical engine (e.g., an optical engine) and a light waveguide. An optical engine (the optical engine (400) of FIG. 4, the optical engine (500) of FIG. 5A, the optical engine (900) of FIG. 9, and the optical engine (1000) of FIG. 10B) may include a display that outputs image light representing an image (e.g., the display (430) of FIG. 4, the display (530) of FIG. 5A, and the display (930) of FIG. 9). Image light may refer to light representing an image output through a specific component included in the electronic device (e.g., the first glass (215), the second glass (225) of FIG. 2, and the lens structure (320) of FIG. 3B). The display (430) may generate image light (402) based on illumination light (401) transmitted from another optical element (e.g., light source (410)) included in the electronic device (e.g., electronic device (101) of FIG. 1, wearable electronic device (200) of FIG. 2, and head-mounted display device (300) of FIG. 3A and FIG. 3B) or may generate image light independently. In the drawings below, an electronic device (e.g., electronic device (101) of FIG. 1, wearable electronic device (200) of FIG. 2, and head-mounted display device (300) of FIG. 3A and FIG. 3B) including a light engine (400) that includes a display (430) that generates image light (402) based on illumination light (401) transmitted from another optical element (e.g., light source (410)) included in the electronic device (101) will be described.

[0143] The light engine (400) may include an illumination system and a projection system. The illumination system may include at least one optical element that generates (or emits) illumination light (401) and outputs (or transmits) it to a display (430). The projection system may include at least one optical element that outputs (or transmits) image light (402) generated by the display (430) to a predetermined area (or a part of the optical path between the display (430) and the predetermined area (e.g., an optical waveguide)). The illumination system and the projection system may share some of the optical elements included in the illumination system and the projection system (e.g., a polarizing beam splitter (PBS) (420), part of a relay lens group (460). The electronic device (101) may include a light waveguide that transmits image light (402) to the user's field of vision (e.g., the exit pupil (1115) of FIG. 11). The electronic device (101) may output image light (402) generated from the display (430) to a predetermined area (e.g., the exit pupil (1115) of FIG. 11) through a projection system and / or a light waveguide included in the light engine (400).

[0144] The light engine (400) may be manufactured to include at least one optical element including at least two collimator lenses, a fly-eye lens (FEL) (450), and a relay lens group (460) in order to maintain the quality of the illumination light (401) (e.g., intensity and uniformity of intensity distribution) above a certain level. Referring to FIG. 4, the light engine (400) according to one embodiment may include a light source (410), a collimator lens group (440), a fly-eye lens (450), a relay lens group (460), a polarizing beam splitter (420), and / or a display (430). The collimator lens group (440) may include a first collimator lens (441) and / or a second collimator lens (442) for collimating the illumination light (401). The relay lens group (460) may include at least one relay lens that transmits illumination light (401) to the display (430). Although the relay lens group (460) in FIG. 4 is shown as including three relay lenses, the number of relay lenses is not limited to three.

[0145] A light source (410), a first condensing lens (441), a second condensing lens (442), and / or a fly-eye lens (450) may be arranged so that illumination light (401) output from the light source (410) is incident on a polarizing beam splitter (420). For example, the light source (410), the first condensing lens (441), the second condensing lens (442), the fly-eye lens (450), and / or the polarizing beam splitter (420) may be arranged sequentially according to a first direction (471). The first direction (471) may be substantially the same direction as the direction of travel of the illumination light (401) output from the light source (410).

[0146] According to one embodiment, a first condensing lens (441) may be positioned so that illumination light (401) output from a light source (410) can pass through the first condensing lens (441). A second condensing lens (442) may be positioned so that illumination light (401) that has passed through the first condensing lens (441) can pass through the second condensing lens (442). A fly-eye lens (450) may be positioned so that illumination light (401) that has passed through the second condensing lens (442) can pass through the fly-eye lens (450). A polarizing beam splitter (420) may be positioned so that illumination light (401) that has passed through the fly-eye lens (450) is incident on the polarizing beam splitter (420) through the first relay lens (461).

[0147] At least one relay lens (e.g., a first relay lens (461)) included in the relay lens group (460) may be positioned between the polarizing beam splitter (420) and the fly-eye lens (450). At least one relay lens (e.g., a second relay lens (462) and / or a third relay lens (463)) included in the relay lens group (460) may be positioned between the polarizing beam splitter (420) and the display (430). Positioning C between A and B of the present disclosure may include positioning the illumination light (401) so that it passes through A and C sequentially and is incident on C. For example, positioning C between A and B may include A, B, and C being positioned in the same direction. The illumination light (401) can pass sequentially through the polarization beam splitter (420), the first relay lens (461), and the fly eye lens as the polarization beam splitter (420), the first relay lens (461), and the fly eye lens are arranged in the same direction and enter the fly eye lens.

[0148] A first relay lens (461) may be positioned so that illumination light (401) passing through a fly-eye lens (450) passes through the first relay lens (461). A second relay lens (462) may be positioned so that illumination light (401) reflected by the polarization separation surface (421) of a polarizing beam splitter (420) passes through the second relay lens (462). A third relay lens (463) may be positioned so that illumination light (401) passing through the second relay lens (462) passes through the third relay lens. According to one embodiment, relay lenses (461, 462, 463) included in a relay lens group (460) can transmit illumination light (401) to a display (430). For example, transmitting the illumination light (401) to the display (430) may include aligning the optical axis so that the illumination light (401) reaches the display (430), adjusting the focal length of the illumination light (401), or correcting the aberration of the illumination light (401).

[0149] The display (430) may be positioned in a direction adjacent to the side of the light source (410) of the polarizing beam splitter (420). For example, the display (430) may be positioned in the second direction (472) of the polarizing beam splitter (420). The second direction (472) may be a direction perpendicular to the first direction (471). The display (430) may be positioned so that illumination light (401) passing through the third relay lens (463) is incident on the display (430). The display (430) may generate image light (420) by reflecting at least a portion of the incident illumination light, in the form of a reflective liquid crystal display. For example, the display (430) may be an LCoS (liquid crystal on silicon) display.

[0150] The light source (410) can emit illumination light (401) directed toward a specific direction (e.g., a first direction (471)). The emitted illumination light (401) can be diffused in multiple directions. For example, the emitted illumination light (401) can be diffused in various directions from the point where the illumination light (401) on the light source (410) is emitted.

[0151] The first condensing lens (441) and the second condensing lens (442) can adjust the illumination light (401) diffused in multiple directions contained in the illumination light (401) emitted from the light source (410) to be parallel to a specific direction (e.g., the first direction (471)). The first condensing lens (441) and the second condensing lens (442) can adjust the direction of travel of the light that is not directed toward the next optical element (e.g., the second condensing lens (442), the fly eye lens (450)) among the illumination light (401) diffused in multiple directions to be directed toward the next optical element on the optical path. The first condensing lens (441) and the second condensing lens (442) can adjust the illumination light that is out of the optical path among the illumination light (401) diffused in multiple directions to be incident on the display (430) by reducing the amount of illumination light that is out of the optical path. For example, among the illumination light (401) diffused in multiple directions, the amount of illumination light that does not enter the next optical element on the optical path may increase as the direction of the illumination light (401) is adjusted by a condensing lens (e.g., a first condensing lens (441) and a second condensing lens (442)). For example, when the illumination light (401) enters the optical element (e.g., a second condensing lens (442)) next to the first condensing lens (441) on the optical path, the amount of illumination light that does not enter the next optical element (e.g., a second condensing lens (442)) may decrease as the direction of the illumination light (401) emitted from the light source (410) is adjusted by the first condensing lens (441). When illumination light (401) is incident on the optical element (e.g., fly eye lens (450)) following the second condensing lens (442) on the optical path, the amount of illumination light not directed toward the next optical element (e.g., fly eye lens (450)) can be reduced as the illumination light (401) incident on the second condensing lens (442) is adjusted by the second condensing lens (442).The light engine (400) can reduce the amount of illumination light that does not enter the display (430) by reducing the illumination light (401) emitted from the light source (410) that deviates from the light path through the first condensing lens (441) and the second condensing lens (442).

[0152] The fly-eye lens (450) can adjust the intensity distribution of the illumination light (401) that has passed through the condensing lens group (440). The illumination light (401) that has passed through the condensing lens group (440) can be incident on the fly-eye lens (450) through the substantial central portion of the fly-eye lens (450) and / or the outer portion excluding the central portion. The degree of uniformity of the intensity distribution according to the angle (or direction) of the light traveling at various angles (or directions) included in the illumination light (401) may be lower than a threshold value. The fly-eye lens (450) can adjust the illumination light (401) so that the intensity distribution according to the angle (or direction) of the light traveling at various angles (or directions) included in the illumination light (401) is uniform. The degree of uniformity of the intensity distribution according to the angle (or direction) of the light traveling at various angles (or directions) included in the illumination light (401) that has passed through the fly-eye lens (450) may be higher than a threshold value.

[0153] Illuminating light (401) passing through the fly-eye lens (450) can be incident on the polarizing beam splitter (420). Illuminating light (401) passing through the fly-eye lens (450) can be incident on the polarizing beam splitter (420) through the first relay lens (461). The polarizing beam splitter (420) can reflect or pass the illuminating light (401) incident on the polarizing beam splitter (420) based on the polarization direction of the illuminating light (401) (e.g., illuminating light (401) passing through the fly-eye lens (450)) incident on the polarizing beam splitter (420). A polarization beam splitter (420) may include a polarization-splitting surface (421) that passes through or reflects the illumination light (401) depending on the polarization direction of the light (e.g., illumination light (401) or image light (402)). The polarization-splitting surface (421) may reflect light (e.g., illumination light (401) or image light (402)) polarized in a first polarization direction (e.g., S-polarization) and pass light (e.g., illumination light (401) or image light (402)) polarized in a second polarization direction (e.g., P-polarization). According to another example, the polarization-splitting surface (421) may be manufactured (or positioned) to pass light polarized in a first polarization direction (e.g., S-polarization) and reflect light polarized in a second polarization direction (e.g., P-polarization).

[0154] The light engine (400) may include at least one polarizing plate for changing (or determining) whether the light illumination light (401) (or image light (402)) passes through the polarization separation plane (421). The at least one polarizing plate may include a polarizing plate that changes (or determines) the polarization direction of the light illumination light (401) to a first polarization direction (e.g., S-polarization) or a second polarization direction (e.g., P-polarization). For example, the light engine (400) may include a polarizing plate on the light source (410) side of the polarizing beam plate that changes (or determines) the polarization direction of the light illumination light (401) to a first polarization direction (e.g., S-polarization). The light illumination light (401) that passes through the polarizing plate may be polarized to a first polarization direction (e.g., S-polarization). Illuminating light (401) polarized in a first polarization direction (e.g., S-polarization) can be reflected by the polarization separation surface (421) of the polarization beam splitter (420).

[0155] The illumination light (401) reflected by the polarization separation surface (421) can proceed in a direction toward the display (430). The illumination light (401) reflected by the polarization separation surface (421) can proceed in a direction toward the display (430) after passing through the second relay lens (462) and / or the third relay lens (463). The display (430) can generate (or output) image light (402) representing an image based on the illumination light (401) incident on the display (430) (e.g., illumination light (401) reflected by the polarization separation surface (421)). The image light (402) generated (or output) by the display (430) can be incident on an optical waveguide through an optical element included in the light engine (400).

[0156] The volume of the optical engine (400) may vary depending on the arrangement of at least one optical element included in the optical engine (400). Referring to FIG. 4, the first condensing lens (441), the second condensing lens (442), and / or the fly-eye lens (450) may be placed in the same direction of the polarizing beam splitter (420) (e.g., the third direction (473) of the polarizing beam splitter (420) (e.g., the opposite direction of the first direction (471)). When the first condensing lens (441), the second condensing lens (442), and / or the fly-eye lens (450) are placed in the same direction of the polarizing beam splitter (420), the volume of the area corresponding to the optical element within the optical engine (400) may increase. When the volume of the area corresponding to the optical element within the optical engine (400) increases, the volume of the optical engine (400) may increase. An increase in the volume of the light engine (400) may be disadvantageous to the miniaturization of the electronic device (101).

[0157] The light engine (400) may include a relay lens group (460) comprising at least one relay lens that transmits illumination light (401) to a display (430). The at least one relay lens may transmit illumination light (401) to the display (430) by collectively adjusting the illumination light (401). Transmitting the illumination light (401) onto the display (430) may involve transmitting light elements that are diffused in substantially the same direction among the illumination light (401) diffused in various directions to the same location on the display (430). In order to maintain the quality of the illumination light (401) (e.g., intensity and uniformity of intensity distribution) above a certain level, the light engine (400) may be manufactured to include a predetermined number of relay lenses. As the light engine (400) is manufactured to include a predetermined number of relay lenses, there may be limitations in reducing the volume of the light engine (400).

[0158] The light engine (500, 900, 1000) described below in FIGS. 5A, 5B, 6, 7, 8, 9, 10A, 10B, and 11 may be smaller in volume than the light engine (400) of FIG. 4 by including a condensing lens (e.g., the second condensing lens (542) of FIG. 5A, the second condensing lens (942) of FIG. 9) which functions as either a condensing lens or a relay lens depending on the surface on which the illumination light (401, 901) is incident.

[0159] FIG. 5A is a drawing illustrating a light engine included in an electronic device according to one embodiment.

[0160] An electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2, and the head-mounted display device (300) of FIG. 3A and FIG. 3B) may include an optical engine (500) and an optical waveguide (e.g., the optical waveguide (1100) of FIG. 11). It should be understood that the description of the optical engine (400) of FIG. 4 and the components included in the optical engine may also apply to the optical engine (500) of FIG. 5A.

[0161] An optical engine (500) according to one embodiment may include a light source (510), a collimator lens group (540), a fly-eye lens (FEL) (550), a relay lens group, a polarization beam splitter (PBS) (520), and / or a display (530). The collimator lens group (540) may include a first collimator lens (541) and / or a second collimator lens (542) that collimates illumination light (501). The relay lens group may include at least one relay lens that transmits illumination light (501) to the display (530). For example, the optical engine (500) may include at least one relay lens having positive refractive power, which is positioned between the polarization beam splitter (520) and the display (530).

[0162] According to one embodiment, at least one relay lens included in the polarizing beam splitter (520), the first condensing lens (541), the second condensing lens (542), and / or the relay lens group may be formed of glass or plastic, but is not limited thereto. According to one example, the first condensing lens (541) may be made of a heat-resistant material as it is positioned in close proximity to the light source (510). The first condensing lens (541) may be formed of a heat-resistant material than the second condensing lens (542). For example, the first condensing lens (541) may be formed of a heat-resistant glass material instead of a heat-sensitive plastic material. Additionally, the first condensing lens (541) and the second condensing lens (542) may be formed of a glass material.

[0163] The first condensing lens (541) may be positioned in the direction of the light output of the light source (510). The first condensing lens (541) may include a first surface (5411) facing the light source (510) and a second surface (5412) opposite the first surface (5411). The second condensing lens (542) may include a third surface (5421) facing the polarizing beam splitter (520) and a fourth surface (5422) opposite the third surface (5421). The fly eye lens (550) may include a fifth surface (5501) facing the fourth surface (5422) of the second condensing lens (542) and a sixth surface (5502) opposite the fifth surface (5501). The polarizing beam splitter (520) may include a seventh surface (5201) facing the second surface (5412) of the first condensing lens (541), an eighth surface (5202) facing the third surface (5421) of the second condensing lens (542), a ninth surface (5203) and a tenth surface (5204) perpendicular to the eighth surface.

[0164] The first surface (5411) of the first condensing lens (541) may have negative curvature, and the second surface (5412) may have positive curvature. The third surface (5421) of the second condensing lens (542) may be flat, and the fourth surface (5422) may have positive curvature. The surface having negative curvature of the present disclosure may be a concave surface. The surface having positive curvature may be a convex surface.

[0165] A light source (510), a first condensing lens (541), a polarizing beam splitter (520), a second condensing lens (542), and / or a fly-eye lens (550) may be arranged so that illumination light (501) output from the light source (510) is incident on a reflective plate (551). For example, the light source (510), the first condensing lens (541), the polarizing beam splitter (520), the second condensing lens (542), the fly-eye lens (550), and / or the reflective plate (551) may be arranged sequentially according to a first direction (471). The first direction (471) may be substantially the same direction as the direction of travel of the illumination light (501) output from the light source (510).

[0166] The first condensing lens (541) may be positioned so that the illumination light (501) output from the light source (510) can pass through the first condensing lens (541). The polarizing beam splitter (520) may be positioned so that the illumination light (501) that has passed through the first condensing lens (541) can pass through the polarizing beam splitter (520). The second condensing lens (542) may be positioned so that the polarizing beam splitter (520) can be positioned between the second condensing lens (542) and the first condensing lens (541). The placement of a polarizing beam splitter (520) between the second focusing lens (542) and the first focusing lens (541) may include the first focusing lens (541) and the second focusing lens (542) being placed in the directions of two surfaces opposite to each other of the polarizing beam splitter (520) among the four surfaces of the polarizing beam splitter (520) (e.g., four surfaces in the horizontal direction (e.g., the seventh surface (5201), the eighth surface (5202), the ninth surface (5203), the tenth surface (5204))). For example, the second focusing lens (542) may be placed on the side opposite to the first focusing lens (541) side (or in the direction of the opposite side) with respect to the polarizing beam splitter (520). For example, the second focusing lens (542) may be placed on the first focusing lens with respect to the polarizing beam splitter (520). The lens (541) may be positioned in a direction opposite to the direction in which it is positioned. The fly-eye lens (550) may be positioned on the opposite side of the third surface (5421) of the second condensing lens (542) facing the polarizing beam splitter (520). For example, the fly-eye lens (550) may be positioned in the direction of the fourth surface (5422) of the second condensing lens (542). The reflective plate (551) may be positioned on the opposite side of the fifth surface (5501) of the fly-eye lens (550) facing (or opposite) the second condensing lens (542). For example, the reflective plate (551) may be positioned in the direction of the sixth surface (5502) of the fly-eye lens (550).

[0167] The display (530) may be positioned in a direction different from the direction in which the first condensing lens (541) and the second condensing lens (542) are positioned relative to the polarizing beam splitter (520). The display (530) may be positioned in the direction of the remaining surface of the polarizing beam splitter (520), excluding the surface adjacent to the first condensing lens (541) and the surface adjacent to the second condensing lens (542) among the four surfaces (e.g., four surfaces in the horizontal direction). For example, the display (530) may be positioned in a fourth direction (474) perpendicular to the first direction (471) relative to the polarizing beam splitter (520). The illumination light (501) may be incident on the display (530) by being reflected by the polarization separation surface (521).

[0168] The light engine (500) may include at least one polarizing plate (e.g., a first polarizing plate (522), a second polarizing plate (523)) for changing (or determining) whether to pass through the polarization separation surface (521). The first polarizing plate (522) may be placed on the side surface of the first condensing lens (541) of the polarizing beam splitter (520). Alternatively, the first polarizing plate (522) may be placed between the light source (510) and the first condensing lens (541). According to one example, the first polarizing plate (522) may be attached to the surface of the first condensing lens (541) (e.g., the first surface (5411)). The second polarizing plate (523) may be placed on the side surface of the second condensing lens (542) of the polarizing beam splitter (520). Alternatively, the second polarizing plate (523) may be placed between the second condensing lens (542) and the fly eye lens (550).

[0169] According to one embodiment, the first condensing lens (541) may be composed of two condensing lenses. The first polarizing plate (522) may be placed between the two condensing lenses constituting the first condensing lens (541).

[0170] The light source (510) can emit illumination light (501). The illumination light (501) can be emitted to travel toward a first direction (471). The emitted illumination light (501) can be diffused in various directions. For example, the emitted illumination light (501) can be diffused in various directions from the point where the illumination light (501) on the light source (510) is emitted.

[0171] The first condensing lens (541) and the second condensing lens (542) can adjust the direction of travel of light that is not directed toward the next optical element on the light path among the illumination light (501) diffused in multiple directions so that it travels toward the next optical element on the light path. The first condensing lens (541) and the second condensing lens (542) can adjust the illumination light that is not directed toward the light path among the illumination light (501) diffused in multiple directions to be incident on the display (530) by reducing the amount of illumination light that is not directed toward the light path. For example, the amount of illumination light that is not directed toward the next optical element on the light path among the illumination light (501) diffused in multiple directions can be reduced as the illumination light (501) (or the direction of the illumination light (501)) is adjusted by the condensing lens (e.g., the first condensing lens (541) and the second condensing lens (542)). For example, when illumination light (501) is incident on an optical element (e.g., a polarizing beam splitter (520)) following a first condensing lens (541) on an optical path (e.g., a first optical path (601) described in FIG. 6), the amount of illumination light not directed toward the next optical element (e.g., a polarizing beam splitter (520)) can be reduced as the illumination light (501) emitted from the light source (510) is adjusted by the first condensing lens (541). When illumination light (501) is incident on a second condensing lens (542) on an optical path (e.g., a second optical path (602) described in FIG. 6) and then on an optical element (e.g., a fly-eye lens (550)), the amount of illumination light that is not directed toward the next optical element (e.g., a fly-eye lens (550)) can be reduced as the illumination light (501) incident on the second condensing lens (542) is adjusted by the second condensing lens (542).

[0172] The second condensing lens (542) functions as a condensing lens for illumination light (501) incident on the second condensing lens through the third surface (5421) of the second condensing lens (542), and can function as a relay lens for illumination light (501) incident on the second condensing lens (542) through the fourth surface (5422), which is the opposite surface of the third surface (5421) of the second condensing lens (542).

[0173] The fly eye lens (550) can adjust the intensity distribution of the illumination light (501) that has passed through the condensing lens group. The illumination light (501) that has passed through the condensing lens group may be incident on the fly eye lens (550) through the substantial central portion of the fly eye lens (550) and / or the outer portion excluding the central portion. The degree of uniformity of the intensity distribution according to the angle (or direction) of the light traveling at various angles (or directions) included in the illumination light (501) may be lower than a threshold value. The fly eye lens (550) can adjust the illumination light (501) so that the intensity distribution of the light traveling at various angles (or directions) included in the illumination light (501) is uniform. The degree of uniformity of the intensity distribution according to the angle (or direction) of the light traveling at various angles (or directions) included in the illumination light (501) that has passed through the fly eye lens (550) may be higher than a threshold value.

[0174] The fly eye lens (550) can adjust the intensity distribution of the illumination light (501) based on the illumination light (501) passing through the second condensing lens (542) being sequentially incident on the fifth surface (5501) on the side of the second condensing lens (542) and the sixth surface (5502) on the side of the reflecting plate (551). The fly eye lens (550) can perform substantially the same function as an optical element having twice the thickness of the fly eye lens (550) by passing the illumination light (501) twice through the fifth surface (5501) and the sixth surface (5502). The fly eye lens (550) may be a lens made of plastic or glass. The reflecting plate (551) may be attached to the fly eye lens (550) or may be spaced apart by a certain distance.

[0175] The polarizing beam splitter (520) can reflect or pass the illumination light (501) incident on the polarizing beam splitter (520) based on the polarization direction of the illumination light (501) incident on the polarizing beam splitter (520). The polarizing beam splitter (520) may include a polarization-splitting surface (521) that passes or reflects the illumination light (501) depending on the polarization direction of the light (e.g., illumination light (501) or image light (502)). The polarization-splitting surface (521) can reflect light polarized in a first polarization direction (e.g., S-polarization) (e.g., illumination light (501) or image light (502)) and pass light polarized in a second polarization direction (e.g., P-polarization) (e.g., illumination light (501) or image light (502)). However, the polarization separation surface (521) may be manufactured (or arranged) to allow light polarized in a first polarization direction (e.g., S-polarization) to pass through and light polarized in a second polarization direction (e.g., P-polarization) to reflect.

[0176] The first polarizing plate (522) may include a linear polarizer (LP) that changes (or determines) the linear polarization direction of the illumination light (501) that has passed through the first condensing lens (541). The linear polarization direction may change (or determine) whether the light passes through or is reflected from the polarization separation plane (521) included in the polarizing beam splitter (520). The linear polarizer may change (or determine) the polarization direction of the illumination light (501) that has passed through the first condensing lens (541) to a first polarization direction (e.g., S-polarization) or a second polarization direction (e.g., P-polarization). The linear polarizer may be either an absorber polarizer or a wire grid polarizer, but is not limited thereto.

[0177] The second polarizing plate (523) may include a quarter wave plate (QWP) that determines the circular polarization direction of the illumination light (501) that has passed through the second condensing lens (542). The quarter wave plate may change the type of polarization of the illumination light (501). Linearly polarized illumination light (501) may become circularly polarized as it passes through the quarter wave plate. Circularly polarized illumination light (501) may become linearly polarized as it passes through the quarter wave plate. The circular polarization direction may be a direction related to the linear polarization direction that determines whether the illumination light (501) passes through or is reflected by the polarization separation plane (521) included in the polarization beam splitter (520). For example, the quarter-wave plate can change the linear polarization direction of the illumination light (501) before and after passing through the second polarization plate (523) by circularly polarizing the illumination light (501) before it is reflected by the reflection plate (551). The reflection plate (551) can change the polarization direction of the circularly polarized illumination light (501) from the first circular polarization direction (e.g., CCW) to the second circular polarization direction (e.g., CW) (or from the second circular polarization direction (e.g., CW) to the first circular polarization direction (e.g., CCW).

[0178] At least one relay lens included in the relay lens group may be positioned between the display (530) and the polarizing beam splitter (520). Alternatively, at least one relay lens may be positioned on the opposite side of the polarizing beam splitter (520) from the side of the display (530). However, the position in which the relay lens is positioned is not limited to the above example and may be positioned adjacent to any one of the light source (510), the first condensing lens (541), the polarizing beam splitter (520), the second condensing lens (542), the fly eye lens (550), and / or the reflective plate (551). According to one embodiment, at least some of the relay lenses constituting the relay lens group may transmit illumination light (501) to the display (530). For example, transmitting the illumination light (501) to the display (530) may include aligning the optical axis of the illumination light (501), adjusting the focal length of the illumination light (501), or correcting the aberration of the illumination light (501). At least some of the relay lenses constituting the relay lens group may function as a projection system.

[0179] The display (530) can generate image light (502) that displays an image based on illumination light (501). The display (530) can generate image light (502) by reflecting at least a portion of the incident illumination light (501) in the form of a reflective liquid crystal display. For example, the display may be an LCoS (liquid crystal on silicon) display. The display (530) and the light source (510) may be implemented in a form that is not electrically connected. For example, the light engine (500) may include different circuits for controlling the display (530) and the light source (510), respectively.

[0180] Referring to FIG. 5A, the first condensing lens (541) and the second condensing lens (542) of the optical engine (500) may be positioned in different directions of the polarizing beam splitter (520). The volume of the region corresponding to the optical element within the optical engine (500) may be reduced as the first condensing lens (541) and the second condensing lens (542) of the optical engine (500) are positioned in different directions of the polarizing beam splitter (520). The volume of the optical engine (500) may be reduced as the volume of the region corresponding to the optical element within the optical engine (500) is reduced. An electronic device including the optical engine (500) may be miniaturized compared to other optical engines (e.g., a device including the optical engine (400) of FIG. 4).

[0181] FIG. 5B is a drawing illustrating a light engine included in an electronic device according to one embodiment.

[0182] An electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2, and the head-mounted display device (300) of FIG. 3A and FIG. 3B) may include an optical engine (500) and an optical waveguide (e.g., the optical waveguide (1100) of FIG. 11). It should be understood that the description of the optical engine and the components included in the optical engine of FIG. 4 and FIG. 5A may also apply to the optical engine of FIG. 5B.

[0183] A light engine (500) according to one embodiment may include a light source (510), a collimator lens group (540), a fly-eye lens (FEL) (550), a relay lens group, a polarization beam splitter (PBS) (520), and / or a display (530). The collimator lens group (540) may include a first collimator lens (541) and / or a second collimator lens (542) that collimates illumination light (501). The relay lens group may include a first relay lens (581), a second relay lens (582), a third relay lens (583), a fourth relay lens (584), and / or a fifth relay lens (585).

[0184] The first relay lens (581), the second relay lens (582), the third relay lens (583) and / or the fourth relay lens (584) may be placed between the polarizing beam splitter (520) and the display (530). The fifth relay lens (585) may be placed in the direction of the tenth plane (5204) of the polarizing beam splitter (520).

[0185] The side of the polarizing beam splitter (520) of the first relay lens (581) may have a negative curvature. The side of the second relay lens (582) of the first relay lens (581) may be flat. The side of the first relay lens (581) of the second relay lens (582) may have a negative curvature. The side of the third relay lens (583) of the second relay lens (582) may have a positive curvature. The side of the second relay lens (582) of the third relay lens (583) may have a positive curvature. The side of the fourth relay lens (584) of the third relay lens (583) may have a positive curvature. The side of the third relay lens (583) of the fourth relay lens (584) may have a negative curvature. The side of the display (530) of the fourth relay lens (584) may have a positive curvature. The side of the polarizing beam splitter (520) of the fifth relay lens (585) may be flat. The side opposite to the side of the polarizing beam splitter (520) of the fifth relay lens (585) may have positive curvature.

[0186] The distance between the light source (510) and the first condensing lens (541) may be greater than the distance between the fly-eye lens (550) and the second condensing lens (542). The distance between the light source (510) and the first condensing lens (541) may be greater than the distance between the first condensing lens (541) and the polarizing beam splitter (520). The distance between the light source (510) and the first condensing lens (541) may be greater than the thickness of the first condensing lens (541). The distance between the light source (510) and the first condensing lens (541) may be greater than the thickness of the second condensing lens (542). The distance between the first condensing lens (541) and the polarizing beam splitter (520) may be smaller than the thickness of the fly-eye lens (550). The distance between the first condensing lens (541) and the fly eye lens (550) may be smaller than the thickness of the fly eye lens (550).

[0187] FIG. 6 is a diagram illustrating the light path of illumination light on a light engine according to one embodiment.

[0188] The first light path (601), second light path (602), third light path (603), fourth light path (604), fifth light path (605) and sixth light path (606) shown in FIG. 6 may represent paths through which illumination light (501) and / or image light (502) generated and / or emitted from the light engine (500) shown in FIG. 5A and FIG. 6 pass.

[0189] A light source (510) can emit illumination light (e.g., illumination light (501) of FIG. 5A) directed toward a specific direction (e.g., first direction (471)). The illumination light emitted from the light source (510) can proceed (or be incident) to a display (530) through a first light path (601), a second light path (602), a third light path (603), a fourth light path (604), and a fifth light path (605). The display (530) can generate image light (e.g., image light (502) of FIG. 5A) representing an image based on the illumination light incident to the display (530) (e.g., illumination light reflected by the polarization separation plane (521)). The image light generated by the display (530) can be output to a predetermined area (e.g., the exit pupil (1115) of FIG. 11) through a sixth light path (606). For example, image light generated by the display (530) can be incident on an optical waveguide through the sixth optical path (606) and output to a predetermined area through the optical waveguide.

[0190] Referring to the first light path (601), the illumination light emitted from the light source (510) can be incident on the polarizing beam splitter (520) through the first condensing lens (541) and the first polarizing plate (522).

[0191] The first condensing lens (541) can adjust the direction of the illumination light so that the illumination light incident on the first condensing lens (541) travels toward the polarizing beam splitter (520).

[0192] The illumination light passing through the first condensing lens (541) may be unpolarized light. The first polarizing plate (522) may change (or determine) the polarization direction of the illumination light passing through the first condensing lens (541) so that it has a second polarization direction (e.g., P-polarization) (or a first polarization direction (e.g., S-polarization)). The illumination light polarized in the second polarization direction (e.g., P-polarization) may be incident on the polarizing beam splitter (520).

[0193] Referring to the second light path (602), the illumination light incident on the polarizing beam splitter (520) can be incident on the fly eye lens (550) through the polarizing beam splitter (520), the second polarizing plate (523), and the second condensing lens (542).

[0194] Illuminating light incident on the polarizing beam splitter (520) may pass through a polarization separation surface (521) that passes light of a second polarization direction (e.g., P-polarization) and reflects light of a first polarization direction (e.g., S-polarization). Illuminating light incident on the polarizing beam splitter (520) may pass through the polarization separation surface (521) based on being polarized in a second polarization direction (e.g., P-polarization) by the first polarization plate (522). The second polarization plate (523) may change (or determine) the polarization direction of the illuminating light (polarized in a second polarization direction (e.g., P-polarization)) that has passed through the polarization separation surface (521) to have a second circular polarization direction (e.g., CW). Illumination light polarized in a second circular polarization direction (e.g., CW) can be incident on the second condensing lens (542) through the third surface (5421) of the second condensing lens (542) facing the polarization beam splitter (520). The second condensing lens (542) can function as a condensing lens for the illumination light incident through the third surface (5421). For example, the second condensing lens (542) can adjust the illumination light (501) incident through the third surface (5421) to be parallel to the first direction (471), which is the direction of travel of the illumination light (501). The illumination light passing through the second condensing lens (542) can be incident on the fly-eye lens (550).

[0195] Referring to the third light path (603), the illumination light incident on the fly eye lens (550) can be incident on the second condensing lens (542) through the fly eye lens (550), the reflecting plate (551), and the fly eye lens (550).

[0196] Illuminating light incident on the fly eye lens (550) can be incident on the fly eye lens (550) through the fifth surface (5501) on the side of the second condensing lens (542) of the fly eye lens (550), and then incident on the reflecting plate (551). The illumination light incident on the reflecting plate (551) can have its circular polarization direction changed (or adjusted) as its phase is switched by 180 degrees by the reflecting plate (551). For example, the illumination light incident on the reflecting plate (551) can have its polarization direction adjusted from the second circular polarization direction (e.g., CW) to the first circular polarization direction (e.g., CCW) as it is reflected from the reflecting plate (551). The illumination light reflected from the reflecting plate (551) can be incident on the sixth surface (5502) on the side of the reflecting plate (551) of the fly eye lens (550). The illumination light incident on the sixth surface (5502) can be adjusted to have a uniform distribution of intensity based on passing through the fly-eye lens (550) twice. The illumination light passing through the fly-eye lens (550) via the sixth surface (5502) may have a higher degree of uniformity in the distribution of intensity according to angle (or direction) compared to the illumination light passing through the second condensing lens (542) in the second light path (602). The degree of uniformity in the distribution of intensity according to angle (or direction) of the light traveling at various angles (or directions) included in the illumination light passing through the fly-eye lens (550) via the sixth surface (5502) may be higher than a threshold value. The illumination light passing through the fly-eye lens (550) via the sixth surface (5502) may be incident on the second condensing lens (542) through the fourth surface (5422) of the second condensing lens (542). The fourth surface (5422) of the second condensing lens (542) may refer to the side surface of the fly eye lens (550) of the second condensing lens (542).

[0197] Referring to the fourth light path (604), the illumination light incident on the second condensing lens (542) is incident on the polarizing beam splitter (520) through the second condensing lens (542) and the second polarizing plate (523), and can be reflected from the polarization separation surface (521) of the polarizing beam splitter (520).

[0198] The light engine (500) may include a relay lens group comprising at least one relay lens that transmits light to transmit light emitted from a light source (510) to a display (530). A second condensing lens (542) may function as a relay lens for light incident through a fourth surface (5422). For example, the second condensing lens (542) may adjust the light incident through the fourth surface (5422) to reach the display (530), either individually or collectively with the relay lens group. One of the relay lenses in the relay lens group included in the light engine (500) may be replaced by the second condensing lens (542) as the second condensing lens (542) functions as a relay lens.

[0199] The illumination light passing through the second condensing lens (542) can be incident on the second polarizing plate (523). The illumination light incident on the second polarizing plate (523) may be polarized in a first circular polarization direction (e.g., CCW) as it is reflected from the reflection plate (551) in the third light path (603). The illumination light incident on the second polarizing plate (523) may have its polarization state changed from circular polarization to linear polarization. For example, the illumination light incident on the second polarizing plate (523) in the fourth light path (604) may be polarized in a first polarization direction (e.g., S-polarization) by the second polarizing plate (523). Illuminating light passing through the second polarizing plate (523) in the fourth optical path (604) can be polarized in a polarization direction opposite to the polarization direction (e.g., second polarization direction) of the illuminating light before passing through the second polarizing plate (523) in the second optical path (602) (e.g., second polarization direction) (e.g., first polarization direction (e.g., S-polarization)). Illuminating light polarized in the first polarization direction (e.g., S-polarization) can be reflected from the polarization separation surface (521). The reflecting plate (551) of FIGS. 5A and FIGS. 6 can cause illuminating light passing through the polarization separation surface (521) in the second optical path (602) to be reflected from the polarization separation surface (521) in the fourth optical path (604) by switching the phase of the illuminating light incident on the reflecting plate (551) by 180 degrees.

[0200] Referring to the fifth light path (605), the illumination light reflected from the polarization separation surface (521) can be incident on the display (530). The illumination light reflected from the polarization separation surface (521) can be incident directly on the display (530) or on the display (530) through at least one relay lens placed between the polarization beam splitter (520) and the display (530). The at least one relay lens placed between the polarization beam splitter (520) and the display (530) can collectively adjust the illumination light to be focused on the display (530) together with the second focusing lens (542).

[0201] Referring to the sixth optical path (606), image light output from the display (530) (e.g., image light (502) of FIG. 5A) can be output to a predetermined area through a polarizing beam splitter (520). According to one embodiment, the optical engine (500) may further include a relay lens between the display (530) and the polarizing beam splitter (520) or in the direction of the opposite side (e.g., tenth side (5404)) of the polarizing beam splitter (520) of the display (530) (e.g., ninth side (5203)).

[0202] The display (530) may generate and / or output image light representing an image based on illumination light incident on the display (530). The image light may refer to light representing an image output through a specific component included in the electronic device (e.g., the first glass (215), the second glass (225) of FIG. 2, the lens structure (320) of FIG. 3B). The image light may be light polarized in a second polarization direction (e.g., P-polarization) by the display (530).

[0203] Image light output from the display (530) can pass through a polarization separation surface (521) as it is polarized in a second polarization direction (e.g., P-polarization). Image light passing through the polarization separation surface (521) is incident on an optical waveguide and can be output to a predetermined area through the optical waveguide.

[0204] The light engine (500) may include a predetermined number of relay lenses to maintain the quality of the illumination light (501) (e.g., intensity and uniformity of intensity distribution) above a certain level. Referring to FIG. 6, a second condensing lens (542) included in the light engine (500) may function as a relay lens. One of the predetermined number of relay lenses included in the light engine (500) may be replaced by the second condensing lens (542). As one of the relay lenses included in the light engine (500) is replaced by the second condensing lens (542), the volume of the light engine (500) may be reduced.

[0205] FIG. 7 is a drawing illustrating illumination light passing through some of the optical elements included in a light engine according to one embodiment.

[0206] The optical elements illustrated in FIG. 7 (e.g., light source (510), first condensing lens (541), first polarizing plate (522), polarizing beam splitter (520), second polarizing plate (523), second condensing lens (542)) may be optical elements included in the light engine (500) described in FIG. 5A and FIG. 6.

[0207] The light source (510) can emit light in a specific direction (e.g., a first direction (471)). The emitted light can be diffused in multiple directions. For example, the emitted light can be diffused in various directions from the point on the light source (510) where the light is emitted.

[0208] The first condensing lens (541) can adjust the illumination light passing through the first condensing lens (541). For example, the first condensing lens (541) can adjust the illumination light (501) diffused in multiple directions to be parallel to the direction in which the illumination light was emitted (e.g., the first direction (471)). The first condensing lens (541) can adjust the direction of the illumination light so that the illumination light incident on the first condensing lens (541) travels toward the polarizing beam splitter (520). The amount of illumination light incident on the polarizing beam splitter (520) through the first condensing lens (541) can be increased as the illumination light emitted from the light source (510) is adjusted by the first condensing lens (541).

[0209] The illumination light passing through the first condensing lens (541) can pass through the polarization separation surface (521) included in the polarization beam splitter (520) and enter the second condensing lens (542).

[0210] The second condensing lens (542) can adjust the illumination light passing through the first condensing lens (542). For example, the second condensing lens (542) can adjust the illumination light (501) diffused in multiple directions to be parallel to the direction in which the light was emitted (e.g., the first direction (471)). The second condensing lens (542) can adjust the direction of the illumination light so that the illumination light incident on the second condensing lens (542) travels toward the fly eye lens (e.g., the fly eye lens (550) of FIG. 5A and FIG. 6). The amount of illumination light incident on the fly eye lens (550) through the second condensing lens (542) can be increased as the illumination light emitted from the light source (510) is adjusted by the second condensing lens (542).

[0211] The light engine (500) can increase the amount of illumination light incident on the display (530) through the first condensing lens (541) and the second condensing lens (542).

[0212] According to one embodiment, the optical element included in the optical engine (500) can be designed as shown in [Table 1]. In [Table 1], the surface type may refer to the geometric shape of the surface (e.g., spherical, planar, aspherical). The radius of curvature may refer to a radius value representing the curvature of the spherical surface. The thickness may refer to the distance between two surfaces of the optical element. The refraction mode may refer to the form in which the illumination light incident on the surface is adjusted (e.g., refraction, reflection, absorption). The hemisphere may refer to the maximum radius through which the illumination light can pass.

[0213] Surface (Drawing Symbol) Surface Type Radius of Curvature Thickness Refraction Mode Hemi-aperture (Y semi-aperture) - Sphere infinity 0.0000 Refraction 1.4944 First Surface (5411) Sphere - 7.2370 1.0560 Refraction 1.4900 Second Surface (5412) Sphere - 1.80400 0.1000 Refraction 1.5000 First Polarizing Plate (522) Sphere infinity 0.1180 Refraction 2.1000 Polarizing Beam Splitter (520) Sphere infinity 4.3200 Refraction 2.1000 Second Polarizing Plate (523) Sphere infinity 0.1180 Refraction 2.1000 - Sphere infinity 0.1000 Refraction 2.1895 Third Surface (5421) Sphere infinity 0.9830 Refraction 2.1233 Fourth surface (5422) Sphere -5.21100 0.1000 Refraction 2.1895

[0214] However, it should be understood that the contents described in [Table 1] are merely examples and that the light engine (500) of the present disclosure is not necessarily designed as shown in [Table 1]. FIG. 8 is a drawing illustrating illumination light passing through some of the optical elements included in a light engine according to one embodiment.

[0215] The illumination light emitted from the light source (510) is adjusted to be parallel to the direction of travel of the illumination light emitted by the first condensing lens (541) and the second condensing lens (542) (e.g., the first direction (471)), and after being adjusted to have a uniform intensity by the fly-eye lens (e.g., the fly-eye lens (550) of FIG. 5A and FIG. 6), it can be incident on the second condensing lens (542) through the second surface (e.g., the fourth surface (5422) of the second condensing lens (542) of FIG. 5A and FIG. 6).

[0216] The second condensing lens (542) can function as a relay lens for illumination light incident on the second surface. Illumination light incident on the second condensing lens (542) through the second surface can be transmitted onto the display (530) by the second condensing lens (542). Transmission of illumination light onto the display (530) may include the transmission of light components that have been diffused in substantially the same direction among illumination light diffused in various directions to the same location on the display (530).

[0217] For example, illumination light diffused in various directions may include a first light group (801), which is a set of light components traveling in substantially the same direction as a first angle, and a second light group (802), which is a set of light components traveling in substantially the same direction as a second angle. The light components included in the first light group (801) may be incident on substantially the same first location (811) on the display (530). The light components included in the second light group (802) may be incident on substantially the same second location (812) on the display (530).

[0218] According to one embodiment, the second condensing lens (542) can be adjusted so that illumination light incident on the second surface reaches the display (530), either individually or collectively with a relay lens group. The light engine (500) may include a relay lens group comprising at least one relay lens that transmits illumination light to the display (530). The light engine (500) may replace one of the relay lenses included in the relay lens group with the second condensing lens (542) as the second condensing lens (542) functions as a relay lens.

[0219] FIG. 9 is a drawing illustrating a light engine included in an electronic device according to one embodiment.

[0220] An electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2, and the head-mounted display device (300) of FIG. 3A and FIG. 3B) may include an optical engine and an optical waveguide. It should be understood that the description of the optical engine (400, 500) and the components included in the optical engine (400, 500) of FIG. 4 through 8 may also apply to the optical engine (900) of FIG. 9.

[0221] A light engine according to one embodiment may include a light source (910), a collimator lens group (940), a fly-eye lens (FEL) (950), a relay lens group, a polarization beam splitter (PBS) (920), and / or a display (930). The collimator lens group (940) may include a first collimator lens (941) and / or a second collimator lens (942) that collimates illumination light (901). The relay lens group may include at least one relay lens that transmits illumination light (901) to the display (930). For example, the light engine (900) may include at least one relay lens having positive refractive power, which is positioned between the polarization beam splitter (520) and the display (930).

[0222] According to one embodiment, the polarizing beam splitter (920), the first condensing lens (941), the second condensing lens (942), and / or at least one relay lens included in the relay lens group may be formed of glass or plastic, but is not limited thereto. According to one example, the first condensing lens (941) may be made of a heat-resistant material as it is positioned in close proximity to the light source (910). The first condensing lens (941) may be formed of a heat-resistant material than the second condensing lens (942). For example, the first condensing lens (941) may be formed of a heat-resistant glass material instead of a heat-sensitive plastic material. Additionally, the first condensing lens (941) and the second condensing lens (942) may be formed of a glass material.

[0223] The first condensing lens (941) may be positioned in the direction of the light output of the light source (910). The first condensing lens (941) may include a first surface (9411) facing the light source (910) and a second surface (9412) opposite the first surface (9411). The second condensing lens (942) may include a third surface (9421) facing the polarizing beam splitter (920) and a fourth surface (9422) opposite the third surface (9421). The fly-eye lens (950) may include a fifth surface (9501) facing the fourth surface (9422) of the second condensing lens (942) and a sixth surface (9502) opposite the fifth surface (9501). The polarizing beam splitter (920) may include a seventh surface (9201) facing the second surface (9412) of the first condensing lens (941), an eighth surface (9202), a ninth surface (9203) perpendicular to the eighth surface (9202), and a tenth surface (9204) facing the third surface (9421) of the second condensing lens (942).

[0224] The first surface (9411) of the first condensing lens (941) may have a negative curvature, and the second surface (9412) may have a positive curvature. The third surface (9421) of the second condensing lens (942) may be flat, and the fourth surface (9422) may have a positive curvature.

[0225] The light source (910) and / or the first condensing lens (941) may be positioned so that the illumination light (901) output from the light source (910) is incident on the polarizing beam splitter (920). For example, the light source (910) and / or the first condensing lens (941) may be positioned sequentially according to a first direction (471). The first direction (471) may be substantially the same direction as the direction of travel of the illumination light (901) output from the light source (910).

[0226] The first condensing lens (941) may be positioned so that the illumination light (901) output from the light source (910) can pass through the first condensing lens (941). The polarizing beam splitter (920) may be positioned so that the illumination light (901) passing through the first condensing lens (941) can be incident on the polarizing beam splitter (920). The second condensing lens (942) may be positioned so that the polarizing beam splitter (920) can be positioned between the second condensing lens (942) and the first condensing lens (941). The placement of a polarizing beam splitter (920) between the second condensing lens (942) and the first condensing lens (941) may include the first condensing lens (941) and the second condensing lens (942) being positioned in the direction of two adjacent faces of the polarizing beam splitter (920) among the four faces of the polarizing beam splitter (920) (e.g., four faces in the horizontal direction (e.g., the seventh face (9201), the eighth face (9202), the ninth face (9203), the tenth face (9204))). For example, the second condensing lens (942) may be positioned on the side adjacent to the seventh face (9201) on the side of the first condensing lens (941) with respect to the polarizing beam splitter (920) (or in the direction of the adjacent side face). For example, the second condensing lens (942) may be positioned with respect to the polarizing beam splitter (920) The first condensing lens (941) may be positioned in a direction perpendicular to the direction in which it is positioned (or in the tenth plane (9204)). The fly-eye lens (950) may be positioned on the opposite side of the third plane (9421) of the second condensing lens (942) facing the polarizing beam splitter (920). For example, the fly-eye lens (950) may be positioned in the direction of the fourth plane (9422) of the second condensing lens (942). The reflective plate (951) may be positioned on the opposite side of the fifth plane (9501) of the fly-eye lens (950) on the side of the second condensing lens (942). For example, the reflective plate (951) may be positioned in the direction of the sixth plane (9502) of the fly-eye lens (950).

[0227] The display (930) may be positioned in a direction different from the direction in which the first condensing lens (941) and the second condensing lens (942) are positioned relative to the polarizing beam splitter (920). The display (930) may be positioned in the direction of the remaining surface of the polarizing beam splitter (920) (e.g., four surfaces in the horizontal direction), excluding the surface adjacent to the first condensing lens (941) and the surface adjacent to the second condensing lens (942). For example, the display (930) may be positioned in the second direction (472) which is perpendicular to the first direction (471). The illumination light (901) may be incident on the display (930) by passing through the polarization separation surface (921).

[0228] The light engine (900) may include at least one polarizing plate (e.g., a first polarizing plate (922), a second polarizing plate (923)) for changing (or determining) whether to pass through the polarization separation surface (921). The first polarizing plate (922) may be placed on the side of the first condensing lens (941) of the polarizing beam splitter (920). Alternatively, the first polarizing plate (922) may be placed between the light source (910) and the first condensing lens (941). According to one example, the first polarizing plate (922) may be attached to the first condensing lens (941). The second polarizing plate (923) may be placed on the side of the second condensing lens (942) of the polarizing beam splitter (920). Alternatively, the second polarizing plate (923) may be placed between the second condensing lens (942) and the fly eye lens (950).

[0229] According to one embodiment, the first condensing lens (941) may be composed of two condensing lenses. The first polarizing plate (922) may be placed between the two condensing lenses constituting the first condensing lens (941).

[0230] The light source (910) can emit illumination light (901). The illumination light (901) can be emitted to travel toward a first direction (471). The emitted illumination light (901) can be diffused in various directions. For example, the emitted illumination light (901) can be diffused in various directions from the point where the illumination light (901) on the light source (910) is emitted.

[0231] The first condensing lens (941) and the second condensing lens (942) can adjust the direction of travel of light that is not directed toward the next optical element on the light path among the illumination light (901) diffused in multiple directions so that it travels toward the next optical element on the light path. The first condensing lens (941) and the second condensing lens (942) can adjust the illumination light that is not directed toward the light path among the illumination light (901) diffused in multiple directions to be incident on the display (930) by reducing the amount of illumination light that is not directed toward the light path. For example, the amount of illumination light that is not directed toward the next optical element on the light path among the illumination light (901) diffused in multiple directions can be reduced as the illumination light (901) (or the direction of the illumination light (901)) is adjusted by the condensing lens (e.g., the first condensing lens (941) and the second condensing lens (942)). For example, when illumination light (901) is incident on an optical element (e.g., a polarizing beam splitter (920)) following a first condensing lens (941) on an optical path (e.g., a first optical path (1001) described in FIG. 10A), the amount of illumination light not directed toward the next optical element (e.g., a polarizing beam splitter (920)) can be increased as the illumination light (901) emitted from the light source (910) is adjusted by the first condensing lens (941). When illumination light (901) is incident on a second condensing lens (942) on an optical path (e.g., a second optical path (1002) described in FIG. 10A) and then on an optical element (e.g., a fly-eye lens (950)), the amount of illumination light that is not directed toward the next optical element (e.g., a fly-eye lens (950)) can be reduced as the illumination light (901) incident on the second condensing lens (942) is adjusted by the second condensing lens (942).

[0232] The second condensing lens (942) functions as a condensing lens for illumination light (901) incident on the second condensing lens through the third surface (9421) of the second condensing lens (942), and can function as a relay lens for illumination light (901) incident on the second condensing lens (942) through the fourth surface (9422), which is the opposite surface of the third surface (9421) of the second condensing lens (942).

[0233] The fly-eye lens (950) can adjust the intensity distribution of the illumination light (901) that has passed through the condensing lens group (940). The illumination light (901) that has passed through the condensing lens group (940) can be incident on the fly-eye lens (950) through the substantial central portion of the fly-eye lens (950) and / or the outer portion excluding the central portion. The degree of uniformity of the intensity distribution according to the angle (or direction) of the light traveling at various angles (or directions) included in the illumination light (901) may be lower than a threshold value. The fly-eye lens (950) can adjust the illumination light (901) so that the intensity distribution according to the angle (or direction) of the light traveling at various angles (or directions) included in the illumination light (901) is uniform. The degree of uniformity of the intensity distribution according to the angle (or direction) of the light traveling at various angles (or directions) included in the illumination light (901) that has passed through the fly-eye lens (950) twice may be higher than a threshold value.

[0234] The fly eye lens (950) can adjust the intensity distribution of the illumination light (901) based on the illumination light (901) passing through the second condensing lens (942) being sequentially incident on the fifth surface (9501) on the side of the second condensing lens (942) and the sixth surface (9502) on the side of the reflecting plate (951). The fly eye lens (950) can perform substantially the same function as an optical element having twice the thickness of the fly eye lens (950) by passing the illumination light (901) twice through the fifth surface (9501) and the sixth surface (9502). The fly eye lens (950) may be a lens made of plastic or glass. The reflecting plate (951) may be attached to the fly eye lens (950) or may be spaced apart from it by a certain distance.

[0235] The polarizing beam splitter (920) can reflect or pass the illumination light (901) incident on the polarizing beam splitter (920) based on the polarization direction of the illumination light (901) incident on the polarizing beam splitter (920). The polarizing beam splitter (920) may include a polarization-splitting surface (921) that passes or reflects the illumination light (901) depending on the polarization direction of the light (e.g., illumination light (901) or image light (902)). The polarization-splitting surface (921) can reflect light polarized in a first polarization direction (e.g., S-polarization) (e.g., illumination light (901) or image light (902)) and pass light polarized in a second polarization direction (e.g., P-polarization) (e.g., illumination light (901) or image light (902)). However, the polarization separation surface (921) may be manufactured (or arranged) to allow light polarized in a first polarization direction (e.g., S-polarization) to pass through and light polarized in a second polarization direction (e.g., P-polarization) to reflect.

[0236] The first polarizing plate (922) may include a linear polarizer that changes (or determines) the linear polarization direction of the illumination light (901) that has passed through the first condensing lens (941). The linear polarization direction may change (or determine) whether the light passes through or is reflected from the polarization separation plane (921) included in the polarizing beam splitter (920). The linear polarizer may change (or determine) the polarization direction of the illumination light (901) that has passed through the first condensing lens (941) to a first polarization direction (e.g., S-polarization) or a second polarization direction (e.g., P-polarization). The linear polarizer may be either an absorber polarizer or a wire grid polarizer, but is not limited thereto.

[0237] The second polarizing plate (923) may include a quarter wave plate (QWP) that determines the circular polarization direction of the illumination light (901) that has passed through the second condensing lens (942). The quarter wave plate may convert the type of polarization of the illumination light (901). The illumination light (901), which is linearly polarized in a first polarization direction (e.g., S-polarization) (or a second polarization direction (e.g., P-polarization)), may be polarized in a first circular polarization direction (e.g., CCW) (or a second circular polarization direction (e.g., CW)) as it passes through the quarter wave plate. Illumination light (901) polarized in a first circular polarization direction (e.g., CCW) (or a second circular polarization direction (e.g., CW)) may be linearly polarized in a first polarization direction (e.g., S-polarization) (or a second polarization direction (e.g., P-polarization)) as it passes through a quarter-wave plate. The circular polarization direction may be a direction related to the linear polarization direction that determines whether the illumination light passes through or is reflected by the polarization separation plane (921) included in the polarization beam splitter (920) of the illumination light. For example, the quarter-wave plate may change the linear polarization direction of the illumination light before and after passing through the second polarization plate (932) by circularly polarizing the illumination light before it is reflected by the reflection plate (951). The reflector plate (951) can change the polarization direction of the circularly polarized light from a first circular polarization direction (e.g., CCW) to a second circular polarization direction (e.g., CW) (or from a second circular polarization direction (e.g., CW) to a first circular polarization direction (e.g., CCW)).

[0238] At least one relay lens included in the relay lens group may be positioned between the display (930) and the polarizing beam splitter (920). Alternatively, at least one relay lens may be positioned on the side opposite to the display (930) of the polarizing beam splitter (920). However, the position in which the relay lens is positioned is not limited to the above example and may be positioned adjacent to any one of the light source (910), the first condensing lens (941), the polarizing beam splitter (920), the second condensing lens (942), the fly eye lens (950), and / or the reflective plate (951). According to one embodiment, the relay lenses constituting the relay lens group may transmit illumination light (901) to the display (930). For example, transmitting the illumination light (901) to the display (930) may include aligning the optical axis of the illumination light (901), adjusting the focal length of the illumination light (901), or correcting the aberration of the illumination light (901). At least some of the relay lenses constituting the relay lens group may function as a projection system.

[0239] The display (930) can generate image light (902) that displays an image based on illumination light (901). The display (930) can generate image light (902) by reflecting at least a portion of the incident illumination light (901) in the form of a reflective liquid crystal display. For example, the display may be an LCoS (liquid crystal on silicon) display. The display (930) and the light source (910) may be implemented in a form that is not electrically connected. For example, the light engine (900) may include different circuits for controlling the display (930) and the light source (910), respectively.

[0240] Referring to FIG. 9, the first focusing lens (941) and the second focusing lens (942) of the optical engine (900) may be positioned in different directions of the polarizing beam splitter (920). The volume of the region corresponding to the optical element within the optical engine (900) may be reduced as the first focusing lens (941) and the second focusing lens (942) of the optical engine (900) are positioned in different directions of the polarizing beam splitter (920). The volume of the optical engine (900) may be reduced as the volume of the region corresponding to the optical element within the optical engine (900) is reduced. An electronic device including the optical engine (900) may be miniaturized compared to other optical engines (e.g., a device including the optical engine (400) of FIG. 4).

[0241] FIG. 10A is a diagram illustrating the light path of illumination light on a light engine according to one embodiment.

[0242] The first light path (1001), second light path (1002), third light path (1003), fourth light path (1004), fifth light path (1005) and sixth light path (1006) shown in FIG. 10A may represent paths through which illumination light and / or image light generated and / or emitted from the light engine shown in FIG. 9 and FIG. 10A passes.

[0243] A light source (910) can emit illumination light (e.g., illumination light (901) of FIG. 9) directed toward a specific direction (e.g., first direction (471)). The illumination light emitted from the light source (910) can proceed to a display (930) through a first light path (1001), a second light path (1002), a third light path (1003), a fourth light path (1004), and a fifth light path (1005). The display (930) can generate image light that represents an image based on the illumination light incident on the display (930) (e.g., illumination light reflected by a polarization separation plane (921)). The image light generated by the display (930) can be output to a predetermined area through a sixth light path (1006). For example, image light generated by the display (930) can be incident on an optical waveguide through the sixth optical path (1006) and output to a predetermined area through the optical waveguide.

[0244] Referring to the first light path (1001), the illumination light emitted from the light source (910) can be incident on the polarizing beam splitter (920) through the first condensing lens (941) and the first polarizing plate (922).

[0245] The first condensing lens (941) can adjust the direction of the illumination light so that the illumination light incident on the first condensing lens (941) travels toward the polarizing beam splitter (920).

[0246] The illumination light passing through the first condensing lens (941) may be unpolarized light. The first polarizing plate (922) may change (or determine) the polarization direction of the illumination light passing through the first condensing lens (941) so that it has a first polarization direction (e.g., S-polarization) (or a second polarization direction (e.g., P-polarization)). The illumination light polarized in the first polarization direction (e.g., S-polarization) may be incident on the polarizing beam splitter (920).

[0247] Referring to the second light path (1002), the illumination light incident on the polarizing beam splitter (920) is reflected at the polarization separation surface (921) and can be incident on the fly eye lens (950) through the second polarizing plate (923) and the second condensing lens (942).

[0248] Illuminating light incident on the polarizing beam splitter (920) may be reflected by a polarization separation surface (921) that passes light of a second polarization direction (e.g., P-polarization) and reflects light of a first polarization direction (e.g., S-polarization). Illuminating light incident on the polarizing beam splitter (920) may be reflected by the polarization separation surface (921) based on being polarized in a first polarization direction (e.g., S-polarization) by a first polarization plate (922).

[0249] The second polarizing plate (923) can convert the polarization direction of the illumination light (polarized in the first polarization direction (e.g., S-polarization)) that has passed through the polarization splitting surface (921) to have a first circular polarization direction (e.g., CCW). The illumination light polarized in the first circular polarization direction (e.g., CCW) can be incident on the second condensing lens (942) through the third surface (9421) of the second condensing lens (942) facing the polarization beam splitter (920). The second condensing lens (942) can function as a condensing lens for the illumination light incident through the third surface (9421). For example, the second condensing lens (942) can adjust the illumination light incident through the third surface (9421) to be parallel to a specific direction (e.g., a second direction (472) perpendicular to the first direction (471)). The illumination light passing through the second condensing lens (942) can enter the fly eye lens (950).

[0250] Referring to the third light path (1003), the illumination light incident on the fly eye lens (950) can be incident on the second condensing lens (942) through the fly eye lens (950), the reflecting plate (951), and the fly eye lens (950).

[0251] Illuminating light incident on the fly eye lens (950) can be incident on the fly eye lens (950) through the fifth surface (9501) on the side of the second condensing lens (942) of the fly eye lens (950), and then incident on the reflecting plate (951). The illumination light incident on the reflecting plate (951) can have its circular polarization direction changed (or adjusted) as its phase is switched by 180 degrees by the reflecting plate (951). For example, the illumination light incident on the reflecting plate (951) can have its polarization direction adjusted from the first circular polarization direction (e.g., CCW) to the second circular polarization direction (e.g., CW) as it is reflected from the reflecting plate (951). The illumination light reflected from the reflecting plate (951) can be incident on the sixth surface (9502) on the side of the reflecting plate (951) of the fly eye lens (950). The illumination light incident on the sixth surface (9502) can be adjusted to have a uniform distribution of intensity based on passing through the fly-eye lens (950) twice. The illumination light passing through the fly-eye lens (950) via the sixth surface (9502) may have a higher degree of uniformity in the distribution of intensity according to angle (or direction) compared to the illumination light passing through the second condensing lens (942) in the second light path (1002). The degree of uniformity in the distribution of intensity according to angle (or direction) of the light traveling at various angles (or directions) included in the illumination light passing through the fly-eye lens (950) twice may be higher than a threshold value. The illumination light passing through the fly-eye lens (950) via the sixth surface (9502) may be incident on the second condensing lens (942) through the fourth surface (9422) of the second condensing lens (942). The fourth surface (9422) of the second condensing lens (942) may refer to the side surface of the fly eye lens (950) of the second condensing lens (942).

[0252] Referring to the fourth light path (1004), the illumination light incident on the second condensing lens (942) is incident on the polarizing beam splitter (920) through the second condensing lens (942) and the second polarizing plate (923), and can pass through the polarization separation surface (921) of the polarizing beam splitter (920).

[0253] The light engine (900) may include a relay lens group comprising at least one relay lens that transmits illumination light emitted from a light source (910) to a display (930). A second condensing lens (942) may function as a relay lens for illumination light incident on a second surface (9422). For example, the second condensing lens (942) may adjust the illumination light incident on the second surface (9422) to reach the display (930), either individually or collectively with the relay lens group. As the second condensing lens (942) functions as a relay lens, the light engine (900) may replace one of the relay lenses included in the relay lens group with the second condensing lens (942).

[0254] The illumination light passing through the second condensing lens (942) can be incident on the second polarizing plate (923). The illumination light incident on the second polarizing plate (923) may be polarized in a second circular polarization direction (e.g., CW) as it is reflected from the reflection plate (951) in the third light path (1003). The illumination light incident on the second polarizing plate (923) may have its polarization state converted from circular polarization to linear polarization. For example, the illumination light incident on the second polarizing plate (923) in the fourth light path (1004) may be polarized in a second polarization direction (e.g., P-polarization) by the second polarizing plate (923). Illuminating light passing through the second polarizing plate (923) in the fourth optical path (1004) can be polarized in a polarization direction opposite to the polarization direction (e.g., first polarization direction) of the illuminating light before passing through the second polarizing plate (923) in the second optical path (1002) (e.g., second polarization direction (e.g., P-polarization)). Illuminating light polarized in the second polarization direction (e.g., P-polarization) can pass through the polarization separation surface (921). The reflecting plate (951) of FIG. 9 and FIG. 10A can control the illuminating light reflected by the polarization separation surface in the second optical path (1002) to pass through the polarization separation surface in the fourth optical path (1004) by switching the phase of the illuminating light incident on the reflecting plate (951) by 180 degrees.

[0255] Referring to the fifth light path (1005), the illumination light passing through the polarization separation plane can be incident on the display (930). The illumination light passing through the polarization separation plane can be incident directly on the display (930) or on the display (930) through at least one relay lens placed between the polarization beam splitter (920) and the display (930). The at least one relay lens placed between the polarization beam splitter (920) and the display (930) can collectively adjust the illumination light to be focused on the display (930) together with the second condensing lens (942).

[0256] Referring to the sixth light path (1006), image light output from the display (930) can be output to a predetermined area through a polarizing beam splitter (920).

[0257] The display (930) may generate and / or output image light representing an image based on illumination light incident on the display (930). The image light may refer to light representing an image output through a specific component included in the electronic device (e.g., the first glass (215), the second glass (225) of FIG. 2, the lens structure (320) of FIG. 3B). The image light may be light polarized in a first polarization direction (e.g., S-polarization) by the display (930).

[0258] Image light output from the display (930) can be reflected by the polarization separation surface (921) as it is polarized in a first polarization direction (e.g., S-polarization). Image light reflected by the polarization separation surface can be incident on an optical waveguide and output to a predetermined area through the optical waveguide.

[0259] The light engine (900) may include a predetermined number of relay lenses to maintain the quality of the illumination light (901) (e.g., intensity and uniformity of intensity distribution) above a certain level. Referring to FIG. 10A, a second condensing lens (942) included in the light engine (900) may function as a relay lens. One of the predetermined number of relay lenses included in the light engine (900) may be replaced by the second condensing lens (942). As one of the relay lenses included in the light engine (900) is replaced by the second condensing lens (942), the volume of the light engine (900) may be reduced.

[0260] FIG. 10B is a drawing illustrating a light engine included in an electronic device according to one embodiment.

[0261] An electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2, and the head-mounted display device (300) of FIG. 3A and FIG. 3B) may include an optical engine (1000) and an optical waveguide (e.g., the optical waveguide (1100) of FIG. 11). It should be understood that the description of the components included in the optical engines of FIG. 4 and FIG. 9 (e.g., the optical engine (400) of FIG. 4, the optical engine (900) of FIG. 9) and the optical engine (e.g., the optical engine (400) of FIG. 4, the optical engine (900) of FIG. 9) may also apply to the optical engine (1000) of FIG. 10B.

[0262] The light engine (1000) may include a TIR prism (990). For example, the light engine (1000) may include a light source (910), a collimator lens group (940), a fly-eye lens (FEL) (950), a relay lens group, a TIR prism (990), and / or a display (930). The TIR prism (990) may include a seventh surface (9901) facing the second surface (9412) of the first collimator lens (941), an eighth surface (9902), a ninth surface (9903) perpendicular to the eighth surface (9902), and a tenth surface (9904) facing the third surface (9421) of the second collimator lens (942).

[0263] The description of the arrangement of the polarizing beam splitter (920) of FIG. 9 may be applied in the same way to the TIR prism (990) of FIG. 10B. For example, the description of the 7th surface (9201), 8th surface (9202), 9th surface (9203), and 10th surface (9204) of the polarizing beam splitter (920) may be applied in the same way to the 7th surface (9901), 8th surface (9902), 9th surface (9903), and 10th surface (9904) of the TIR prism (990).

[0264] The TIR prism (990) may be composed of a first prism (9911), a second prism (9912), and an air layer (991) separated by a predetermined distance. Illuminating light emitted from a light source (910) may enter the first prism (9911) through a first condensing lens (941). Illuminating light entered through the first prism (9911) may be reflected at the surface where the air layer (991) and the first prism (9911) meet, and may enter the second condensing lens (942). Illuminating light entered through the second condensing lens (942) may enter the reflecting plate (951) through the second condensing lens (942) and a fly eye lens (950). The illumination light reflected from the reflecting plate (951) can enter the first prism (9911) through the fly-eye lens (950) and the second condensing lens (942). The illumination light entering the first prism (9911) can pass through the surface where the air layer (991) and the first prism (9911) meet and enter the second prism (9912). The illumination light entering the second prism (9912) can enter the display (930). The display (930) can generate and emit image light based on the illumination light. The image light can be reflected from the surface where the second prism (9912) and the air layer (991) meet and output to a predetermined area.

[0265] FIG. 11 is a drawing illustrating an optical engine and an optical waveguide included in an electronic device according to one embodiment.

[0266] An electronic device (e.g., the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2, and the head-mounted display device (300) of FIG. 3A and FIG. 3B) may include an optical engine (500) (or the optical engine (900) of FIG. 9, the optical engine (1000) of FIG. 10B)) and an optical waveguide.

[0267] According to one embodiment, in some examples, at least one relay lens included in the relay lens group may be positioned between the polarizing beam splitter (520) (or the polarizing beam splitter (920) of FIG. 9) and the optical waveguide (1100) as an optical element included in the projection system.

[0268] The optical engine (500) and optical waveguide (1100) illustrated in FIG. 11 are merely examples of optical engines and optical waveguides included in the electronic device (101) and are not limited to the form illustrated in FIG. 11. For example, the optical engine (500) illustrated in FIG. 11 may be replaced with the optical engine (900) illustrated in FIG. 9. Additionally, the optical waveguide (1100) illustrated in FIG. 11 may be replaced with an optical waveguide commonly used in the relevant technical field.

[0269] The optical waveguide (1100) may be a structure that propagates various light, including image light (1102) generated by illumination light (1101), along a predetermined path (e.g., a waveguide area (1113)). The optical waveguide (1100) may include an incident grating (1112) (e.g., an input grating area in FIG. 3A, FIG. 3B), a waveguide area (1113), and / or an output grating (1114) (e.g., an output grating area in FIG. 3A, FIG. 3B). Some components of the optical waveguide (1100) may be omitted.

[0270] Image light output from the optical engine (e.g., image light after the 6th optical path (606) of FIG. 6 or image light after the 6th optical path (1006) of FIG. 10A) can be incident on the incident grating (1112) through the incident pupil (1111). The incident pupil (1111) (input pupil) may refer to a path through which the image light (1102) is incident on the optical waveguide (1100).

[0271] The incident grating (1112) can transmit image light (1102) output from the light engine (500) to the light waveguide region (1113). For example, the image light (1102) may be light representing an image acquired by an image sensor (e.g., camera module (180) of FIG. 1, camera module (203) of FIG. 2) included in the electronic device (101).

[0272] The waveguide region (1113) can propagate image light (1102) incident through the incident grating (1112) to the emission grating (1114). According to one embodiment, the waveguide region (1113) may transmit external light as it is made of a transparent material. The image acquired by the image sensor (180, 203) may include an image acquired by capturing the front (e.g., -y-axis direction) of a user (e.g., user of the wearable electronic device (200)). The electronic device (101, 200) can transmit external light as well as image light (1102) generated from a display (530) included in the light engine (500) through the waveguide region (1113) to the emission pupil (1115). The electronic device (101) can transmit external light and image light together to the emission pupil (1115).

[0273] The output grating (1114) can emit image light (1102) propagated through the waveguide area (1113) into a predetermined area (e.g., output pupil (1115)). The output pupil (1115) may refer to a passage through which image light is emitted from the optical waveguide (1100). The image light (1102) can reach the user's eye (1116) through the output pupil (1115).

[0274] FIG. 12 is a drawing illustrating an electronic device according to one embodiment.

[0275] An electronic device (e.g., electronic device (101) of FIG. 1, wearable electronic device (200) of FIG. 2, head-mounted display device (300)) may include a first rim (1210) (e.g., first rim (210) of FIG. 2), a second rim (1220) (e.g., second rim (220) of FIG. 2), a first temple (1250) (e.g., first rim (250) of FIG. 2), a second temple (1240) (e.g., second rim (260) of FIG. 2), a first glass (1215) (e.g., first glass (215) of FIG. 2), a second glass (1225) (e.g., second glass (225) of FIG. 2)) and / or a light engine (500) (or a light engine (900) of FIG. 9, a light engine (1000) of FIG. 10B).

[0276] The first rim (1210) and the second rim (1220) may form the frame of an electronic device. The first temple (1250) may be rotatably positioned with respect to the first rim (1210). The second temple (1240) may be rotatably positioned with respect to the second rim (1220). The first glass (1215) may be positioned on the inner surface of the first rim (1210). The second glass (1225) may be positioned on the inner surface of the second rim (1220).

[0277] According to one embodiment, the light engine (500) may be placed on the second rim (1220). For example, the light engine (500) may be placed in an area adjacent to the second temple (1240) on the side of the user's eye of the second rim (1220). For example, the light engine (500) may be placed on the second rim (1220) such that the second rim (1220) is positioned in the direction of the light output of the light source (510) included in the light engine (500).

[0278] The optical waveguide (1100) illustrated in FIG. 11 may be placed inside the second glass (1225). The optical engine (500) may generate image light and transmit it to the user's eye (e.g., the user's eye (1116) in FIG. 11) through the optical waveguide (1100) inside the second glass (1225).

[0279] The first glass (1215) and the second glass (1225) may be formed of a transparent material. The first glass (1215) and the second glass (1225) may transmit external light to the user's eyes. The second glass (1225) may transmit image light generated by the light engine (500) and external light to the user's right eye.

[0280] According to one embodiment, the light engine (500) may be placed on the first rim (1210). Additionally, two light engines identical to the light engine (500) may be placed on the first rim (1210) and the second rim (1220), respectively.

[0281] The volume of the optical engine may vary depending on the arrangement of multiple optical elements included in the optical engine. Multiple optical elements (e.g., multiple condensing lenses or fly-eye lenses) may be arranged in the same direction as a specific optical element (e.g., a polarizing beam splitter). When multiple optical elements are arranged in the same direction as a specific optical element (e.g., a polarizing beam splitter), the volume of the area corresponding to the optical elements within the optical engine may increase. If the volume of the area corresponding to the optical elements within the optical engine increases, the volume of the optical engine may increase. An increase in the volume of the optical engine may be disadvantageous for the miniaturization of electronic devices.

[0282] The optical engine may include a group of relay lenses comprising at least one relay lens that transmits illumination light to a display. The at least one relay lens can transmit illumination light to a display by collectively adjusting the illumination light. The optical engine may be manufactured to include a predetermined number of relay lenses to maintain the quality of the illumination light (e.g., intensity and uniformity of intensity distribution) above a certain level. As the optical engine is manufactured to include a predetermined number of relay lenses, there may be limitations in reducing the volume of the optical engine.

[0283] The technical problems to be solved in this document are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this invention belongs from the description below.

[0284] In an electronic device (e.g., electronic device (101) of FIG. 1, wearable electronic device (200) of FIG. 2, head-mounted display device (300) of FIG. 3) comprising a light engine (e.g., light engine (500) of FIG. 5A, light engine (900) of FIG. 9, light engine (1000) of FIG. 10B) according to one embodiment, the light engine (500, 900) may include a light source (e.g., light source (510) of FIG. 5A, e.g., light source (910) of FIG. 9) that emits illumination light (e.g., illumination light (501) of FIG. 5A, illumination light (901) of FIG. 9). The light engine (500, 900) may include a first condensing lens (e.g., the first condensing lens (541) of FIG. 5A, the first condensing lens (941) of FIG. 9) that is positioned in the light output direction of the light source (510, 910) and includes a first surface (5411, 9411) and a second surface (5412, 9412) facing the light source (510, 910). The light engine (500, 900) may include a second condensing lens (e.g., the second condensing lens (542) of FIG. 5A, the second condensing lens (942) of FIG. 9) that includes a third surface (5421, 9421) and a fourth surface (5422, 9422). The light engine (500, 900) may include a polarization beam splitter (PBS) disposed between the first condensing lens (541, 941) and the second condensing lens (542). The light engine (500, 900) may include a fly-eye lens (550, 950) comprising a fifth surface (5501, 9501) and a sixth surface (5502, 9502) facing the fourth surface (5422, 9422) of the second condensing lens (542, 942).The light engine (500, 900) may include a reflective plate (551, 951) disposed on the sixth surface (5502, 9502) of the fly-eye lens (550, 950). The light engine (500, 900) may include a display (530, 930) that generates image light based on the illumination light (501, 901). The third surface (5421, 9421) of the second condensing lens (542, 942) faces the polarizing beam splitter (520, 920), and the illumination light (501, 901) reflected by the reflecting plate (551, 951) can be output to the display (530, 930) through the fly eye lens (550, 950) and the second condensing lens.

[0285] The second condensing lens (542, 942) can function as a condensing lens for illumination light (501, 901) incident from the polarizing beam splitter (520, 920) to the second condensing lens. The second condensing lens (542, 942) can function as a relay lens for illumination light (501, 901) incident from the fly-eye lens (550, 950) to the second condensing lens (542, 942).

[0286] The fly-eye lens (550, 950) can transmit illumination light (501, 901) that has passed through the second condensing lens (542, 942) to the reflecting plate (551, 951). The fly-eye lens (550, 950) can transmit illumination light (501, 901) reflected from the reflecting plate (551, 951) to the second condensing lens (542, 942).

[0287] The fly eye lens (550, 950) can adjust the intensity distribution of the illumination light (501, 901) based on the fact that the illumination light (501, 901) passing through the second condensing lens (542, 942) is sequentially incident through the fifth surface (5501, 9501) and the sixth surface (5502, 9502) of the fly eye lens (550, 950).

[0288] The light engine (500, 900) may further include a first polarizing plate (522, 922) disposed on a seventh surface (5201, 9201) facing the second surface (5412, 9412) of the first condensing lens (541, 941) of the polarizing beam splitter (520, 920) and adjusting the characteristics of the illumination light (501, 901) to linear polarization.

[0289] The first polarizing plate (522, 922) may include a linear polarizer that adjusts the illumination light (501, 901) from the first condensing lens (541, 941) to pass through a polarization-splitting surface (521, 921) included in the polarization beam splitter (520, 920).

[0290] The light engine (500, 900) may further include a second polarizing plate (523, 923) disposed on an eighth surface (5202, 9202) facing the third surface (5421, 9421) of the second condensing lens (542, 942) of the polarizing beam splitter (520, 920), and adjusting the characteristics of the illumination light (501, 901) from linear polarization to circular polarization.

[0291] The second polarizing plate (523, 923) may include a quarter wave plate that adjusts the illumination light (501, 901) from the second condensing lens (542, 942) to be reflected from the polarization separation surface (521, 921) included in the polarizing beam splitter (520, 920).

[0292] The above-mentioned reflective plate (551, 951) can change the circular polarization direction of the above-mentioned illumination light (501, 901).

[0293] The light engine (500, 900) may include at least one relay lens that transmits the illumination light (501, 901) to the display (530, 930). The at least one relay lens may transmit the illumination light (501, 901) that passes through the second condensing lens (542, 942) and is reflected by the polarizing beam splitter (520, 920) to the display (530, 930).

[0294] The above at least one relay lens may be placed between the display (530, 930) and the polarizing beam splitter (520, 920).

[0295] The above display (530, 930) may be positioned in the direction of the ninth surface (5203, 9203) which is perpendicular to the seventh surface (5201, 9201) and the eighth surface of the polarizing beam splitter (520, 920).

[0296] The second condensing lens (542, 942) may be positioned in a direction opposite to or perpendicular to the direction in which the first condensing lens (541, 941) is positioned, relative to the polarizing beam splitter (520, 920).

[0297] The electronic device (101, 200, 300) may further include a light waveguide. The light waveguide can guide image light from the display (530, 930) to a predetermined area.

[0298] The optical waveguide may include an input grating that adjusts the image light to propagate within a waveguide region included in the optical waveguide, and an output grating that guides the image light to a predetermined region.

[0299] The electronic device (101, 200, 300) can output external light representing an image acquired by an image sensor included in the electronic device (101, 200, 300) and / or said image light to a predetermined area.

[0300] The above electronic device (101, 200, 300) may be a head-mounted display (HMD) or AR glasses.

[0301] The first condensing lens (541, 941) may have a positive refractive power. The first surface (5411, 9411) of the first condensing lens (541, 941) may be concave, and the second surface (5412, 9412) of the first condensing lens (541, 941) may be convex.

[0302] The second condensing lens (542, 942) may have a positive refractive power. The third surface (5421, 9421) of the second condensing lens (542, 942) may be flat, and the fourth surface (5422, 9422) of the second condensing lens (542, 942) may be convex.

[0303] The polarization separation planes (521, 921) included in the polarization beam splitter (520, 920) may be formed based on the boundary between the 7th and 9th planes of the polarization beam splitter (520, 920) and the boundary between the 8th and 10th planes of the polarization beam splitter (520, 920).

[0304] In an electronic device (101, 200, 300) including a light engine (500, 900), the light engine (500, 900) may include a light source (510, 910) that emits illumination light (501, 901). The light engine (500, 900) may include a first condensing lens (541, 941) (collimator) that is positioned in the light output direction of the light source (510, 910) and includes a first surface (5411, 9411) and a second surface (5412, 9412) facing the light source (510, 910). The light engine (500, 900) may include a second condensing lens (542, 942) comprising a third surface (5421, 9421) and a fourth surface (5422, 9422). The light engine (500, 900) may include two prisms spaced apart from each other and a TIR prism (990) positioned between the first condensing lens (541, 941) and the second condensing lens (542, 942). The light engine (500, 900) may include a fly-eye lens (550, 950) (FEL) comprising a fifth surface (5501, 9501) and a sixth surface facing the fourth surface (5422, 9422) of the second condensing lens (542, 942). The light engine (500, 900) may include a reflective plate (551, 951) disposed on the sixth surface of the fly-eye lens (550, 950). The light engine (500, 900) may include a display (530, 930) that generates image light based on the illumination light (501, 901). The third surface (5421, 9421) of the second condensing lens (542, 942) may face the TIR prism. The fifth surface (5501, 9501) of the fly-eye lens (550, 950) may face the fourth surface (5422, 9422) of the second condensing lens (542, 942).The illumination light (501, 901) reflected by the reflection plate (551, 951) can be output to the display (530, 930) through the fly eye lens (550, 950) and the second condensing lens (5412, 9412).

[0305] The first and second condensing lenses of the optical engine may be positioned in different directions of the polarizing beam splitter. The volume of the region corresponding to the optical element within the optical engine may be reduced as the first and second condensing lenses of the optical engine are positioned in different directions of the polarizing beam splitter. The volume of the optical engine may be reduced as the volume of the region corresponding to the optical element within the optical engine is reduced. A specific condensing lens included in the optical engine may function as a relay lens. One of a predetermined number or more relay lenses included in the optical engine may be replaced with a specific condensing lens that functions as a relay lens. As one of the relay lenses included in the optical engine is replaced with a specific condensing lens, the volume of the optical engine may be reduced.

[0306] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs from the description below.

[0307] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0308] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any possible combination of items listed together in the corresponding phrase. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0309] As used in this document, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be a component formed as a whole, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0310] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' merely means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0311] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0312] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the components of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to the integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In an electronic device including a light engine, The above-mentioned optical engine is, A light source that emits illumination light; A first collimator positioned in the light output direction of the light source and comprising a first surface and a second surface facing the light source; A second condensing lens including a third surface and a fourth surface; A polarization beam splitter (PBS) disposed between the first condensing lens and the second condensing lens; A fly-eye lens (FEL) comprising a fifth surface and a sixth surface facing the fourth surface of the second condensing lens; A reflective plate disposed on the sixth surface of the fly-eye lens; and It includes a display that generates image light based on the above illumination light, and The third surface of the second concentrating lens faces the polarizing beam splitter, and the illumination light reflected by the reflecting plate is An electronic device that outputs to the display through the fly-eye lens and the second condensing lens.

2. In claim 1, the second condensing lens is, An electronic device that functions as a condensing lens for illumination light incident from the polarizing beam splitter to the second condensing lens, and functions as a relay lens for illumination light incident from the fly-eye lens to the second condensing lens.

3. In claim 1, the fly eye lens is, An electronic device that transmits illumination light passing through the second condensing lens to the reflecting plate and transmits illumination light reflected from the reflecting plate to the second condensing lens.

4. In paragraph 1, the fly eye lens is, An electronic device that adjusts the intensity distribution of illumination light based on the illumination light passing through the second condensing lens being sequentially incident through the fifth surface and the sixth surface of the fly-eye lens.

5. In claim 1, the optical engine is, It further includes a first polarizing plate disposed on a seventh surface opposite to the second surface of the first focusing lens of the polarizing beam splitter, and adjusting the characteristics of the illumination light to linear polarization. The first polarizing plate above is, An electronic device comprising a linear polarizer that adjusts illumination light from the first condensing lens to pass through a polarization-splitting surface included in the polarization beam splitter.

6. In claim 1, the optical engine is, An electronic device comprising: a second polarizing plate disposed on an eighth surface opposite to a third surface of a second condensing lens of the polarizing beam splitter, and adjusting the characteristics of the illumination light from linear polarization to circular polarization, wherein the second polarizing plate comprises a quarter wave plate that adjusts the illumination light from the second condensing lens to be reflected from a polarization separation surface included in the polarizing beam splitter.

7. In claim 6, the reflector plate is an electronic device that changes the circular polarization direction of the illumination light.

8. In claim 1, the optical engine It includes at least one relay lens that transmits the above illumination light to the display, and An electronic device in which at least one relay lens passes through the second condensing lens and transmits illumination light reflected by the polarizing beam splitter to the display.

9. In claim 8, the electronic device wherein at least one relay lens is disposed between the display and the polarizing beam splitter.

10. An electronic device according to claim 1, wherein the display is positioned in a ninth plane direction perpendicular to the seventh and eighth planes of the polarizing beam splitter.

11. An electronic device according to claim 1, wherein the second focusing lens is positioned in a direction opposite to or perpendicular to the direction in which the first focusing lens is positioned, with respect to the polarizing beam splitter.

12. In claim 1, the electronic device further comprises a light waveguide that guides image light from the display to a predetermined area, and The above optical waveguide is an electronic device comprising an input grating that adjusts the image light to propagate within a waveguide region included in the optical waveguide and an output grating that guides the image light to a predetermined region.

13. In paragraph 1, the first condensing lens has a positive refractive power, The first surface of the first condensing lens is concave, the second surface of the first condensing lens is convex, and the second condensing lens has a positive refractive power. An electronic device in which the third surface of the second condensing lens is flat and the fourth surface of the second condensing lens is convex.

14. The electronic device according to claim 1, wherein the polarization separation plane included in the polarization beam splitter is formed based on the boundary between the 7th and 9th planes of the polarization beam splitter and the boundary between the 8th and 10th planes of the polarization beam splitter.

15. In an electronic device including a light engine, The above-mentioned optical engine is, A light source that emits illumination light; A first collimator positioned in the light output direction of the light source and comprising a first surface and a second surface facing the light source; A second condensing lens including a third surface and a fourth surface; A TIR prism comprising two prisms spaced apart from each other, and positioned between the first condensing lens and the second condensing lens; A fly-eye lens (FEL) comprising a fifth surface and a sixth surface facing the fourth surface of the second condensing lens; A reflective plate disposed on the sixth surface of the fly-eye lens; and It includes a display that generates image light based on the above illumination light, and The third surface of the second condensing lens faces the TIR prism, and The fifth surface of the fly-eye lens is opposite to the fourth surface of the second condensing lens, and The illumination light reflected by the above-mentioned reflecting plate is An electronic device that outputs to the display through the fly-eye lens and the second condensing lens.

Images