Wearable electronic device comprising tunable lens

Abstract

A wearable electronic device according to an embodiment may comprise: a camera; a display; a lens assembly configured to focus or guide light representing visual information output from the display, the lens assembly comprising a first lens configured to receive an electrical signal applied thereto and to adjust the refractive index thereof; and a processor. According to an embodiment, the processor may be configured to control the display so as to output light representing visual information through the lens assembly. According to an embodiment, the processor may be configured to adjust the refractive index of a first region of the first lens corresponding to a first distance from the edge of the first lens to a first value so as to reduce the blur of a first object displayed on the basis of first light passing through the first region of the first lens corresponding to the first distance from the edge of the first lens. According to an embodiment, the processor may be configured to adjust the refractive index of a second region of the first lens corresponding to a second distance larger than the first distance from the edge of the first lens to a second value. Various other embodiments may also be possible.

Description

Wearable electronic device comprising a tunable lens

[0001] The present disclosure relates to electronic devices, and more particularly, to wearable electronic devices including tunable lenses.

[0002] Portable electronic devices, such as electronic notebooks, portable multimedia players, mobile communication terminals, and tablet PCs (personal computers), generally include display elements (e.g., display modules) and batteries, and have had bar-shaped, folder-shaped, or sliding-type appearances due to the shape of the display elements or batteries. Recently, as the performance of display elements and batteries has improved, they have become smaller, and electronic devices that can be worn on parts of the body, such as the wrist or head, or in the form of clothing (hereinafter referred to as "wearable electronic devices") have emerged.

[0003] Examples of wearable electronic devices include head-mounted devices (HMDs), smart glasses, smart watches (or bands), contact lens-type devices, ring-type devices, and clothing / shoe / glove-type devices. These body-worn electronic devices are easy to carry and can improve user accessibility.

[0004] For example, a head-mounted wearable device is a device worn on the user's head or face that projects an image onto the user's retina, allowing the user to view virtual images in three-dimensional space. For example, head-mounted wearable devices can be categorized into see-through types that provide augmented reality (AR) and see-closed types that provide virtual reality (VR). A see-through type head-mounted wearable device can be implemented in the form of glasses, for example, and can provide the user with information such as buildings and objects in the space within the user's field of vision in the form of images or text. A see-closed type head-mounted wearable device can output independent images to both eyes of the user, and can provide the user, or one person, with an excellent sense of immersion by outputting content (games, movies, streaming, broadcasts, etc.) provided by a mobile communication terminal or an external input in the form of images or audio. Additionally, head-mounted wearable devices may be used to provide mixed reality (MR) or extended reality (XR), which are a combination of augmented reality (AR) and virtual reality (VR).

[0005] Recently, product development for head-mounted wearable devices has been actively underway, and they are being used for a variety of purposes, including military, gaming, industrial, and medical applications. Consequently, there is a growing demand for smaller, lighter devices while also providing superior image quality.

[0006] The above information is provided solely as background information to aid in understanding the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0007] Aspects of the present disclosure address at least the problems and / or disadvantages mentioned above, and provide at least the advantages described below. Accordingly, one aspect of the present invention provides a wearable electronic device including a tunable lens.

[0008] Additional aspects will be partly explained in the following description, partly will be obvious from the description, or may be learned by practice of the presented embodiments.

[0009] According to one embodiment, a wearable electronic device may include a camera, a display, a lens assembly configured to focus or guide light representing visual information output from the display, the lens assembly including a first lens configured to adjust a refractive index in response to an electrical signal, and a processor. According to one embodiment, the processor may be configured to control the display to output light representing visual information through the lens assembly. According to one embodiment, the processor may be configured to adjust a refractive index of a first region of the first lens corresponding to a first distance from an edge of the first lens to a first value to reduce blur of a first object displayed based on first light passing through a first region of the first lens corresponding to a first distance from an edge of the first lens. According to one embodiment, the processor may be configured to adjust a refractive index of a second region of the first lens corresponding to a second distance from the edge of the first lens longer than the first distance to a second value.

[0010] In one embodiment, a method of operating a wearable electronic device may include a display and a lens assembly configured to focus or guide light representing visual information output from the display, the lens assembly including a first lens configured to adjust a refractive index in response to an electrical signal. In one embodiment, the method of operating the wearable electronic device may include an operation of controlling the display to output light representing visual information through the lens assembly. In one embodiment, the method of operating the wearable electronic device may include an operation of adjusting a refractive index of a first region of the first lens corresponding to a first distance from an edge of the first lens to a first value to reduce blur of a first object displayed based on first light passing through a first region of the first lens corresponding to a first distance from an edge of the first lens. In one embodiment, the method of operating the wearable electronic device may include adjusting a refractive index of a second region of the first lens to a second value corresponding to a second distance longer than the first distance from the edge of the first lens.

[0011] A computer-readable recording medium according to one embodiment may store instructions that, when executed, cause an electronic device to perform the above-described method or operation of the electronic device.

[0012] Other aspects, advantages and salient features of the present disclosure will become apparent to those skilled in the art from the following detailed description of various embodiments of the present disclosure taken in conjunction with the accompanying drawings.

[0013] The above-described aspects or other aspects, configurations and / or advantages of one embodiment of the present disclosure may be further clarified by the following detailed description taken in conjunction with the accompanying drawings.

[0014] FIG. 1 is a block diagram illustrating an electronic device within a network environment according to one embodiment of the present disclosure.

[0015] FIG. 2 is a diagram illustrating a wearable electronic device according to one embodiment of the present disclosure.

[0016] FIGS. 3 and 4 are drawings showing the front and back of a wearable electronic device according to one embodiment of the present disclosure.

[0017] FIG. 5 illustrates a path along which light output by a display is focused or guided to a user's eye in a wearable electronic device according to one embodiment of the present disclosure.

[0018] FIG. 6 is a diagram illustrating a tunable lens of a wearable electronic device according to one embodiment of the present disclosure.

[0019] FIG. 7 is a drawing showing a tunable lens of a wearable electronic device according to one embodiment of the present disclosure, cut along line A-A' of FIG. 6.

[0020] FIG. 8 is a drawing illustrating a first operating state of a tunable lens of a wearable electronic device according to one embodiment of the present disclosure, and is a drawing showing the tunable lens cut along line A-A' of FIG. 6.

[0021] FIG. 9 is a drawing illustrating a second operating state of a tunable lens of a wearable electronic device according to one embodiment of the present disclosure, which is a drawing showing the tunable lens cut along line A-A' of FIG. 6.

[0022] FIG. 10 is a drawing showing a tunable lens of a wearable electronic device according to one embodiment of the present disclosure.

[0023] FIG. 11 is a diagram illustrating an operating state of a tunable lens of a wearable electronic device according to one embodiment of the present disclosure.

[0024] FIG. 12 is a schematic block diagram of a wearable electronic device according to one embodiment of the present disclosure.

[0025] FIG. 13 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive index of a tunable lens (or first lens) based on a user's gaze.

[0026] FIGS. 14A and 14B are drawings for explaining a method for adjusting the refractive index of a tunable lens (or first lens) of a wearable electronic device according to one embodiment of the present disclosure.

[0027] FIG. 15 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive index of a tunable lens (or first lens).

[0028] FIG. 16 is a diagram illustrating a method for adjusting the refractive index of a tunable lens (or first lens) in a wearable electronic device according to one embodiment of the present disclosure.

[0029] FIG. 17 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to dynamically adjust the refractive index of a tunable lens (or first lens) based on an angle corresponding to a user's gaze.

[0030] FIG. 18 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust refractive indices of a plurality of tunable lenses (or a first lens and a second lens).

[0031] FIG. 19 is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive indices of a plurality of tunable lenses (or a first lens and a second lens).

[0032] FIG. 20 is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive indices of a plurality of tunable lenses (or a first lens and a second lens).

[0033] FIG. 21A is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive index of a tunable lens (or first lens) when a user's gaze is directed toward the front of the lens assembly.

[0034] FIG. 21B is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive index of a tunable lens (or first lens) when a user's gaze gazes at the outer edge of the lens assembly.

[0035] FIG. 22 is a diagram showing a change in the MTF (modulation transfer function) value according to a change in the resolution of the outer field of a tunable lens according to an embodiment of the present disclosure.

[0036] It should be noted that similar reference numbers are used throughout the drawings to describe identical or similar elements, features and structures.

[0037] The following description, with reference to the accompanying drawings, is provided to facilitate a comprehensive understanding of various embodiments of the disclosure as defined by the claims and their equivalents. While numerous specific details are included herein to aid understanding, they are to be considered merely exemplary. Accordingly, those skilled in the art will recognize that various modifications and variations can be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure. Furthermore, descriptions of commonly known functions and structures may be omitted for clarity and brevity.

[0038] The terms and words used in the following description and claims are not intended to be limited by their bibliographic meanings, but rather have been used by the inventors solely to facilitate a clear and consistent understanding of the present invention. Therefore, it will be apparent to those skilled in the art that the following description of various embodiments of the present invention is provided for illustrative purposes only and is not intended to limit the present invention as defined by the appended claims and their equivalents.

[0039] The singular forms "a," "an," and "the" should be understood to include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a surface of a part" includes reference to one or more of those surfaces.

[0040] Wearable electronic devices that implement augmented reality, virtual reality, mixed reality, and / or extended reality can generally be used while worn on the user's head or face. For example, a display that outputs visual information may be placed at a relatively close distance from the user's eyes. Depending on the user's eyesight, body type, and / or wearing condition, there may be differences in the performance (e.g., image quality) of the display as perceived by the user. This difference in performance as perceived by the user can be suppressed by guiding or focusing the visual information output from the display to the user's eyes using an optical system (e.g., a lens assembly) with adjustable refractive power or focal length. However, in a lightweight wearable electronic device intended to ensure comfort or reduce user fatigue, it may be difficult to implement an optical system that satisfies users with different eyesight, body type, and / or wearing tendencies.

[0041] Moreover, when implementing an optical system combining multiple lenses, the resolution in the peripheral region may be lower than in the central region. This is due to field curvature (or aberration) depending on the wavelength of the incident light and the material and shape of the lens(es). The greater the number of lenses, the easier it is to suppress field curvature or aberration. However, in miniaturized or lightweight wearable electronic devices, it may be difficult to arrange a sufficient number of lenses to sufficiently suppress distortion or aberration.

[0042] One embodiment of the present disclosure is intended to at least resolve the above-described problems and / or disadvantages and provide at least the advantages described below, and can provide a wearable electronic device including a tunable lens that is easy to adjust optical performance such as refractive power or focal length.

[0043] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which the present disclosure belongs from the description below.

[0044] It should be understood that each block of the flowchart and the combination of flowcharts can be performed by one or more computer programs containing instructions. One or more computer programs may be stored entirely in a single memory device, or one or more computer programs may be divided into different parts stored in multiple different memory devices.

[0045] Any function or operation described herein may be processed by a single processor or a combination of processors. A single processor or a combination of processors is a circuit that performs processing, and a single processor or a combination of processors includes an application processor (AP, e.g., a central processing unit (CPU)), a communication processor (CP, e.g., a modem), a graphics processing unit (GPU), a neural processing unit (NPU) (e.g., an artificial intelligence (AI) chip), a Wi-Fi chip, a Bluetooth® chip, a global positioning system (GPS) chip, a near field communication (NFC) chip, a connection chip, a sensor controller, a touch controller, a fingerprint sensor controller, a display driver integrated circuit (IC), an audio codec chip, a universal serial bus (USB) controller, a camera controller, an image processing IC, a microprocessor unit (MPU), a system on a chip (SoC), an IC, or a circuit thereof.

[0046] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to one embodiment of the present disclosure. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In one embodiment, the electronic device (101) may have at least one of these components (e.g., the connection terminal (178)) omitted, or one or more other components added. In one embodiment, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0047] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor), or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0048] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0049] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0050] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0051] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0052] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0053] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0054] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0055] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0056] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) to an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0057] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0058] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0059] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0060] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0061] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0062] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0063] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0064] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In one embodiment, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0065] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0066] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0067] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0068] Electronic devices according to embodiments of the present disclosure may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments of the present disclosure are not limited to the aforementioned devices.

[0069] The embodiments of the present disclosure and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to encompass various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly dictates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B, or C," "at least one of A, B, and C," and "at least one of A, B, or C" can each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish the corresponding component from other corresponding components, and do not limit the corresponding components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it is understood that the component can be connected to the other component directly (e.g., wired), wirelessly, or via a third component.

[0070] The term "module" used in the embodiments of the present disclosure may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0071] Embodiments of the present disclosure may be implemented as software (e.g., a program) including one or more instructions stored in a storage medium (e.g., built-in memory or external memory) readable by a machine (e.g., an electronic device). For example, a processor (e.g., a processor) of the machine (e.g., an electronic device) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, "non-transitory" only means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium.

[0072] According to one embodiment, a method according to an embodiment(s) of the present disclosure may be provided as a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0073] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0074] FIG. 2 is a drawing showing a wearable electronic device (200) according to one embodiment of the present disclosure.

[0075] In describing one embodiment of the present disclosure, some numerical values ​​and the like may be presented, but it should be noted that such numerical values ​​do not limit one embodiment of the present disclosure unless stated in the claims.

[0076] Referring to FIG. 2, a wearable electronic device (200) (e.g., electronic device (101) of FIG. 1) is an electronic device that can be worn on a user's head or face, and the user can visually recognize surrounding objects or environments even while wearing the wearable electronic device (200). The wearable electronic device (200) uses a camera module to acquire and / or recognize visual images of objects or environments viewed by the user or in the direction in which the wearable electronic device (200) is directed, and can receive information about the objects or environments from an external electronic device via a network. The wearable electronic device (200) can provide the user with information about the objects or environments received in an acoustic or visual form. For example, the wearable electronic device (200) can provide the user with information about the objects or environments received in a visual form by using a display member such as a display module. By visualizing information about objects or the environment and combining it with actual images (or videos) of the user's surroundings, the wearable electronic device (200) can implement augmented reality (AR), virtual reality (VR), mixed reality (MR), and / or extended reality (XR). The display member can provide the user with information about objects or the environment around him / her by outputting a screen in which an augmented reality object is added to an actual image (or video) of the user's surroundings.

[0077] According to one embodiment, all or part of the operations executed by the electronic device (101) or the wearable electronic device (200) may be executed by one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) or the wearable electronic device (200) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) or the wearable electronic device (200) may, instead of executing the function or service by itself or in addition, request one or more of the external electronic devices (102, 104, or 108) to execute the function or at least a part of the service. The one or more external electronic devices that receive the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101) or the wearable electronic device (200). The electronic device (101) or the wearable electronic device (200) may process the result as is or additionally and provide it as at least a part of a response to the request. For example, the external electronic device (102) renders content data executed in an application and transmits it to the electronic device (101) or the wearable electronic device (200), and the electronic device (101) or the wearable electronic device (200) that receives the data may output the content data to a display module. When the electronic device (101) or the wearable electronic device (200) detects user movement through a sensor(s) such as an inertial measurement unit sensor, the processor (e.g., the processor (120) of FIG. 1) of the electronic device (101) or the wearable electronic device (200) may correct the rendering data received from the external electronic device (102) based on the movement information and output the corrected data to the display module.Or, when a user movement is detected through a sensor(s), a processor (e.g., processor (120) of FIG. 1) of the electronic device (101) or wearable electronic device (200) may transmit the movement information to an external electronic device (102) and request rendering so that screen data is updated accordingly. According to various embodiments, the external electronic device (102) may be a device of various forms, such as a case device capable of storing and charging the electronic device (101).

[0078] It should be noted that the detailed description below may refer to various things such as "a state or position in which an electronic device or a designated component of an electronic device faces the user's face," and this is based on the assumption that the user is wearing the wearable electronic device (200).

[0079] According to one embodiment, a wearable electronic device (200) may include at least one display member (e.g., a display module (160) of FIG. 1) and a wearing member. Depending on the structure of the display member, the wearable electronic device (200) may further include a structure (e.g., a lens frame) for mounting or supporting the display member. The display members may be provided as a pair including a first display member and a second display member, and may be arranged to correspond to the user's right eye and left eye, respectively, when the wearable electronic device (200) is worn on the user's body. In one embodiment, the wearable electronic device (200) may also include a housing form (e.g., a goggle form) including one display member corresponding to the right eye and the left eye.

[0080] According to one embodiment, the display member is a configuration provided to provide visual information to a user, and may include, for example, a display (D), a plurality of lenses (L1, L2, L3, L4) (e.g., the lens assembly (LA) of FIG. 5) and / or at least one sensor. Here, the lens assembly and the display (D) may each be formed transparently or translucently. However, the display member is not limited thereto. In one embodiment, the display member may include a window member, and the window member may be a translucent glass or a member whose light transmittance can be adjusted as the tinting density is adjusted. In one embodiment, the display member may include a lens including a waveguide or a reflective lens, and an image output from an optical output device (e.g., a projector or the display (D)) is formed on each lens to provide visual information to the user. For example, the display member may include a waveguide (e.g., a light waveguide) provided in at least a portion of each lens, and may mean a display that transmits an image (or light) output from an optical output device, such as a display (D), to the user's eyes through the waveguide included in the display member, and at the same time transmits the real world to the user's eyes through that area in a see-through manner. In one embodiment, the waveguide may be understood as a part of a lens assembly. The lens assembly as an optical system may be a configuration including a plurality of lenses (e.g., L1, L2, L3, L4), and may be arranged in a state aligned with the optical axis (O) in the space within the wearable electronic device (200). A configuration in which visual information output from the display (D) is provided to the user's eyes through the lens assembly will be discussed again below with reference to FIG. 5.

[0081] FIGS. 3 and 4 are drawings showing the front and back of a wearable electronic device (300) according to one embodiment.

[0082] Referring to FIGS. 3 and 4, in one embodiment, camera modules (311, 312, 313, 314, 315, 316) and / or depth sensors (317) for obtaining information related to the surrounding environment of the wearable electronic device (300) may be arranged on a first surface (310) of the electronic device (300) (e.g., housing).

[0083] In one embodiment, the camera modules (311, 312) can acquire images related to the surrounding environment of the wearable electronic device (300).

[0084] In one embodiment, the camera modules (313, 314, 315, 316) can acquire images while the wearable electronic device is worn by a user. The camera modules (313, 314, 315, 316) can be used for hand detection, tracking, and recognition of user gestures (e.g., hand movements). The camera modules (313, 314, 315, 316) can be used for 3DoF (degrees of freedom), 6DoF head tracking, position (spatial, environmental) recognition, and / or movement recognition. In one embodiment, the camera modules (311, 312) can also be used for hand detection and tracking or recognition or detection of user gestures.

[0085] In one embodiment, the depth sensor (317) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for purposes such as time of flight (TOF) to determine the distance to an object. Instead of or in addition to the depth sensor (317), camera modules (313, 314, 315, 316) may determine the distance to an object.

[0086] According to one embodiment, a camera module (325, 326) for facial recognition and / or a display (331) (and / or a lens) may be disposed on the second side (320) of the housing.

[0087] In one embodiment, a face recognition camera module (325, 326) adjacent to the display may be used to recognize a user's face, or may recognize and / or track both eyes of the user.

[0088] In one embodiment, the display (331) (and / or lens) may be disposed on the second side (320) of the wearable electronic device (300). In one embodiment, the display (331) (and / or lens) may be at least partially similar to, or substantially identical to, the display (D) (and / or lenses L1, L2, L3, L4) of FIG. 2. In one embodiment, the wearable electronic device (300) may not include the camera modules (315, 316) among the plurality of camera modules (313, 314, 315, 316). Although not illustrated in FIGS. 3 and 4 , the wearable electronic device (300) may further include at least one of the configurations illustrated in FIGS. 1 and / or 2 .

[0089] In one embodiment, the display (331) may be understood to include a display module (e.g., the display module (160) of FIG. 1 or the display (D) of FIG. 2) that outputs a screen, and a lens assembly (e.g., the lens assembly (LA) of FIG. 5) that focuses the output screen onto the user's eyes. In FIG. 4, it is noted that reference numerals are assigned to parts of the structure of the display (331) that are visible from the exterior of the wearable electronic device (300), indicating the lens closest to the user's eyes.

[0090] As described above, according to one embodiment, the wearable electronic device (300) may have a form factor for being worn on a user's head. The wearable electronic device (300) may further include a strap and / or a wearing member for being secured to a body part of the user. The wearable electronic device (300) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0091] FIG. 5 illustrates a path along which light output by a display (D) is focused or guided to a user's eye (E) in a wearable electronic device (300) according to one embodiment of the present disclosure.

[0092] Referring further to FIG. 5 along with FIG. 2, a wearable electronic device (300) according to an embodiment of the present disclosure may include a display (D), a lens assembly (LA) (e.g., a plurality of lenses (L1, L2, L3, L4)), at least one quarter wave plate (QWP) (203, 205), at least one reflective polarizer (RP) (202), and / or at least one beam splitter (204). In one embodiment, the at least one quarter wave plate (203, 205), the at least one reflective polarizer (202), and / or the at least one beam splitter (204) may be understood as part of the lens assembly (LA). In one embodiment, at least one of the plurality of lenses (L1, L2, L3, L4) may be movable to adjust a diopter, thereby providing a vision correction function to a user. In one embodiment, at least one of the plurality of lenses (L1, L2, L3, L4) is implemented as a tunable lens, thereby adjusting the refractive power or focal length of the lens assembly (LA). For example, at least one of the plurality of lenses (L1, L2, L3, L4) in the lens assembly (LA) may be implemented as a tunable lens to provide a vision correction function to the user. Such tunable lenses will be discussed again with reference to FIGS. 6 to 11. In describing the embodiment(s) of the present disclosure, “adjusting the refractive power” may be understood to include converting to positive or negative refractive power, adjusting focus, and / or adjusting the focal length. In one embodiment, in describing the embodiment(s) of the present disclosure, “adjusting the refractive power” may be understood to include modulating the phase of light passing through the lens assembly (LA) and / or the tunable lens.

[0093] In one embodiment, when moving at least one of the plurality of lenses (L1, L2, L3, L4) for diopter adjustment, an actuator or guide structure for moving the lens(es) may be provided. In one embodiment, when at least one of the plurality of lenses (L1, L2, L3, L4) is implemented as a tunable lens, a mechanical structure (e.g., an actuator or guide structure) for diopter adjustment may be omitted. For example, since the lens assembly (LA) includes at least one tunable lens, it may be easy to provide optical performance suitable for a user's eyesight, body type, and / or wearing habits.

[0094] In one embodiment, at least one quarter wave plate (203, 205), at least one reflective polarizer (202), and at least one beam splitter (204) can extend and / or adjust the optical path length between the user's eye (E) and the display (D). For example, by implementing a focal length longer than the mechanical or physical length of the lens assembly (LA), the quality of the image provided to the user can be improved. Since wearable electronic devices (e.g., AR / VR glasses) have limitations in size or weight due to the actual use environment (e.g., use in a worn state), the resolution of the output virtual image may be limited, and it may be difficult to provide a good quality image to the user even through the optical system. In one embodiment, the wearable electronic device (300) includes an optical system (e.g., lens assembly (LA)) with a pancake lens structure, thereby extending the optical path length of the incident light relative to its external size, and / or increasing the image resolution provided to the user. For example, the wearable electronic device (300) may be an optical device (e.g., AR / VR glasses) that provides visual information to the user while being worn on the user's head or face by including a display (D) and a lens assembly (LA).

[0095] According to one embodiment, the display (D) may include a screen display area that displays visual information to portions corresponding to the user's eyes when the user wears the wearable electronic device (300). In one embodiment, the wearable electronic device (300) may include a pair of displays (D) corresponding to the user's eyes. The displays (D) may include, for example, a liquid crystal display (LCD), a light emitting diode (LED) display, an organic light emitting diode (OLED) display, a micro electro mechanical system (MEMS) display, or an electronic paper display. The displays (D) may display, for example, various contents (e.g., text, images, videos, icons, symbols, etc.) provided as visual information to the user.

[0096] According to one embodiment, various contents (e.g., text, images, videos, icons, or symbols, etc.) output in the form of light from the display (D) may be provided to the user's eyes by passing through at least one 1 / 4 wave plate (203, 205), at least one reflective polarizer (202), at least one beam splitter (204), and / or a lens assembly (LA). The order in which the light passes through the at least one 1 / 4 wave plate (203, 205), at least one reflective polarizer (202), at least one beam splitter (204), and / or the lens assembly (LA) may be set in various ways depending on the embodiment.

[0097] According to one embodiment, a first 1 / 4 wave plate (203) and a reflective polarizer (202) may be disposed on the eye side surface of the first lens (L1) (hereinafter, referred to as the “first lens (L1)”) of the lens assembly (LA) from the user’s eye (E), and a beam splitter (204) may be disposed on either the first lens (L1) or the second lens (L2) (hereinafter, referred to as the “second lens (L2)”) of the lens assembly (LA) from the user’s eye (E). For example, in the illustrated embodiment, the beam splitter (204) may be disposed on the display side surface of the second lens (L2), and in the embodiment described below, the beam splitter may be disposed on the display side surface of the first lens (L1). Here, “disposed on XX” may refer to being disposed adjacent to or substantially in contact with XX. For example, the beam splitter (204) may be positioned adjacent to the display-side surface of the first lens (L1) or the second lens (L2), or may be provided in a state of substantially contacting the display-side surface of the first lens (L1) or the second lens (L2).

[0098] In the illustrated embodiment, the first lens (L1) of the wearable electronic device (300) or the lens assembly (LA) may be understood as the lens that is positioned farthest from the display (D) among a plurality of lenses (e.g., at least four lenses), or the lens that is positioned closest to the user's eye (E). However, it should be noted that the embodiment(s) of the present disclosure are not limited thereto. For example, although not illustrated, the wearable electronic device (300) or the lens assembly (LA) may further include a transmissive optical member that is positioned farther from the display (D) than the first lens (L1). In one embodiment, the transmissive optical member may have a refractive power that does not affect the optical performance of the lens assembly (LA). In one embodiment, the transmissive optical member that is positioned farther from the display (D) than the first lens (L1) may have a transmittance of about 90% or more with respect to visible light. In one embodiment, the transmissive optical member may have a transmittance close to 100% with respect to visible light. In the illustrated embodiment, reference numeral '201' is intended to illustrate the first polarizer, but in one embodiment, the first polarizer may be omitted. In a structure where the first polarizer is omitted, reference numeral '201' may be understood as the above-described transmissive optical member. In one embodiment, the transmissive optical member may be arranged between the first lens (L1) and the first polarizer (201) or between the reflective polarizer (202) and the first polarizer (201).

[0099] FIG. 5 illustrates an example in which a first quarter wave plate (203) and / or a reflective polarizer (202) are disposed adjacent to (or substantially in contact with) the user's eye-side surface of the first lens (L1), and a beam splitter (204) is disposed adjacent to (or substantially in contact with) the display-side surface of the second lens (L2) (or the first lens (L1)). In one embodiment, the reflective polarizer (202) is configured in a film form and is laminated with the first quarter wave plate (203) to form a first film portion (F1), which can be attached to the first lens (L1) from the user's eye. Here, 'lamination' may mean that at least one of two different members is provided with an adhesive and is bonded to each other. In one embodiment, when the first 1 / 4 wave plate (203) and / or the reflective polarizer (202) are placed in contact with a lens (e.g., the first lens (L1)), for example, when attached to one surface of the first lens (L1), the surface of the first lens (L1) that is in contact with the first 1 / 4 wave plate (203) and / or the reflective polarizer (202) can be implemented as a substantially flat surface.

[0100] According to one embodiment, the first film portion (F1) in the form of a first 1 / 4 wave plate (203) and a reflective polarizer (202) laminated together may be thinner and have superior optical performance than a film portion having a simple laminated structure. According to one embodiment, the wearable electronic device (300), the lens assembly (LA), and / or the first film portion (F1) may further include at least one separately provided polarizing film (e.g., the first polarizer (201)), as illustrated in FIG. 5, and additionally or alternatively, may further include at least one anti-reflection (AR) film (not illustrated). In one embodiment, when the wearable electronic device (300) and / or the lens assembly (LA) further include a transmissive optical member (not illustrated), the transmissive optical member may be disposed between the reflective polarizer (202) and the first polarizer (201). For example, the first polarizer (201) may be understood as a part of the first film portion (F1) or as an independent component with respect to the first film portion (F1).

[0101] In one embodiment, a liquid crystal display, an organic light emitting diode display, and / or a micro LED can provide a good quality image by including a polarizing plate. In one embodiment, when the lens assembly (LA) further includes a first film portion (F1) and / or a first polarizer (201), the image quality perceived by the user can be improved even if the display (D) outputs an image of the same quality. In one embodiment, when combined with a lens assembly (LA) including a first film portion (F1), a second film portion (F2), and / or a first polarizer (201), some polarizing plates may be omitted from a display (D) implemented as an organic light emitting diode display or a micro LED. In one embodiment, the lens assembly (LA) may include a first film portion (F1) and / or a first polarizer (201), and the display (D) may include a polarizing plate.

[0102] In one embodiment, the first film portion (F1) (or polarizing plate) is positioned closer to the user's eye (E) than the lens assembly (LA) to selectively transmit, reflect, and / or block light (e.g., light output from the display (D)) entering the user's eye. The beam splitter (204) may be positioned between the lenses of the lens assembly (LA), for example, between the first lens (L1) and the second lens or between the second lens (L2) and the third lens (L3). The beam splitter (204) may be configured to transmit a portion of the light incident on the beam splitter (204) and reflect another portion of the light incident on the beam splitter (204). For example, the beam splitter (204) may be configured to transmit approximately 50% of the light and reflect approximately 50% of the light. In one embodiment, the beam splitter (204) may be configured as a semi-transparent mirror, for example, in the form of a mirror coated on one surface of the first lens (L1) or the second lens (L2). Hereinafter, based on the functional aspect of light reflection, the reflective polarizer (202) may be referred to as a 'first reflective member', and the beam splitter (204) may be referred to as a 'second reflective member'.

[0103] In the following description, a direction from the user's eye (E) toward the display (D) may be referred to as a first direction, and a direction from the display (D) toward the user's eye (E) opposite to the first direction may be referred to as a second direction. The first direction and the second direction may be substantially parallel to the optical axis (O). The lens assembly (LA) may include a plurality of lenses (e.g., a first lens (L1), a second lens (L2), a third lens (L3), and a fourth lens (L4)) sequentially arranged along the first direction.

[0104] According to one embodiment, the wearable electronic device (300) may include a second film portion (F2) disposed at a position further from the user's eye (E) than the lens assembly (LA) to selectively transmit, reflect, and / or block light entering the lens assembly (LA). In the illustrated embodiment, the second film portion (F2) may be exemplified as being disposed between the display (D) and the lens assembly (LA) (e.g., the fourth lens (L4)). However, the embodiment(s) of the present disclosure are not limited thereto, and the second film portion (F2) may be disposed at any position between the display (D) and the first lens (L1), or at any position between the display (D) and the first film portion (F1).

[0105] According to one embodiment, the second film portion (F2) may include a second 1 / 4 wavelength plate (205) and a second polarizer (206). Similar to the first film portion (F1), the second 1 / 4 wavelength plate (205) and the polarizer (206) may be laminated to implement the second film portion (F2). As previously mentioned, for the purpose of distinguishing the components, the 1 / 4 wavelength plate (203) of the first film portion (F1) described above may be referred to as the first 1 / 4 wavelength plate (203), and the 1 / 4 wavelength plate (205) of the second film portion (F2) may be referred to as the second 1 / 4 wavelength plate (205). Additionally, the polarizer (206) of the second film portion (F2) may be referred to as a second polarizer (206) to distinguish it from the first polarizer (201) included in the first film portion (F1).

[0106] According to one embodiment, the arrangement of the film portions (F1, F2) and / or the beam splitter (204) can provide good quality images while miniaturizing the optical system implemented with a limited number of lenses (e.g., approximately 4). For example, by reducing the number of lenses (or the number of lens surfaces) arranged between the reflective polarizer (202) as the first reflective member and the beam splitter (204) as the second reflective member, refraction or scattering in the path of reflected light, and / or birefringence due to manufacturing errors can be suppressed.

[0107] According to one embodiment, the wearable electronic device (300) may operate as follows. Light output from the display (D) may reach the user's eye (E) after passing through the second film portion (F2), the lens assembly (LA), and the first film portion (F1). At this time, the second polarizer (206) of the second film portion (F2) may transmit the first linear polarization, for example, vertical polarization (or p polarization), and may not transmit the second linear polarization, for example, horizontal polarization (or s polarization). For example, among the light reaching the second polarizer (206), only vertical polarization (or p polarization) may be transmitted. Light transmitted through the second polarizer (206) is converted into circular polarization (right-hand circular polarization or left-hand circular polarization) by the second 1 / 4 wave plate (205), and this circular polarization can reach the first 1 / 4 wave plate (203) after passing through the lens assembly (LA) and the beam splitter (204). The circular polarization reaching the first 1 / 4 wave plate (203) is converted back into linear polarization (e.g., vertical polarization (or p-polarization)) while passing through the first 1 / 4 wave plate (203) and can reach the reflective polarizer (202). Until reaching the reflective polarizer (202), the light can move in the second direction (display (D) -> user's eye (E)). Light reaching the reflective polarizer (202) is reflected by the reflective polarizer (202) and directed in a first direction (user's eye (E) -> display (D)), and can be converted into circular polarization (right-hand circular polarization or left-hand circular polarization) while passing through the first 1 / 4 wave plate (203). This circular polarization (right-hand circular polarization or left-hand circular polarization) is reflected by the beam splitter (204) and directed in a second direction again, and at this time, the phase can be converted (for example, when it is left-hand circular polarization -> right-hand circular polarization, when it is right-hand circular polarization -> left-hand circular polarization). The circular polarization whose phase has been converted can pass through the first 1 / 4 wave plate (203) and the reflective polarizer (202) along the second direction and reach the user's eye (E).At this time, the light passing through the first 1 / 4 wave plate (203) is converted into horizontal polarization (or s polarization) and can reach the user's eye (E). However, the embodiment of FIG. 5 is an example of a state change of light passing through a wearable electronic device (300) according to one embodiment, and it should be noted that the conversion of polarization components by the reflective polarizer (202), the 1 / 4 wave plate (203, 205), the beam splitter (204), and / or the second polarizer (206) may be different from the mentioned embodiment.

[0108] In the embodiment of FIG. 5, the optical path from the display (D) to the user's eye (E) or the polarization state of the light passing through (or reflected) the film portions (F1, F2) or the beam splitter (204) is described. For the convenience of description of the optical path or the polarization state, FIG. 5 illustrates that the second film portion (F2) is disposed on the fourth lens (L4), but the embodiment(s) of the present disclosure are not limited thereto, and the first film portion (F1) and the second film portion (F2) may be disposed between two adjacent lenses (e.g., the first lens (L1) and the second lens (L2)), and the beam splitter (204) may be disposed between the first film portion (F1) and the second film portion (F2).

[0109] FIG. 6 is a diagram illustrating a tunable lens (TL1) (e.g., at least one of the lenses L1, L2, L3, and L4 of FIG. 5) of a wearable electronic device (e.g., the electronic device (101) of FIG. 1 and / or the wearable electronic devices (200, 300) of FIGS. 2 to 5) according to an embodiment of the present disclosure. FIG. 7 is a diagram illustrating a tunable lens (TL1) of a wearable electronic device (300) according to an embodiment of the present disclosure, taken along line A-A' of FIG. 6.

[0110] Referring to FIGS. 6 and 7, the tunable lens (TL1) may include an optical chamber (13) filled with an electrically conductive liquid and electrode terminals (11a, 11b)(s). The conductive liquid may be, for example, substantially transparent and move in response to an applied electrical signal. In one embodiment, the conductive liquid may move within the optical chamber (13) by an electrical signal or an external force applied to the electrode terminals (11a, 11b)(s). The optical chamber (13) may transmit at least a portion of visible light and may have a shape that changes depending on the movement or distribution of the conductive liquid. For example, by controlling the shape of the optical chamber (13) by applying an electrical signal to the electrode terminals (11a, 11b)(s), the refractive power or focal length of the optical chamber (13) may be adjusted. In one embodiment, the tunable lens (TL1) is provided as at least one of the lenses (L1, L2, L3, L4) of FIG. 5, thereby controlling the optical performance of the lens assembly (LA) to suit the user's physical condition or wearing condition.

[0111] According to one embodiment, the electrode terminal may include a first electrode terminal (11a) provided as a positive pole and a second electrode terminal (11b) provided as a negative pole. In one embodiment, the first electrode terminal (11a) and the second electrode terminal (11b) may be arranged to face each other and / or to face in opposite directions with respect to each other. In one embodiment, the first electrode terminal (11a) may be understood as a structure having a plate shape and determining an effective diameter of the optical chamber (13). For example, the first electrode terminal (11a) may define an aperture area through which light is incident on the optical chamber (13), and at least a portion (e.g., an edge portion) of the optical chamber (13) may be arranged between the first electrode terminal (11a) and the second electrode terminal (11b). In one embodiment, the second electrode terminal (11b) is made substantially transparent so as to transmit light focused or guided by the first electrode terminal (11a) and / or the optical chamber (13). In one embodiment, the first electrode terminal (11a) and the second electrode terminal (11b) may be arranged to face each other by a spacer (15), and the optical chamber (13) may be arranged between the first electrode terminal (11a) and the second electrode terminal (11b) in an area at least partially surrounded by the spacer (15).

[0112] According to one embodiment, as the shape of the optical chamber (13) is deformed, the size or volume of a portion of the optical chamber (13) disposed between the first electrode terminal (11a) and the second electrode terminal (11b) may change. In one embodiment, the first electrode terminal (11a) and / or the second electrode terminal (11b) may include at least one ventilation hole (17), thereby facilitating the change in the size or volume of the portion of the optical chamber (13) disposed between the first electrode terminal (11a) and the second electrode terminal (11b). For example, in a space where a portion of the optical chamber (13) is to be accommodated, the air inside may be discharged to the outside through the ventilation hole (17)(s), thereby facilitating the deformation of the optical chamber (13). The deformation of the optical chamber (13) will be further described with reference to FIGS. 8 and 9.

[0113] FIG. 8 is a drawing illustrating a first operating state of a tunable lens (TL1) (e.g., at least one of the lenses L1, L2, L3, and L4 of FIG. 5) of a wearable electronic device (e.g., the electronic device (101) of FIG. 1 and / or the wearable electronic devices (200, 300) of FIGS. 2 to 5) according to an embodiment of the present disclosure, which is a drawing illustrating the tunable lens (TL1) cut along the line A-A' of FIG. 6. FIG. 9 is a drawing illustrating a second operating state of a tunable lens (TL1) of a wearable electronic device (300) according to an embodiment of the present disclosure, which is a drawing illustrating the tunable lens (TL1) cut along the line A-A' of FIG. 6.

[0114] Referring further to FIGS. 8 and 9, when an electric signal is applied to the electrode terminals (11a, 11b), the optical chamber (13) may be deformed, thereby adjusting the refractive power or focal length of the tunable lens (TL1). For example, depending on the electric signal applied to the electrode terminals (11a, 11b), the shape or refractive power of the optical chamber (13) may be adjusted as the distribution of the conductive liquid changes. In one embodiment, the tunable lens (TL1) may be provided as at least one of the lenses (L1, L2, L3, L4) described above. In one embodiment, the tunable lens (TL1) may be provided as the lens (e.g., the fourth lens (L4) of FIG. 5) that is closest to the display (D) among the lenses (L1, L2, L3, L4) described above. For example, among the lenses (L1, L2, L3, L4) described above, at least the fourth lens (L4) may be implemented by the tunable lens (TL1). In one embodiment, among the lenses (L1, L2, L3, L4) described above, the lens implemented by the tunable lens (TL1) may be arranged closer to the display (D) than the film portions (F1, F2) described above, or may be arranged farther from the display (D) than the film portions (F1, F2) described above.

[0115] According to one embodiment, when FIG. 7 exemplifies a state in which the optical chamber (13) has positive refractive power, FIG. 9 may exemplify a state in which the optical chamber (13) has negative refractive power. FIG. 8 may be understood as exemplifying a state in which the optical chamber (13) has positive refractive power but lower refractive power than that in FIG. 7. In one embodiment, the shape of the optical chamber (13) filled with a transparent liquid can be forcibly (e.g., mechanically) deformed to control the distribution of the liquid and control the refractive power of the tunable lens (TL1). A tunable lens (TL1) having such a mechanical operating structure can be implemented with reference to Korean Patent Publication No. 10-2023-0012181 (published on January 26, 2023; U.S. Patent Publication No. 2023 / 0019936 (published on January 19, 2023)) filed by the applicant of the present invention. When the tunable lens (TL1) has a mechanical operating structure, the liquid filled in the optical chamber may not have conductivity.

[0116] FIG. 10 is a diagram illustrating a tunable lens (TL2) (e.g., at least one of the lenses L1, L2, L3, and L4 of FIG. 5) of a wearable electronic device (e.g., the electronic device (101) of FIG. 1 and / or the wearable electronic devices (200, 300) of FIGS. 2 to 5) according to an embodiment of the present disclosure. FIG. 11 is a diagram illustrating an operating state of a tunable lens (TL2) of a wearable electronic device (300) according to an embodiment of the present disclosure.

[0117] Referring to FIGS. 10 and 11, the tunable lens (TL2) may be provided as at least one of the lenses (L1, L2, L3, L4) described above, and may include transparent plates (29) arranged to face each other, liquid crystals (23a) provided in a space between the transparent plates (29), and electrode terminals (21a, 21b) for applying an electric signal to the liquid crystals (23a). In one embodiment, the first electrode terminal (21a), which is a positive pole among the electrode terminals (21a, 21b), may be provided above or below the region in which the liquid crystals (23a) are provided with a transparent insulating layer (21c) therebetween, and the second electrode terminal (21b), which is a negative pole among the electrode terminals (21a, 21b), may be provided below or above the region in which the liquid crystals (23a) are provided. In one embodiment, the second electrode terminal (21b) may be placed in contact with the liquid crystals (23a).

[0118] According to one embodiment, the arrangement or orientation of the liquid crystals (23a) may change depending on an operation of applying an electric signal to the electrode terminals (21a, 21b) (e.g., an on / off operation of the switch (SW). This change in the arrangement (or orientation) of the liquid crystals (23a) may adjust the refractive power of the tunable lens (TL2) (e.g., the focal length or refractive performance of the lens assembly (LA) of FIG. 5). In one embodiment, when the switch (SW) is in the on state, the inclination or arrangement of the liquid crystals (23a) may change depending on the voltage of the applied electric signal. FIG. 10 illustrates, for example, a state in which the switch (SW) is off, and at this time, the tunable lens (TL2) may have substantially no refractive power. FIG. 11 illustrates, for example, a state in which the switch (SW) is on, and at this time, the tunable lens (TL2) may have positive refractive power. When the switch is on, the refractive power of the tunable lens (TL2) can be adjusted depending on the magnitude of the voltage (or the intensity of the current) of the electric signal applied to the electrode terminals (21a, 21b). For example, by varying the voltage (or current) of the electric signal applied to the electrode terminals (21a, 21b), the refractive performance, such as the focal length, of the tunable lens (TL2) and / or the lens assembly (LA) of FIG. 5 can be adjusted.

[0119] In one embodiment, although not shown, at least one of the transparent plates (29) arranged facing each other may include a Fresnel structure having a grid pattern. The Fresnel structure may refer to a structure including grooves arranged concentrically on the surface of the transparent plate (29)(s). In one embodiment, the transparent plate (29)(s) including the Fresnel structure may be referred to as a Fresnel lens. In one embodiment, the Fresnel lens (29) may provide different refractive performances depending on the shape or spacing of the grooves. For example, it may be useful for suppressing resolution deviation between the central region and the peripheral region of the lens (e.g., the transparent plate (29)(s)). The pattern or shape of the Fresnel structure for suppressing resolution deviation on the transparent plate (29)(s) may vary depending on the specifications of the lens assembly (e.g., the lens assembly (LA) of FIG. 5) to be actually manufactured and / or the tunable lens (TL2). In one embodiment, when the tunable lens (TL2) includes a Fresnel structure, it may be easy to increase the resolution in the peripheral area. This configuration will be further discussed in the embodiments described below.

[0120] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure pertains from the description of the above-described embodiment(s).

[0121] FIG. 12 is a schematic block diagram of a wearable electronic device according to one embodiment of the present disclosure.

[0122] Referring to FIG. 12, a wearable electronic device (1201) (e.g., the electronic device (101) of FIG. 1, the wearable electronic devices (200, 300) of FIGS. 2 to 5) may include a camera (1210), a processor (1220), a memory (1230), a power supply (1240), a lens assembly (1250), and a display (1260).

[0123] According to one embodiment, the processor (1220) may control the overall operation of the wearable electronic device (1201). For example, the processor (1220) may be implemented in a manner identical to or similar to the processor (120) of FIG. 1.

[0124] According to one embodiment, the processor (1220) may control the display (1260) to output lights representing visual information through the lens assembly (1250) (e.g., the lens assembly (LA) of FIG. 5). For example, the lens assembly (1250) may be in contact with the display (1260). The display (1260) may include a plurality of pixels. Lights output from the plurality of pixels included in the display (1260) may pass through the lens assembly (1250) and reach the user's eyes. A user wearing the wearable electronic device (1201) may view visual objects or visual information represented by the lights output from the display (1260).

[0125] According to one embodiment, the lens assembly (1250) may include a plurality of lenses (1251, 1252) (e.g., pancake lenses) and a tunable lens (1255) capable of adjusting the refractive index of light (or the phase of light). Meanwhile, in FIG. 12, the lens assembly (1250) is illustrated as including only one tunable lens (1255), but this is only for convenience of explanation and the technical idea of ​​the present document may not be limited thereto. Depending on the implementation, the lens assembly (1250) may include a plurality of tunable lenses.

[0126] According to one embodiment, the processor (1220) may adjust the refractive index of each of the plurality of regions of the tunable lens (1255). For example, the processor (1220) may apply a designated current (or voltage) to each of the plurality of regions of the tunable lens (1255) through a power supply unit (PSU) (1240). When a designated current (or voltage) is applied to each of the plurality of regions of the tunable lens (1255), the refractive index of each of the plurality of regions may be adjusted or changed.

[0127] In an object (or image) represented by light passing through a plurality of lenses (1251, 1252) included in a lens assembly (1250), the image quality of an area corresponding to the edge or outer edge of the lenses (1251, 1252) may deteriorate. For example, an object displayed in an area corresponding to the edge or outer edge of the lenses (1251, 1252) may be partially distorted or blurred (or light spread). For example, a straight object may be displayed as a curved line. Or, the thickness of a line included in an object may be modified.

[0128] In order to solve the above problem, a wearable electronic device (1201) according to an embodiment can reduce distortion or blur of an object displayed in an area corresponding to the edge or outer edge of the lenses (1251, 1252) by adjusting the refractive index of each of the plurality of areas of the tunable lens (1255) (or modulating the phase of light passing through each of the plurality of areas of the tunable lens (1255). The operation of adjusting the refractive index of light described below may include an operation of modulating the phase of light passing through each of the plurality of areas of the tunable lens (1255). However, for convenience of explanation, it will be described in this document as an operation of adjusting the refractive index of light.

[0129] According to one embodiment, the processor (1220) may adjust a refractive index of a first region of the tunable lens (1255) corresponding to a first distance from an edge (e.g., an outermost edge) of the tunable lens (1255) to a first value. The processor (1220) may adjust a refractive index of a second region of the tunable lens (1255) corresponding to a second distance longer than the first distance from the edge of the tunable lens (1255) to a second value. For example, the first region may be a region corresponding to an edge of the tunable lens (1255). The second region may be a region corresponding to a center of the tunable lens (1255).

[0130] According to one embodiment, the processor (1220) may check or monitor the gaze of a user wearing the wearable electronic device (1201) through the camera (1210). For example, the camera (1210) may be implemented as a camera for tracking the gaze of the user (e.g., an eye tracking camera or eye tracker). The wearable electronic device (1201) may further include a plurality of optical elements (not shown) for facilitating tracking when tracking the gaze of the user. For example, the plurality of optical elements may be arranged outside the lens assembly (1250). For example, the plurality of optical elements may output infrared light to the user's eyes to enable the camera (1210) to easily track the user's gaze.

[0131] According to one embodiment, the processor (1220) can adjust the refractive index of each of the first and second regions of the tunable lens (1255) based on the user's gaze (e.g., gaze direction or gaze angle).

[0132] According to one embodiment, the processor (1220) may use the camera (1210) to determine an angle corresponding to the user's gaze. For example, the processor (1220) may determine a first angle corresponding to the user's gaze based on an angle at which the user gazes forward. For example, the processor (1220) may set the angle at which the user gazes forward as a reference angle (e.g., 0 degrees). The processor (1220) may determine the first angle corresponding to the user's gaze based on the reference angle.

[0133] According to one embodiment, the processor (1220) may compare a first angle corresponding to the user's gaze with a threshold value. For example, the threshold value may be a pre-specified angular value to determine whether the user's gaze points to a specific area of ​​the tunable lens (1255). For example, the processor (1220) may adjust the refractive index of the first area of ​​the tunable lens (1255) to a first value based on determining that the first angle corresponding to the user's gaze is greater than the first threshold value. In this case, the first value may be a value for increasing the resolution and reducing blur of a visual object displayed in an area corresponding to the first area (e.g., an edge area). The processor (1220) may control the power supply unit (1240) to apply a first current specified to the first area of ​​the tunable lens (1255). For example, the specified first current may mean a current for changing the refractive index of the first area to the first value.

[0134] According to one embodiment, the processor (1220) may adjust the refractive index of the first region of the tunable lens (1255) to an initial value based on determining that the first angle corresponding to the user's gaze is not greater than a first threshold value. For example, the initial value may refer to a refractive index in a state where no current is applied to the tunable lens (1255) (e.g., a transparent glass state). Alternatively, the initial value may refer to a refractive index in a state where a specified current is applied only to a portion of the first region.

[0135] According to one embodiment, the processor (1220) may adjust the refractive index of the second region (e.g., the central region) of the tunable lens (1255) to a second value based on determining that the first angle corresponding to the user's gaze is greater than the first threshold value. At this time, the second value may be a value for increasing the resolution of a visual object displayed in the region corresponding to the first region and reducing blur. The processor (1220) may control the power supply unit (1240) to apply a second current designated to the second region of the tunable lens (1255). Alternatively, the processor (1220) may set the refractive index of the second region of the tunable lens (1255) to an initial value. For example, the initial value may mean a refractive index in a state in which no current is applied to the tunable lens (1255) (e.g., a transparent glass state). Alternatively, the initial value may mean the refractive index in a state where a specified current is applied only to a portion of the second region.

[0136] According to one embodiment, the processor (1220) may adjust the refractive index of the first region using a table stored in the memory (1230) (e.g., the memory (130) of FIG. 1). For example, if the processor (1220) determines that the first angle corresponding to the user's gaze is greater than a first threshold value, the processor (1220) may apply a current pre-specified in the table to the first region to adjust the refractive index of the first region. Alternatively, if the processor (1220) determines that the first angle corresponding to the user's gaze is not greater than the first threshold value, the processor (1220) may apply a current pre-specified in the table to the first region to set the refractive index of the first region to an initial value.

[0137] Through the above-described method, the processor (1220) can increase the resolution and reduce the blur of the first object displayed based on the first lights passing through (or transmitting) a first area (or first field) of the tunable lens (1255) corresponding to a first distance from the edge of the tunable lens (1255) (e.g., an edge area of ​​the tunable lens (1255)).

[0138] Meanwhile, at least some of the operations of the wearable electronic device (1201) described below may be performed by the processor (1220). However, for convenience of explanation, it will be described that the wearable electronic device (1201) performs the corresponding operations.

[0139] FIG. 13 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive index of a tunable lens (hereinafter, referred to as a first lens) based on a user's gaze.

[0140] Referring to FIG. 13, according to one embodiment, in operation 1301, a wearable electronic device (e.g., the wearable electronic device (1201) of FIG. 12) may output lights representing visual information through a display (e.g., the display (1260) of FIG. 12). For example, the lights may pass through a plurality of lenses (1251, 1252) included in a lens assembly (e.g., the lens assembly (1250) of FIG. 12) and a first lens (e.g., the tunable lens (1255) of FIG. 12) capable of adjusting a refractive index by applying an electrical signal) to reach a user's eye.

[0141] According to one embodiment, in operation 1302, the wearable electronic device (1201) can identify the gaze of a user wearing the wearable electronic device (1201) through a camera (e.g., the face recognition camera module (325, 326) of FIG. 4, the camera (1210) of FIG. 12). The wearable electronic device (1201) can identify a first angle corresponding to the user's gaze. For example, the wearable electronic device (1201) can set an angle when the user gazes straight ahead as a reference angle. The wearable electronic device (1201) can identify the first angle indicated by the user's gaze based on the reference angle.

[0142] In one embodiment, in operation 1303, the wearable electronic device (1201) may determine whether a first angle corresponding to the user's gaze is greater than a first threshold value. For example, the first threshold value may be an angle value for determining whether the user's gaze is outside the center of the first lens (1255).

[0143] According to one embodiment, if it is determined that the first angle corresponding to the user's gaze is greater than the first threshold value (example of operation 1303), in operation 1305, the wearable electronic device (1201) may control or adjust the refractive indices of the first and second regions of the first lens (1255) (or the phases of light passing through the first and second regions) based on the first angle. For example, if it is determined that the user's gaze is directed toward the outer portion or edge portion of the first lens (1255), the wearable electronic device (1201) may adjust the refractive indices of the first and second regions of the first lens (1255). Through this, the wearable electronic device (1201) may increase the resolution of an object indicated by light passing through the edge portion of the first lens (1255) and reduce blur (e.g., optical blur).

[0144] According to one embodiment, if it is determined that the first angle corresponding to the user's gaze is not greater than the first threshold value (NO in operation 1303), in operation 1307, the wearable electronic device (1201) may control the refractive indices of the first region and the second region of the first lens (1255) to initial values. For example, if it is determined that the user's gaze is directed toward the center part or the center region of the first lens (1255), the wearable electronic device (1201) may set the refractive indices of the first region and the second region of the first lens (1255) to initial values. Since the resolution of the object indicated by the light passing through the center region of the first lens (1255) is good, the wearable electronic device (1201) may minimize power consumption when the user's gaze is directed straight ahead. For example, the first lens (1255) controlled to the initial value may be transparent glass. Alternatively, the first lens (1255) controlled by the initial value may have the refractive index of some areas (e.g., some edge areas) controlled.

[0145] FIGS. 14A and 14B are drawings for explaining a method for adjusting the refractive index of a tunable lens (or first lens) of a wearable electronic device according to one embodiment of the present disclosure.

[0146] Referring to FIGS. 14A and 14B, the wearable electronic device (1201) can control or adjust the refractive index of each of the plurality of regions (multiple fields) of the first lens (e.g., the tunable lens (1255) of FIG. 12) by applying a designated current to each of the plurality of regions.

[0147] Referring to (a) of FIG. 14A, according to one embodiment, the first current map (1410) may be a current map when the user's gaze is directed toward the central portion of the first lens (1255). For example, the wearable electronic device (1201) may not apply any current to the first lens (1255) as the initial value of the first lens (1255), as in the first current map (1410). At this time, the first lens (1255) may be transparent glass. Referring to (a) of FIG. 14B, according to one embodiment, the wearable electronic device (1201) may apply a specified current to a portion (1421) of the first lens (1255) as the initial value of the first lens (1255). At this time, the edge portion of the first lens (1255) (e.g., the portion corresponding to 1421) may have its refractive index changed.

[0148] Referring to (b) of FIG. 14a (or (b) of FIG. 14b), according to an embodiment, the second current map (1430) may be a current map when the user's gaze is directed toward the edge of the first lens (1255). For example, the wearable electronic device (1201) may control the refractive index of the first region (1450) by applying current to the first region (1450) of the first lens, as in the second current map (1430). In addition, the wearable electronic device (1201) may not apply any current to the second region (1440), as in the second current map (1430). In this case, the second region (1440) may be transparent glass. Depending on the implementation, currents of different magnitudes may be applied to a plurality of regions included in the first region (1450). That is, the wearable electronic device (1201) can apply different currents depending on the positions of the plurality of regions included in the first region (1450). Alternatively, the same magnitude of current may be applied to the plurality of regions included in the first region (1450).

[0149] According to one embodiment, the first current map (1410 or 1420) and the second current map (1430) may be stored in advance in a memory (e.g., the memory (1230) of FIG. 12). The wearable electronic device (1201) may read the corresponding current map according to the user's gaze and adjust the refractive index of the first lens (1255).

[0150] According to the above-described method, the wearable electronic device (1201) can control the refractive index of each of the plurality of regions of the first lens (1255) by applying a current of a specified size to the first region (1450) and the second region (1440) of the first lens (1255) according to the user's gaze. Through this, the wearable electronic device (1201) can increase the resolution of the first object displayed and reduce blur based on the first lights transmitting through the first region (e.g., the edge region) of the first lens (1255).

[0151] Meanwhile, the current values ​​applied to the first lens (1255) in FIGS. 14a and 14b are exemplary, and the technical idea of ​​this document may not be limited thereto.

[0152] FIG. 15 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive index of a tunable lens (or first lens).

[0153] Referring to FIG. 15, according to one embodiment, in operation 1501, a wearable electronic device (e.g., the wearable electronic device (1201) of FIG. 12) can detect the gaze of a user wearing the wearable electronic device (1201) through a camera (e.g., the camera (1210) of FIG. 12).

[0154] In one embodiment, in operation 1503, the wearable electronic device (1201) may determine whether a first angle corresponding to the user's gaze is greater than a first threshold value. For example, the first threshold value (e.g., approximately 30 degrees) may be an angle value for determining whether the user's gaze is at a central portion of the first lens (1255) (e.g., a portion corresponding to 0 to 0.3F).

[0155] According to one embodiment, if it is determined that the first angle corresponding to the user's gaze is not greater than the first threshold value (NO in operation 1503), in operation 1511, the wearable electronic device (1201) may control the refractive indices of the first area and the second area of ​​the first lens (1255) to initial values.

[0156] According to one embodiment, if it is determined that the first angle corresponding to the user's gaze is greater than the first threshold (as in the example of operation 1503), in operation 1505, the wearable electronic device (1201) may determine whether the first angle corresponding to the user's gaze is greater than the second threshold. For example, the second threshold (e.g., approximately 70 degrees) may be an angle value for determining whether the user's gaze is at the middle part of the first lens (1255) (e.g., the part corresponding to 0.3F to 0.7F) or the outer part (e.g., the part corresponding to 0.7F to 1.0F). The second threshold may be greater than the first threshold.

[0157] According to one embodiment, if it is determined that the first angle corresponding to the user's gaze is not greater than the second threshold (NO in operation 1505), in operation 1507, the wearable electronic device (1201) may control the first region of the first lens (1255) to a first refractive index corresponding to the first angle and control the second region to a second refractive index corresponding to the first angle. For example, the first refractive index and the second refractive index may be determined as values ​​at which the resolution of an object represented by light passing through a middle portion of the first lens (e.g., a portion between the center portion and the outer portion) increases and blur decreases.

[0158] According to one embodiment, if it is determined that the first angle corresponding to the user's gaze is greater than the second threshold (example of operation 1505), in operation 1509, the wearable electronic device (1201) may control the first area of ​​the first lens to a third refractive index corresponding to the first angle, and may control the second area to a fourth refractive index corresponding to the first angle. For example, the third refractive index and the fourth refractive index may be determined as values ​​at which the resolution of an object represented by light passing through an outer portion of the first lens (1255) is increased and blur is reduced.

[0159] FIG. 16 is a diagram illustrating a method for adjusting the refractive index of a tunable lens (or first lens) in a wearable electronic device according to one embodiment of the present disclosure.

[0160] Referring to (a) of FIG. 16, according to one embodiment, the first current map (1610) may be a current map when the user's gaze is directed toward the central portion of the first lens (1255). For example, the wearable electronic device (1201) may not apply any current to the first lens (1255) as the initial value of the first lens (1255), as in the first current map (1610). In this case, the first lens (1255) may be transparent glass.

[0161] Referring to FIG. 16 (b), according to one embodiment, the second current map (1630) may be a current map when the user's gaze is directed toward the middle portion (e.g., the portion between the center portion and the outer portion) of the first lens (1255). For example, the wearable electronic device (1201) may control the refractive index of the first region (1640) by applying a current specified to the first region (1640) of the first lens, as in the second current map (1630). In addition, the wearable electronic device (1201) may apply a current specified to the second region (1635), as in the second current map (1630). At this time, the magnitude of the current applied to the first region (1640) and the magnitude of the current applied to the second region (1635) may be different.

[0162] Referring to FIG. 16 (c), according to one embodiment, the third current map (1650) may be a current map when the user's gaze is directed toward the edge of the first lens (1255). For example, the wearable electronic device (1201) may control the refractive index of the first region (1640) by applying a specified current to the first region (1640) of the first lens, as in the third current map (1650). In addition, the wearable electronic device (1201) may not apply any current to the second region (1635), as in the third current map (1650). In this case, the second region (1635) may be transparent glass. Currents of different magnitudes may be applied to a plurality of regions included in the first region (1640). That is, the wearable electronic device (1201) can apply different currents depending on the positions of the plurality of regions included in the first region (1640). Alternatively, the wearable electronic device (1201) can apply currents of the same magnitude to the plurality of regions included in the first region (1640).

[0163] According to one embodiment, the first current map (1610), the second current map (1630), and the third current map (1650) may be stored in advance in a memory (e.g., the memory (1230) of FIG. 12). The wearable electronic device (1201) may read the corresponding current map according to the user's gaze and adjust the refractive index of the first lens (1255).

[0164] According to the above-described method, the wearable electronic device (1201) can control the refractive index of each of the plurality of regions of the first lens (1255) by applying a current of a specified size to the first region (1640) and the second region (1635) of the first lens (1255) according to the user's gaze. Through this, the wearable electronic device (1201) can increase the resolution of the first object displayed and reduce blur based on the first lights transmitting through the first region (e.g., the edge region) of the first lens (1255).

[0165] Meanwhile, the current values ​​applied to the first lens (1255) in FIG. 16 (a) to FIG. 16 (c) are merely examples, and the technical concept of this document may not be limited thereto. For example, the current values ​​applied to the first lens (1255) may be determined as values ​​having an optimal phase.

[0166] FIG. 17 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to dynamically adjust the refractive index of a tunable lens (or first lens) based on an angle corresponding to a user's gaze.

[0167] Referring to FIG. 17, according to one embodiment, in operation 1701, a wearable electronic device (e.g., the wearable electronic device (1201) of FIG. 12) can use a camera (e.g., the camera (1210) of FIG. 12) to determine the gaze of a user wearing the wearable electronic device (1201).

[0168] In one embodiment, in operation 1703, the wearable electronic device (1201) may identify or determine a first angle corresponding to the user's gaze.

[0169] According to one embodiment, in operation 1705, the wearable electronic device (1201) may determine the current (or voltage) to be applied to each of the plurality of regions of the first lens (e.g., the tunable lens (1255) of FIG. 12) based on the first angle. For example, the wearable electronic device (1201) may calculate or determine the current (or voltage) to be applied to each of the plurality of regions of the first lens (1255) based on the first angle in real time, instead of a pre-specified current map.

[0170] In one embodiment, at operation 1707, the wearable electronic device (1201) may control the refractive index (or phase of light passing through the plurality of regions of the first lens (1255)) of each of the plurality of regions of the first lens (1255) by applying the identified current (or voltage) to each of the plurality of regions of the first lens (1255).

[0171] FIG. 18 is a flowchart illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust refractive indices of a plurality of tunable lenses (or a first lens and a second lens).

[0172] Referring to FIG. 18, a wearable electronic device (e.g., the wearable electronic device (1201) of FIG. 12) may include a lens assembly (e.g., the lens assembly (1250) of FIG. 12) including a plurality of tunable lenses (hereinafter, the first lens and the second lens).

[0173] According to one embodiment, in operation 1801, the wearable electronic device (1201) can detect the gaze of a user wearing the wearable electronic device (1201) using a camera (e.g., camera (1210) of FIG. 12).

[0174] According to one embodiment, in operation 1803, the wearable electronic device (1201) may identify an area corresponding to the user's gaze. For example, the wearable electronic device (1201) may identify or determine an area toward which the user's gaze is directed based on a first angle corresponding to the user's gaze.

[0175] According to one embodiment, in operation 1805, the wearable electronic device (1201) may control or adjust the refractive index of each of the first lens and the second lens based on the identified area. For example, the wearable electronic device (1201) may control the refractive index of each of the plurality of areas of the first lens and may control the refractive index of each of the plurality of areas of the second lens based on the identified area. To this end, the wearable electronic device (1201) may apply a designated current to each of the plurality of areas of the first lens and may apply a designated current to each of the plurality of areas of the second lens.

[0176] According to the above-described method, the wearable electronic device (1201) can appropriately adjust the refractive index of each of the plurality of tunable lenses (e.g., the first lens and the second lens) according to the user's gaze. Through this, the wearable electronic device (1201) can increase the resolution of a first object displayed and reduce blur based on the first lights that pass through the first region (e.g., the edge region) of each of the plurality of tunable lenses.

[0177] FIG. 19 is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive indices of a plurality of tunable lenses (or a first lens and a second lens).

[0178] Referring to FIG. 19, according to one embodiment, a lens assembly (e.g., lens assembly (1250) of FIG. 12) may include a plurality of pancake lenses (1910) and a plurality of tunable lenses (hereinafter, a first lens (1901) and a second lens (1902)).

[0179] Referring to (a) of FIG. 19, according to one embodiment, a wearable electronic device (e.g., the wearable electronic device (1201) of FIG. 12) can detect a user's gaze toward a front portion (1910) (e.g., a central portion) of a display (1950). The wearable electronic device (1201) can turn off the first lens (1901) and turn on the second lens (1902). For example, the wearable electronic device (1201) may not apply any current to a plurality of regions of the first lens (1901). In addition, the wearable electronic device (1201) can apply a designated current to each of the plurality of regions of the second lens (1902) to adjust the refractive index of each of the plurality of regions of the second lens (1902). Through this, the wearable electronic device (1201) can increase the resolution and reduce blur of an object displayed on the frontal portion (1910).

[0180] Referring to (b) of FIG. 19, according to an embodiment, a wearable electronic device (e.g., the wearable electronic device (1201) of FIG. 12) can detect a user's gaze toward a middle portion (1920) of a display (1950). The wearable electronic device (1201) can turn on the first lens (1901) and turn off the second lens (1902). For example, the wearable electronic device (1201) may not apply any current to a plurality of regions of the second lens (1902). In addition, the wearable electronic device (1201) can apply a designated current to each of the plurality of regions of the first lens (1901) to adjust the refractive index of each of the plurality of regions of the first lens (1901). Through this, the wearable electronic device (1201) can increase the resolution and reduce blur of an object displayed in the middle portion (1920).

[0181] Referring to (c) of FIG. 19, according to an embodiment, a wearable electronic device (e.g., the wearable electronic device (1201) of FIG. 12) can detect a user's gaze toward an outer portion (1930) of a display (1950). The wearable electronic device (1201) can turn on the first lens (1901) and turn on the second lens (1902). For example, the wearable electronic device (1201) can apply a designated current to each of the plurality of regions of the first lens (1901) to adjust the refractive index of each of the plurality of regions of the first lens (1901). In addition, the wearable electronic device (1201) can apply a designated current to each of the plurality of regions of the second lens (1902) to adjust the refractive index of each of the plurality of regions of the second lens (1902). Through this, the wearable electronic device (1201) can increase the resolution and reduce blur of objects displayed in the outer portion (1930).

[0182] According to the above-described method, the wearable electronic device (1201) can turn on / off the first lens (1901) and the second lens (1902) according to the user's gaze, thereby increasing the resolution and reducing the blur of the first object displayed based on the first lights passing through the lens assembly (1250).

[0183] Meanwhile, the combination of turning on / off the first lens (1901) and the second lens (1902) in FIG. 19 is merely an example, and the technical concept of this document may not be limited thereto. In addition, the arrangement order and number of the lenses (1901, 1902, 1910) are merely exemplary, and the technical concept of this document may not be limited thereto.

[0184] According to another embodiment, the wearable electronic device (1201), when performing the operation (a) described in FIG. 19, may control the first lens (1901) as in the first current map (2010) of FIG. 20 (a) and control the second lens (1902) as in the second current map (2020). In addition, the wearable electronic device (1201), when performing the operation (b) described in FIG. 19, may control the second lens (1902) as in the first current map (2010) of FIG. 20 (a) and control the first lens (1901) as in the second current map (2020). This will be described in more detail with reference to FIG. 20 below.

[0185] FIG. 20 is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive indices of a plurality of tunable lenses (or a first lens and a second lens).

[0186] Referring to (a) of FIG. 20, according to one embodiment, the first current map (2010) may be a current map when the user's gaze is directed toward the central portion of the first lens (e.g., the first lens (1901) of FIG. 19). The second current map (2020) may be a current map when the user's gaze is directed toward the central portion of the second lens (e.g., the second lens (1902) of FIG. 19). For example, the first current map (2010) may represent a mapping table applied to the first lens (1901) when the first lens (1901) is turned off. For example, the second current map (2020) may represent a mapping table applied to the second lens (1902) when the second lens (1902) is turned off. For example, the wearable electronic device (1201) may not apply any current to the second lens (1902) as the initial value of the second lens (1902), as in the second current map (2020). At this time, the second lens (1902) may be transparent glass. The wearable electronic device (1201) may apply a designated current to some regions (e.g., corner regions) among a plurality of regions of the first lens (1901) as the initial value of the first lens (1901), as in the first current map (2010). At this time, the first lens (1901) may provide an optical effect due to a change in the refractive index for the corner region.

[0187] Referring to (b) of FIG. 20, according to one embodiment, the third current map (2030) may be a current map when the user's gaze is directed toward the middle portion (e.g., the portion between the center portion and the outer portion) of the first lens (1901). The fourth current map (2040) may be a current map when the user's gaze is directed toward the middle portion (e.g., the portion between the center portion and the outer portion) of the second lens (1902). For example, the wearable electronic device (1201) may control the refractive index of the first lens (1901) by applying a designated current to each of a plurality of regions of the first lens (1901), such as the third current map (2030). In addition, the wearable electronic device (1201) can control the refractive index of the second lens (1902) by applying a designated current to each of the plurality of regions of the second lens (1902), as in the fourth current map (2040). At this time, the magnitude of the current applied to each of the plurality of regions of the first lens (1901) may be different depending on the location of each of the plurality of regions. In addition, the magnitude of the current applied to each of the plurality of regions of the second lens (1902) may be different depending on the location of each of the plurality of regions. Depending on the implementation, the wearable electronic device (1201) may also apply a current having a negative value, as in the fourth current map (2040). At this time, the surface of the second lens (1902) may become concave or the phase profile may change in the “- direction”.

[0188] Referring to (c) of FIG. 20, according to an embodiment, the fifth current map (2050) may be a current map when the user's gaze is directed toward the outer portion of the first lens (1901). The sixth current map (2060) may be a current map when the user's gaze is directed toward the outer portion of the second lens (1902). For example, the wearable electronic device (1201) may adjust the refractive index of the first lens (1901) by applying a designated current to each of a plurality of regions of the first lens (1901), as in the fifth current map (2050). In addition, the wearable electronic device (1201) may adjust the refractive index of the second lens (1902) by applying a designated current to each of a plurality of regions of the second lens (1902), as in the sixth current map (2060). At this time, the magnitude of the current applied to each of the plurality of regions of the first lens (1901) may be different depending on the position of each of the plurality of regions. In addition, the magnitude of the current applied to each of the plurality of regions of the second lens (1902) may be different depending on the position of each of the plurality of regions. For example, in (c) of FIG. 20, when compared to (b) of FIG. 20, the values ​​of the current applied to each of the first lens (1901) and the second lens (1902) may be different. This may be an exemplary value set to adjust the refractive index of each of the lenses (1901, 1902) according to the user's line of sight. For example, the position of the region to which a negative current is applied in the sixth current map (2060) may be different from the position of the region to which a negative current is applied in the fourth current map (2040). Additionally, the size of the negative current applied in the sixth current map (2060) may be different from the size of the negative current applied in the fourth current map (2040).

[0189] According to the above-described method, the wearable electronic device (1201) can increase the resolution and reduce blur of the first object displayed based on the first lights passing through the lens assembly (1250) by applying a specified current to the first lens (1901) and the second lens (1902) according to the user's gaze.

[0190] Meanwhile, the current values ​​applied to the first lens (1901) and the second lens (1902) in FIG. 20 are merely examples, and the technical concept of this document may not be limited thereto. For example, the current values ​​applied to the first lens (1901) and the second lens (1902) may be determined as optimal phase combination values.

[0191] According to one embodiment, the variable lens (e.g., the first lens (1901) and the second lens (1902)) can be utilized to adjust the focal distance of the entire field, in addition to increasing the resolution of a specific field region. For example, the wearable electronic device (1201) can move the focal distance to an arbitrary position by adjusting the current or voltage applied to the variable lens. Through this, the wearable electronic device (1201) can correct the user's eyesight. For example, since eyesight may vary from user to user, the wearable electronic device (1201) can obtain (or read) a phase profile of the variable lens optimized for a pre-registered user through a user authentication method. Through this, the wearable electronic device (1201) can set a focal distance optimized for the user's eyesight.

[0192] In one embodiment, a wearable electronic device (1201) (e.g., a VR device or a VST device) equipped with a multi-focus display module or a continuous focus display module in which a VR image or a video see-through (VST) image is not fixed to a single focal plane cannot change the focal positions of all planes simultaneously. In this case, the wearable electronic device (1201) can adjust the focal plane of the field corresponding to the gaze-zone of the user by taking into account the value of the user's vision correction (e.g., the concept of foveated vision correction). To support this, electrodes may be arranged in the variable lenses included in the wearable electronic device (e.g., the first lens (1901) and the second lens (1902)) to enable local curvature / phase profile adjustment rather than concentric symmetry.

[0193] FIG. 21A is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive index of a tunable lens (or first lens) when a user's gaze is directed toward the front of the lens assembly.

[0194] Referring to FIG. 21A, according to one embodiment, a wearable electronic device (e.g., the wearable electronic device (1201) of FIG. 12) may operate in a default mode when it is determined that the user's gaze is looking at the front. For example, the default mode may indicate a mode in which a tunable lens (2110) included in a lens assembly (e.g., the lens assembly (1250) of FIG. 12) is not operated (e.g., a state in which the refractive index of the tunable lens (2110) is not adjusted).

[0195] According to one embodiment, light passing through the pancake lenses (2101, 2102) and reaching the central field (2120) may have different resolutions depending on where the image is formed in the field (2115).

[0196] According to one embodiment, an object captured by light passing through the pancake lenses (2101, 2102) and reaching the central field (2120) may have a small spot size. That is, an object captured by light passing through the pancake lenses (2101, 2102) and reaching the central field (2120) may have a high resolution. On the other hand, an object captured by light passing through the pancake lenses (2101, 2102) and reaching the outer field (2130) may have a large spot size. That is, an object captured by light passing through the pancake lenses (2101, 2102) and reaching the outer field (2130) may have a low resolution.

[0197] As described above, if the tunable lens (2110) is not operated (e.g., the refractive index of the tunable lens (2110) is not adjusted), objects captured by light reaching the outer field (2130) may have low resolution. Therefore, if the user's gaze is directed toward the outer field (2130), the wearable electronic device (1201) has no choice but to provide the user with objects of low resolution.

[0198] FIG. 21B is a diagram illustrating an operation of a wearable electronic device according to one embodiment of the present disclosure to adjust the refractive index of a tunable lens (or first lens) when a user's gaze gazes at the edge of the lens assembly.

[0199] Referring to FIG. 21B, according to one embodiment, a wearable electronic device (e.g., the wearable electronic device (1201) of FIG. 12) may operate an ambient enhancement mode when it is determined that a user's gaze is gazing at an outer portion. For example, the ambient enhancement mode may represent a mode in which a tunable lens (2110) included in a lens assembly (e.g., a lens assembly (1250) of FIG. 12) operates (e.g., a state in which a refractive index of the tunable lens (2110) is adjusted).

[0200] According to one embodiment, light passing through the pancake lenses (2101, 2102) and reaching the central field (e.g., the central field (2120) of FIG. 21A) may have different resolutions depending on where the image is formed in the field (2117).

[0201] According to one embodiment, an object by light that passes through the pancake lenses (2101, 2102) and the tunable lens (2110) with a controlled refractive index and reaches the outer field (2140) may have a small spot size. That is, an object by light that passes through the pancake lenses (2101, 2102) and the tunable lens (2110) with a controlled refractive index and reaches the outer field (2140) may have a high resolution.

[0202] As described above, when the tunable lens (2110) is operated (e.g., a state in which the refractive index or optical phase of the tunable lens (2110) is adjusted), objects by light reaching the outer field (2140) can have high resolution. Accordingly, even if the user's gaze is directed toward the outer field (2140), the wearable electronic device (1201) can provide the user with objects of high resolution.

[0203] FIG. 22 is a diagram showing a change in the MTF (modulation transfer function) value according to a change in the resolution of the outer field of a tunable lens according to an embodiment of the present disclosure.

[0204] According to one embodiment, (a) of FIG. 22 illustrates graphs representing MTF values ​​(e.g., contrast) of the center field and the outer field of a tunable lens (e.g., the first lens or the tunable lens (1255) of FIG. 12) before compensating for the refractive index (or optical phase) of the tunable lens. According to one embodiment, (b) of FIG. 22 illustrates graphs representing MTF values ​​(e.g., contrast) of the center field and the outer field of the tunable lens (1255) before compensating for the refractive index (or optical phase) of the tunable lens (1255).

[0205] According to one embodiment, the first graph (2210) may represent the MTF value of the center field of the tunable lens (1255) before compensating for the refractive index (or optical phase) of the tunable lens (1255).

[0206] According to one embodiment, the second graph (2220) may represent the MTF value of the outer field of the tunable lens (1255) before compensating for the refractive index (or optical phase) of the tunable lens (1255). For example, the MTF value of the outer field of the tunable lens (1255) before compensation may be considerably low.

[0207] According to one embodiment, the third graph (2230) may represent the MTF value of the central field of the tunable lens (1255) after compensating for the refractive index (or optical phase) of the tunable lens (1255). For example, the third graph (2230) may represent an improvement in the MTF value compared to the first graph (2210).

[0208] According to one embodiment, the fourth graph (2240) may represent the MTF value of the outer field of the tunable lens (1255) after compensating for the refractive index (or optical phase) of the tunable lens (1255). For example, the fourth graph (2240) may represent that the MTF value is reduced or maintained compared to the second graph (2220).

[0209] As described above, when controlling the tunable lens (e.g., adjusting the refractive index or optical phase of the tunable lens (1255) of FIG. 12), objects captured by light reaching the outer field can have a higher resolution than before compensation. Accordingly, even when the user's gaze is directed toward the outer field of the tunable lens, the wearable electronic device (1201) can provide the user with objects of high resolution.

[0210] According to one embodiment, a wearable electronic device (101; 200; 300; 1201) may include a camera (1210), a display (160, D, 1260), a lens assembly (LA, 1250) configured to focus or guide light representing visual information output from the display, the lens assembly including a first lens (1255) configured to adjust a refractive index by receiving an electrical signal, at least one processor (1220), and; and a memory (1230) storing instructions. According to one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to control the display to output light representing visual information through the lens assembly. In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to adjust a refractive index of a first region of the first lens corresponding to a first distance from an edge of the first lens to a first value to reduce blur of a first object displayed based on first lights passing through the first region of the first lens corresponding to a first distance from an edge of the first lens. In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to adjust a refractive index of a second region of the first lens corresponding to a second distance from the edge of the first lens longer than the first distance to a second value.

[0211] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to determine a gaze of a user wearing the wearable electronic device through the camera. In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to apply a first current specified to the first region of the first lens to adjust a refractive index of the first region of the first lens to the first value based on determining that a first angle corresponding to the gaze is greater than a first threshold value.

[0212] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to adjust a refractive index of the first area of ​​the first lens to an initial value based on determining that the first angle corresponding to the line of sight is not greater than a first threshold value.

[0213] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to apply a specified current to at least a portion of the first region to adjust a refractive index of the first region to the initial value.

[0214] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to not apply any current to the first lens based on determining that the first angle corresponding to the gaze is not greater than a first threshold value.

[0215] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to determine a gaze of a user wearing the wearable electronic device through the camera. In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to adjust a refractive index of the first region to a third value corresponding to the first angle and to adjust a refractive index of the second region to a fourth value corresponding to the first angle based on determining that a first angle corresponding to the gaze is greater than a first threshold value and not greater than a second threshold value greater than the first threshold value.

[0216] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to adjust a refractive index of the first area to a fifth value corresponding to the first angle and to adjust a refractive index of the second area to an initial value based on determining that the first angle corresponding to the line of sight is greater than the second threshold value.

[0217] According to one embodiment, the lens assembly may further include a second lens configured to adjust a refractive index by receiving an electrical signal.

[0218] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to determine the gaze of a user wearing the wearable electronic device through the camera. In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to adjust the refractive index of the first lens and the refractive index of the second lens, respectively, based on an area toward which the gaze of the user is directed.

[0219] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to adjust each of the refractive indices of the first lens and the second lens to an initial value based on determining that the user's gaze is directed toward the second area.

[0220] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to adjust the refractive index of the first lens to the first value and to adjust the refractive index of the second lens to an initial value based on determining that the user's gaze is directed toward a third region between the first region and the second region.

[0221] In one embodiment, the instructions, when executed by the at least one processor, may cause the wearable electronic device to adjust the refractive index of the first lens to an initial value and to adjust the refractive index of the second lens to the second value based on determining that the user's gaze is directed toward the second area.

[0222] According to one embodiment, the wearable electronic device may include a video see through (VST) device.

[0223] In an embodiment, a method of operating a wearable electronic device (101; 200; 300; 1201) may include a display (160, D, 1260) and a lens assembly (LA, 1250) configured to focus or guide light representing visual information output from the display, the lens assembly including a first lens (1255) configured to adjust a refractive index by receiving an electrical signal. In an embodiment, the method of operating the wearable electronic device may include an operation of controlling the display to output light representing visual information through the lens assembly. In one embodiment, the method of operating the wearable electronic device may include adjusting a refractive index of a first region of the first lens corresponding to a first distance from an edge of the first lens to a first value to reduce blur of a first object displayed based on first lights passing through the first region of the first lens corresponding to a first distance from an edge of the first lens. In one embodiment, the method of operating the wearable electronic device may include adjusting a refractive index of a second region of the first lens corresponding to a second distance longer than the first distance from the edge of the first lens to a second value.

[0224] According to one embodiment, the operation of adjusting the refractive index of the first region of the first lens to the first value may include an operation of confirming the line of sight of a user wearing the wearable electronic device through a camera (1210) included in the wearable electronic device. According to one embodiment, the operation of adjusting the refractive index of the first region of the first lens to the first value may include an operation of applying a specified first current to the first region of the first lens to adjust the refractive index of the first region of the first lens to the first value based on confirming that a first angle corresponding to the line of sight is greater than a first threshold value.

[0225] According to one embodiment, the method of operating the wearable electronic device may further include adjusting the refractive index of the first area of ​​the first lens to an initial value based on determining that the first angle corresponding to the line of sight is not greater than a first threshold value.

[0226] According to one embodiment, the operation of adjusting the refractive index of the first region of the first lens to the initial value may include an operation of adjusting the refractive index of the first region to the initial value by applying a specified current to at least a portion of the first region.

[0227] According to one embodiment, the method of operating the wearable electronic device may further include an operation of not applying any current to the first lens based on determining that the first angle corresponding to the gaze is not greater than a first threshold value.

[0228] According to one embodiment, the operating method of the wearable electronic device may further include an operation of confirming a gaze of a user wearing the wearable electronic device through the camera. According to one embodiment, the operating method of the wearable electronic device may further include an operation of adjusting a refractive index of the first region to a third value corresponding to the first angle and adjusting a refractive index of the second region to a fourth value corresponding to the first angle based on confirming that a first angle corresponding to the gaze is greater than a first threshold value and not greater than a second threshold value greater than the first threshold value.

[0229] According to one embodiment, the method of operating the wearable electronic device may further include adjusting the refractive index of the first region to a fifth value corresponding to the first angle, and adjusting the refractive index of the second region to an initial value, based on determining that the first angle corresponding to the line of sight is greater than the second threshold value.

[0230] While this disclosure has been described by way of example and example, it should be understood that the example is intended to be illustrative and not limiting. It will be apparent to those skilled in the art that various changes in form and detail may be made without departing from the overall scope of this disclosure, including the appended claims and their equivalents.

Claims

1. In a wearable electronic device (101; 200; 300; 1201), Camera (1210); display(160, D, 1260)); A lens assembly (LA, 1250) configured to focus or guide light representing visual information output from the display, the lens assembly including a first lens (1255) configured to adjust a refractive index by receiving an electrical signal; At least one processor (1220); and A wearable electronic device comprises a memory (1230) storing instructions, wherein the instructions, when executed by the at least one processor, Controlling the display to output lights representing visual information through the lens assembly; Adjusting the refractive index of the first region of the first lens corresponding to a first distance from an edge of the first lens to a first value to reduce blur of the first object displayed based on the first light passing through the first region of the first lens corresponding to a first distance from an edge of the first lens, An electronic device that adjusts the refractive index of a second region of the first lens to a second value corresponding to a second distance longer than the first distance from the edge of the first lens.

2. In the first paragraph, the instructions, when executed by the at least one processor, cause the wearable electronic device to: Check the gaze of the user wearing the wearable electronic device through the above camera, A wearable electronic device that applies a first current specified to the first region of the first lens to adjust a refractive index of the first region of the first lens to the first value based on determining that the first angle corresponding to the gaze is greater than the first threshold value.

3. In any one of paragraphs 1 to 2, the instructions, when executed by the at least one processor, cause the wearable electronic device to: A wearable electronic device that adjusts the refractive index of the first area of ​​the first lens to an initial value based on determining that the first angle corresponding to the gaze is not greater than a first threshold value.

4. In any one of paragraphs 1 to 3, the instructions, when executed by the at least one processor, cause the wearable electronic device to: A wearable electronic device that applies a specified current to at least a portion of the first region to adjust the refractive index of the first region to the initial value.

5. In any one of paragraphs 1 to 4, the instructions, when executed by the at least one processor, cause the wearable electronic device to: A wearable electronic device that does not apply any current to the first lens based on determining that the first angle corresponding to the gaze is not greater than the first threshold value.

6. In any one of paragraphs 1 to 5, the instructions, when executed by the at least one processor, cause the wearable electronic device to: Check the gaze of the user wearing the wearable electronic device through the above camera, A wearable electronic device that adjusts the refractive index of the first region to a third value corresponding to the first angle and adjusts the refractive index of the second region to a fourth value corresponding to the first angle based on determining that the first angle corresponding to the line of sight is greater than the first threshold value and not greater than the second threshold value greater than the first threshold value.

7. In any one of paragraphs 1 to 6, the instructions, when executed by the at least one processor, cause the wearable electronic device to: A wearable electronic device that adjusts the refractive index of the first region to a fifth value corresponding to the first angle and adjusts the refractive index of the second region to an initial value based on determining that the first angle corresponding to the above-described line of sight is greater than the second threshold value.

8. In any one of paragraphs 1 to 7, A wearable electronic device, wherein the lens assembly further includes a second lens configured to adjust a refractive index by receiving an electrical signal.

9. In any one of paragraphs 1 to 8, the instructions, when executed by the at least one processor, cause the wearable electronic device to: Check the gaze of the user wearing the wearable electronic device through the above camera, A wearable electronic device that adjusts the refractive index of the first lens and the refractive index of the second lens based on the area where the user's gaze is directed.

10. In any one of claims 1 to 9, the instructions, when executed by the at least one processor, cause the wearable electronic device to: An electronic device that adjusts the refractive index of the first lens and the refractive index of the second lens to initial values ​​based on determining that the user's gaze is directed toward the second area.

11. In any one of claims 1 to 10, the instructions, when executed by the at least one processor, cause the wearable electronic device to: An electronic device that adjusts the refractive index of the first lens to the first value and adjusts the refractive index of the second lens to an initial value based on determining that the user's gaze is directed toward a third region between the first region and the second region.

12. In any one of claims 1 to 11, the instructions, when executed by the at least one processor, cause the wearable electronic device to: An electronic device that adjusts the refractive index of the first lens to an initial value and adjusts the refractive index of the second lens to the second value based on determining that the user's gaze is directed toward the second area.

13. In any one of paragraphs 1 to 12, The above wearable electronic device is a wearable electronic device including a VST (video see through) device.

14. In a method of operating a wearable electronic device (101; 200; 300; 1201), The wearable electronic device comprises a display (160, D, 1260) and a lens assembly (LA, 1250) configured to focus or guide light representing visual information output from the display, the lens assembly including a first lens (1255) configured to adjust a refractive index by receiving an electrical signal, An operation of controlling the display to output lights representing visual information through the lens assembly; An operation of adjusting a refractive index of a first region of the first lens corresponding to a first distance from an edge of the first lens to a first value to reduce blur of a first object displayed based on first lights passing through a first region of the first lens corresponding to a first distance from an edge of the first lens; and A method of operating a wearable electronic device, comprising an operation of adjusting a refractive index of a second region of the first lens to a second value corresponding to a second distance longer than the first distance from the edge of the first lens.

15. In the 14th paragraph, the operation of adjusting the refractive index of the first region of the first lens to the first value is, An action of checking the gaze of a user wearing the wearable electronic device through a camera (1210) included in the wearable electronic device; and A method of operating a wearable electronic device, comprising: applying a first current specified to the first region of the first lens to adjust a refractive index of the first region of the first lens to the first value based on determining that a first angle corresponding to the gaze is greater than a first threshold value.

Images