Wearable electronic device including first lens assembly and second lens assembly

Abstract

In one embodiment, a wearable electronic device may include: a housing configured to be worn on the head of a user; a display panel provided in the housing; a first lens assembly provided in the housing and positioned in a first direction with respect to the display panel; an infrared light source for emitting infrared light to the outside through the first lens assembly; a camera for capturing external images through the first lens assembly; a second lens assembly detachably attached to the first lens assembly so as to be positioned in the first direction with respect to the first lens assembly; and a processor configured to control at least part of the operation of the wearable electronic device. The first lens assembly may include a first barrel, at least one first lens provided in the first barrel, and a first communication module provided in the first barrel. The second lens assembly may include: a second barrel configured to engage with the first barrel; at least one second lens provided in the second barrel; and a second communication module configured to transmit information about the second lens assembly, including the diopter or refractive index of the at least one second lens, to the first communication module when the second lens assembly is coupled to the first lens assembly. The processor may be configured to correct an image, captured by the camera, by using the information about the second lens assembly when the second lens assembly is coupled to the first lens assembly.

Description

A wearable electronic device comprising a first lens assembly and a second lens assembly

[0001] Various embodiments of the present document relate to a wearable electronic device including a first lens assembly and a second lens assembly.

[0002] A variety of wearable electronic devices, such as virtual reality (VR) devices, augmented reality (AR) devices, and / or mixed reality (MR) devices, are becoming commercially available. Wearable electronic devices can be configured to fit on a user's head. For example, wearable electronic devices can take the form of glasses or goggles.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] In one embodiment, a wearable electronic device may include a housing configured to be worn on a user's head. The wearable electronic device may include a display panel provided in the housing. The wearable electronic device may include a first lens assembly provided in the housing and positioned in a first direction with respect to the display panel. The wearable electronic device may include an infrared light source that radiates infrared light to the outside through the first lens assembly. The wearable electronic device may include a camera that captures an external image through the first lens assembly. The wearable electronic device may include a second lens assembly that is detachably configured to be positioned in the first direction with respect to the first lens assembly. The wearable electronic device may include a processor configured to control at least a portion of an operation of the wearable electronic device. The first lens assembly may include a first barrel. The first lens assembly may include at least one first lens provided in the first barrel. The first lens assembly may include a first communication module provided in the first barrel. The second lens assembly may include a second barrel configured to be coupled with the first barrel. The second lens assembly may include at least one second lens provided in the second barrel. The second lens assembly may include a second communication module configured to transmit information about the second lens assembly, including a diopter or refractive index of the at least one second lens, to the first communication module when the second lens assembly is coupled to the first lens assembly. The processor may be configured to correct an image captured by the camera using the information about the second lens assembly when the second lens assembly is coupled to the first lens assembly.

[0005] In one embodiment, a wearable electronic device may include a housing configured to be worn on a user's head. The wearable electronic device may include a display panel provided in the housing. The wearable electronic device may include a first lens assembly provided in the housing, positioned in a first direction with respect to the display panel, and including a first communication module. The wearable electronic device may include an infrared light source that radiates infrared light to the outside through the first lens assembly. The wearable electronic device may include a camera that captures an image of the outside through the first lens assembly. The wearable electronic device may include a processor configured to control at least a part of an operation of the wearable electronic device. When a second lens assembly is coupled to a portion of the first lens assembly facing the first direction, the first communication module may be configured to receive information about the second lens assembly from a second communication module provided in the second lens assembly. The processor may be configured to correct an image captured by the camera using information about the second lens assembly when the second lens assembly is coupled to the first lens assembly.

[0006] In one embodiment, a wearable electronic device configured to be worn on a user's head may include a housing. The wearable electronic device may include a display panel provided in the housing. The wearable electronic device may include a first lens assembly provided in the housing and positioned in a first direction with respect to the display panel. The wearable electronic device may include a second lens assembly configured to be detachably attached to the wearable electronic device so as to be positioned in the first direction with respect to the first lens assembly. The second lens assembly may be configured to store information regarding a diopter or a refractive index of the second lens assembly. The wearable electronic device may include an infrared light source positioned between the display panel and the first lens assembly and configured to irradiate infrared rays for gaze tracking. The wearable electronic device may include a camera positioned between the display panel and the first lens assembly and configured to capture images for gaze tracking. The wearable electronic device may include a processor configured to control operations of the wearable electronic device. While the second lens assembly is coupled to the wearable electronic device, the processor may be configured to: obtain information about the second lens assembly, control the infrared light source to irradiate infrared light through the first lens assembly and the second lens assembly for gaze tracking, control the camera to capture images through the first lens assembly and the second lens assembly for gaze tracking, and perform gaze tracking based on the obtained information about the second lens assembly and the images captured by the camera.

[0007] In one embodiment, when a second lens assembly is coupled to the first lens assembly to correct the user's eyesight, the first communication module may receive information about the second lens assembly from the second communication module. The processor may use the received information about the second lens assembly to perform correction (e.g., correction of a captured image) according to the changed optical path.

[0008] The effects of the wearable electronic device according to various embodiments are not limited to those mentioned above, and other effects not mentioned will be clearly understood by those skilled in the art from the description below.

[0009] The above and other aspects, features and advantages of specific embodiments of the present invention will become more apparent from the following detailed description taken in conjunction with the accompanying drawings.

[0010] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0011] FIG. 2A is a drawing showing the front side of a wearable electronic device according to one embodiment.

[0012] FIG. 2b is a drawing showing the back of a wearable electronic device according to one embodiment.

[0013] FIG. 3A is a perspective view of a display assembly according to one embodiment.

[0014] FIG. 3b is a perspective view illustrating a state in which the first lens assembly is removed from the display assembly according to one embodiment.

[0015] FIG. 3c is a perspective view of a first communication module according to one embodiment.

[0016] FIG. 4A is an exploded perspective view of a display assembly and a second lens assembly according to one embodiment.

[0017] FIG. 4b is a perspective view of a combined display assembly and a second lens assembly according to one embodiment.

[0018] FIG. 5A is an exploded perspective view of a second lens assembly according to one embodiment.

[0019] FIG. 5b is a cross-sectional view of a second lens assembly according to one embodiment.

[0020] FIG. 5c is a side view of a second lens according to one embodiment.

[0021] FIG. 6A is a perspective view of a second barrel according to one embodiment.

[0022] FIG. 6b is a rear perspective view of a second barrel according to one embodiment.

[0023] FIG. 6c is a partial perspective view of a first barrel according to one embodiment.

[0024] Figure 7 is a flowchart of a method for controlling a wearable electronic device according to one embodiment.

[0025] FIG. 8A is an exploded perspective view of a display assembly according to one embodiment.

[0026] FIG. 8b is an exploded perspective view of a display assembly and a second lens assembly according to one embodiment.

[0027] FIG. 9A is an exemplary image of a user's eye captured by a camera without the second lens assembly being coupled to the wearable electronic device.

[0028] FIG. 9b is an exemplary image of a user's eye captured by a camera with a second lens assembly coupled to the wearable electronic device.

[0029] FIG. 10A is a flowchart of a control method of a wearable electronic device according to one embodiment.

[0030] FIG. 10b is a flowchart of a control method of a wearable electronic device according to one embodiment.

[0031] FIG. 10c is a flowchart of a control method of a wearable electronic device according to one embodiment.

[0032] FIG. 11A is an exploded perspective view of a display assembly, an adapter, and a second lens assembly according to one embodiment.

[0033] FIG. 11B is a perspective view of a combined display assembly, adapter, and second lens assembly according to one embodiment.

[0034] Figure 12a is a perspective view illustrating a portion of the second lens assembly.

[0035] Figure 12b is a perspective view of the shielding case and magnet separated.

[0036] Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the attached drawings, identical components are assigned the same reference numerals regardless of the drawing numbers, and redundant descriptions thereof will be omitted.

[0037] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to an embodiment. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to an embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In one embodiment, the electronic device (101) may have at least one of these components (e.g., the connection terminal (178)) omitted, or one or more other components added. In one embodiment, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0038] The processor (120) may control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing, for example, software (e.g., a program (140)), and may perform various data processing or calculations. According to one embodiment, as at least a part of the data processing or calculation, the processor (120) may store a command or data received from another component (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the command or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or a secondary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together therewith. For example, if the electronic device (101) includes a main processor (121) and a secondary processor (123), the secondary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a specified function. The secondary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0039] The auxiliary processor (123) may control at least a part of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0040] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0041] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0042] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0043] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. According to one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0044] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0045] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0046] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, an illuminance sensor, an IMU (inertial measurement unit) sensor, or a touch sensor. For example, when the electronic device (101) detects a user movement through an IMU sensor or the like, the processor (120) of the electronic device (101) can correct the rendering data received from the external electronic device (102) based on the movement information and output it to the display module (160). Alternatively, the processor (120) can transmit the movement information to the external electronic device (102) and request rendering so that the screen data is updated accordingly.

[0047] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0048] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0049] A haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0050] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0051] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0052] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0053] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0054] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0055] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. According to one embodiment, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0056] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0057] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0058] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technologies. In one embodiment, the external electronic device (102) can be various types of devices, such as a smartphone or a case device capable of storing and charging the electronic device (101).

[0059] Electronic devices according to embodiments disclosed herein may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to embodiments disclosed herein are not limited to the aforementioned devices.

[0060] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0061] The term "module" used in one embodiment of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0062] An embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0063] According to one embodiment, the method according to one embodiment disclosed in the present document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0064] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0065] FIGS. 2A and 2B are diagrams showing the front and back of a wearable electronic device (200) according to one embodiment. When a user wears the wearable electronic device (200), the appearance seen by the user's eyes may be as shown in FIG. 2B.

[0066] Referring to FIG. 2A, according to various embodiments, the electronic device (101) of FIG. 1 may include a wearable electronic device (200) that provides a service that provides an extended reality (XR) experience to a user. For example, XR or XR service may be defined as a service that collectively refers to virtual reality (VR), augmented reality (AR), and / or mixed reality (MR).

[0067] According to one embodiment, the wearable electronic device (200) may have a form factor for being worn on a user's head. The wearable electronic device (200) may refer to a head-mounted device or a head-mounted display worn on the user's head, but may also be configured in the form of at least one of glasses, goggles, a helmet, or a hat. The wearable electronic device (200) may include an OST (optical see-through) type configured to allow external light to reach the user's eyes through glasses when worn, or a VST (video see-through) type configured to allow light emitted from a display to reach the user's eyes when worn, but block external light so that external light does not reach the user's eyes.

[0068] According to one embodiment, the wearable electronic device (200) may be worn on the user's head and provide the user with an image related to an extended reality (XR) service. For example, the wearable electronic device (200) may provide XR content (hereinafter referred to as an XR content image) that outputs at least one virtual object to be superimposed on a display area or an area determined to be the user's field of view (FoV). According to one embodiment, the XR content may refer to an image or image that appears to have at least one virtual object superimposed on an image related to a real space acquired through a camera (e.g., a camera for taking pictures) or a virtual space. According to one embodiment, the wearable electronic device (200) may provide XR content based on a function being performed by the wearable electronic device (200) and / or a function being performed by one or more external electronic devices (e.g., the electronic devices 102, 104, or 108 of FIG. 1).

[0069] According to one embodiment, the wearable electronic device (200) is at least partially controlled by an external electronic device (e.g., electronic devices (102 or 104) of FIG. 1), and may perform at least one function under the control of the external electronic device, but may also perform at least one function independently.

[0070] Referring to FIGS. 2A and 2B , a wearable electronic device (200) may include a housing (210) in which at least some of the components of FIG. 1 are arranged. The housing (210) may be configured to be wearable on a user's head. For example, the housing (210) may include a strap (219) and / or a wearing member for being fixed on a body part of the user. For example, the user may wear the wearable electronic device (200) on the head so that the first direction (①) of the wearable electronic device (200) is faced.

[0071] Referring to FIG. 2B, a fourth function camera (e.g., a face recognition camera) (225, 226, 227) and / or a display assembly (300) may be disposed in a first direction (①) of the housing (210) facing the user's face. Referring to FIG. 2A, a first function camera (e.g., a recognition camera) (215), a second function camera (e.g., a shooting camera) (211, 212), a depth sensor (217), and / or a touch sensor (213) may be disposed in a second direction (②) of the housing (210) opposite to the first direction (①). Although not illustrated in the drawing, the housing (210) may include a memory (e.g., a memory (130) of FIG. 1) and a processor (e.g., a processor (120) of FIG. 1), and may further include other components illustrated in FIG. 1.

[0072] In one embodiment, the display assembly (300) may be positioned in the first direction (①) of the wearable electronic device (200). For example, the display assembly (300) may be positioned toward the user's face. The display assembly (300) may include a display panel (e.g., the display module (160) of FIG. 1 and / or the display panel (310) of FIG. 3A), a first lens assembly (e.g., the first lens assembly (320) of FIG. 3A) and / or a second lens assembly (e.g., the second lens assembly (330) of FIG. 4A).

[0073] According to one embodiment, the display assembly (300) may include a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), a light emitting diode (LED) on silicon (LEDoS), an organic light emitting diode (OLED), an organic light emitting diode (LED) on silicon (OLEDoS), or a micro light emitting diode (micro LED).

[0074] In one embodiment, when the display assembly (300) is formed of one of a liquid crystal display (LCD), a digital mirror display, or a silicon liquid crystal display (LCD), the wearable electronic device (200) may include a light source that irradiates light (e.g., visible light) to a screen output area of ​​the display assembly (300). In one embodiment, when the display assembly (300) can generate light (e.g., visible light) on its own, for example, when the wearable electronic device (200) is formed of one of an organic light-emitting diode (OLED) or a micro LED, the wearable electronic device (200) may provide a user with good quality XR content images even without including a separate light source. For example, if the display assembly (300) is implemented with an organic light-emitting diode (OLED) or a micro LED, a light source is unnecessary, and thus the wearable electronic device (200) may be lightweight.

[0075] According to one embodiment, the display assembly (300) may include a first display assembly (300a) and / or a second display assembly (300b). According to one embodiment, the first display assembly (300a) may be arranged to face the user's left eye in the fourth direction (④), and the second display assembly (300b) may be arranged to face the user's right eye in the third direction (③).

[0076] According to one embodiment, the display assembly (300) may include a first lens assembly (e.g., the first lens assembly (320) of FIG. 3A) including a transparent waveguide. The first lens assembly (320) may serve to adjust a focus so that a screen (e.g., an XR content image) output from a display panel (e.g., the display panel (310) of FIG. 3A) can be viewed by a user. For example, light (e.g., visible light) emitted from the display panel (310) may pass through the first lens assembly (320) and be transmitted to the user through a waveguide formed within the first lens assembly (320). The first lens assembly (320) may include at least one of a Fresnel lens, a pancake lens, a convex lens, or a multi-channel lens.

[0077] In one embodiment, the first function cameras (e.g., recognition cameras) (215) can acquire images while the wearable electronic device (200) is worn by the user. The first function cameras (215) can be used for the purpose of detecting user movements or recognizing user gestures. For example, the first function cameras (215) can be used for at least one of hand detection, hand tracking, recognition of user gestures (e.g., hand movements), and / or space recognition. For example, the first function cameras (215) mainly use GS (global shutter) cameras, which have superior performance compared to RS (rolling shutter) cameras, to detect and track fine movements of hand movements and fingers, and can be configured as a stereo camera including two or more GS cameras for head tracking and space recognition. The first function cameras (215) can be used for 3DoF (degrees of freedom), 6DoF head tracking, location (spatial, environmental) recognition, and / or movement recognition. The first function camera (215) can perform simultaneous localization and mapping (SLAM) function to recognize information (e.g., location and / or direction) related to the surrounding space through spatial recognition for 6DoF and depth shooting. In one embodiment, the second function cameras (211, 212) can also be used for hand detection and tracking, and user gestures.

[0078] In one embodiment, the second function camera (e.g., a camera for shooting) (211, 212) can obtain an image related to the surrounding environment of the wearable electronic device (200). The second function camera (211, 212) can be used to shoot the outside and generate an image or video corresponding to the outside and transmit it to a processor (e.g., the processor (120) of FIG. 1). The processor (120) can display the image provided from the second function camera (211, 212) on the display assembly (300). The second function camera (211, 212) may also be referred to as an HR (high resolution) or PV (photo video) camera and may include a high-resolution camera. For example, the second function camera (211, 212) may include a color camera equipped with functions for obtaining high-quality images, such as an auto focus (AF) function and an optical image stabilizer (OIS), but is not limited thereto, and the second function camera (211, 212) may also include a GS camera or an RS camera.

[0079] In one embodiment, a third function camera (e.g., a gaze tracking camera) (e.g., a camera (350) of FIG. 3B) may be positioned in the display assembly (300) (or inside the housing (210)) so that the camera lens faces the user's eyes when the user wears the wearable electronic device (200). The third function camera (350) may be used for the purpose of detecting and tracking pupils (ET) and / or recognizing the user's iris. The processor (120) may track the movements of the user's left and right eyes in the images received from the third function camera (350) to determine the gaze direction. The processor (120) may track the position of the pupil in the images so that the center of the XR content image displayed in the screen display area is positioned according to the direction in which the pupil is gazing. As an example, the third function camera (350) may be a GS camera to detect the pupil and track the movement of the pupil. The third function camera (350) can be installed for the left eye and the right eye, respectively, and cameras with the same performance and specifications can be used.

[0080] In one embodiment, the fourth functional camera (e.g., a face recognition camera) (225, 226, 227) may be used to detect and track (FT) the user's facial expression when the user wears the wearable electronic device (200). For example, the fourth functional camera (225, 226, 227) may be used to recognize the user's face, or to recognize and / or track the user's two eyes.

[0081] According to one embodiment, the depth sensor (or depth camera) (217) can be used for the purpose of checking the distance to an object (e.g., an object), such as TOF (time of flight). TOF (time of flight) is a technology that measures the distance to an object using a signal (e.g., near-infrared, ultrasound, or laser). After a signal is transmitted from a transmitter, a signal is measured at a receiver, and the distance to the object can be measured based on the flight time of the signal. For example, the depth sensor (217) can be configured to transmit a signal and receive a signal reflected from a subject. Instead of or in addition to the depth sensor (217), a first function camera (215) can check the distance to an object.

[0082] According to one embodiment, the touch sensor (213) may be arranged in the second direction (②) of the housing (210). The touch sensor (213) may be implemented as a single type or a left / right separated type depending on the shape of the housing (210), but is not limited thereto. For example, when the touch sensor (213) is implemented as a left / right separated type as illustrated in FIG. 2A, when the user wears the wearable electronic device (200), the first touch sensor (213a) may be arranged at the user's left eye position, such as in the fourth direction (④), and the second touch sensor (213b) may be arranged at the user's right eye position, such as in the third direction (③).

[0083] In one embodiment, the touch sensor (213) can recognize a touch input in at least one of, for example, a capacitive, pressure-sensitive, infrared, or ultrasonic manner. For example, the capacitive touch sensor (213) can recognize a physical touch (or contact) input or a hovering input (or proximity) of an external object. According to some embodiments, the wearable electronic device (200) may utilize a proximity sensor (not shown) to enable proximity recognition of an external object.

[0084] According to one embodiment, the touch sensor (213) has a two-dimensional surface and can transmit touch data (e.g., touch coordinates) of an external object (e.g., a user's finger) that comes into contact with the touch sensor (213) to a processor (e.g., the processor (120) of FIG. 1). The touch sensor (213) can detect a hovering input for an external object (e.g., a user's finger) that approaches within a first distance from the touch sensor (213), or detect a touch input that touches the touch sensor (213).

[0085] According to one embodiment, the touch sensor (213) may provide two-dimensional information about the contact point as “touch data” to the processor (120) when an external object touches the touch sensor (213). The touch data may be described as a “touch mode.” The touch sensor (213) may provide hovering data about the time or location of hovering around the touch sensor (213) to the processor (120) when an external object is located within a first distance from the touch sensor (or in proximity, hovering above the touch sensor). The hovering data may be described as a “hovering mode / proximity mode.”

[0086] According to one embodiment, the wearable electronic device (200) may obtain hovering data using at least one of a touch sensor (213), a proximity sensor (not shown), or / and a depth sensor (217) to generate information about a distance, location, or time point between the touch sensor (213) and an external object.

[0087] According to one embodiment, the interior of the housing (210) may include components of FIG. 1, for example, a processor (e.g., processor (120) of FIG. 1) and memory (e.g., memory (130) of FIG. 1).

[0088] In one embodiment, the memory (130) may store various instructions that may be performed by the processor (120). The instructions may include arithmetic and logical operations, data movement, or control commands such as input / output that may be recognized by the processor (120). The memory (130) may include volatile memory (e.g., volatile memory (132) of FIG. 1) and non-volatile memory (e.g., non-volatile memory (134) of FIG. 1), and may temporarily or permanently store various data.

[0089] In one embodiment, the processor (120) may be operatively, functionally, and / or electrically connected to each component of the wearable electronic device (200) and may be configured to perform calculations or data processing related to control and / or communication of each component. Operations performed by the processor (120) may be stored in the memory (130) and, when executed, may be executed by instructions that cause the processor (120) to operate. For example, the processor (120) may be configured to control at least a portion of the operation of the wearable electronic device (200).

[0090] Hereinafter, the computational and data processing functions that the processor (120) can implement on the wearable electronic device (200) are not limited, but a series of operations related to the XR content service function will be described. The operations of the processor (120) described below can be performed by executing instructions stored in the memory (130).

[0091] According to one embodiment, the processor (120) may generate a virtual object based on virtual information based on image information. The processor (120) may output a virtual object related to an XR service together with background space information through the display assembly (300). For example, the processor (120) may capture an image related to an actual space corresponding to the field of view of a user wearing the wearable electronic device (200) through the second function camera (211, 212) to obtain image information or generate a virtual space for a virtual environment. For example, the processor (120) may control the display assembly (300) to display XR content (hereinafter referred to as an XR content screen) in which at least one virtual object is output to be overlapped in an area determined to be a display area or a field of view (FoV) of the user.

[0092] FIG. 3A is a perspective view of a display assembly according to one embodiment. FIG. 3B is a perspective view illustrating a state in which a first lens assembly is removed from a display assembly according to one embodiment. FIG. 3C is a perspective view of a first communication module according to one embodiment.

[0093] Referring to FIGS. 3A to 3C, a display assembly (300) according to one embodiment may be applied to a wearable electronic device (e.g., the wearable electronic device (200) of FIGS. 2A and 2B). In FIGS. 3A to 3C, a first direction (①) may be a direction toward a user's face, and a second direction (②) may be a direction opposite to the first direction (①).

[0094] In one embodiment, the display assembly (300) may include a display panel (310), a fixed barrel (311), a first lens assembly (320), an infrared light source (340), and / or a camera (350).

[0095] In one embodiment, the fixed barrel (311) may provide a space in which each component of the display assembly (300) is placed. For example, the display panel (310), the first lens assembly (320), the infrared light source (340), and / or the camera (350) may be fixedly positioned in the fixed barrel (311). However, this is exemplary, and the components positioned in the fixed barrel (311) are not limited thereto.

[0096] In one embodiment, the display panel (310) can generate light (e.g., visible light) in at least a first direction (①). The display panel (310) can be provided inside a housing (e.g., the housing (210) of FIG. 2B) of a wearable electronic device (e.g., the wearable electronic device (200) of FIG. 2B). For example, the display panel (310) can be fixedly connected to a second direction (②) portion of a fixed barrel (311). Light generated from the display panel (310) can pass through the first lens assembly (320) and be transmitted to the user's eyes.

[0097] In one embodiment, the first lens assembly (320) may be provided in a housing (e.g., the housing (210) of FIG. 2B) of a wearable electronic device (e.g., the wearable electronic device (200) of FIG. 2B). The first lens assembly (320) may be positioned in a first direction (①) with respect to the display panel (310). The first lens assembly (320) may provide a path through which visible light and / or infrared light pass. For example, the first lens assembly (320) may be formed to transmit both visible light and infrared light. For example, the first lens assembly (320) may be formed to filter a region excluding a visible light region and an infrared region. For example, the first lens assembly (320) may be configured to substantially function as a dual wavelength band-pass filter.

[0098] In one embodiment, the first lens assembly (320) may include a first barrel (321), at least one first lens (322), and a first communication module (323).

[0099] In one embodiment, the first barrel (321) may provide a space in which at least one first lens (322) and / or a first communication module (323) is disposed. For example, the first barrel (321) may include a space in which at least one first lens (322) is disposed. For example, the first barrel (321) may be formed to surround an outer periphery of at least one first lens (322). The first barrel (321) may be connected to the fixed barrel (311). For example, the first barrel (321) may be fixedly connected to a first direction (①) portion of the fixed barrel (311). Meanwhile, this is exemplary, and the first barrel (321) and the fixed barrel (311) may be formed substantially integrally. For example, the first barrel (321) may be understood as a portion that provides a space in which at least one first lens (322) is disposed. For example, the first barrel (321) may be understood as a housing or a rim, and the term barrel does not limit the structure of the first barrel (321).

[0100] In one embodiment, the first lens (322) may be provided in one or more pieces. At least one first lens (322) may be provided in the first barrel (321). For example, at least one first lens (322) may be positioned in a first direction (①) with respect to the display panel (310). The first lens (322) may provide a path for light (e.g., visible light and / or infrared light) to pass through. For example, the first lens (322) may be configured to provide a light path for visible light generated from the display panel (310) to reach the user's eyes. For example, the first lens (322) may enlarge and / or reduce content displayed on the display panel (310) and transmit the enlarged and / or reduced content to the user's eyes. For example, the first lens (322) may adjust a focus so that content displayed on the display panel (310) is visible to the user. For example, the first lens (322) may be configured to provide an optical path for infrared light generated from the infrared light source (340) to reach the user's eye. For example, the first lens (322) may be configured to provide an optical path for infrared light reflected from the user's eye to reach the camera (350). For example, the first lens (322) may include at least one of a Fresnel lens, a pancake lens, a convex lens, or a multi-channel lens. However, this is merely exemplary, and the type of the first lens (322) is not limited thereto.

[0101] In one embodiment, the first communication module (323) may be provided in the first barrel (321). For example, at least a portion of the first communication module (323) may be embedded within the first barrel (321). For example, the first communication module (323) may be positioned adjacent to a surface of the first barrel (321) facing the first direction (①). For example, the first communication module (323) may be formed to have a shape corresponding to the shape of the first barrel (321). For example, when the first barrel (321) has a cylindrical shape, the first communication module (323) may be formed to have a circular shape. However, this is exemplary, and the shape of the first communication module (323) is not limited thereto. For example, the first communication module (323) may be formed in a shape different from the shape of the first barrel (321) (e.g., an oval or a polygon). The first communication module (323) may be configured to wirelessly communicate with a second communication module (e.g., the second communication module (333) of FIG. 5A) described below. For example, when the second lens assembly (e.g., the second lens assembly (330) of FIG. 4B) described below is coupled to the first lens assembly (320), the first communication module (323) may be configured to receive information about the second lens assembly (330) from the second communication module (333). For example, the first communication module (323) and the second communication module (333) may be configured to communicate in a radio frequency identification (RFID) or near field communication (NFC) manner. However, this is an example, and the communication method of the first communication module (323) and the second communication module (333) is not limited thereto.

[0102] In one embodiment, the first communication module (323) may include a first printed circuit board (3231), a first metal loop (3232), and / or a first IC chip (3233). For example, the first printed circuit board (3231) may include a flexible printed circuit board. For example, at least a portion of the first printed circuit board (3231) may form a loop and be embedded within the first barrel (321). For example, the first printed circuit board (3231) may include a loop portion (3231a) and an extension portion (3231b). The loop portion (3231a) may be formed in a loop shape. For example, the loop portion (3231a) may be formed in a circular, oval, or polygonal shape. The loop portion (3231a) may be embedded within the first barrel (321). The extension portion (3231b) may extend longitudinally (e.g., in the second direction (②)) from the loop portion (3231a). For example, the extension portion (3231b) may extend from the loop portion (3231a) and be visually exposed to the outside of the first barrel (321). For example, the extension portion (3231b) may be bent so that an end thereof is positioned on a surface facing the second direction (②) of the display assembly (300). However, this is merely exemplary, and the extension direction, position, and / or structure of the extension portion (3231b) are not limited thereto. For example, the extension portion (3231b) may be embedded in the interior of the first barrel (321), or may not be visually exposed to the outside by at least a portion of the first barrel (321) and / or a separate structure. For example, the first barrel (321) may be formed with a portion for covering and / or shielding the extension portion (3231b). The first metal loop (3232) may be positioned on the first printed circuit board (3231) (e.g., loop portion (3231a)). For example, the first metal loop (3232) may form a plurality of loops.

[0103] In one embodiment, a first IC chip (3233) may be positioned on a first printed circuit board (3231) (e.g., an extension portion (3231b)). The first IC chip (3233) may be electrically connected to a first metal loop (3232). For example, the first IC chip (3233) may include a circuit for wireless communication. For example, the first IC chip (3233) may include a circuit for RFID or NFC communication. For example, when a second lens assembly (e.g., a second lens assembly (330) of FIG. 4b) described below is coupled to the first lens assembly (320), the first IC chip (3233) may be configured to receive information from the second IC chip (e.g., a second IC chip (3333) of FIG. 5a) described below. For example, the first IC chip (3233) may be a chip capable of reading and / or writing. However, this is merely exemplary, and the structure of the first communication module (323) is not limited thereto.

[0104] In one embodiment, the infrared light source (340) can generate infrared light for gaze tracking. For example, the infrared light source (340) can generate infrared light at least in a first direction (①). The infrared light source (340) can irradiate infrared light to the outside (e.g., the user's eyes). For example, the infrared light source (340) can be provided in the fixed barrel (311). For example, the infrared light source (340) can be positioned in the fixed barrel (311) so as to face the first direction (①). For example, the infrared light source (340) can be positioned in the second direction (②) with respect to at least one first lens (322). For example, the infrared light source (340) can be positioned between the first lens assembly (320) and the display panel (310). The infrared light source (340) can irradiate infrared rays to the outside (e.g., the user's eyes) through at least one first lens (322). Infrared rays generated from the infrared light source (340) can reach the user's eyes through at least one first lens (322). One or more infrared light sources (340) may be provided. For example, as shown in FIG. 3B, a plurality of infrared light sources (340) may be spaced apart from each other along a circular orbit. However, this is merely exemplary, and the positions of the infrared light sources (340) are not limited thereto. For example, the infrared light source (340) may be positioned in an outer region of the display panel (310).

[0105] In one embodiment, the camera (350) can capture images of the outside (e.g., the user's eye). For example, the camera (350) can sense infrared rays to acquire images. For example, the camera (350) can sense infrared rays generated from an infrared light source (340) and reflected from the user's eye. For example, the camera (350) can capture a glint image and / or an iris image of the user's eye. For example, the camera (350) can be used to track the user's gaze and / or recognize the user's iris. For example, a processor (e.g., the processor (120) of FIG. 1) can be configured to track the user's gaze or recognize the user's iris using the sensing information of the camera (350). For example, the camera (350) can be provided in the fixed barrel (311). For example, the camera (350) may be positioned in the fixed barrel (311) so as to face the first direction (①). For example, the camera (350) may be positioned in the second direction (②) with respect to at least one first lens (322). For example, the camera (350) may be positioned between the first lens assembly (320) and the display panel (310). For example, the camera (350) may capture an image of the outside (e.g., a user's eye) through at least one first lens (322). One or more cameras (350) may be provided. For example, the cameras (350) may be provided as a pair and positioned spaced apart from each other. However, this is exemplary, and the position of the cameras (350) is not limited thereto. For example, the camera (350) may be positioned on the back surface (e.g., the surface in the second direction (②)) of the display panel (310) using an under display camera (UDC) structure.

[0106] In one embodiment, a processor (e.g., processor (120) of FIG. 1) may be configured to control an infrared light source (340) to irradiate infrared light through a first lens assembly (320) for gaze tracking, control a camera (350) to capture images through the first lens assembly (320) for gaze tracking, and perform gaze tracking based on the images captured by the camera (350).

[0107] FIG. 4A is an exploded perspective view of a display assembly and a second lens assembly according to one embodiment. FIG. 4B is a combined perspective view of the display assembly and the second lens assembly according to one embodiment.

[0108] Referring to FIGS. 4A and 4B, in one embodiment, a second lens assembly (330) may be detachably attached to a surface of the display assembly (300) facing the first direction (①). The second lens assembly (330) may be detachably configured to be positioned in the first direction (①) with respect to the first lens assembly (320). For example, as shown in FIG. 4B, the second lens assembly (330) may be attached to a surface of the first lens assembly (320) facing the first direction (①). For example, the second lens assembly (330) may be formed to have a smaller diameter or size than the first lens assembly (320). However, this is exemplary, and the second lens assembly (330) may be formed to have a diameter or size that is larger than or substantially the same as the first lens assembly (320) so that the second lens assembly (330) covers the first lens assembly (320). Meanwhile, this is exemplary, and the second lens assembly (330) may be configured to be detachable from a wearable electronic device (e.g., the wearable electronic device (200) of FIGS. 2A and 2B). For example, the second lens assembly (330) may be configured to be detachable from a housing (e.g., the housing (210) of FIGS. 2A and 2B) of the wearable electronic device (200). The second lens assembly (330) may be attached to the first lens assembly (320) to correct the user's eyesight. For example, the second lens assembly (330) may be understood as an optical insert, an optical clip, a lens insert, and / or a prescription mount. The first lens assembly (320) and the second lens assembly (330) may be detachable from each other by magnetic force. For example, the first lens assembly (320) and the second lens assembly (330) can be magnetically attached to each other at designated locations.For example, when the first lens assembly (320) and the second lens assembly (330) are aligned with each other in a specified direction, the first lens assembly (320) and the second lens assembly (330) can be attached to each other by magnetic force. For example, when the first lens assembly (320) and the second lens assembly (330) are aligned with each other so that the fastening protrusion of the first lens assembly (320) described below (e.g., the fastening protrusion (3211) of FIG. 6c) is inserted into the fastening groove of the second lens assembly (330) (e.g., the fastening groove (3311) of FIG. 6b)), the first lens assembly (320) and the second lens assembly (330) can be attached to each other by magnetic force. However, this is merely exemplary, and the method of attaching and detaching the first lens assembly (320) and the second lens assembly (330) is not limited thereto.

[0109] FIG. 5A is an exploded perspective view of a second lens assembly according to one embodiment. FIG. 5B is a cross-sectional view of a second lens assembly according to one embodiment. FIG. 5C is a side view of a second lens according to one embodiment.

[0110] Referring to FIGS. 3A to 5C, in one embodiment, the second lens assembly (330) may include a second barrel (331), at least one second lens (332), and a second communication module (333).

[0111] In one embodiment, the second barrel (331) may provide a space in which at least one second lens (332) and / or a second communication module (333) are disposed. For example, the second barrel (331) may include a space in which at least one second lens (332) is seated. For example, the second barrel (331) may be formed to surround an outer periphery of at least one second lens (332). For example, the second barrel (331) may be understood as a portion that provides a space in which at least one second lens (332) is disposed. For example, the second barrel (331) may be understood as a housing or a rim, and the term barrel does not limit the structure of the second barrel. The second barrel (331) may be configured to be coupled with the first barrel (321). For example, the first barrel (321) and the second barrel (331) may be coupled to each other by magnetic force. However, this is an example, and the method of combining the first barrel (321) and the second barrel (331) is not limited thereto.

[0112] In one embodiment, the second lens (332) may be provided in one or more pieces. At least one second lens (332) may be provided in the second barrel (331). At least one second lens (332) may have a diopter and / or refractive index selected by the user to correct the user's eyesight. For example, as shown in FIG. 5C, the second lens (332) may include a left-right asymmetrical shape. When the second lens assembly (330) is coupled to the first lens assembly (320), the first lens (322) and the second lens (332) may provide a path for light (e.g., visible light and / or infrared rays) to pass through. For example, when the second lens assembly (330) is coupled to the first lens assembly (320), the first lens (322) and the second lens (332) can be configured to provide an optical path for visible light generated from the display panel (310) to reach the user's eyes. For example, when the second lens assembly (330) is coupled to the first lens assembly (320), the first lens (322) and the second lens (332) can magnify and / or reduce content displayed on the display panel (310) and transmit it to the user's eyes. For example, when the second lens assembly (330) is coupled to the first lens assembly (320), the first lens (322) and the second lens (332) can adjust the focus so that content displayed on the display panel (310) is visible to the user. For example, when the second lens assembly (330) is coupled to the first lens assembly (320), the first lens (322) and the second lens (332) may be configured to provide an optical path for infrared light generated from the infrared light source (340) to reach the user's eye. For example, when the second lens assembly (330) is coupled to the first lens assembly (320), the first lens (322) and the second lens (332) may be configured to provide an optical path for infrared light reflected from the user's eye to reach the camera (350).For example, the second lens (332) may include at least one of a Fresnel lens, a pancake lens, a convex lens, or a multi-channel lens. However, this is merely exemplary, and the type of the second lens (332) is not limited thereto.

[0113] In one embodiment, the second communication module (333) may be provided in the second barrel (331). For example, as shown in FIG. 5B, the second communication module (333) may be embedded inside the second barrel (331). For example, the second communication module (333) may be formed to have a shape corresponding to the shape of the first communication module (323). For example, when the first communication module (323) has a circular shape, the second communication module (333) may be formed to have a circular shape substantially identical to the shape of the first communication module (323). However, this is merely exemplary, and the shape of the second communication module (333) is not limited thereto. For example, the second communication module (333) may be positioned adjacent to a surface of the second barrel (331) facing the second direction (②). However, this is an example, and the location of the second communication module (333) is not limited thereto. For example, at least a portion of the second communication module (333) may be exposed to the outside of the second barrel (331). For example, at least a portion of the second communication module (333) may be provided in the second lens (332). For example, at least a portion of the second communication module (333) (e.g., the second metal loop (3332)) may be positioned adjacent to the outer peripheral surface (e.g., the surface facing outward in the diametric direction) of the second barrel (331).

[0114] In one embodiment, the second communication module (333) may be configured to communicate with the first communication module (323). For example, when the second lens assembly (330) is coupled to the first lens assembly (320), the second communication module (333) may be configured to transmit information about the second lens assembly (330) to the first communication module (323). For example, the second communication module (333) may include a second printed circuit board (3331), a second metal loop (3332), and / or a second IC chip (3333). For example, the second printed circuit board (3331) may include a flexible printed circuit board. For example, at least a portion of the second printed circuit board (3331) may form a loop and be embedded within the second barrel (331). The second metal loop (3332) may be located on the second printed circuit board (3331). For example, the second metal loop (3332) can form a plurality of loops. The second metal loop (3332) can be formed in a pattern substantially identical or similar to that of the first metal loop (3232). When the second lens assembly (330) is coupled to the first lens assembly (320), the second metal loop (3332) can be electromagnetically paired with the first metal loop (3232).

[0115] In one embodiment, the second IC chip (3333) may be located on the second printed circuit board (3331). The second IC chip (3333) may be electrically connected to the second metal loop (3332). For example, the second IC chip (3333) may include circuitry for wireless communication. For example, the second IC chip (3333) may include circuitry for RFID or NFC communication. When the second lens assembly (330) is coupled to the first lens assembly (320), the second IC chip (3333) may be configured to transmit information to the first IC chip (3233). For example, the second IC chip (3333) may store information about the second lens assembly (330). For example, the second IC chip (3333) may be a tag IC chip that includes information about the second lens assembly (330). For example, the second IC chip (3333) may be a chip capable of reading and / or writing. For example, if the second IC chip (3333) is configured to be writable, when the second lens (332) provided in the second barrel (331) is replaced, the second IC chip (3333) may update information about the second lens (332). However, this is merely exemplary, and the structure of the second communication module (333) is not limited thereto.

[0116] In one embodiment, a user may select a second lens assembly (330) having a specific diopter and / or refractive index according to his or her eyesight, and couple the second lens assembly (330) to the first lens assembly (320). When the second lens assembly (330) is coupled to the first lens assembly (320), the second lens assembly (330) may provide an optical path together with the first lens assembly (320). Because the second lens (332) of the second lens assembly (330) has a diopter and / or refractive index, the optical path provided by the first lens assembly (320) and the second lens assembly (330) together may be different from the optical path provided by the first lens assembly (320) alone. For example, when the second lens assembly (330) is coupled to the first lens assembly (320), the optical path for visible light generated from the display panel (310) to reach the user's eye, the optical path for infrared light generated from the infrared light source (340) to reach the user's eye, and / or the optical path for infrared light reflected from the user's eye to reach the camera (350) may be different compared to a state in which the second lens assembly (330) is not coupled to the first lens assembly (320) (e.g., a state in which only the first lens assembly (320) is present). Accordingly, when the second lens assembly (330) is coupled to the first lens assembly (320), the processor (e.g., the processor (120) of FIG. 1) may be configured to perform correction according to the changed optical path by using information about the second lens assembly (330).

[0117] In one embodiment, when the second lens assembly (330) is coupled to the first lens assembly (320), the first communication module (323) provided in the first lens assembly (320) can wirelessly communicate with the second communication module (333) provided in the second lens assembly (330) by electromagnetic coupling between the first metal loop (3232) and the second metal loop (3332). When the second lens assembly (330) is coupled to the first lens assembly (320), the first communication module (323) can wirelessly receive information about the second lens assembly (330) from the second communication module (333). For example, information about the second lens assembly (330) transmitted from the second communication module (333) to the first communication module (323) may include at least one of the diopter or refractive index of at least one second lens (332), or manufacturer information, serial information, or version information of the second lens assembly (330). However, this is merely exemplary, and the information about the second lens assembly (330) transmitted from the second communication module (333) to the first communication module (323) is not limited thereto.

[0118] In one embodiment, while the second lens assembly (330) is coupled to the wearable electronic device (200) (e.g., coupled to the first lens assembly (320)), a processor (e.g., the processor (120) of FIG. 1) may be configured to acquire information about the second lens assembly (330). For example, the processor (120) may control an infrared light source (340) to irradiate infrared light through the first lens assembly (320) and the second lens assembly (330) for gaze tracking. For example, the processor (120) may be configured to control a camera (350) to capture images through the first lens assembly (320) and the second lens assembly (330) for gaze tracking. For example, the processor (120) may be configured to perform gaze tracking based on the acquired information about the second lens assembly (330) and / or images captured by the camera (350). For example, the processor (120) may be configured to correct images captured by the camera (350) based on information about the acquired second lens assembly (330). For example, the processor (120) may be configured to perform gaze tracking based on the corrected images. For example, the processor (120) may be configured to control the camera (350) to perform gaze tracking based on information about the second lens assembly (330). This will be described in detail below. Meanwhile, it will be readily apparent to those skilled in the art that even in a state where the second lens assembly (330) is not coupled to the wearable electronic device (200) (e.g., a state where only the first lens assembly (320) is provided), the processor (120) can be configured to control the infrared light source (340) to irradiate infrared rays through the first lens assembly (320) for gaze tracking, control the camera (350) to capture images through the first lens assembly (320) for gaze tracking, and perform gaze tracking based on the images captured by the camera (350).

[0119] In one embodiment, the information about the second lens assembly (330) may include the diopter and / or refractive index of at least one second lens (332). The information about the second lens assembly (330) received by the first communication module (323) may be transmitted to a processor (e.g., the processor (120) of FIG. 1). The processor (120) may be configured to correct an image captured by the camera (350) using the information about the second lens assembly (330) when the second lens assembly (330) is coupled to the first lens assembly (320). For example, the processor (120) may be configured to correct an image captured by the camera (350) according to the diopter and / or refractive index of at least one second lens (332) based on a predefined correction table. For example, when the second lens assembly (330) is coupled to the first lens assembly (320), the optical path for the infrared ray generated from the infrared light source (340) to reach the user's eye and / or the optical path for the infrared ray reflected from the user's eye to reach the camera (350) may be different, so that the image captured by the camera (350) may be different from an existing image (e.g., an image captured with only the first lens assembly (320) present). Therefore, the processor (120) may correct the image captured by the camera (350) using information about the diopter and / or refractive index of the second lens (332) to obtain an accurate image. For example, a predefined correction table may be stored in a memory (e.g., the memory (130) of FIG. 1). The correction table may include information about a correction process (e.g., calibration) for correcting the image for each of the various diopters and / or refractive indices of the second lens (332). For example, a calibration table can be generated experimentally in advance.For example, a processor (e.g., processor (120) of FIG. 1) can receive or update a correction table from an external source (e.g., server (108) of FIG. 1) through a communication module (e.g., communication module (190) of FIG. 1). The processor (120) can find the received diopter and / or refractive index of the second lens (332) in a predefined correction table and correct the image captured by the camera (350) using the corresponding correction process. By performing such correction, an accurate image can be acquired even when the second lens assembly (330) is coupled to the first lens assembly (320). However, this is merely exemplary, and the method of correcting the image captured by the camera (350) is not limited thereto. For example, the processor (120) can also correct the image captured by the camera (350) using the received diopter and / or refractive index of the second lens (332) through artificial intelligence.

[0120] In one embodiment, the information about the second lens assembly (330) may include at least one of manufacturer information, serial information, and / or version information of the second lens assembly (330). For example, the characteristics of the second lens (332) may vary depending on at least one of the manufacturer, manufacturing time, manufacturing plant, and product version of the second lens assembly (330). For example, the characteristics of the second lens (332) may include surface treatment characteristics, surface coating characteristics, outer curvature characteristics, or various other characteristics. For example, the characteristics of the second lens (332) described above may cause a change in the intensity of light (e.g., visible light and / or infrared light) passing through the second lens (332). Accordingly, the processor (120) may be configured to adjust the intensity of light generated from the display panel (310) and / or the infrared light source (340) by using at least one of the manufacturer information, serial information, and / or version information of the second lens assembly (330) to compensate for the aforementioned change in intensity. For example, when the intensity of light decreases as it passes through the second lens (332), the processor (120) may increase the intensity of light generated from the display panel (310) and / or the infrared light source (340) to compensate for this.

[0121] In one embodiment, the processor (120) may be configured to use information about the second lens assembly (330) to determine at least one of the lifespan, replacement time, damage, and / or proper positioning of the second lens assembly (330). For example, the processor (120) may record at least one of the first wearing time, number of wearing times, and / or wearing time of the second lens assembly (330), to determine the lifespan and / or replacement time of the second lens assembly (330). For example, the processor (120) may recognize a change in an optical path to determine whether the second lens assembly (330) is damaged and / or proper positioning. For example, a processor (e.g., processor (120) of FIG. 1) may estimate information about the second lens assembly (330) (e.g., diopter and / or refractive index of the second lens assembly (330)) by comparing pre-stored lens diopter or refractive index-based data with an actual captured image, and may compare the estimated information about the second lens assembly (330) with actually received information about the second lens assembly (330) (e.g., diopter and / or refractive index of the second lens assembly (330)) to determine whether the second lens assembly (330) is broken and / or not properly coupled. For example, if the estimated information about the second lens assembly (330) and the actually received information about the second lens assembly (330) are different, the processor (120) may determine that the second lens assembly (330) is broken or not properly coupled, and the processor (120) may notify the user of this. Meanwhile, this is merely exemplary, and the operations that the processor (120) can perform using information about the second lens assembly (330) are not limited thereto. For example, the processor (120) may be configured to record and utilize personal information (e.g., eyesight) of the user or detect changes in the user's eyesight using information about the second lens assembly (330).For example, a processor (e.g., processor (120) of FIG. 1) can match user information with information about the second lens assembly (330) and utilize additional user-selected correction information using unique identification information of the second lens assembly (330).

[0122] Figure 6a is a perspective view of a second barrel according to one embodiment. Figure 6b is a rear perspective view of the second barrel according to one embodiment. Figure 6c is a partial perspective view of the first barrel according to one embodiment.

[0123] Referring to FIGS. 6A to 6C, in one embodiment, the second barrel (331) may include a fastening groove (3311), a magnetic groove (3312), and / or an asymmetrical portion (3313). The fastening groove (3311) may be formed on a portion of the second barrel (331) facing the second direction (②). The first barrel (321) may include a fastening protrusion (3211) that is formed to protrude at a position corresponding to the fastening groove (3311). However, this is merely exemplary, and the positions of the fastening groove (3311) and the fastening protrusion (3211) are not limited thereto. The fastening protrusion (3211) and the fastening groove (3311) may align positions where the first barrel (321) and the second barrel (331) are coupled to each other. In the process of combining the first barrel (321) and the second barrel (331), the fastening protrusion (3211) of the first barrel (321) is inserted into the fastening groove (3311) of the second barrel (331), so that the relative positions of the first barrel (321) and the second barrel (331) can be aligned. According to the fastening protrusion (3211) and the fastening groove (3311), the alignment state of the first barrel (321) and the second barrel (331) can be guided, and in the aligned state, the first barrel (321) and the second barrel (331) can be coupled to each other by magnetic force. According to the fastening protrusion (3211) and the fastening groove (3311), the alignment state of the first barrel (321) and the second barrel (331) can be guided, and in the alignment state, the relative shapes of the first communication module (e.g., the first communication module (323) of FIG. 3C) and the second communication module (e.g., the second communication module (333) of FIG. 5A) can be aligned with each other, so that the communication sensitivity between the first communication module (323) and the second communication module (333) can be improved. Meanwhile, this is exemplary, and the second barrel (331) may include the fastening protrusion, and the first barrel (321) may include the fastening groove.For example, the fastening groove may be formed on the outer surface (e.g., the surface facing outward in the diametric direction) of the first barrel (321), and the fastening projection may be formed on the inner surface (e.g., the surface facing inward in the diametric direction) of the second barrel (331).

[0124] In one embodiment, the magnet groove (3312) may be formed in a portion of the second barrel (331) facing the second direction (②). For example, one or more magnet grooves (3312) may be provided. For example, a plurality of magnet grooves (3312) may be positioned spaced apart from each other along the circumference of the second barrel (331). A magnet (e.g., a magnet (334) of FIG. 8B) may be inserted and positioned in the magnet groove (3312). A magnet groove may also be formed in the first barrel (321) at a position corresponding to the magnet groove (3312) of the second barrel (331). Meanwhile, the magnet groove (3312) illustrated in FIG. 6B is exemplary, and the magnet may be embedded inside the second barrel (331).

[0125] In one embodiment, the second barrel (331) may be formed asymmetrically left and right. For example, the second barrel (331) may include an asymmetrical portion (3313) as shown in FIG. 6A. With this structure, the second lens assembly (e.g., the second lens assembly (330) of FIG. 4A) may be formed asymmetrically left and right. The user can distinguish whether the second lens assembly (330) is a left-side assembly or a right-side assembly through the asymmetrical shape of the second lens assembly (330). For example, the left-side second lens assembly (330) may be coupled only to the left-side first lens assembly (e.g., the first lens assembly (320) of FIG. 4A) due to the asymmetrical shape, and may not be coupled to the right-side first lens assembly (320).

[0126] Figure 7 is a flowchart of a method for controlling a wearable electronic device according to one embodiment.

[0127] Referring to FIG. 7, in one embodiment, a control method (400) of a wearable electronic device may be understood as a method of controlling the wearable electronic device described above (e.g., the wearable electronic device (200) of FIGS. 2A and 2B). For example, the control method (400) of a wearable electronic device may be performed by a processor (e.g., the processor (120) of FIG. 1).

[0128] In one embodiment, a method (400) for controlling a wearable electronic device may include an operation (410) of attaching a second lens assembly to a first lens assembly of the wearable electronic device, an operation (420) of a first communication module of the first lens assembly receiving information about the second lens assembly from a second communication module of the second lens assembly, and an operation (430) of a processor of the wearable electronic device controlling the wearable electronic device using information about the second lens assembly.

[0129] In one embodiment, the information about the second lens assembly may include a diopter or refractive index of a lens of the second lens assembly.

[0130] In one embodiment, the operation (430) of controlling the wearable electronic device using information about the second lens assembly may include an operation of correcting an image captured by a camera built into the first lens assembly using information about the second lens assembly.

[0131] In one embodiment, the operation of correcting the image may be an operation configured to correct an image captured by the camera according to a diopter or refractive index of a lens of the second lens assembly based on a predefined correction table.

[0132] In one embodiment, the control method (400) of a wearable electronic device may further include an operation of receiving or updating the correction table from an external server.

[0133] In one embodiment, the information about the second lens assembly may include at least one of manufacturer information, serial information, and version information of the second lens assembly.

[0134] In one embodiment, the operation (430) of controlling the wearable electronic device using information about the second lens assembly may include an operation of adjusting the intensity of light generated from a display panel or an infrared light source using information about the second lens assembly.

[0135] In one embodiment, the operation (430) of controlling the wearable electronic device using information about the second lens assembly may include an operation of determining at least one of the lifespan of the second lens assembly, replacement time, whether it is broken, and whether it is properly coupled using information about the second lens assembly.

[0136] In one embodiment, the operation (430) of controlling the wearable electronic device using information about the second lens assembly may include estimating information about the second lens assembly by comparing pre-stored data with an actual captured image. In one embodiment, the operation (430) of controlling the wearable electronic device using information about the second lens assembly may include comparing the estimated information about the second lens assembly with actually received information about the second lens assembly to determine whether the second lens assembly is damaged or properly coupled.

[0137] In one embodiment, a computer program may be stored in a computer-readable recording medium to execute the control method (400) of the wearable electronic device described above in combination with hardware.

[0138] FIG. 8A is an exploded perspective view of a display assembly according to one embodiment. FIG. 8B is an exploded perspective view of a display assembly and a second lens assembly according to one embodiment. It will be readily apparent to those skilled in the art that the description of the embodiments described with reference to FIGS. 3A to 5C may be applied to the description of the embodiments described with reference to FIGS. 8A and 8B.

[0139] Referring to FIGS. 8A and 8B , in one embodiment, the display assembly (300) may further include a magnetic sensor (324). The magnetic sensor (324) may be provided inside and / or outside the display assembly (300). For example, the magnetic sensor (324) may be disposed on the first printed circuit board (3231). For example, the magnetic sensor (324) may be disposed inside the first barrel (321) and may not be visually exposed to the outside. The magnetic sensor (324) may include a sensor that detects the magnitude and / or direction of a magnetic field. For example, the magnetic sensor (324) may include a Hall sensor. However, this is merely exemplary, and the position and / or type of the magnetic sensor (324) is not limited thereto.

[0140] In one embodiment, the second lens assembly (330) may further include a magnet (334). For example, the magnet (334) may be provided on the inside and / or outside of the second barrel (331). For example, the magnet (334) may be provided in a magnet groove (e.g., magnet groove (3312) of FIG. 6B) formed in the second barrel (331). As shown in FIG. 8B, when the second lens assembly (330) is aligned in a direction in which it is coupled to the first lens assembly (320), the magnet (334) may be aligned to be positioned adjacent to the magnetic sensor (324). The magnetic sensor (324) may detect a magnetic field generated by the magnet (334) of the second lens assembly (330). A processor (e.g., processor (120) of FIG. 1) can determine whether the second lens assembly (330) is coupled to the first lens assembly (320) using the measurement value measured by the magnetic sensor (324). For example, the processor (120) can determine that the second lens assembly (330) is coupled to the first lens assembly (320) if the value measured by the magnetic sensor (324) satisfies a specified condition.

[0141] In one embodiment, a wearable electronic device (e.g., the wearable electronic device (200) of FIGS. 2A and 2B) may further include a 6-axis sensor (not shown). For example, the 6-axis sensor may include three acceleration sensors and three gyro sensors. For example, the 6-axis sensor may detect the position and / or orientation of the wearable electronic device (200) or a change therein. For example, a processor (e.g., the processor (120) of FIG. 1) may use the measured values ​​from the 6-axis sensor to determine whether the wearable electronic device (200) is in a mounted state and / or in use. For example, when a user couples the second lens assembly (330) to the wearable electronic device (200), the wearable electronic device (200) may be oriented in a specific direction. Using this, the processor (120) can determine whether the user is performing an action to couple the second lens assembly (330) to the wearable electronic device (200) based on the measurement values ​​measured by the 6-axis sensor.

[0142] FIG. 9A is an exemplary image of a user's eye captured by a camera without the second lens assembly attached to the wearable electronic device. FIG. 9B is an exemplary image of a user's eye captured by a camera with the second lens assembly attached to the wearable electronic device.

[0143] In one embodiment, as shown in FIG. 9A, in the basic use state of the wearable electronic device (e.g., when the second lens assembly is not coupled to the wearable electronic device), an infrared reflection image may be formed in the user's iris area. On the other hand, when the second lens assembly is coupled to the wearable electronic device, an infrared reflection image may be formed in other areas as well as the user's iris area due to the light path change and / or diffuse reflection caused by the second lens assembly, as shown in FIG. 9B. Using this difference, a processor (e.g., the processor (120) of FIG. 1) may determine whether the second lens assembly is coupled by analyzing an eye image captured by a camera (e.g., the camera (350) of FIG. 3B). For example, if an infrared reflection image appears in an area other than the user's iris area in the eye image captured by the camera (350), the processor (120) may determine that the second lens assembly is coupled to the wearable electronic device.

[0144] FIG. 10A is a flowchart of a control method of a wearable electronic device according to one embodiment.

[0145] Referring to FIG. 10A, in one embodiment, a control method (510) of a wearable electronic device may include an operation for determining whether a second lens assembly is coupled (511), an operation for activating a first communication module (512), an operation for checking whether communication is present (513), an operation for performing a procedure for checking information about the second lens assembly (514), and an operation for storing information about the second lens assembly (515). The control method (510) of a wearable electronic device may be understood as a method for controlling the above-described wearable electronic device (e.g., the wearable electronic device (200) of FIGS. 2A and 2B). For example, the control method (510) of a wearable electronic device may be performed by a processor (e.g., the processor (120) of FIG. 1).

[0146] In one embodiment, the operation (511) of determining whether the second lens assembly is coupled may be an operation of determining whether the second lens assembly is coupled to the wearable electronic device (or the first lens assembly). For example, the processor may determine whether the second lens assembly is coupled to the wearable electronic device (or the first lens assembly) by using a measurement value of a magnetic sensor (e.g., the magnetic sensor (324) of FIGS. 8A and 8B), a measurement value of a 6-axis sensor, and / or an eye image captured by a camera (e.g., the camera (350) of FIG. 3B). For example, the processor may determine that the second lens assembly is coupled to the wearable electronic device (or the first lens assembly) if the measurement value of the magnetic sensor satisfies a specified condition. For example, the processor may determine that the second lens assembly is coupled to the wearable electronic device (or the first lens assembly) if the measurement value of the 6-axis sensor satisfies a specified condition. For example, if an infrared reflection image appears in an area other than the user's iris area in the eye image captured by the camera (350), the processor may determine that the second lens assembly is coupled to the wearable electronic device (or the first lens assembly). However, this is merely exemplary, and the operation (511) for determining whether the second lens assembly is coupled is not limited thereto. For example, the operation (511) for determining whether the second lens assembly is coupled may also be performed through a user's manual input.

[0147] In one embodiment, the processor may determine whether the second lens assembly is coupled, and if the second lens assembly is coupled to the wearable electronic device (or the first lens assembly), the processor may activate the first communication module. For example, in a basic use state of the wearable electronic device (e.g., a state in which the second lens assembly is not coupled to the wearable electronic device), the first communication module may be maintained in a deactivated state. If the processor determines that the second lens assembly is coupled based on the result of the operation (511) of determining whether the second lens assembly is coupled, the processor may perform the operation (511-1) of maintaining the first communication module in a deactivated state if the second lens assembly is determined not to be coupled based on the result of the operation (511) of determining whether the second lens assembly is coupled. In this way, by keeping the first communication module in a deactivated state when the second lens assembly is not coupled, and activating the first communication module only when the second lens assembly is coupled, the power consumed by the wearable electronic device can be reduced.

[0148] In one embodiment, when the first communication module is activated, a communication confirmation operation (513) may be performed. The communication confirmation operation (513) may be an operation for confirming whether the first communication module can communicate with the second communication module and / or whether the first communication module successfully communicates with the second communication module. The communication confirmation operation (513) may include an operation for attempting communication between the first communication module and the second communication module for a certain period of time and / or a certain number of times. If it is confirmed that communication is possible between the first communication module and the second communication module, an operation (513-1) for receiving information about the second lens assembly through communication may be performed. The operation (513-1) for receiving information about the second lens assembly through communication of FIG. 10A may be substantially the same as the operation (420) for receiving information about the second lens assembly of FIG. 7. After the operation (513-1) of receiving information about the second lens assembly of FIG. 10A, the operation (430) of controlling the electronic device using the information about the second lens assembly of FIG. 7 may be performed. For example, the operation (430) of controlling the electronic device using the information about the second lens assembly may be performed online through communication with a server. For example, when the operation (513-1) of receiving information about the second lens assembly is completed, the information about the second lens assembly may be stored in the wearable electronic device, and the main UX may be displayed on the display.

[0149] In one embodiment, when it is determined that communication between the first communication module and the second communication module is impossible or has failed (e.g., when the second lens assembly is not equipped with a second communication module), a procedure (514) for checking information about the second lens assembly may be performed. The procedure (514) for checking information about the second lens assembly may include an identifier recognition operation (5141) using a camera, an eye image analysis operation (5142), and / or a manual input mode provision operation (5143).

[0150] In one embodiment, the camera-based identifier recognition operation (5141) may be an operation of recognizing an identifier displayed on the second lens assembly using a camera built into the display assembly (e.g., camera (350) of FIG. 3B). The identifier displayed on the second lens assembly may include information about the second lens assembly. For example, the identifier displayed on the second lens assembly may include a barcode, a QR code, or another form of identifier. For example, the identifier displayed on the second lens assembly may be printed on a surface of the second lens. For example, the identifier displayed on the second lens assembly may be configured to be visible only in the infrared region.

[0151] In one embodiment, the eye image analysis operation (5142) may be an operation of analyzing an eye image of the user captured by a camera built into the display assembly (e.g., camera (350) of FIG. 3B). For example, the pattern (e.g., number, position, size, spacing, distribution, and / or clarity) of the infrared reflection image may be different depending on which second lens assembly is coupled. The eye image analysis operation (5142) may be an operation of analyzing the pattern of the infrared reflection image to estimate information (e.g., diopter or refractive index) about the second lens assembly. For example, the processor may estimate information (e.g., diopter or refractive index) about the second lens assembly by analyzing an image captured by the camera (350) using a database of infrared reflection image patterns according to information (e.g., diopter or refractive index) about the second lens assembly.

[0152] In one embodiment, the manual input mode providing operation (5143) may be an operation that provides a mode for the user to directly input information about the second lens assembly. For example, the processor may provide the user with a notification and / or screen that can guide the user to directly input information about the second lens assembly (e.g., prescription information).

[0153] In one embodiment, the procedure (514) for confirming information about the second lens assembly may be configured to sequentially perform an identifier recognition operation (5141) using a camera, an eye image analysis operation (5142), and a manual input mode provision operation (5143). For example, if the identifier recognition operation (5141) using a camera is performed first and information about the second lens assembly is confirmed, subsequent operations may be omitted. If the identifier recognition operation (5141) using a camera is performed first but information about the second lens assembly is not confirmed, the eye image analysis operation (5142) may be performed next. For example, if the eye image analysis operation (5142) is performed and information about the second lens assembly is confirmed, subsequent operations may be omitted. If the eye image analysis operation (5142) is performed but information about the second lens assembly is not confirmed, the manual input mode provision operation (5143) may be performed next. However, this is an example, and the order of the procedure (514) for checking information about the second lens assembly is not limited thereto, and some of the above-described operations may be omitted or other operations other than the above-described operations may be added.

[0154] In one embodiment, the operation (515) of storing information about the second lens assembly may be an operation in which information about the second lens assembly obtained through the procedure (514) for checking information about the second lens assembly is stored in the wearable electronic device. Thereafter, the operation (430) of controlling the electronic device using the information about the second lens assembly of FIG. 7 may be performed. For example, the operation (430) of controlling the electronic device using the information about the second lens assembly may be performed online through communication with a server. For example, when the operation (515) of storing information about the second lens assembly is completed, the main UX may be displayed on the display.

[0155] FIG. 10b is a flowchart of a control method of a wearable electronic device according to one embodiment.

[0156] Referring to FIG. 10B, in one embodiment, a control method (520) of a wearable electronic device may include an operation for determining whether a second lens assembly is coupled (511), an operation for activating a first communication module (512), an operation for checking whether communication is present (513), an operation for activating a camera (521), an operation for displaying a screen reflecting information about the second lens assembly (522), an operation for detecting the presence of an eye (523), an operation for obtaining information about the second lens assembly (524), and an operation for storing information about the second lens assembly (525). The control method (520) of a wearable electronic device may be understood as a method for controlling the above-described wearable electronic device (e.g., the wearable electronic device (200) of FIGS. 2A and 2B). For example, the control method (520) of a wearable electronic device may be performed by a processor (e.g., the processor (120) of FIG. 1). The operation for determining whether the second lens assembly is combined (511), the operation for activating the first communication module (512), and the operation for checking whether communication is possible (513) are to be applied in accordance with the contents described through Fig. 10a unless otherwise stated.

[0157] In one embodiment, if it is determined that communication between the first communication module and the second communication module is impossible or has failed (e.g., the second communication module is not provided in the second lens assembly) based on the result of the communication confirmation operation (513), a camera activation operation (521) may be performed. The camera activation operation (521) may be an operation for activating a camera (e.g., the camera (350) of FIG. 3B) for photographing the user's eye.

[0158] In one embodiment, the operation (522) of displaying a screen reflecting information about the second lens assembly may be an operation of displaying a screen for reflecting information about the second lens assembly on the display. For example, the screen may include content guiding a user to directly input information about the second lens assembly. For example, the screen may include content notifying that information about the second lens assembly is being acquired. For example, the screen may include content notifying that information about the second lens assembly is needed.

[0159] In one embodiment, the eye presence detection operation (523) may be an operation for determining whether the user's eye is detected in an image captured by the camera. For example, when the user is not wearing the wearable electronic device, the image captured by the camera may not include an eye image. In this case, the processor may determine that the eye does not exist, perform an operation (523-1) for maintaining a screen reflecting information about the second lens assembly, and perform the eye presence detection operation (523) again. For example, even when the wearable electronic device changes from a sleep state to a use state, the operation (523-1) for maintaining a screen reflecting information about the second lens assembly may be continuously performed. For example, when the user is wearing the wearable electronic device, the image captured by the camera may include an eye image of the user. In this case, the processor may recognize the eye image of the user, determine that the eye exists, and perform an operation for obtaining information about the second lens assembly (524).

[0160] In one embodiment, the second lens assembly information acquisition operation (524) may include an operation for acquiring information about the second lens assembly. For example, the second lens assembly information acquisition operation (524) may include an eye image analysis operation (5241) and an input information acquisition operation (5242). The eye image analysis operation (5241) is to be applied to the contents of the eye image analysis operation (5142) of FIG. 10A. The input information acquisition operation (5242) may be an operation for acquiring information about the second lens assembly directly input by the user. For example, the user may be guided to directly input information about the second lens assembly through an information reflection screen about the second lens assembly (e.g., see operation 522).

[0161] In one embodiment, the operation (525) of storing information about the second lens assembly may be an operation in which information about the second lens assembly acquired through the operation (524) of obtaining information about the second lens assembly is stored in the wearable electronic device. Thereafter, the operation (430) of controlling the electronic device using the information about the second lens assembly of FIG. 7 may be performed. For example, the operation (430) of controlling the electronic device using the information about the second lens assembly may be performed online through communication with a server. For example, when the operation (525) of storing information about the second lens assembly is completed, the main UX may be displayed on the display.

[0162] FIG. 10c is a flowchart of a control method of a wearable electronic device according to one embodiment.

[0163] Referring to FIG. 10c, in one embodiment, a control method (530) of a wearable electronic device may include a 6-axis sensor specific direction detection operation (531), a wearable electronic device activation operation (532), a communication confirmation operation (513), a camera activation operation (521), an eye presence detection operation (523), a second lens assembly combination determination operation (533), a second lens assembly information reflection screen display operation (522), a second lens assembly information acquisition operation (524), a second lens assembly information storage operation (525), and a main UX display operation (534). The control method (530) of a wearable electronic device may be understood as a method of controlling the above-described wearable electronic device (e.g., the wearable electronic device (200) of FIGS. 2a and 2b). For example, a control method (530) of a wearable electronic device may be performed by a processor (e.g., processor (120) of FIG. 1). The communication confirmation operation (513), the camera activation operation (521), the eye presence detection operation (523), the information reflection screen display operation (522) for the second lens assembly, the second lens assembly information acquisition operation (524), and the information storage operation (525) for the second lens assembly are to be performed in accordance with the contents described through FIGS. 10A and 10B unless otherwise stated.

[0164] In one embodiment, the 6-axis sensor specific direction detection operation (531) may be an operation to detect whether the wearable electronic device is oriented in a specific direction using a measurement value measured by the 6-axis sensor. For example, the 6-axis sensor specific direction detection operation (531) may detect whether the wearable electronic device has changed from a stationary state (e.g., a sleep state) to a use state. For example, if it is detected that the wearable electronic device has changed to a use state, a wearable electronic device activation operation (532) may be performed. The wearable electronic device activation operation (532) may be understood as an operation to wake up the wearable electronic device. When the wearable electronic device is activated, a communication confirmation operation (513) may be performed.

[0165] In one embodiment, if it is determined that communication between the first communication module and the second communication module is impossible or has failed (e.g., the second communication module is not provided in the second lens assembly) based on the result of the communication confirmation operation (513), a camera activation operation (521) may be performed. If the camera is activated, an eye presence detection operation (523) may be performed. If the eye is not detected, an operation (523-2) for periodically reconfirming the eye presence may be performed. For example, the reconfirmation may be performed at specific intervals. For example, even when the wearable electronic device changes from a sleep state to a use state, the operation (523-2) for periodically reconfirming the eye presence may be performed.

[0166] In one embodiment, if the presence of an eyeball is detected, a second lens assembly combination determination operation (533) may be performed. For example, the second lens assembly combination determination operation (533) may be substantially the same as the second lens assembly combination determination operation (511) of FIG. 10A. If the second lens assembly is determined not to be combined, a main UX display operation (534) may be performed. The main UX may refer to a screen displayed in a general usage situation.

[0167] In one embodiment, when it is determined that the second lens assembly is coupled, an operation (522) for displaying information on a screen for the second lens assembly and an operation (524) for obtaining information on the second lens assembly may be performed. After the operation (524) for obtaining information on the second lens assembly, an operation (525) for storing information on the second lens assembly may be performed. When the operation (525) for storing information on the second lens assembly is completed, a main UX display operation (534) may be performed. In one embodiment, in the main UX display operation (534), the processor may be configured to display different main UXs when it is determined that the second lens assembly is coupled (e.g., Y of operation 533) and when it is determined that the second lens assembly is not coupled (e.g., N of operation 533). However, this is exemplary, and the same main UX may be displayed in both cases.

[0168] In one embodiment, a computer program may be stored in a computer-readable recording medium to execute the control method (510, 520, 530) of the wearable electronic device described above in combination with hardware. FIGS. 10A to 10C are examples for explaining the control method (510, 520, 530) of the wearable electronic device, and the order of the control method (510, 520, 530) of the wearable electronic device is not limited to that illustrated in the drawings. In addition, each operation of the control method (510, 520, 530) of the wearable electronic device in FIGS. 10A to 10C may be combined with each other within a range that does not contradict each other.

[0169] FIG. 11A is an exploded perspective view of a display assembly, an adapter, and a second lens assembly according to one embodiment. FIG. 11B is a combined perspective view of the display assembly, an adapter, and a second lens assembly according to one embodiment.

[0170] Referring to FIGS. 11A and 11B, the second lens assembly (330) can be coupled to the display assembly (300) (or the first lens assembly (320)) via an adapter (360). For example, when it is difficult for the second lens assembly (330) to be directly coupled to the display assembly (300) (or the first lens assembly (320)) (e.g., when the form factors of the first lens assembly (320) and the second lens assembly (330) are different), the second lens assembly (330) can be coupled to the display assembly (300) (or the first lens assembly (320)) via an adapter (360). For example, the adapter (360) can be positioned between the first lens assembly (320) and the second lens assembly (330). For example, the upper part of the adapter (360) may be configured to be coupled with the second lens assembly (330), and the lower part of the adapter (360) may be configured to be coupled with the first lens assembly (320). For example, the upper diameter of the adapter (360) may correspond to the diameter of the second lens assembly (330), and the lower diameter of the adapter (360) may correspond to the diameter of the first lens assembly (320). The adapter (360) may be coupled to the first lens assembly (320) and / or the second lens assembly (330) using a mechanical coupling structure and / or a magnetic coupling structure. Even when the second lens assembly (330) is coupled to the display assembly (300) (or the first lens assembly (320)) via the adapter (360), the method of acquiring and using information about the second lens assembly (330) described above may be equally applied.

[0171] In one embodiment, the manner in which the second lens assembly (330) is coupled to the display assembly (300) (or the first lens assembly (320)) may not be limited to the manner described above. For example, the second lens assembly (330) may include at least one protrusion (not shown) for coupling to the display assembly (300) (or the first lens assembly (320)). For example, the protrusion may protrude radially from the outer surface of the second lens assembly (330). For example, a plurality of protrusions may be provided, and the plurality of protrusions may be arranged at a specified interval on the outer surface of the second lens assembly (330). For example, the display assembly (300) or the first lens assembly (320) may have a recessed portion formed at a position corresponding to the protrusion. The height at which the protrusion protrudes from the outer surface of the second lens assembly (330) may be changeable. For example, the protrusion may be connected to an elastic member so that the protrusion height may be adjusted. For example, the height of the protrusion can be varied depending on the width of the area where the second lens assembly (330) is coupled to the display assembly (300) (or the first lens assembly (320)). With this structure, second lens assemblies (330) having various sizes can be easily coupled to the display assembly (300) (or the first lens assembly (320)). However, this is merely exemplary, and the structure of the protrusion described above may also be formed in the display assembly (300) or the first lens assembly (320).

[0172] In one embodiment, the height at which the first lens assembly (320) and the second lens assembly (330) are coupled to each other can be adjusted using the above-described adapter (360) and / or the protrusion. For example, the distance in the focal direction between the first lens assembly (320) and the second lens assembly (330) can be adjusted using the above-described adapter (360) and / or the protrusion when the first lens assembly (320) and the second lens assembly (330) are coupled to each other. With this structure, the focus of the lens assembly formed by the first lens assembly (320) and the second lens assembly (330) can be adjusted using the above-described adapter (360) and / or the protrusion.

[0173] Fig. 12a is a perspective view showing a portion of the second lens assembly. Fig. 12b is an exploded perspective view of the shielding case and magnet.

[0174] Referring to FIGS. 12A and 12B , in one embodiment, the magnet (334) may be provided in the second lens assembly (330) while being accommodated in a shielding case (335). For example, the magnet (334) may be embedded in the second barrel (331) while being accommodated in the shielding case (335). The shielding case (335) may have at least one open side or may have all sides closed. For example, the shielding case (335) may be formed of a metal material (e.g., stainless steel) to enable magnetic shielding. When the magnet (334) is provided in the second lens assembly (330) while being accommodated in the shielding case (335), even if the magnet (334) is positioned adjacent to the second metal loop (3332), the magnetic force generated from the magnet (334) can be reduced from affecting the second metal loop (3332). According to this structure, even if the magnet (334) is positioned adjacent to the second communication module (333), deterioration of the communication performance of the second communication module (333) due to the magnetic force of the magnet (334) can be prevented or reduced.

[0175] The technical problems to be achieved in the present disclosure are not limited to the technical problems mentioned above, and other technical problems not mentioned will be clearly understood by a person having ordinary knowledge in the technical field to which the present disclosure pertains.

[0176] In one embodiment, a wearable electronic device (200) may include a housing (210) configured to be worn on a user's head, a display panel (310) provided in the housing (210), a first lens assembly (320) provided in the housing (210) and positioned in a first direction with respect to the display panel (310), an infrared light source (340) that irradiates infrared rays to the outside through the first lens assembly (320), a camera (350) that captures an external image through the first lens assembly (320), a second lens assembly (330) that is configured to be detachably attached to the first lens assembly (320) so as to be positioned in the first direction with respect to the first lens assembly (320), and a processor (120) configured to control at least a part of an operation of the wearable electronic device (200). The first lens assembly (320) may include a first barrel (321), at least one first lens (322) provided in the first barrel (321), and a first communication module (323) provided in the first barrel (321). The second lens assembly (330) may include a second barrel (331) configured to be connectable with the first barrel (321), at least one second lens (332) provided in the second barrel (331), and a second communication module (333) configured to transmit information about the second lens assembly (330), including a diopter or refractive index of the at least one second lens (332), to the first communication module (323) when the second lens assembly (330) is connected to the first lens assembly (320). The processor (120) may be configured to correct an image captured by the camera (350) using information about the second lens assembly (330) when the second lens assembly (330) is coupled to the first lens assembly (320).

[0177] In one embodiment, the processor (120) may be configured to correct an image captured by the camera (350) according to a diopter or refractive index of the at least one second lens (332) based on a predefined correction table.

[0178] In one embodiment, the processor (120) may be configured to receive or update the correction table from an external server.

[0179] In one embodiment, the information about the second lens assembly (330) may further include at least one of manufacturer information, serial information, and version information of the second lens assembly (330).

[0180] In one embodiment, the processor (120) may be configured to adjust the intensity of light generated from the display panel (310) or the infrared light source (340) using information about the second lens assembly (330) when the second lens assembly (330) is coupled to the first lens assembly (320).

[0181] In one embodiment, the processor (120) may be configured to use information about the second lens assembly (330) to determine at least one of the lifespan of the second lens assembly (330), replacement time, whether it is broken, and whether it is properly coupled.

[0182] In one embodiment, the processor (120) may be configured to estimate information about the second lens assembly (330) by comparing pre-stored data with an actual captured image, and to compare the estimated information about the second lens assembly (330) with actually received information about the second lens assembly (330) to determine whether the second lens assembly (330) is damaged or properly coupled.

[0183] In one embodiment, the first communication module (323) and the second communication module (333) may be configured to communicate in an RFID or NFC manner.

[0184] In one embodiment, each of the first communication module (323) and the second communication module (333) may include a printed circuit board (3231, 3331), a metal loop (3232, 3332) positioned on the printed circuit board (3231, 3331), and an IC chip (3233, 3333) electrically connected to the metal loop (3232, 3332).

[0185] In one embodiment, the second communication module (333) may be embedded inside the second barrel (331).

[0186] In one embodiment, the second lens assembly (330) may be for correcting the user's eyesight.

[0187] In one embodiment, the first lens assembly (320) and the second lens assembly (330) can be attached to each other magnetically.

[0188] In one embodiment, the first barrel (321) and the second barrel (331) may include a fastening protrusion (3211) or a fastening groove (3311) for aligning the coupling positions of the first lens assembly (320) and the second lens assembly (330).

[0189] In one embodiment, when the fastening protrusion (3211) and the fastening groove (3311) are coupled to each other, the relative shapes of the first communication module (323) and the second communication module (333) can be aligned with each other.

[0190] In one embodiment, the second lens assembly (330) may be formed asymmetrically left and right.

[0191] In one embodiment, a wearable electronic device (200) may include a housing (210) configured to be wearable on a user's head, a display panel (310) provided in the housing (210), a first lens assembly (320) provided in the housing (210), positioned in a first direction with respect to the display panel (310), and including a first communication module (323), an infrared light source (340) that irradiates infrared rays to the outside through the first lens assembly (320), a camera (350) that captures an image of the outside through the first lens assembly (320), and a processor (120) configured to control at least a part of an operation of the wearable electronic device (200). When the second lens assembly (330) is coupled to the portion of the first lens assembly (320) facing the first direction, the first communication module (323) may be configured to receive information about the second lens assembly (330) from the second communication module (333) provided in the second lens assembly (330). When the second lens assembly (330) is coupled to the first lens assembly (320), the processor (120) may be configured to correct an image captured by the camera (350) using information about the second lens assembly (330).

[0192] In one embodiment, the information about the second lens assembly (330) may include the diopter or refractive index of the lens (332) provided in the second lens assembly (330).

[0193] In one embodiment, the processor (120) may be configured to correct an image captured by the camera (350) according to a diopter or refractive index of a lens (332) provided in the second lens assembly (330) based on a predefined correction table.

[0194] In one embodiment, the processor (120) may be configured to receive or update the correction table from an external server.

[0195] In one embodiment, the first lens assembly (320) may include a fastening protrusion (3211) or a fastening groove (3311) for aligning the coupling position of the second lens assembly (330).

[0196] In one embodiment, a method for controlling a wearable electronic device may include an operation of attaching a second lens assembly to a first lens assembly of the wearable electronic device, an operation of a first communication module of the first lens assembly receiving information about the second lens assembly from a second communication module of the second lens assembly, and an operation of a processor of the wearable electronic device controlling the wearable electronic device using the information about the second lens assembly.

[0197] In one embodiment, the information about the second lens assembly may include a diopter or refractive index of a lens of the second lens assembly.

[0198] In one embodiment, the operation of controlling the wearable electronic device using information about the second lens assembly may include an operation of correcting an image captured by a camera built into the first lens assembly using information about the second lens assembly.

[0199] In one embodiment, the operation of correcting the image may be an operation configured to correct an image captured by the camera according to a diopter or refractive index of a lens of the second lens assembly based on a predefined correction table.

[0200] In one embodiment, the control method of a wearable electronic device may further include an operation of receiving or updating the correction table from an external server.

[0201] In one embodiment, the information about the second lens assembly may include at least one of manufacturer information, serial information, and version information of the second lens assembly.

[0202] In one embodiment, the act of controlling the wearable electronic device using information about the second lens assembly may include an act of adjusting the intensity of light generated from a display panel or an infrared light source using information about the second lens assembly.

[0203] In one embodiment, the operation of controlling the wearable electronic device using information about the second lens assembly may include an operation of determining at least one of the lifespan of the second lens assembly, replacement time, whether it is broken, and whether it is properly coupled using information about the second lens assembly.

[0204] In one embodiment, the operation of controlling the wearable electronic device using information about the second lens assembly may include an operation of comparing pre-stored data with an actual captured image to estimate information about the second lens assembly, and comparing the estimated information about the second lens assembly with actually received information about the second lens assembly to determine whether the second lens assembly is broken or properly connected.

[0205] In one embodiment, a computer program may be stored in a computer-readable recording medium to execute the control method of the wearable electronic device described above in combination with hardware.

[0206] In one embodiment, a wearable electronic device (200) configured to be worn on a user's head includes: a housing (210); a display panel (310) provided in the housing (210); a first lens assembly (320) provided in the housing (210) and positioned in a first direction with respect to the display panel (310); a second lens assembly (330) configured to be detachably attached to the wearable electronic device (200) so as to be positioned in the first direction with respect to the first lens assembly (320), the second lens assembly (330) being configured to store information on a diopter or refractive index of the second lens assembly (330); an infrared light source (340) located between the display panel (310) and the first lens assembly (320) and configured to irradiate infrared rays for eye tracking; It may include a camera (350) positioned between the display panel (310) and the first lens assembly (320) and configured to capture images for eye tracking; and a processor (120) configured to control operations of the wearable electronic device (200). While the second lens assembly (330) is coupled to the wearable electronic device (200), the processor (120) may be configured to: obtain information about the second lens assembly (330), control the infrared light source (340) to irradiate infrared rays through the first lens assembly (320) and the second lens assembly (330) for gaze tracking, control the camera (350) to capture images through the first lens assembly (320) and the second lens assembly (330) for gaze tracking, and perform gaze tracking based on the obtained information about the second lens assembly (330) and the images captured by the camera (350).

[0207] In one embodiment, the second lens assembly (330) may be configured to be detachably attached to the first lens assembly (320).

[0208] In one embodiment, the first lens assembly (320) may include a first barrel (321); at least one first lens (322) provided in the first barrel (321); and a first communication module (323) provided in the first barrel (321).

[0209] In one embodiment, the second lens assembly (330) may include a second barrel (331) configured to be coupled with the first barrel (321); at least one second lens (332) provided in the second barrel (331); and a second communication module (333) configured to transmit information about the second lens assembly (330), including a diopter or refractive index of the at least one second lens (332), to the first communication module (323) when the second lens assembly (330) is coupled to the first lens assembly (320).

[0210] In one embodiment, the second lens assembly (330) may be for correcting the user's eyesight.

[0211] In one embodiment, a wearable electronic device (200) may be configured to be worn on a user's head. The wearable electronic device (200) includes a housing (210). A display panel (310) provided in the housing (210). A first lens assembly (320) provided in the housing (210) and positioned in a first direction with respect to the display panel (310). A second lens assembly (330) configured to be detachably attached to the wearable electronic device (200) so as to be positioned in the first direction with respect to the first lens assembly (320), wherein the second lens assembly (330) is configured to store information on a diopter or refractive index of the second lens assembly (330). An infrared light source (340) located between the display panel (310) and the first lens assembly (320) and configured to irradiate infrared rays for gaze tracking. A camera (350) positioned between the display panel (310) and the first lens assembly (320) and configured to capture images for eye tracking; and a processor (120) configured to control operations of the wearable electronic device (200). While the second lens assembly (330) is coupled to the wearable electronic device (200), the processor (120) may be configured to: check whether communication with the second lens assembly (330) is established, and if communication with the second lens assembly (330) is not established, recognize an identifier included in the second lens assembly (330) with the camera (350), analyze an eye image of the user with the camera (350), or provide a manual input mode to the user.

[0212] As used herein, the term "if" will be understood to mean "when, upon," "in response to determining," or "in response to detecting," depending on the context. Similarly, "if it is determined to," or "if [the stated condition or event] is detected," will optionally be understood to mean "upon determining," or "in response to determining," "upon detecting [the stated condition or event]," or "in response to detecting [the stated condition or event]."

[0213] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. A processing device (or processing circuit) may execute an operating system (OS) and one or more software applications running on the operating system. In addition, the processing device may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0214] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0215] According to one embodiment, the method may be implemented in the form of program instructions that can be executed by various computer means and recorded on a computer-readable medium. The medium may continuously store a computer-executable program or temporarily store it for execution or download. Furthermore, the medium may be a variety of recording or storage means in the form of a single or multiple hardware devices combined. It is not limited to media directly connected to a computer system, but may also be distributed across a network.

[0216] Although the embodiments have been described with limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above teachings. For example, appropriate results can be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents. Therefore, other implementations, other embodiments, and equivalents of the claims also fall within the scope of the claims described below.

Claims

1. In a wearable electronic device (200), A housing (210) configured to be worn on a user's head; A display panel (310) provided in the above housing (210); A first lens assembly (320) provided in the housing (210) and positioned in a first direction with respect to the display panel (310); An infrared light source (340) that irradiates infrared rays to the outside through the first lens assembly (320); A camera (350) that captures an external image through the first lens assembly (320); A second lens assembly (330) configured to be detachably attached to the first lens assembly (320) so as to be positioned in the first direction with respect to the first lens assembly (320); and A processor (120) configured to control at least a part of the operation of the wearable electronic device (200), The above first lens assembly (320) is 1st barrel (321); At least one first lens (322) provided in the first barrel (321); and Includes a first communication module (323) provided in the first barrel (321), The above second lens assembly (330) is A second barrel (331) configured to be connectable with the first barrel (321); At least one second lens (332) provided in the second barrel (331); and A second communication module (333) configured to transmit information about the second lens assembly (330), including a diopter or refractive index of the at least one second lens (332), to the first communication module (323) while the second lens assembly (330) is coupled to the first lens assembly (320). A wearable electronic device (200) in which the processor (120) is configured to correct an image captured by the camera (350) using information about the second lens assembly (330) when the second lens assembly (330) is coupled to the first lens assembly (320).

2. In paragraph 1, A wearable electronic device (200), wherein the processor (120) is configured to correct an image captured by the camera (350) according to a diopter or refractive index of the at least one second lens (332) based on a predefined correction table.

3. In paragraph 1 or 2, A wearable electronic device (200) wherein the processor (120) is configured to receive or update the correction table from an external server.

4. In any one of paragraphs 1 to 3, A wearable electronic device (200), wherein the information about the second lens assembly (330) further includes at least one of manufacturer information, serial information, and version information of the second lens assembly (330).

5. In any one of paragraphs 1 to 4, A wearable electronic device (200) in which the processor (120) is configured to adjust the intensity of light generated from the display panel (310) or the infrared light source (340) by using information about the second lens assembly (330) when the second lens assembly (330) is coupled to the first lens assembly (320).

6. In any one of paragraphs 1 to 5, A wearable electronic device (200) in which the processor (120) is configured to determine at least one of the lifespan, replacement time, damage, and correct positioning of the second lens assembly (330) using information about the second lens assembly (330).

7. In any one of paragraphs 1 to 6, A wearable electronic device (200) configured such that the processor (120) estimates information about the second lens assembly (330) by comparing pre-stored data with an actual captured image, and compares the estimated information about the second lens assembly (330) with actually received information about the second lens assembly (330) to determine whether the second lens assembly (330) is damaged or properly connected.

8. In any one of paragraphs 1 to 7, A wearable electronic device (200) in which the first communication module (323) and the second communication module (333) are configured to communicate in an RFID or NFC manner.

9. In any one of paragraphs 1 to 8, Each of the first communication module (323) and the second communication module (333) Printed circuit board (3231; 3331); A metal loop (3232; 3332) positioned on the printed circuit board (3231; 3331); and A wearable electronic device (200) comprising an IC chip (3233; 3333) electrically connected to the metal loop (3232; 3332).

10. In any one of paragraphs 1 to 9, The second communication module (333) is a wearable electronic device (200) embedded inside the second barrel (331).

11. In any one of paragraphs 1 to 10, The second lens assembly (330) is a wearable electronic device (200) for correcting the user's eyesight.

12. In any one of paragraphs 1 to 11, A wearable electronic device (200) in which the first lens assembly (320) and the second lens assembly (330) are attached to each other by magnetic force.

13. In any one of paragraphs 1 to 12, A wearable electronic device (200), wherein the first barrel (321) and the second barrel (331) include a fastening protrusion (3211) or a fastening groove (3311) for aligning the coupling positions of the first lens assembly (320) and the second lens assembly (330).

14. In any one of paragraphs 1 to 13, A wearable electronic device (200) in which the relative shapes of the first communication module (323) and the second communication module (333) are aligned with each other while the above-mentioned fastening protrusion (3211) and the above-mentioned fastening groove (3311) are coupled to each other.

15. In any one of paragraphs 1 to 14, The above second lens assembly (330) is formed asymmetrically left and right, wearable electronic device (200).

Images