Wearable electronic device comprising infrared light receiver

Abstract

A wearable electronic device, according to one embodiment of the present disclosure, may be configured to be worn on the head of a user and may comprise: a display module; a plurality of infrared light emitters; an infrared light receiver; an eye tracking camera; at least one processor; and a memory storing instructions, wherein the instructions may, when executed by the at least one processor, instruct the wearable electronic device to: detect, via the infrared light receiver, an amount of reflected infrared light emitted from the infrared light emitters; and when the amount of reflected light detected via the infrared light receiver is greater than a reference value, acquire, via the eye tracking camera, an image corresponding to an eye of the user.

Description

Wearable electronic device including an infrared photodetector

[0001] Various embodiments disclosed in this document relate to wearable electronic devices, for example, to wearable electronic devices including an infrared photodetector.

[0002] With the advancement of electronics, information, and communication technologies, a variety of functions are being integrated into a single electronic device. For example, electronic devices (e.g., smartphones) incorporate functions such as audio playback, imaging, and electronic notebooks in addition to communication functions. Furthermore, smartphones can be equipped with even more diverse functions through the installation of additional applications. In addition to executing pre-installed applications or stored functions, electronic devices can also access servers or other electronic devices via wired or wireless means to receive a variety of information in real time.

[0003] As the use of electronic devices becomes more commonplace, user demands for portability and usability may increase. In response to this demand, electronic devices that can be worn on the body (hereinafter referred to as "wearable electronic devices"), similar to wristwatches or glasses, have become commercially available. Examples of wearable electronic devices include head-mounted wearable devices (HMDs), smart glasses, smart watches (or bands), contact lens-type devices, ring-type devices, or clothing / shoe / glove-type devices. These body-worn electronic devices are easy to carry and can improve user accessibility. A "head-mounted wearable device" is a device worn on the user's head or face that projects images onto the user's retina, allowing the user to view virtual images in three-dimensional space. For example, head-mounted wearable devices can be divided into see-through types that provide augmented reality (AR) and see-closed types that provide virtual reality (VR). A see-through type head-mounted wearable device can be implemented in the form of glasses, for example, and can provide information about buildings or objects in the user's field of vision in the form of images or text to the user. A see-closed type head-mounted wearable device can output independent images to both eyes of the user, and can provide an excellent sense of immersion by outputting content (games, movies, streaming, or broadcasting) provided from a mobile communication terminal or an external input in the form of images or audio to the user or individual wearing the device.Additionally, head-mounted wearable devices may be used to provide mixed reality (MR) or extended reality (XR), which are a combination of augmented reality (AR) and virtual reality (VR).

[0004] The above information may be provided as background information to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0005] A wearable electronic device according to one embodiment of the present disclosure may be configured to be mounted on a user's head and may include a lens frame having a lens disposed thereon, a display module configured to display visual information to the user through the lens, a plurality of infrared emitters disposed around the lens and configured to radiate infrared light toward the user, an infrared receiver disposed around the lens and configured to recognize an amount of reflected light of the infrared light reflected by the user, an eye-tracking camera disposed around the lens and configured to capture an image corresponding to an eye of the user, at least one processor, and a memory storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor, cause the wearable electronic device to control at least one infrared emitter among the plurality of infrared emitters to radiate infrared light in a state in which the eye-tracking camera is deactivated, recognize an amount of reflected light of infrared light radiated from the at least one infrared emitter using the infrared receiver, and activate the eye-tracking camera to acquire an image corresponding to an eye of the user based on recognizing that the amount of reflected light is greater than a reference value, and to capture the image corresponding to the eye of the user by activating the plurality of infrared emitters. At least one infrared light emitter among the light emitters can be controlled to radiate infrared light, and based on an image acquired by the activated gaze tracking camera, it can be determined whether the wearable electronic device is worn by the user.

[0006] According to one embodiment of the present disclosure, a wearable electronic device includes a display module, a plurality of infrared emitters, an infrared receiver, at least one processor, and a memory storing instructions, wherein the instructions, when executed by the at least one processor, cause the wearable electronic device to recognize an amount of reflected light of infrared ray radiated from the infrared emitter using the infrared receiver, and display visual information through the display module when the amount of reflected light recognized using the infrared receiver is greater than a reference value.

[0007] FIG. 1 is a block diagram illustrating an electronic device within a network environment according to one embodiment of the present disclosure.

[0008] FIG. 2 is a diagram schematically illustrating a usage pattern of a wearable electronic device according to one embodiment of the present disclosure.

[0009] FIG. 3 is a perspective view of a wearable electronic device showing a front side of the wearable electronic device according to one embodiment of the present disclosure.

[0010] FIG. 4 is a perspective view of a wearable electronic device showing a rear side of the wearable electronic device according to one embodiment of the present disclosure.

[0011] FIG. 5 is an exploded perspective view of a lens module of a wearable electronic device according to one embodiment of the present disclosure.

[0012] FIG. 6 is a block diagram of a portion of a wearable electronic device according to one embodiment of the present disclosure.

[0013] FIG. 7 is a flowchart illustrating a method for determining whether a wearable electronic device is worn using an infrared light receiver, according to one embodiment of the present disclosure.

[0014] FIG. 8 is a flowchart illustrating a method for determining whether a wearable electronic device is worn using an infrared photodetector and an eye tracking camera according to one embodiment of the present disclosure.

[0015] FIG. 9 is a flowchart illustrating a method for disabling a wearable electronic device using a gaze tracking camera and an infrared photodetector according to one embodiment of the present disclosure.

[0016] FIG. 10 is a flowchart illustrating an operation of activating an external display when a wearable electronic device is deactivated, according to one embodiment of the present disclosure.

[0017] FIG. 11 illustrates a display screen provided to a user through a display module when iris recognition is performed in an activated state of a wearable electronic device according to one embodiment of the present disclosure.

[0018] FIG. 12 illustrates a display screen provided to a user through a display module in an activation operation of a wearable electronic device according to one embodiment of the present disclosure.

[0019] FIG. 13 illustrates a display screen provided to a user through a display module when a correct wearing notification is provided in an activation operation of a wearable electronic device according to one embodiment of the present disclosure.

[0020] FIG. 14 illustrates a display screen provided to a user through a display module when adjusting the distance between pupils in an activation operation of a wearable electronic device according to one embodiment of the present disclosure.

[0021] FIG. 15 is an exploded perspective view of a lens module of a wearable electronic device according to one embodiment of the present disclosure.

[0022] FIG. 16 illustrates a top view of a lens according to one embodiment of the present disclosure.

[0023] FIG. 17 is a cross-sectional view of a portion of a wearable electronic device according to one embodiment of the present disclosure taken along the DD' cut line illustrated in FIG. 16.

[0024] FIG. 18 is a cross-sectional view of a portion of a wearable electronic device according to one embodiment of the present disclosure taken along the EE' cut line illustrated in FIG. 16.

[0025] FIG. 19 is an enlarged view of part A of FIG. 18, showing an infrared receiver and a partition wall according to one embodiment of the present disclosure.

[0026] FIG. 20 is a perspective view of a portion of a wearable electronic device illustrating a substrate according to one embodiment of the present disclosure.

[0027] FIG. 21 is a perspective view of a portion of a wearable electronic device illustrating a substrate according to one embodiment of the present disclosure.

[0028] FIG. 22 is a perspective view of a portion of a wearable electronic device illustrating a substrate according to one embodiment of the present disclosure.

[0029] FIGS. 23 to 27 are schematic diagrams of a portion of a wearable electronic device illustrating the positional relationship between an infrared emitter, an infrared receiver, and an eye tracking camera according to various embodiments of the present disclosure.

[0030] FIG. 28 is a perspective view of a wearable electronic device according to one embodiment of the present disclosure.

[0031] FIG. 29 is a perspective view illustrating an internal configuration of a wearable electronic device according to one embodiment of the present disclosure.

[0032] FIG. 30 is an exploded perspective view of a wearable electronic device according to one embodiment of the present disclosure.

[0033] FIG. 31 is a perspective view of a wearable electronic device schematically illustrating the wearable electronic device according to one embodiment of the present disclosure.

[0034] FIG. 32 is an exploded perspective view of a portion of a wearable electronic device schematically illustrating the wearable electronic device.

[0035] The following description of the accompanying drawings may provide an understanding of various exemplary implementations of the present disclosure, including the claims and their equivalents. While the exemplary embodiments disclosed in the following description include numerous specific details to aid understanding, they are to be considered as one example of various exemplary embodiments. Accordingly, those skilled in the art will appreciate that various modifications and variations of the various implementations described herein may be made without departing from the scope and spirit of the disclosure. Furthermore, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0036] The terms and words used in the following description and claims are not limited to their reference meanings and can be used to clearly and consistently describe one embodiment of the present disclosure. Therefore, it will be apparent to those skilled in the art that the following description of various implementations of the disclosure is provided for illustrative purposes, not for the purpose of limiting the scope of the disclosure and its equivalents.

[0037] Unless the context clearly dictates otherwise, the singular forms of "a," "an," and "the" should be understood to include plural meanings. Thus, for example, "a component surface" could be understood to include one or more of the surfaces of the component.

[0038] The various embodiments and terminology used in this document are not intended to limit the technical features described in this document to specific embodiments, but should be understood to encompass various modifications, equivalents, or alternatives of the embodiments. In connection with the description of the drawings, similar reference numerals may be used to refer to similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise.

[0039] In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof.

[0040] Terms such as "first," "second," or "first" or "second" may be used simply to distinguish one component from another, and do not qualify the components in any other respect (e.g., importance or order).

[0041] When a component (e.g., a first component) is referred to as being “coupled” or “connected” to another component (e.g., a second component), with or without the terms “functionally” or “communicatively,” it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0042] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to one embodiment of the present disclosure. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In one embodiment, the electronic device (101) may have at least one of these components (e.g., the connection terminal (178)) omitted, or one or more other components added. In one embodiment, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0043] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor), or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0044] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0045] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0046] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0047] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0048] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0049] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0050] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0051] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0052] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) to an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0053] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0054] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0055] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0056] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0057] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0058] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0059] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0060] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In one embodiment, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0061] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0062] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0063] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0064] For convenience of explanation, FIGS. 2 to 5 and 15 to 32 illustrate coordinate axes defined with respect to a user when the user wears a wearable electronic device (300) according to an embodiment of the present disclosure. The coordinate axes defined with respect to the user may include at least one of front (F), back (B), upward (U), downward (D), left (L), and right (R). Hereinafter, the embodiments of the present disclosure will be described with reference to the coordinate axes defined with respect to the user.

[0065] FIG. 2 is a drawing schematically showing a usage appearance of a wearable electronic device (300) according to one embodiment of the present disclosure, showing the wearable electronic device (300) positioned in front of a user.

[0066] Referring to FIG. 2, a wearable electronic device (300) (e.g., electronic device (101) of FIG. 1) may be configured to be worn (or mounted) on a user's head or face. The user may visually recognize surrounding objects or environments while wearing the wearable electronic device (300). The wearable electronic device (300) may obtain and / or recognize visual images of objects or environments in the direction the user is looking or objects or environments in the direction toward which the wearable electronic device (300) is directed using a camera module (e.g., camera modules (311, 312, 313, 314, 315, 316) of FIGS. 3 and 4), and may receive information about objects or environments from an external electronic device (e.g., electronic devices (102, 104) of FIG. 1) through a network (e.g., networks (198, 199) of FIG. 1).

[0067] According to one embodiment of the present disclosure, the wearable electronic device (300) can provide information about a provided object or environment to the user in an acoustic or visual form. For example, the wearable electronic device (300) can provide information about a provided object or environment to the user in a visual form by using a display member such as a display module. By implementing information about an object or environment in a visual form and combining it with an actual image (or video) of the user's surrounding environment, the wearable electronic device (300) can implement augmented reality (AR), virtual reality (VR), mixed reality (MR), and / or extended reality (XR). The display member can provide the user with information about the surrounding objects or environment by outputting a screen in which an augmented reality object is added to an actual image (or video) of the user's surrounding environment.

[0068] According to one embodiment of the present disclosure, all or part of the operations executed by the electronic device (101) or the wearable electronic device (300) may be executed by one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) or the wearable electronic device (300) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) or the wearable electronic device (300) may, instead of executing the function or service on its own or in addition, request one or more external electronic devices to execute at least a part of the function or service. The one or more external electronic devices that receive the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101) or the wearable electronic device (300). The electronic device (101) or the wearable electronic device (300) may provide the result as is or additionally processed as at least a part of the response to the request. For example, the external electronic device (102) may render content data executed in an application and then transmit it to the electronic device (101) or the wearable electronic device (300), and the electronic device (101) or the wearable electronic device (300) that has received the data may output the content data to a display module. When the electronic device (101) or the wearable electronic device (300) detects user movement through a sensor(s) such as an inertial measurement unit sensor, the processor (e.g., the processor (120) of FIG. 1) of the electronic device (101) or the wearable electronic device (300) may correct the rendering data received from the external electronic device (102) based on the movement information and output the corrected data to the display module.Or, when a user movement is detected through a sensor(s), a processor (e.g., processor (120) of FIG. 1) of the electronic device (101) or wearable electronic device (300) may transmit the movement information to an external electronic device (102) to request rendering so that screen data is updated accordingly. According to various embodiments, the external electronic device (102) may be a device of various forms, such as a case device capable of storing and charging the electronic device (101) or wearable electronic device (300).

[0069] In the detailed description below, various references may be made to "a state or position in which a wearable electronic device or a designated component of the wearable electronic device faces the user's face," and it should be noted that this is based on the assumption that the user is wearing the wearable electronic device (300).

[0070] According to one embodiment of the present disclosure, a wearable electronic device (300) may include at least one display member and a wearing member (e.g., a temple). Depending on the structure of the display member, the wearable electronic device (300) may include a structure (e.g., a lens frame (410) of FIG. 5) for mounting or supporting the display member. The display members may be provided as a pair including a first display member and a second display member, so that the display members may be positioned to correspond to the user's right and left eyes, respectively, when the wearable electronic device (300) is worn on the user's body.

[0071] According to one embodiment of the present disclosure, a display member is a configuration provided to provide visual information to a user, and may include, for example, a display (D), a plurality of lenses (L) (e.g., a lens assembly), and / or at least one sensor. Here, the lens assembly and the display (D) may each be formed transparently or translucently. However, the display member is not limited thereto. In one embodiment, the display member may include a window member, and the window member may be a translucent glass or a member whose light transmittance can be adjusted by adjusting the tinting density. In one embodiment, the display member may include a lens including a waveguide or a reflective lens, and an image output from an optical output device (e.g., a projector or the display (D)) is formed on each lens, thereby providing visual information to the user. For example, the display member may include a waveguide (e.g., a light waveguide) in at least a portion of each lens, and may mean a display that transmits an image (or light) output from an optical output device, such as a display (D), to the user's eyes through the waveguide included in the display member, and at the same time transmits the real world to the user's eyes through that area in a see-through manner. In one embodiment, the waveguide may be understood as a part of a lens assembly. The lens assembly may be a configuration including a plurality of lenses (L1, L2, L3, L4), and may be arranged in a state aligned with the optical axis (O) (e.g., the lens axis (LA) of FIGS. 20 to 22) in a space within the wearable electronic device (300).

[0072] FIG. 3 is a perspective view of a wearable electronic device (300) showing a front side (310) of the wearable electronic device (300) according to one embodiment of the present disclosure, illustrating a view of the wearable electronic device (300) as viewed from the front. FIG. 4 is a perspective view of a wearable electronic device (300) showing a rear side (330) of the wearable electronic device (300) according to one embodiment of the present disclosure, illustrating a view of the wearable electronic device (300) as viewed from the rear.

[0073] Referring to FIGS. 3 and 4 , a wearable electronic device (300) according to one embodiment of the present disclosure may include a housing (301) forming an exterior. The housing (301) may be visually exposed to the outside. Electronic components for the operation of the wearable electronic device (300) may be arranged inside the housing (301). One side of the housing (301) facing the front (F) may be referred to as the front side (310) (or first side) of the wearable electronic device (300). One side of the housing (301) facing the rear (B) may be referred to as the rear side (330) (or second side) of the wearable electronic device (300).

[0074] According to one embodiment of the present disclosure, camera modules (311, 312, 313, 314, 315, 316) and / or a depth sensor (317) for obtaining information related to the surrounding environment of the wearable electronic device (300) may be arranged on the front (or first side) (310) of the wearable electronic device (300).

[0075] According to one embodiment of the present disclosure, an external display (ED) (e.g., a display module (160) of FIG. 1) may be disposed on the front surface (310) of a wearable electronic device (300). The wearable electronic device (300) may display an image to the front surface (F) through the external display (ED). As an example, even if a user does not wear the wearable electronic device (300), the user may view images and / or videos through the external display (ED).

[0076] According to one embodiment of the present disclosure, the first camera modules (311, 312) can acquire images related to the surrounding environment of the wearable electronic device (300). The second camera modules (313, 314, 315, 316) can acquire images when the wearable electronic device (300) is worn by a user. The second camera modules (313, 314, 315, 316) can be used for hand detection, tracking, and recognition of user gestures (e.g., hand movements). The second camera modules (313, 314, 315, 316) can be used for 3DoF (degrees of freedom), 6DoF head tracking, position (spatial, environmental) recognition, and / or movement recognition. In one embodiment, the first camera modules (311, 312) may be used for hand detection and tracking or to recognize or detect user gestures.

[0077] According to one embodiment of the present disclosure, the depth sensor (317) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for purposes such as time of flight (TOF) to determine the distance to an object. Instead of or in addition to the depth sensor (317), the second camera modules (313, 314, 315, 316) may determine the distance to an object.

[0078] According to one embodiment of the present disclosure, a third camera module (335, 336) and / or a lens module (321, 322) may be disposed on a second side (or rear side) (330) of a wearable electronic device (300). The lens module (321, 322) may be referred to as a lens assembly (321, 322). The third camera module (335, 336) disposed on the second side (330) of the wearable electronic device (300) may be used to recognize a user's face, or may recognize (e.g., iris recognition) and / or track (e.g., gaze tracking) both eyes of the user.

[0079] According to one embodiment of the present disclosure, the lens modules (321, 322) may be disposed on the second side (330) of the wearable electronic device (300). The lens modules (321, 322) may be at least partially similar to or substantially identical to the display (D) and / or lenses (L) illustrated in FIG. 2, to the extent that they are not disposed with each other.

[0080] For convenience of explanation, the first lens module (321) may be named a right lens module (321), and the second lens module (322) may be named a left lens module (322). Hereinafter, in the infrared light emitter (440), the infrared light receiver (450), and the gaze tracking camera (460) described with reference to FIGS. 5 to 28, the infrared light emitter arranged in the left lens module (322) may be named a left infrared light emitter, and the infrared light emitter arranged in the right lens module (321) may be named a right infrared light emitter. In addition, the infrared light receiver arranged in the left lens module (322) may be named a left infrared light receiver, and the infrared light receiver arranged in the right lens module (321) may be named a right infrared light receiver. Additionally, the gaze tracking camera placed in the left lens module (322) may be named a left gaze tracking camera, and the gaze tracking camera placed in the right lens module (321) may be named a right gaze tracking camera.

[0081] As described above, according to one embodiment, the wearable electronic device (300) may be configured to be worn on a user's head. The wearable electronic device (300) may further include a strap for being fixed on a body part of the user, and / or a wearing member (e.g., the wearing member (203) of FIG. 28). The wearable electronic device (300) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0082] FIG. 5 is an exploded perspective view of a lens module (321, 322, see FIG. 4) of a wearable electronic device (300, see FIGS. 3 and 4) according to one embodiment of the present disclosure, illustrating an infrared emitter (440) and an infrared receiver (450). The description with reference to FIGS. 5 to 27 may be applied to either one of the two lens modules (321, 322) illustrated in FIG. 4, or to each of the two lens modules (321, 322).

[0083] Referring to FIG. 5, a wearable electronic device (300) according to an embodiment of the present disclosure may include a lens frame (410). A lens (430) (e.g., lens (L) of FIG. 2) providing an optical path may be disposed on the lens frame (410). The lens frame (410) may be referred to as a lens housing. The wearable electronic device (300) may display visual information to a user by projecting the visual information to the user through the optical path of the lens (430). According to another embodiment (not shown), a display panel (not shown) may be disposed on the lens frame (410) to display visual information toward a window (420).

[0084] According to one embodiment of the present disclosure, the lens frame (410) may have a shape corresponding to the shape of the lens (430). As an example, the lens (430) and the lens frame (410) may have a cylindrical shape, and although not shown, the lens (430) and the lens frame (410) may also be designed to have a square prism shape. The lens frame (410) may be referred to as a barrel. The lens frame (410) will be described in detail below with reference to FIG. 15.

[0085] According to one embodiment of the present disclosure, a wearable electronic device (300) may include a window (420). The window (420) may be positioned to overlap a lens (430). An infrared-transmitting film (421) configured to allow infrared rays to pass through may be positioned at an edge of the window (420). The window (420) may be fixed to the lens frame (410) via an adhesive member (480). The infrared-transmitting film (421) may extend along the edge of the window (420). The infrared-transmitting film (421) may be formed of a translucent or opaque material.

[0086] According to one embodiment of the present disclosure, a wearable electronic device (300) may include a substrate (470). The substrate (470) may be disposed on a lens frame (410). The substrate (470) may be disposed closer to the user's eyes than the lens (430). As an example, the substrate (470) may be positioned at the rear (B) of the lens (430).

[0087] According to one embodiment of the present disclosure, the substrate (470) may extend along the edge of the lens (430). An infrared emitter (440), an infrared receiver (450), and / or an eye tracking camera (460) may be disposed on one side of the substrate (470) facing the user. According to another embodiment, the infrared emitter (440), the infrared receiver (450), and / or the eye tracking camera (460) may not be disposed on the substrate (470), but may be disposed on one area of ​​the lens frame (410) and may be electrically connected to the substrate (470).

[0088] According to one embodiment of the present disclosure, a wearable electronic device (300) may include an infrared emitter (440). The infrared emitter (440) may emit infrared light. As an example, the infrared emitter (440) may include an infrared light emitting diode (IRED). The wearable electronic device (300) may include a plurality of infrared emitters (440). The plurality of infrared emitters (440) may be positioned around a lens (430). The plurality of infrared emitters (440) may be arranged along an edge of the lens (430).

[0089] According to one embodiment of the present disclosure, an infrared emitter (440) may be disposed on a substrate (470) to radiate infrared rays toward a user. The infrared emitter (440) may be disposed so as to overlap an infrared-transmitting film (421) of the window (420) when viewed from above the window (420), and be covered by the infrared-transmitting film (421). When a user wears the wearable electronic device (300), at least a portion of the light radiated from the infrared emitter (440) may transmit through the window (420), be reflected by the user, and be detected (recognized) by the infrared receiver (450).

[0090] According to one embodiment of the present disclosure, a wearable electronic device (300) may include an infrared light receiver (450). The infrared light receiver (450) may acquire data corresponding to the amount of light in the infrared band. The infrared light receiver (450) may measure the amount (or intensity) of light irradiated from the infrared light emitter (440) and reflected by a user. The infrared light receiver (450) may be referred to as an infrared sensor. For example, the infrared light receiver (450) may be an infrared photodiode.

[0091] According to one embodiment of the present disclosure, the infrared light receiver (450) can detect the reflected light of infrared light irradiated from the infrared light emitter (440) through the window (420). The infrared light receiver (450) can be arranged around the lens (430). The infrared light receiver (450) can be positioned between a plurality of infrared light emitters (440). The wearable electronic device (300) can include a plurality of infrared light receivers (450). The plurality of infrared light receivers (450) can be positioned around the lens (430). As an example, the plurality of infrared light receivers (450) can be arranged at equal intervals along the edge of the lens (430). As another example, the plurality of infrared light receivers (450) can be arranged intensively in one area of ​​the edge of the lens (430).

[0092] According to one embodiment of the present disclosure, a wearable electronic device (300) may include a gaze tracking camera (460) (e.g., the third camera module (335, 336) of FIG. 4). The gaze tracking camera (460) may be located around a lens (430). The gaze tracking camera (460) may identify a cornea area and / or a pupil area of ​​a user's eye or track the user's gaze based on a change in the amount of infrared light reflected from the user's eye. In addition, the wearable electronic device (300) may determine whether the user is wearing the wearable electronic device (300) based on an image corresponding to the user's eye being acquired through the gaze tracking camera (460).

[0093] FIG. 6 is a block diagram of a portion of a wearable electronic device (300) according to one embodiment of the present disclosure.

[0094] Referring to FIG. 6, a wearable electronic device (300) (e.g., electronic device (101) of FIG. 1) according to one embodiment of the present disclosure may include at least one processor (120), a display module (160), a sensor module (176) including an infrared light receiver (450), a camera module (180) including an eye tracking camera (460), a battery (189), an infrared light emitter (440), and / or a memory (130) storing commands. The commands, when executed by the at least one processor (120), may cause the wearable electronic device (300) to perform a specific operation. For example, the commands, when executed by the at least one processor (120), may cause the wearable electronic device (300) to provide visual information to a user through the display module (160). As another example, the instructions, when executed by at least one processor (120), may cause the wearable electronic device (300) to cause the infrared receiver (450) to detect a reflection of light emitted from the infrared emitter (440).

[0095] According to one embodiment of the present disclosure, the gaze tracking camera (460) of the camera module (180) (e.g., the third camera module (335, 336) of FIG. 4) may be controlled by at least one processor (120). For example, the instructions stored in the memory (130), when executed by at least one processor (120), may cause the wearable electronic device (300) to capture (acquire) an image corresponding to the user's eyes through the gaze tracking camera (460).

[0096] According to one embodiment of the present disclosure, the infrared emitter (440) and the infrared receiver (450) may be controlled by at least one processor (120). For example, the instructions stored in the memory (130), when executed by at least one processor (120), may cause the wearable electronic device (300) to radiate infrared light through the infrared emitter (440) and detect infrared light through the infrared receiver (450). The infrared emitter (440) and the infrared receiver (450) may be placed at various locations of the wearable electronic device (300) and may be included in one module (e.g., sensor module (176)).

[0097] FIG. 7 is a flowchart illustrating a method for determining whether a wearable electronic device (300, see FIG. 6) is worn through an infrared light receiver (450, see FIG. 6), according to one embodiment of the present disclosure.

[0098] Referring to FIGS. 6 and 7, a method for determining whether a wearable electronic device (300) is worn according to an embodiment of the present disclosure may include an operation (S1) of activating an infrared light emitter (440) and an infrared light receiver (450). In the operation (S1) of activating the infrared light emitter (440) and the infrared light receiver (450), the wearable electronic device (300) may activate at least one infrared light emitter (440) among a plurality of infrared light emitters (440). The activated infrared light emitter (440) and the infrared light receiver (450) may operate at a predetermined mutually synchronized operation cycle.

[0099] According to one embodiment of the present disclosure, in the operation (S1) of activating the infrared emitter (440) and the infrared receiver (450), the activated infrared emitter (440) can irradiate infrared light toward the user. In the operation (S1) of activating the infrared emitter (440) and the infrared receiver (450), the wearable electronic device (300) can activate at least one infrared receiver (450) among a plurality of infrared receivers (450). As an example, in the operation (S1) of activating the infrared emitter (440) and the infrared receiver (450), the wearable electronic device (300) can activate the infrared emitter (440) and the infrared receiver (450) located on opposite sides with respect to the center of the lens (430, see FIG. 5).

[0100] According to one embodiment of the present disclosure, in the operation (S1) of activating the infrared emitter (440) and the infrared receiver (450), the wearable electronic device (300) may activate all or some of the plurality of infrared receivers (450). As an example, the wearable electronic device (300) may activate some of the infrared receivers (450) that are arranged at equal intervals among the plurality of infrared receivers (450). According to one embodiment of the present disclosure, the operation (S1) of activating the infrared emitter (440) and the infrared receiver (450) may be performed when the wearable electronic device (300) is in a sleep mode. The sleep mode may be a mode in which the operation of at least one processor (120) of the wearable electronic device (300) is limited and the usage of the battery (189) of the wearable electronic device (300) is reduced. As an example, in the power saving mode, the performance of at least one processor (120) may be limited.

[0101] According to one embodiment of the present disclosure, a method for determining whether a wearable electronic device (300) is worn may include an operation (S2) of measuring the amount of infrared light using an infrared light receiving body (450). The operation (S2) of measuring the amount of infrared light may be performed after the operation (S1) of activating the infrared light emitting body (440) and the infrared light receiving body (450). In the operation (S2) of measuring the amount of infrared light, the gaze tracking camera (460) may be in a deactivated state (e.g., power saving mode or OFF).

[0102] According to one embodiment of the present disclosure, in the operation (S2) of measuring the amount of infrared light, the activated infrared light receiver (450) can obtain data corresponding to the amount of infrared light. In the operation (S2) of measuring the amount of infrared light, the infrared light receiver (450) can obtain data corresponding to the intensity of the infrared light. In the operation (S2) of measuring the amount of infrared light, the infrared light receiver (450) can obtain data corresponding to the intensity of the infrared light. According to one embodiment of the present disclosure, the operation (S1) of activating the infrared light emitter (440) and the infrared light receiver (450) and the operation (S2) of measuring the amount of infrared light can be performed using only the infrared light emitter (440) and the infrared light receiver (450) included in one of the two lens modules (321, 322, see FIG. 4) corresponding to the user's two eyes (e.g., the first lens module (321) or the second lens module (322)). Through this, the power consumption of the battery (189) can be reduced.

[0103] According to one embodiment of the present disclosure, the operation (S1) of activating the infrared light emitter (440) and the infrared light receiver (450) and the operation (S2) of measuring the amount of infrared light may be performed primarily using only the infrared light emitter (440) and the infrared light receiver (450) included in one of the two lens modules (321, 322, see FIG. 4) corresponding to the user's two eyes, and then secondarily using only the infrared light emitter (440) and the infrared light receiver (450) included in the other lens module (e.g., the second lens module (322)).

[0104] According to one embodiment of the present disclosure, in the operation (S1) of activating an infrared light emitter (440) and an infrared light receiver (450) and the operation (S2) of measuring the amount of infrared light, the left infrared light emitter and the left infrared light receiver, or the right infrared light emitter and the right infrared light receiver, may be activated. Accordingly, compared to a case where the left infrared light emitter, the right infrared light emitter, the left infrared light receiver, and the right infrared light receiver are all activated, the amount of power consumed by the wearable electronic device (300) can be reduced.

[0105] According to one embodiment of the present disclosure, a method for determining whether a wearable electronic device (300) is worn may include an operation (S3) of comparing a value measured by an infrared light receiver (450) with a previously stored reference value. In the operation (S3) of comparing a measurement value (amount or intensity of infrared light) measured by the infrared light receiver (450) with a previously stored reference value, at least one processor (120) may perform a size comparison between data acquired by the infrared light receiver (450) and data (the reference value) stored in a memory (130) (e.g., a non-volatile memory (134) of FIG. 1). If the measurement value is greater than the reference value, it may be understood that the amount of infrared light reflected by the user's face is large when the user wears the wearable electronic device (300). If the above measurement value is smaller than the reference value, it can be understood that the user is not wearing the wearable electronic device (300), and this can include a case where the amount of reflected light recognized through the infrared light receiving body (450) is smaller than the reference value by the user holding the wearable electronic device (300) without wearing the wearable electronic device (300).

[0106] According to one embodiment of the present disclosure, in the operation (S1) of activating the infrared light emitter (440) and the infrared light receiver (450), if either the left infrared light receiver or the right infrared light receiver is activated, in the operation (S3) of comparing the measured value (amount or intensity of infrared light) with a pre-stored reference value, the measured value recognized through either the left infrared light receiver or the right infrared light receiver may be compared with the pre-stored reference value. Accordingly, compared to a case where both the measured value recognized through the left infrared light receiver and the measured value recognized through the right infrared light receiver are compared with the pre-stored reference value, the amount of power consumed by the wearable electronic device (300) can be reduced.

[0107] According to one embodiment of the present disclosure, in the operation (S3) of comparing the measured value (amount or intensity of infrared light) with a pre-stored reference value, if the measured value recognized through one of the infrared receivers among the left infrared receiver and the right infrared receiver is greater than the pre-stored reference value, the measured value recognized through one of the infrared receivers among the left infrared receiver and the right infrared receiver may be compared with the pre-stored reference value. Accordingly, in a case where a user does not wear the wearable electronic device (300) on his / her head but is holding a part of the wearable electronic device (300), it is possible to prevent the wearable electronic device (300) from being mistakenly recognized as being worn, and accordingly, by blocking the wearable electronic device (300) from being activated due to a mistaken recognition that the wearable electronic device (300) is being worn, the amount of power consumed by the wearable electronic device (300) can be reduced.

[0108] According to one embodiment of the present disclosure, a method for determining whether a wearable electronic device (300) is worn may include an operation (S4) of correcting an operating condition of an infrared light emitter (440) if the measured value is less than or equal to the reference value. As an example, in the operation (S4) of correcting the operating condition of the infrared light emitter (440), the operating cycle of the infrared light emitter (440) may be extended by at least one processor (120). As an example, the operating cycle of the infrared light emitter (440) may be extended from 300 ms to 700 ms. Accordingly, the power consumption of the battery (189) may be reduced. In the operation (S4) of correcting the operating condition of the infrared light emitter (440), as the operating cycle of the infrared light emitter (440) is extended, the operating cycle of the infrared light receiver (450) may be synchronized with the corrected operating cycle of the infrared light emitter (440) by at least one processor (120).

[0109] According to one embodiment of the present disclosure, a method for determining whether a wearable electronic device (300) is worn may include an operation (S5) of determining that the user is wearing the wearable electronic device (300) if the measured value is greater than the reference value. At least one processor (120) may determine that the user is wearing the wearable electronic device (300) on the body (e.g., head) if the measured value is greater than the reference value.

[0110] According to one embodiment of the present disclosure, a method for determining whether a wearable electronic device (300) is worn may include an operation of deactivating (e.g., power saving mode or OFF) an infrared light receiver (460) when it is determined by at least one processor (120) that a user is wearing the wearable electronic device (300).

[0111] According to one embodiment of the present disclosure, after the operation (S5) of determining whether the wearable electronic device (300) is worn, an operation (S6) of activating the wearable electronic device (300) may be further performed. When the wearable electronic device (300) is activated, power consumption may be higher than the limited power of the power saving mode. The operation (S6) of activating the wearable electronic device (300) may include an operation of performing a security process (e.g., iris recognition) for user identification (see FIG. 11), or an operation of providing visual information through the display module (160) (see FIGS. 12 to 14).

[0112] According to one embodiment of the present disclosure, the instructions stored in the memory (130), when executed by at least one processor (120), can cause the wearable electronic device (300) to recognize the amount of reflected light of infrared rays irradiated from the infrared emitter (440) using the infrared receiver (450), and if the amount of reflected light detected using the infrared receiver (450) (the measured value) is greater than the reference value, display visual information through the display module (160).

[0113] FIG. 8 is a flowchart illustrating a method for determining whether a wearable electronic device (300) is worn using an infrared light receiver (450) and an eye tracking camera (460) according to one embodiment of the present disclosure.

[0114] Referring to FIGS. 6 and 8, a method for determining whether a wearable electronic device (300) is worn according to one embodiment of the present disclosure may further include operations (S7, S8, S9) for determining whether the wearable electronic device (300) is worn through a gaze tracking camera (460).

[0115] According to one embodiment of the present disclosure, a method for determining whether a wearable electronic device (300) is worn may include an operation (S7) of activating a gaze tracking camera (460) if the measurement value is greater than the reference value. In the operation of activating the gaze tracking camera (460), either the left gaze tracking camera or the right gaze tracking camera may be activated, or both the left gaze tracking camera and the right gaze tracking camera may be activated.

[0116] According to one embodiment of the present disclosure, in the activation operation (S7) of the gaze tracking camera (460), the gaze tracking camera (460) may be activated based on a difference in the measurement value (the amount or intensity of infrared light) continuously detected using the infrared light receiver (450). As an example, in the activation operation (S7) of the gaze tracking camera (460), if the measurement value (the amount or intensity of infrared light) continuously detected by the infrared light receiver (450) for a predetermined period of time continuously increases, the gaze tracking camera (460) may be activated.

[0117] According to one embodiment of the present disclosure, in the activation operation (S7) of the gaze tracking camera (460), the gaze tracking camera (460) may be activated from an inactive state (e.g., a power-off state or a power-saving state) and may operate at a predetermined operating cycle (e.g., 60 FPS). In the activation operation (S7) of the gaze tracking camera (460), the operating cycle of the infrared light emitter (440) may be synchronized to correspond to the operating cycle of the gaze tracking camera (460).

[0118] According to one embodiment of the present disclosure, the operation (S1) of activating an infrared light emitter (440) and an infrared light receiver (450), the operation (S2) of measuring the amount of infrared light, the operation (S7) of activating a gaze tracking camera, and the operation (S8) of acquiring an image may be performed using only the infrared light emitter (440), the infrared light receiver (450), and the gaze tracking camera (460) included in one of the two lens modules (321, 322, see FIG. 4) corresponding to the user's two eyes (e.g., the first lens module (321) or the second lens module (322)). Through this, the power consumption of the battery (189) can be reduced.

[0119] According to one embodiment of the present disclosure, the operation (S1) of activating an infrared light emitter (440) and an infrared light receiver (450) and the operation (S2) of measuring the amount of infrared light may be performed using only the infrared light emitter (440) and the infrared light receiver (450) included in one of the two lens modules (321, 322, see FIG. 4) corresponding to the user's two eyes (e.g., the first lens module (321) or the second lens module (322)), and the operation (S7) of activating the gaze tracking camera and the operation (S8) of acquiring an image may be performed using only the infrared light emitter (440) and the gaze tracking camera (460) included in the other lens module (e.g., the second lens module (322)).

[0120] According to one embodiment of the present disclosure, a method for determining whether a wearable electronic device (300) is worn may include an operation (S8) of acquiring an image corresponding to a user's eye through a gaze tracking camera (460). In the image acquisition operation (S8), a command stored in the memory (130), when executed by at least one processor (120), may cause the wearable electronic device (300) to capture an image corresponding to the user's eye through the gaze tracking camera (460). If the left gaze tracking camera or the right gaze tracking camera is activated in the gaze tracking camera (460) activation operation (S7), an image may be acquired using the left gaze tracking camera or the right gaze tracking camera in the image acquisition operation (S8). Therefore, compared to a case where a plurality of images are acquired using the left gaze tracking camera and the right gaze tracking camera, the amount of power consumed by the wearable electronic device (300) may be reduced.

[0121] According to one embodiment of the present disclosure, a method for determining whether a wearable electronic device (300) is worn may include a pupil recognition operation (S9). In the pupil recognition operation (S9), at least one processor (120) may recognize the user's pupil from an image acquired by the gaze tracking camera (460). As an example, the user's eye may be recognized through the shape and / or size of a glint of infrared light reflected by the user's cornea. When the left gaze tracking camera or the right gaze tracking camera is activated in the gaze tracking camera (460) activation operation (S7), the pupil recognition operation (S9) may be performed based on an image acquired using the left gaze tracking camera or the right gaze tracking camera in the image acquisition operation (S8).

[0122] According to one embodiment of the present disclosure, the number of infrared light emitters (440) emitting light in the infrared light quantity measurement operation (S2) may be different from the number of infrared light emitters (440) emitting light in the image capturing operation (S8). As an example, the number of infrared light emitters (440) emitting light in the image capturing operation (S8) may be greater than the number of infrared light emitters (440) emitting light in the infrared light quantity measurement operation (S2).

[0123] According to one embodiment of the present disclosure, the brightness of the infrared light emitter (440) emitting light in the infrared light quantity measurement operation (S2) may be different from the brightness of the infrared light emitter (440) emitting light in the image capturing operation (S8). As an example, the brightness of the infrared light emitter (440) emitting light in the image capturing operation (S8) may be greater than the brightness of the infrared light emitter (440) emitting light in the infrared light quantity measurement operation (S2).

[0124] According to one embodiment of the present disclosure, when the user's pupil is recognized in the pupil recognition operation (S9), the wearable electronic device (300) can determine that the user is wearing the wearable electronic device (300) (S5). When the at least one processor (120) determines that the user is wearing the wearable electronic device (300), the at least one processor (120) can perform an operation (S6) of activating the wearable electronic device (300).

[0125] According to one embodiment of the present disclosure, when the left gaze tracking camera or the right gaze tracking camera is activated in the activation operation (S7) of the gaze tracking camera (460), both the left gaze tracking camera and the right gaze tracking camera may be activated in the activation operation (S6) of the wearable electronic device (300) performed subsequently. The method for determining whether the wearable electronic device (300) is worn, as illustrated in FIG. 8, can first determine whether the user is wearing the wearable electronic device (300) through the determination operations (S2, S3) of whether the wearable electronic device (300) is worn using an infrared light receiver (450) with relatively low power consumption, and secondarily determine whether the user is wearing the wearable electronic device (300) through the determination operations (S7, S8, S9) of whether the wearable electronic device (300) is worn using a gaze tracking camera (460) with relatively high power consumption.

[0126] Accordingly, it is possible to prevent the wearable electronic device (300) from being activated in a situation where the user does not intend to operate the wearable electronic device (300), such as when the user is holding the wearable electronic device (300) or when the wearable electronic device (300) is worn on a part of the user's body.

[0127] FIG. 9 is a flowchart illustrating a method for deactivating a wearable electronic device (300) using a gaze tracking camera (460) and an infrared light receiver (450) according to one embodiment of the present disclosure.

[0128] Referring to FIGS. 6 and 9, a method for deactivating a wearable electronic device (300) according to an embodiment of the present disclosure may be performed while the wearable electronic device (300) is activated. The method for deactivating a wearable electronic device (300) may follow an activation operation (S10) of the wearable electronic device (300). The description of the activation operation (S10) of the wearable electronic device (300) described with reference to FIGS. 7 and 8 may be substantially identically applied to the same.

[0129] According to one embodiment of the present disclosure, a method for deactivating a wearable electronic device (300) may include an operation (S11) of comparing a time during which the user's pupil is not recognized (hereinafter, pupil non-recognition time) with a reference time (reference duration). The reference time may be understood as data stored in a memory (e.g., memory (130) of FIG. 6) and pre-stored in the wearable electronic device (300).

[0130] According to one embodiment of the present disclosure, the pupil non-recognition time may refer to a duration during which the user's pupil is not recognized by the gaze tracking camera (460). As an example, the gaze tracking camera activation operation (S7), the image capture operation (S8), and the pupil recognition operation (S9) described with reference to FIG. 8 may precede the operation (S11) of comparing the pupil non-recognition time with the reference time. If the pupil non-recognition time is less than the reference time, the wearable electronic device (300) may maintain an activated state.

[0131] According to one embodiment of the present disclosure, a method for deactivating a wearable electronic device (300) may include an operation (S12) of correcting an operating condition of an infrared light emitter (440) if the pupil non-recognition time is greater than the reference time. In the operation condition correction operation (S12) of the infrared light emitter (440), the number of infrared light emitters (440) that emit light and / or the brightness of the infrared light emitter (440) may be adjusted. The description regarding the operation condition correction operation (S4) of the infrared light emitter (440) described with reference to FIGS. 7 and 8 may be substantially identically applied to the operation condition correction operation (S12) of the infrared light emitter (440) illustrated in FIGS. 9 and 10 to the extent that they are not overlapping with each other. As an example, in the infrared light emitter (440) operating condition correction operation (S12), the number of emitting infrared light emitters (440) may be reduced, and / or the brightness of the infrared light emitter (440) may be reduced, and accordingly, the power consumption of the wearable electronic device (300) may be reduced.

[0132] According to one embodiment of the present disclosure, a method for deactivating a wearable electronic device (300) may include an operation (S13) of measuring the amount of infrared light through an infrared light receiver (450) and an operation (S14) of comparing the value measured through the infrared light receiver (450) with a reference value. The description of the operation (S2) of measuring the amount of infrared light and the operation (S3) of comparing the value measured through the infrared light receiver (450) with a reference value described with reference to FIGS. 7 and 8 may be substantially equally applied to the operation (S13) of measuring the amount of infrared light and the operation (S14) of comparing the value measured through the infrared light receiver (450) with a reference value, as illustrated in FIGS. 9 and 10, to the extent that they are not overlapping with each other. According to one embodiment of the present disclosure, if the amount of infrared light measured in the infrared light amount measurement operation (S13) is greater than the reference value, the operation condition correction operation (S12) of the infrared light emitter (440) may be performed.

[0133] According to one embodiment of the present disclosure, the operation (S13) of measuring the amount of infrared light may include an operation of activating an infrared light receiver (460) that is in an inactive state. As an example, if at least one processor (120) determines that the user has taken off the wearable electronic device (300), the processor may activate the infrared light receiver (460) and measure the amount of reflected infrared light irradiated from the infrared light emitter (440) through the activated infrared light receiver (460).

[0134] According to one embodiment of the present disclosure, a method for deactivating a wearable electronic device (300) may include an operation (S15) of deactivating the wearable electronic device (300) if the amount of infrared light measured in the infrared light amount measurement operation (S13) is less than the reference value. The deactivation operation (S15) of the wearable electronic device (300) is an operation for a user to reduce power consumption of the wearable electronic device (300), and may include, for example, an operation of deactivating (e.g., power OFF or power saving mode) a display module (160), a speaker (e.g., an audio output module (155) of FIG. 1), and / or an external camera (e.g., camera modules (311, 312, 313, 314, 315, 316) of FIG. 3).

[0135] FIG. 10 is a flowchart illustrating an operation of activating an external display (ED) when a wearable electronic device (300) is deactivated, according to one embodiment of the present disclosure.

[0136] Referring to FIGS. 3 and 10, an external display activation operation (S16) may be performed after a deactivation operation (S15) of the wearable electronic device (300). As an example, the external display activation operation (S16) may be performed while the user takes off the wearable electronic device (300). When the external display activation operation (S16) is performed, visual information projected onto the lens (430, see FIG. 5) by the display module (160) may be displayed through the external display (ED).

[0137] FIGS. 11 to 14 illustrate examples of an activation operation of a wearable electronic device (300) (the wearable electronic device activation operation (S6) of FIGS. 7 and 8 and / or the wearable electronic device activation operation (S10) of FIGS. 9 and 10) according to one embodiment of the present disclosure.

[0138] FIG. 11 illustrates a display screen (H1) provided to a user through a display module (160, see FIG. 6) when iris recognition is performed in an activation operation of a wearable electronic device (300) (wearable electronic device activation operations (S6, S10) of FIGS. 7 to 10) according to one embodiment of the present disclosure. For example, the iris recognition operation may be performed after the activation operation of the wearable electronic device (300) (wearable electronic device activation operations (S6, S10) of FIGS. 7 to 10).

[0139] Referring to FIG. 11, according to one embodiment of the present disclosure, a wearable electronic device (300) may provide visual information corresponding to the operation of the wearable electronic device (300) through a display module (160, see FIG. 6). In an activation operation of the wearable electronic device (300) (wearable electronic device activation operation (S6, S10) of FIGS. 7 to 10), an iris recognition operation for user identification may be performed. FIG. 11 illustrates, as an example, a display area (DS) on which visual information provided through the display module (160) is displayed during the iris recognition operation of the wearable electronic device (300). The visual information provided through the display module (160) may include text (e.g., “Iris recognition in progress. Look straight ahead.”). As an example, the display area (DS) may be understood as a portion of a lens (430, see FIG. 5) (see FIG. 16), and according to another embodiment (not shown), the display area (DS) may be understood as a display panel. According to another embodiment of the present disclosure, in the activation operation of the wearable electronic device (300) (the wearable electronic device activation operation (S6, S10) of FIGS. 7 to 10), a password input process (not shown) for user identification may be performed.

[0140] FIG. 12 illustrates a display screen (H2) provided to a user through a display module (160, see FIG. 6) in an activated state of a wearable electronic device (300) according to one embodiment of the present disclosure.

[0141] Referring to FIG. 12, in the activation operation of the wearable electronic device (300) (the wearable electronic device activation operation (S6, S10) of FIGS. 7 to 10), the wearable electronic device (300) can provide visual information through the display module (160, see FIG. 6). FIG. 12 illustrates, as an example, a display area (DS) on which a home screen including app icons, widgets, and / or indicators is displayed through the display module (160).

[0142] FIG. 13 illustrates a display screen (H3) provided to a user through a display module (160, see FIG. 6) when notifying of correct wearing in an activation operation of a wearable electronic device (300) (wearable electronic device activation operation (S6, S10) of FIGS. 7 to 10) according to one embodiment of the present disclosure.

[0143] Referring to FIG. 13, according to one embodiment of the present disclosure, a wearable electronic device (300) may provide visual information corresponding to the operation of the wearable electronic device (300) through a display module (160, see FIG. 6). In an activation operation of the wearable electronic device (300) (wearable electronic device activation operation (S6, S10) of FIGS. 7 to 10), a pop-up notification operation may be performed to guide proper wearing of the wearable electronic device (300). FIG. 11 illustrates, as an example, a display area (DS) on which visual information provided through the display module (160) is displayed during the pop-up notification operation of the wearable electronic device (300). The visual information provided through the display module (160) may include text (M, e.g., wear the device correctly). The visual information provided through the display module (160) may include an image captured through an external camera (e.g., camera modules (311, 312, 313, 314, 315, 316) of FIG. 3). As an example, when a user wears a wearable electronic device (300) and the wearable electronic device (300) is activated, if the user's pupil, which is recognized through an eye tracking camera (460, see FIG. 6), is out of the correct position, text (M, e.g., wear the device correctly) may be displayed through the display module (160).

[0144] FIG. 14 illustrates a display screen (H4) provided to a user through a display module (160, see FIG. 6) when adjusting an inter-pupillary distance in an activation operation of a wearable electronic device (300) (wearable electronic device activation operation (S6, S10) of FIGS. 7 to 10) according to one embodiment of the present disclosure.

[0145] Referring to FIG. 14, according to one embodiment of the present disclosure, a wearable electronic device (300) may provide visual information corresponding to the operation of the wearable electronic device (300) through a display module (160, see FIG. 6). FIG. 14 illustrates, as an example, a display area (DS) on which visual information provided through the display module (160) is displayed when the interpupillary distance of the wearable electronic device (300) is adjusted. When the interpupillary distance of the wearable electronic device (300) is adjusted, the visual information provided through the display module (160) may include a visual indicator (W) corresponding to both eyes of the user. As an example, in the interpupillary distance adjustment operation, the interpupillary distance of the wearable electronic device (300) (e.g., the distance between lens modules (321, 322) of FIG. 4) may be adjusted within a range of about 55 mm to 75 mm to correspond to the interpupillary distance of the user. The visual information provided through the display module (160) may include an image captured through an external camera (e.g., camera modules (311, 312, 313, 314, 315, 316) of FIG. 3). As an example, when a user wears a wearable electronic device (300) and the wearable electronic device (300) is activated, if the user's pupil, which is recognized through an eye tracking camera (460, see FIG. 6), is out of the correct position, text (M, e.g., wear the device correctly) may be displayed through the display module (160).

[0146] FIG. 15 is an exploded perspective view of a lens module (321, 322, see FIG. 4) of a wearable electronic device (300) according to one embodiment of the present disclosure.

[0147] According to one embodiment of the present disclosure, a lens frame (410) of a lens module (321, 322, see FIG. 4) may include a first barrel (411). A lens (430) may be disposed inside the first barrel (411). As an example, the first barrel (411) may have a cylindrical shape. The first barrel (411) may include a first peripheral wall (414).

[0148] According to one embodiment of the present disclosure, the lens (430) may be disposed on the inner side of the first peripheral wall (414). The first barrel (411) may include a barrel protrusion (413). The barrel protrusion (413) may protrude outward from the first peripheral wall (414). The first barrel (411) may include a first hole (415). The first hole (415) may be located in the first peripheral wall (414). The first hole (415) may have a slit shape. The first holes (415) may be formed in plurality and arranged along the perimeter of the first peripheral wall (414). According to one embodiment of the present disclosure, the lens frame (410) of the lens module (321, 322, see FIG. 4) may include a second barrel (412). The second tube (412) may surround at least a portion of the first tube (411). As an example, the second tube (412) may have a cylindrical shape surrounding the first tube (411). The second tube (412) may include a second peripheral wall (416, 417).

[0149] According to one embodiment of the present disclosure, the second peripheral wall (416, 417) may include a second-first peripheral wall (416) and a second-second peripheral wall (417). The second-first peripheral wall (416) may surround the upper portion of the first tube (411). The second-second peripheral wall (417) may surround the lower portion of the first tube (411).

[0150] According to one embodiment of the present disclosure, a second hole (418) may be arranged in the second barrel (412). A plurality of second holes (418) may be arranged in the second-first peripheral wall (416) of the second barrel (412). A portion of the second-first peripheral wall (416) located between two adjacent second holes (418) may be referred to as a bar portion (419) of the second-first peripheral wall (416). The first hole (415) and the second hole (418) may be spatially connected to each other. The plurality of second holes (418) may correspond to each of the plurality of first holes (415). As an example, the second hole (418) may overlap the first hole (416). According to one embodiment of the present disclosure, the lens module (321, 322, see FIG. 4) may include a substrate (470). As an example, the substrate (470) may be a flexible printed circuit board (FPCB). The substrate (470) may extend along the edge of the lens (430). As an example, the substrate (470) may extend in a ring shape to correspond to the shape of the lens. The substrate (470) may include a first substrate portion (471) extending along the edge of the lens (430). An infrared emitter (440) and / or an infrared receiver (450) may be disposed on the first substrate portion (471). A gaze tracking camera (460) may be positioned in front (F) of the substrate (470). The substrate (470) may include a second substrate portion (472). The second substrate portion (472) may extend from one side of the first substrate portion (471). The second substrate portion (472) can connect the first substrate portion (471) and internal components of the wearable electronic device (300, see FIG. 6) (e.g., the processor (120) and / or battery (189) of FIG. 6). The second substrate portion (472) can extend in a direction intersecting the longitudinal direction of the first substrate portion (471).

[0151] FIG. 16 is a view of a lens (L) (e.g., lens (430) of FIG. 5) viewed from above, according to one embodiment of the present disclosure, showing a view of the lens (L) from the perspective of a user wearing a wearable electronic device (300).

[0152] Referring to FIG. 16, according to one embodiment of the present disclosure, an infrared light receiver (450) and a gaze tracking camera (460) may be placed between a plurality of infrared light emitters (440). As an example, the infrared light receiver (450) and the gaze tracking camera (460) may be placed between two adjacent light emitters of the plurality of infrared light emitters (440).

[0153] According to one embodiment of the present disclosure, the infrared light receiver (450) and the gaze tracking camera (460) may be positioned adjacent to the lower end of the lens (L). As an example, when viewed from above the lens (430), the user's eyes may be positioned within the display area (DS) of the lens (430), and the infrared light receiver (450) and the gaze tracking camera (460) may be positioned lower than the user's eyes. Accordingly, the problem of not being able to accurately detect the amount of reflected light due to the amount of reflected light reflected to the infrared light receiver (450) being reduced due to the user's eyebrows, hair, etc. may be prevented.

[0154] According to one embodiment of the present disclosure, a wearable electronic device (300) may include a plurality (e.g., two) of gaze tracking cameras (460). The plurality of gaze tracking cameras (460) may be arranged to be spaced apart from each other on a predetermined annular path defined with respect to a lens axis (e.g., the lens axis LA of FIG. 20). As an example, a first gaze tracking camera (461) and a second gaze tracking camera (462) may be arranged on one side and the other side of a substrate (470) that are opposite to each other with respect to the lens axis LA.

[0155] According to one embodiment of the present disclosure, the infrared light receiver (450) may include a first infrared light receiver (451) positioned adjacent to the gaze tracking camera (460) (e.g., a first gaze tracking camera (461)). The infrared light receiver (450) may include a second infrared light receiver (452) positioned on the opposite side of the gaze tracking camera (460) (e.g., a second gaze tracking camera (461)) with respect to the central axis (LA) of the lens (L). For example, the second infrared light receiver (452) may be positioned adjacent to the second gaze tracking camera (462).

[0156] FIG. 17 is a cross-sectional view of a portion of a wearable electronic device (300) according to an embodiment of the present disclosure taken along the line DD' illustrated in FIG. 16, illustrating a cross-section of an infrared light receiver (450). FIG. 18 is a cross-sectional view of a portion of a wearable electronic device (300) according to an embodiment of the present disclosure taken along the line EE' illustrated in FIG. 16, illustrating a cross-section of an eye tracking camera (460). FIG. 19 is an enlarged view of portion A of FIG. 18, illustrating an infrared light receiver (450) and a partition wall (459) according to an embodiment of the present disclosure.

[0157] Referring to FIGS. 16 to 19, a lens module (321, 322, see FIG. 4) according to an embodiment of the present disclosure may include a partition wall (459). The partition wall (459) may prevent light emitted from an infrared light emitter (440) positioned around an infrared light receiver (450) from directly entering the infrared light receiver (450) without being reflected by a user. The partition wall (459) may be disposed on one surface of a substrate (470). The partition wall (459) may be disposed between the one surface of the substrate (470) and a window (420, see FIG. 5). The partition wall (459) may be in contact with a bottom surface of the window (420, see FIG. 5).

[0158] According to one embodiment of the present disclosure, a partition wall (459) may surround an infrared light receiver (450). The partition wall (459) may protrude from a substrate (470) and extend to surround the infrared light receiver (450). As an example, the partition wall (459) may be formed of a sponge. The partition wall (459) may include a plurality of parts. A description of the partition wall (459) will be described below with reference to FIG. 20.

[0159] Fig. 18 schematically illustrates a lens frame (410) according to one embodiment of the present disclosure. The lens frame (410) illustrated in Figs. 16 to 19 does not have the first barrel (411) and the second barrel (412) described with reference to Fig. 15 illustrated in detail, but the descriptions with reference to Fig. 15 may be substantially identically applied to each other. A plurality of lenses (L1, L2, L3, see Fig. 2) may be arranged in the lens frame (410).

[0160] FIGS. 20 to 22 illustrate the positional relationship between the substrate (1470; 2470; 3470) and the lens (L) according to various embodiments. The various embodiments illustrated in FIGS. 20 to 22 may have different positions of the substrate (1470; 2470; 3470) relative to the lens (L) (e.g., lens (430) of FIG. 5) compared to the embodiment illustrated in FIG. 5.

[0161] FIG. 20 is a perspective view of a portion of a wearable electronic device (300) illustrating a substrate (470) according to one embodiment of the present disclosure. The description of the substrate (470) described with reference to FIG. 15 can be substantially equally applied to the substrate (3470) illustrated in FIG. 20 to the extent that they are not mutually disposed.

[0162] Referring to FIG. 20, according to one embodiment of the present disclosure, the lens axis (LA) of the wearable electronic device (300) may be substantially identical to the central axis of the lens (L). As an example, the lens axis (LA) may be understood as an axis extending forward (F) and backward (B) defined with respect to the user while passing through the center of the lens (L).

[0163] According to one embodiment of the present disclosure, the substrate (3470) may be spaced forward from the lens (L). The substrate (3470) may extend along the edge of the lens (L). Light emitted from a plurality of infrared light emitters (440) disposed on the substrate (3470) may travel through the lens (L) to the outside of the wearable electronic device (300). The infrared light receiver (450) and the gaze tracking camera (460) may recognize the infrared light traveling toward the infrared light receiver (450) through the lens (L).

[0164] FIG. 21 is a perspective view of a portion of a wearable electronic device (300) illustrating a substrate (1470) according to one embodiment of the present disclosure. The description of the substrate (470) described with reference to FIG. 15 can be substantially equally applied to the substrate (1470) illustrated in FIG. 21 to the extent that they are not mutually disposed.

[0165] Referring to FIG. 21, the substrate (1470) may include an inner bypass portion (1473) extending along the inner portion of the gaze tracking camera (460) when viewed from above the lens (L). The inner bypass portion (1473) may be understood as a portion of the first substrate portion (471) illustrated in FIG. 15. The inner portion of the gaze tracking camera (460) may be a portion of an outer surface forming the exterior of the gaze tracking camera (460), and may be a portion of an outer surface of the gaze tracking camera (460) that faces the lens axis (LA). As an example, the inner bypass portion (1473) may overlap with the lens (L) when viewed from above the lens (L). By extending the inner bypass portion (1473) to avoid the gaze tracking camera (460), an optimized arrangement structure of a wearable electronic device (300) including the gaze tracking camera (460) and the substrate (1470) can be provided.

[0166] FIG. 22 is an exploded perspective view of a substrate (2470) and a lens frame (410) according to one embodiment of the present disclosure. The description of the substrate (470) described with reference to FIG. 15 can be substantially equally applied to the substrate (2470) illustrated in FIG. 22 to the extent that they are not mutually disposed.

[0167] Referring to FIG. 22, the substrate (2470) may include an outer bypass portion (2473) extending along the inner portion of the gaze tracking camera (460) when viewed from above (e.g., from the rear (B)) of the lens (L). The outer bypass portion (2473) may be understood as a section of the first substrate portion (2471) described with reference to FIG. 15. The outer portion of the gaze tracking camera (460) may be a portion of the outer surface of the gaze tracking camera (460) that faces a direction opposite to the direction in which the inner portion of the gaze tracking camera (460) faces. As an example, the outer bypass portion (2473) may not overlap the lens (L) when viewed from above the lens (L). By extending the outer bypass portion (2473) to avoid the gaze tracking camera (460), an optimized arrangement structure of a wearable electronic device (300) including the gaze tracking camera (460) and the substrate (2470) can be provided.

[0168] FIGS. 23 to 27 are schematic diagrams of a portion of a wearable electronic device (300) illustrating the positional relationship between an infrared emitter (440), an infrared receiver (450), and an eye tracking camera (460) according to various embodiments of the present disclosure.

[0169] Referring to FIGS. 23 to 27, the display module (160, see FIG. 6) according to one embodiment of the present disclosure may include a display member (500) that overlaps the lens (L) when viewed from above (e.g., from the rear (B)) the lens (L). The display member (500) is a device that projects visual information toward the lens (L), and may be understood as, for example, a projector or a display. The axial direction of the lens (L), as described below, may be understood as the longitudinal direction of the lens axis (LA, see FIG. 20).

[0170] Referring to FIG. 23, according to one embodiment of the present disclosure, in the axial direction of the lens (L), the infrared light emitters (440) and the gaze tracking camera (460) may be positioned in front of the display member (500), and the infrared light receiver (450) may be positioned at the rear of the lens (L). The infrared light receiver (450) may be positioned at the rear of the gaze tracking camera (460). The infrared light receiver (450) may be positioned closer to the user's eyes than the gaze tracking camera (460).

[0171] Referring to FIG. 24, according to one embodiment of the present disclosure, in the axial direction of the lens (L), the gaze tracking camera (460) may be positioned between the display member (500) and the lens (L), and the infrared light receiver (450) and the plurality of infrared light emitters (440) may be positioned at the rear of the lens (L). The infrared light receiver (450) may be positioned at the rear of the gaze tracking camera (460).

[0172] Referring to FIG. 25, according to one embodiment of the present disclosure, in the axial direction of the lens (L), the gaze tracking camera (460) may be positioned in front of the display member (500), and the infrared light emitter (440) and the infrared light receiver (450) may be positioned at the rear of the lens (L). The infrared light receiver (450) may be positioned at the rear of the gaze tracking camera (460).

[0173] Referring to FIG. 26, according to one embodiment of the present disclosure, in the axial direction of the lens (L), the infrared light receiver (450) and the plurality of infrared light emitters (440) may be positioned between the display member (500) and the lens (L), and the gaze tracking camera (460) may be positioned in front of the display member (500). The infrared light emitter (440), the infrared light receiver (450), and the gaze tracking camera (460) may be positioned in front of the lens (L). The infrared light receiver (450) may be positioned behind the gaze tracking camera (460).

[0174] Referring to FIG. 27, according to one embodiment of the present disclosure, in the axial direction of the lens (L), the infrared light emitter (440) and the infrared light receiver (450) may be positioned in front of the display member (500), and the gaze tracking camera (460) may be positioned at the edge of the display member (500). The infrared light receiver (450) may be positioned in front of the gaze tracking camera (460).

[0175] FIG. 28 is a perspective view of a wearable electronic device (200) according to one embodiment of the present disclosure.

[0176] Referring to FIG. 28, a wearable electronic device (200) is an electronic device in the form of glasses, and a user can visually perceive surrounding objects or the environment while wearing the wearable electronic device (200). For example, the wearable electronic device (200) may be a head-mounted device (HMD) or smart glasses that can directly provide images in front of the user's eyes. The configuration of the wearable electronic device (200) of FIG. 28 may be partially or entirely identical to the configuration of the electronic device (101) of FIG. 1 and / or the configuration of the wearable electronic device (300) of FIG. 2.

[0177] According to one embodiment of the present disclosure, a wearable electronic device (200) may include a housing (210) that forms an exterior of the wearable electronic device (200). The housing (210) may provide a space in which components of the wearable electronic device (200) may be placed. For example, the housing (210) may include a lens frame (202) (e.g., the lens frame (410) of FIG. 5) and at least one wearing member (203).

[0178] According to one embodiment of the present disclosure, a wearable electronic device (200) may be disposed within a housing (210) and may include a display member (201) capable of outputting a visual image. For example, the wearable electronic device (200) may include at least one display member (201) capable of providing visual information (or images) to a user. For example, the display member (201) may include a module equipped with a lens (e.g., lens (430) of FIG. 5), a display, a waveguide, and / or a touch circuit. According to one embodiment, the display member (201) may be formed transparently or translucently. According to one embodiment, the display member (201) may include a window member whose light transmittance may be adjusted as a glass of a translucent material or a coloring concentration is adjusted.

[0179] According to one embodiment of the present disclosure, the lens frame (202) can accommodate at least a portion of the indicator member (201). For example, the lens frame (202) can surround at least a portion of an edge of the indicator member (201). According to one embodiment, the lens frame (202) can position at least one of the indicator members (201) to correspond to a user's eye. According to one embodiment, the lens frame (202) can be a rim of a typical eyeglass structure. According to one embodiment, the lens frame (202) can include at least one closed curve surrounding the indicator member (201). According to one embodiment, the lens frame (202) can include a first end (202c) and a second end (202d) opposite the first end (202c). The first end (202c) may be positioned adjacent to the first wearing member (203a), and the second end (202d) may be positioned adjacent to the second wearing member (203b).

[0180] According to one embodiment of the present disclosure, the wearing member (203) may extend from the lens frame (202). For example, the wearing member (203) may extend from an end of the lens frame (202) and, together with the lens frame (202), may be supported or positioned on a user's body (e.g., an ear). According to one embodiment, the wearing member (203) may be rotatably coupled to the lens frame (202) via a hinge structure (229). According to one embodiment, the wearing member (203) may include an inner side (231c) configured to face the user's body and an outer side (231d) opposite the inner side (231c). According to one embodiment (not shown), at least a portion of the wearing member (203) may be formed of a flexible material (e.g., rubber). For example, at least a portion of the wearing member (203) may be formed in a band shape that surrounds at least a portion of the user's body (e.g., an ear).

[0181] According to one embodiment of the present disclosure, the wearable electronic device (200) may include a hinge structure (229) configured to fold the wearing member (203) relative to the lens frame (202). The hinge structure (229) may be positioned between the lens frame (202) and the wearing member (203). When the user is not wearing the wearable electronic device (200), the user may fold the wearing member (203) so that a portion thereof overlaps the lens frame (202) and carry or store the device. In one embodiment, the hinge structure (229) may include a first hinge structure (229a) connected to a portion of the lens frame (202) (e.g., a first end (202c)) and a first wearing member (203a) and a second hinge structure (229b) connected to a portion of the lens frame (202) (e.g., a second end (202d)) and a second wearing member (203b).

[0182] FIG. 29 is a perspective view illustrating the internal configuration of a wearable electronic device (200) according to one embodiment of the present disclosure. FIG. 30 is an exploded perspective view of a wearable electronic device (200) according to one embodiment of the present disclosure.

[0183] Referring to FIGS. 28 to 30, a wearable electronic device (200) may include a display member (201), a lens frame (202), a wearing member (203), a hinge structure (229), at least one circuit board (241), at least one battery (243), at least one power transmission structure (246), a camera module (250), and / or a sensor module (280).

[0184] According to one embodiment of the present disclosure, the wearable electronic device (200) may acquire and / or recognize a visual image of an object or environment in a direction (e.g., direction F) that the user is looking at or the wearable electronic device (200) is facing by using a camera module (250) (e.g., camera module (180) of FIG. 1), and may receive information about the object or environment from an external electronic device (e.g., electronic devices (102, 104) of FIG. 1 or server (108) of FIG. 1) through a network (e.g., first network (198) or second network (199) of FIG. 1). In another embodiment, the wearable electronic device (200) may provide the received information about the object or environment to the user in an acoustic or visual form. The wearable electronic device (200) may provide the received information about the object or environment to the user in a visual form through a display member (201) by using a display module (e.g., display module (160) of FIG. 1). For example, the wearable electronic device (200) can implement augmented reality by visualizing information about objects or the environment and combining it with actual images of the user's surroundings.

[0185] According to one embodiment of the present disclosure, the display member (201) may be provided as a pair and may be arranged to correspond to the left and right eyes of the user, respectively, when the wearable electronic device (200) is worn on the user's body. For example, the display member (201) may include a first display member (201a) and a second display member (201b) arranged spaced apart from the first display member (201a). The first display member (201a) may be arranged to correspond to the user's right eye, and the second display member (201b) may be arranged to correspond to the user's left eye.

[0186] According to one embodiment of the present disclosure, the display member (201) may include a first surface (F1) facing a direction in which external light is incident (e.g., direction F) and a second surface (F2) facing a direction opposite to the first surface (F1) (e.g., direction B). When a user wears the wearable electronic device (200), at least a portion of light or an image incident through the first surface (F1) may pass through the second surface (F2) of the display member (201) arranged to face the user's left eye and / or right eye and be incident on the user's left eye and / or right eye.

[0187] According to one embodiment of the present disclosure, the lens frame (202) may include at least two frames. For example, the lens frame (202) may include a first frame (202a) and a second frame (202b). According to one embodiment, when a user wears the wearable electronic device (200), the first frame (202a) may be a frame that faces the user's face, and the second frame (202b) may be a part of the lens frame (202) that is spaced apart from the first frame (202a) in a direction of the user's gaze (e.g., direction F).

[0188] According to one embodiment of the present disclosure, a wearable electronic device (200) may include a light output module (211) configured to provide images and / or videos to a user. For example, the light output module (211) may include a display panel (not shown) capable of outputting videos and a lens (not shown) corresponding to a user's eye and guiding the videos to a display member (201). For example, a user may obtain videos output from the display panel of the light output module (211) through the lens of the light output module (211). According to various embodiments, the light output module (211) may include a device configured to display various pieces of information. For example, the light output module (211) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED). According to one embodiment, when the light output module (211) and / or the display member (201) includes one of a liquid crystal display, a digital mirror display, or a silicon liquid crystal display, the wearable electronic device (200) may include a light source that irradiates light to a display area of ​​the light output module (211) and / or the display member (201). According to another embodiment, when the light output module (211) and / or the display member (201) includes one of an organic light emitting diode or a micro LED, the wearable electronic device (200) may provide a virtual image to a user without including a separate light source.

[0189] According to one embodiment of the present disclosure, at least a portion of the light output module (211) may be disposed within the housing (210). For example, the light output module (211) may be connected to the display member (201) and may provide an image to a user through the display member (201). For example, an image output from the light output module (211) may be incident on the display member (201) through an input optical member (not shown) positioned at one end of the display member (201), and may be radiated toward the user's eyes through a waveguide (not shown) and an output optical member (not shown) positioned at at least a portion of the display member (201).

[0190] According to one embodiment of the present disclosure, a wearable electronic device (200) may include a circuit board (241) (e.g., a printed circuit board (PCB), a printed board assembly (PBA), a flexible PCB (FPCB), or a rigid-flexible PCB (RFPCB)) that accommodates components for driving the wearable electronic device (200). For example, the circuit board (241) may include at least one integrated circuit chip, and at least one of a processor (not shown) (e.g., a processor (120) of FIG. 1), a memory (not shown) (e.g., a memory (130) of FIG. 1), a power management module (not shown) (e.g., a power management module (188) of FIG. 1), or a communication module (e.g., a communication module (190) of FIG. 1) may be provided on the integrated circuit chip. According to one embodiment, the circuit board (241) may be disposed within the wearing member (203) of the housing (210). For example, the circuit board (241) may include a first circuit board (241a) disposed within a first wearing member (203a) and a second circuit board (241b) disposed within a second wearing member (203b). According to one embodiment, the communication module (e.g., the communication module (190) of FIG. 1) may be disposed within the first wearing member. A first circuit board (241a) located within a member (203a) may be disposed, and a processor (e.g., processor (120) of FIG. 1) may be disposed within a second circuit board (241b) located within a second wearable member (203b). According to one embodiment, the circuit board (241) may be electrically connected to a battery (243) (e.g., battery (189) of FIG. 1) via a power transmission structure (246). According to one embodiment, the circuit board (241) may be an interposer board.

[0191] According to one embodiment of the present disclosure, the battery (243) can be electrically connected to components of the wearable electronic device (200) (e.g., the light output module (211), the circuit board (241), the speaker module (245), the microphone module (247), and / or the camera module (250)) and can supply power to the components of the wearable electronic device (200).

[0192] According to one embodiment of the present disclosure, at least a portion of the battery (243) may be disposed in the wearable member (203). According to one embodiment, the battery (243) may include a first battery (243a) disposed within a first wearable member (203a) and a second battery (243b) disposed within a second wearable member (203b). According to one embodiment, the battery (243) may be disposed adjacent to an end (203c, 203d) of the wearable member (203).

[0193] According to one embodiment of the present disclosure, a speaker module (245) (e.g., audio module (170) or sound output module (155) of FIG. 1) can convert an electrical signal into sound. At least a portion of the speaker module (245) can be positioned within the wearable member (203) of the housing (210). According to one embodiment, the speaker module (245) can be positioned within the wearable member (203) so as to correspond to the user's ear.

[0194] According to one embodiment of the present disclosure, a wearable electronic device (200) may include a power transmission structure (246) configured to transmit power from a battery (243) to an electronic component (e.g., an optical output module (211)) of the wearable electronic device (200). For example, the power transmission structure (246) is electrically connected to the battery (243) and / or a circuit board (241), and the circuit board (241) may transmit power received through the power transmission structure (246) to the optical output module (211). According to one embodiment, the power transmission structure (246) may be a configuration capable of transmitting power. For example, the power transmission structure (246) may include a flexible printed circuit board or a wire. For example, the wire may include a plurality of cables (not shown). In various embodiments, the shape of the power transmission structure (246) may be variously modified in consideration of the number and / or type of cables.

[0195] According to one embodiment of the present disclosure, a microphone module (247) (e.g., the input module (150) and / or the audio module (170) of FIG. 1) may convert sound into an electrical signal. According to one embodiment, the microphone module (247) may be disposed within the lens frame (202). For example, at least one microphone module (247) may be disposed at the bottom (e.g., in the direction toward the D-axis) and / or the top (e.g., in the direction toward the U-axis) of the wearable electronic device (200). According to various embodiments, the wearable electronic device (200) may recognize a user's voice more clearly by using voice information (e.g., sound) acquired from the at least one microphone module (247). For example, the electronic device (200) may distinguish voice information from ambient noise based on the acquired voice information and / or additional information (e.g., low-frequency vibration of the user's skin and bones). For example, a wearable electronic device (200) can clearly recognize a user's voice and perform a function of reducing ambient noise (e.g., noise canceling).

[0196] According to various embodiments, the camera module (250) can capture still images and / or moving images. The camera module (250) may include at least one of a lens, at least one image sensor, an image signal processor, or a flash. According to one embodiment, the camera module (250) may be disposed within the lens frame (202) and may be disposed around the display member (201).

[0197] According to various embodiments, the camera module (250) may include at least one first camera module (251). According to one embodiment, the first camera module (251) may capture a trajectory of a user's eye (e.g., pupil) or gaze. For example, the first camera module (251) may include a light emitting unit (e.g., IRED) configured to emit light in an infrared band (e.g., infrared light emitting unit (440) of FIG. 5) and a camera structure (not shown) configured to capture a reflection pattern of light emitted by the light emitting unit toward the user's eye. According to one embodiment, a processor (e.g., processor (120) of FIG. 1) may adjust the position of the virtual image projected on the display member (201) so that the virtual image corresponds to a direction in which the user's pupil is gazing. According to one embodiment, the first camera module (251) may track a trajectory of the user's eye or gaze by using a plurality of first camera modules (251) having the same specifications and performance.

[0198] According to one embodiment, the first camera module (251) may periodically or aperiodically transmit information related to the trajectory of the user's eyes or gaze (e.g., trajectory information) to a processor (e.g., processor (120) of FIG. 1). According to another embodiment, the first camera module (251) may transmit the trajectory information to the processor when it detects that the user's gaze has changed (e.g., the eyes move more than a reference value while the head is still) based on the trajectory information.

[0199] According to one embodiment of the present disclosure, the camera module (250) may include a second camera module (253). According to one embodiment, the second camera module (253) may capture an external image. According to one embodiment, the second camera module (253) may capture an external image through a second optical hole (223) formed in the second frame (202b). For example, the second camera module (253) may include a high-resolution color camera, and may be a high-resolution (HR) or photo video (PV) camera. According to one embodiment, the second camera module (253) may provide an auto focus (AF) function and an optical image stabilizer (OIS) function.

[0200] According to various embodiments (not shown), the wearable electronic device (200) may include a flash (not shown) positioned adjacent to the second camera module (253). For example, the flash (not shown) may provide light to increase the brightness (e.g., illuminance) around the wearable electronic device (200) when the second camera module (253) acquires an external image, and may reduce difficulties in acquiring images due to a dark environment, mixing of various light sources, and / or reflection of light.

[0201] According to one embodiment of the present disclosure, the camera module (250) may include at least one third camera module (255). According to one embodiment, the third camera module (255) may capture a user's action through a first optical hole (221) formed in the lens frame (202). For example, the third camera module (255) may capture a user's gesture (e.g., hand motion). The third camera module (255) and / or the first optical hole (221) may be respectively disposed at opposite side ends of the lens frame (202) (e.g., the second frame (202b)), for example, at opposite ends of the lens frame (202) (e.g., the second frame (202b)) in the R or L direction. According to one embodiment, the third camera module (255) may be a global shutter (GS) type camera. For example, the third camera module (255) can provide 360-degree space (e.g., omnidirectional), position recognition and / or movement recognition as a camera that supports 3DoF (degrees of freedom) or 6DoF. According to one embodiment, the third camera module (255) can perform a movement path tracking function (simultaneous localization and mapping, SLAM) and a user movement recognition function by using a plurality of global shutter type cameras with the same specifications and performance as a stereo camera. According to one embodiment, the third camera module (255) can include an infrared (IR) camera (e.g., a time of flight (TOF) camera or a structured light camera). For example, the IR camera can operate as at least a part of a sensor module (e.g., the sensor module (176) of FIG. 1) for detecting a distance to a subject.

[0202] According to one embodiment of the present disclosure, at least one of the first camera module (251) or the third camera module (255) may be replaced with a sensor module (e.g., the sensor module (176) of FIG. 1). For example, the sensor module may include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode. For example, the photodiode may include a positive intrinsic negative (PIN) photodiode or an avalanche photodiode (APD). The photodiode may be interpreted as a photo detector or a photo sensor.

[0203] According to one embodiment of the present disclosure, at least one of the first camera module (251), the second camera module (253), or the third camera module (255) may include a plurality of camera modules (not shown). For example, the second camera module (253) may be configured with a plurality of lenses (e.g., wide-angle and telephoto lenses) and image sensors and may be arranged on one side (e.g., the side facing the F direction) of the wearable electronic device (200). For example, the wearable electronic device (200) may include a plurality of camera modules, each having a different property (e.g., angle of view) or function, and may be controlled to change the angle of view of the camera module based on a user's selection and / or trajectory information. For example, at least one of the plurality of camera modules may be a wide-angle camera, and at least another may be a telephoto camera.

[0204] According to one embodiment of the present disclosure, a processor (e.g., processor (120) of FIG. 1) may determine movement of the wearable electronic device (200) and / or movement of the user by using information of the wearable electronic device (200) acquired using at least one of a gesture sensor, a gyro sensor, or an acceleration sensor of a sensor module (e.g., sensor module (176) of FIG. 1) and a user's motion (e.g., approach of the user's body to the electronic device (200)) acquired using a third camera module (255). According to one embodiment, the wearable electronic device (200) may include, in addition to the described sensors, a magnetic (geomagnetic) sensor capable of measuring a direction using a magnetic field and magnetism, and / or a Hall sensor capable of acquiring movement information (e.g., a moving direction or a moving distance) using the strength of a magnetic field. For example, the processor can determine movement of the electronic device (200) and / or movement of the user based on information obtained from a magnetic (geomagnetic) sensor and / or a Hall sensor.

[0205] According to various embodiments (not shown), the wearable electronic device (200) can perform an input function (e.g., a touch and / or pressure sensing function) that enables interaction with a user. For example, a component configured to perform a touch and / or pressure sensing function (e.g., a touch sensor and / or a pressure sensor) may be disposed on at least a portion of the wearable member (203). The wearable electronic device (200) can control a virtual image output through the display member (201) based on information acquired through the component. For example, the sensor related to the touch and / or pressure sensing function may be configured in various ways, such as a resistive type, a capacitive type, an electromagnetic induction (EM) type, or an optical type. According to one embodiment, the component configured to perform the touch and / or pressure sensing function may have part or all of the same configuration as the input module (150) of FIG. 1.

[0206] According to one embodiment of the present disclosure, a wearable electronic device (200) may include a reinforcing member (260) disposed in an internal space of a lens frame (202) and formed to have a rigidity higher than that of the lens frame (202).

[0207] According to one embodiment of the present disclosure, the electronic device (200) may include a lens structure (273). The lens structure (273) may refract at least a portion of light. For example, the lens structure (273) may be a prescription lens having a specified refractive power. According to one embodiment, at least a portion of the lens structure (273) may be positioned behind the display member (201). For example, the lens structure (273) may be positioned between the display member (201) and the user's eye.

[0208] According to one embodiment of the present disclosure, the housing (210) may include a hinge cover (227) that may conceal a portion of the hinge structure (229). Another portion of the hinge structure (229) may be accommodated or concealed between an inner cover (231) and an outer cover (233) described below.

[0209] According to one embodiment of the present disclosure, the wearing member (203) may include an inner cover (231) and an outer cover (233). For example, the inner cover (231) is a cover configured to face the user's body or to come into direct contact with the user's body, and may be made of a material with low thermal conductivity, for example, a synthetic resin. According to one embodiment, the inner cover (231) may include an inner side facing the user's body (for example, the inner side (231c) of FIG. 2). For example, the outer cover (233) may include a material capable of at least partially transmitting heat (for example, a metal material) and may be coupled to face the inner cover (231). According to one embodiment, the outer cover (233) may include an outer side opposite the inner side (231c) (for example, the outer side (231d) of FIG. 2). In one embodiment, at least one of the circuit board (241) or the speaker module (245) may be accommodated in a space separate from the battery (243) within the wearable member (203). In the illustrated embodiment, the inner cover (231) may include a first cover (231a) that accommodates the circuit board (241) and / or the speaker module (245), and a second cover (231b) that accommodates the battery (243), and the outer cover (233) may include a third cover (233a) that is coupled to face the first cover (231a), and a fourth cover (233b) that is coupled to face the second cover (231b). For example, the first cover (231a) and the third cover (233a) may be combined (hereinafter, 'the first cover portion (231a, 233a)') to accommodate a circuit board (241) and / or a speaker module (245), and the second cover (231b) and the fourth cover (233b) may be combined (hereinafter, 'the second cover portion (231b, 233b)') to accommodate a battery (243).

[0210] According to one embodiment of the present disclosure, the first cover portion (231a, 233a) is rotatably coupled to the lens frame (202) via a hinge structure (229), and the second cover portion (231b, 233b) can be connected or mounted to an end of the first cover portion (231a, 233a) via a connection structure (235). According to one embodiment, a portion of the connection structure (235) that comes into contact with the user's body can be made of a material with low thermal conductivity, for example, an elastic material such as silicone, polyurethane, or rubber, and a portion that does not come into contact with the user's body can be made of a material with high thermal conductivity, for example, a metal material. For example, when heat is generated in the circuit board (241) or the battery (243), the connection structure (235) can block the heat from being transferred to the portion that comes into contact with the user's body, and can disperse or release the heat through the portion that does not come into contact with the user's body. According to one embodiment, a portion of the connection structure (235) that is configured to come into contact with the user's body may be interpreted as a part of the inner cover (231), and a portion of the connection structure (235) that is not configured to come into contact with the user's body may be interpreted as a part of the outer cover (233). According to one embodiment (not shown), the first cover (231a) and the second cover (231b) may be configured as an integral body without the connection structure (235), and the third cover (233a) and the fourth cover (233b) may be configured as an integral body without the connection structure (235). According to various embodiments, in addition to the illustrated components, other components (e.g., antenna module (197) of FIG. 1) may be further included, and information about objects or environments may be provided from an external electronic device (e.g., electronic device (102, 104) of FIG. 1 or server (108) of FIG. 1) through a network (e.g., first network (198) or second network (199) of FIG. 1) using a communication module (e.g., communication module (190) of FIG. 1).

[0211] According to one embodiment of the present disclosure, the lens frame (202) may include a connecting portion (274) between the first display member (201a) and the second display member (201b). For example, the connecting portion (274) may be interpreted as a portion corresponding to a nose pad of glasses.

[0212] According to one embodiment of the present disclosure, the electronic device (200) may include a connection member (205). According to one embodiment, the circuit board (241) is connected to the connection member (205) and may transmit electrical signals to components of the electronic device (200) (e.g., the light output module (211) and / or the camera module (250)) through the connection member (205). For example, a control signal transmitted from a processor (e.g., the processor (120) of FIG. 1) located on the circuit board (241) may be transmitted to the electronic components using at least a portion of the connection member (205). For example, at least a portion of the connection member (205) may include wiring (not shown) electrically connected to components of the electronic device (200).

[0213] According to one embodiment of the present disclosure, the connecting member (205) may include a first connecting member (205a) at least partially disposed within the first wearing member (203a) and a second connecting member (205b) at least partially disposed within the second wearing member (203b). According to one embodiment, at least a portion of the first connecting member (205a) and / or the second connecting member (205b) may face the hinge structure (229). For example, the first connecting member (205a) may extend from the first circuit board (241a) across the hinge structure (229) into the interior of the lens frame (202). The second connecting member (205b) may extend from the second circuit board (241b) across the hinge structure (229) into the interior of the lens frame (202). For example, a portion of the first connecting member (205a) and a portion of the second connecting member (205b) may be placed within the wearing member (203), and the other portion may be placed within the lens frame (202).

[0214] According to one embodiment of the present disclosure, the first connecting member (205a) and the second connecting member (205b) may include structures that can be folded or unfolded based on the rotation of the hinge structure (229). For example, the first connecting member (205a) and / or the second connecting member (205b) may include a flexible printed circuit board (FPCB). According to one embodiment, the first connecting member (205a) may be electrically and / or mechanically connected to the first circuit board (241a). According to one embodiment, the second connecting member (205b) may be electrically and / or mechanically connected to the second circuit board (241b). According to one embodiment, the first connecting member (205a) and / or the second connecting member (205b) may include structures (e.g., wiring and / or cables) for transmitting signals.

[0215] According to one embodiment of the present disclosure, the sensor module (280) (e.g., the sensor module (176) of FIG. 1) can detect light passing through the display member (201). According to one embodiment, the sensor module (280) can include a first sensor module (281) capable of detecting light passing through the first display member (201a) and a second sensor module (282) capable of detecting light passing through the second display member (201b). For example, the first sensor module (281) can detect light from the rear (e.g., in the B direction) of the first display member (201a), and the second sensor module (282) can detect light from the rear of the second display member (201b). According to one embodiment, the sensor module (280) can include a third sensor module (283) capable of detecting light in front of the display member (201). For example, the third sensor module (283) can detect light in front of the display member (201). In one embodiment, the sensor module (280) can be a light sensor. In one embodiment, the third sensor module (283) can have part or all of the same configuration as the second camera module (253).

[0216] FIG. 31 is a perspective view schematically illustrating a wearable electronic device (200) according to one embodiment of the present disclosure. FIG. 32 is an exploded perspective view schematically illustrating a portion of the wearable electronic device (200).

[0217] The description of the substrate (470) described with reference to FIGS. 5 to 19 can be substantially equally applied to the substrates (3471, 3472) illustrated in FIGS. 31 and 32 to the extent that they are not arranged with each other.

[0218] Referring to FIGS. 31 and 32 , a wearable electronic device (200) according to an embodiment of the present disclosure may include substrates (3471, 3472) (e.g., the connecting member (205) of FIG. 29 ). The substrates (3471, 3472) may be disposed inside the lens frame (202). The substrates (3471, 3472) may include a first substrate (3471) extending along an edge of a first display member (201a) and a second substrate (3472) extending along an edge of a second display member (201b). The substrates (3471, 3472) may be disposed between the first frame (202a) and the second frame (202b) of the lens frame (202).

[0219] According to one embodiment of the present disclosure, a wearable electronic device (200) may include an infrared emitter (440) and an infrared receiver (450). The infrared emitter (440) and the infrared receiver (450) may be disposed on a substrate (3471, 3472) of the wearable electronic device (200). The infrared emitter (440) and the infrared receiver (450) may be configured as a single or multiple units, and may be arranged along the edge of the display member (201a, 201b).

[0220] According to one embodiment of the present disclosure, the wearable electronic device (200) can perform the method for determining whether the wearable electronic device (300) is worn in the same manner as described with reference to FIGS. 6 and 7 by using an infrared light receiver (450), an infrared light emitter (440), and a camera module. In addition, the wearable electronic device (200) can perform the method for determining whether the wearable electronic device (300) is worn in the same manner as described with reference to FIGS. 6 and 8 by using an infrared light receiver (450), an infrared light emitter (440), and a camera module (251, see FIGS. 29 and 30).

[0221] For wearable electronic devices worn on the user's body (e.g., head, wrist, or ankle), the battery capacity is limited due to weight, size, and / or shape constraints. Therefore, to ensure long-term use, wearable electronic devices need to minimize power consumption in unintended situations (e.g., when not being worn). Accordingly, extensive research is being conducted on reducing the power consumption of wearable electronic devices.

[0222] A problem to be solved in the present disclosure may be reducing power consumption of a wearable electronic device.

[0223] A problem to be solved in the present disclosure may be to optimize the arrangement structure of a wearable electronic device including an infrared photodetector.

[0224] However, the problem to be solved in this disclosure is not limited to the problem mentioned above, and may be determined in various ways without departing from the spirit and scope of this disclosure.

[0225] A wearable electronic device according to various embodiments of the present disclosure can reduce power consumption of the wearable electronic device by minimizing the operation of components that consume a lot of power (e.g., an eye tracking camera).

[0226] A wearable electronic device according to various embodiments of the present disclosure can optimize the arrangement structure of a wearable electronic device including an infrared light receiver.

[0227] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0228] According to one embodiment of the present disclosure, a wearable electronic device (300) may be configured to be mounted on a user's head.

[0229] According to one embodiment of the present disclosure, a wearable electronic device (300) may include a lens frame (410) in which a lens (430) is arranged.

[0230] According to one embodiment of the present disclosure, a wearable electronic device (300) may include a display module (160) configured to display visual information to the user through the lens (430).

[0231] According to one embodiment of the present disclosure, a wearable electronic device (300) may include a plurality of infrared light emitters (440) configured to irradiate infrared rays toward the user.

[0232] According to one embodiment of the present disclosure, a wearable electronic device (300) may include an infrared receiver (450) configured to recognize the amount of infrared light reflected by the user.

[0233] According to one embodiment of the present disclosure, a wearable electronic device (300) may include an eye tracking camera (460) configured to capture an image corresponding to the user's eye.

[0234] According to one embodiment of the present disclosure, a plurality of infrared emitters (440), infrared receivers (450), and / or gaze tracking cameras (460) may be arranged around a lens (430).

[0235] According to one embodiment of the present disclosure, a wearable electronic device (300) may include at least one processor (120) and a memory (130) storing instructions.

[0236] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), can control the wearable electronic device (300) to cause at least one infrared light emitter (440) among the plurality of infrared light emitters (440) to emit infrared light while the gaze tracking camera is deactivated.

[0237] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable electronic device (300) to recognize the amount of reflected infrared light emitted from the infrared emitter (440) using the infrared receiver (450).

[0238] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), can cause the wearable electronic device (300) to activate the gaze tracking camera (460) to acquire an image corresponding to the user's eye based on recognizing that the amount of reflected light is greater than a reference value, and control at least one infrared light emitter (440) among the plurality of infrared light emitters (440) to irradiate infrared light.

[0239] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable electronic device (300) to determine whether the wearable electronic device (300) is worn by the user based on an image acquired by the gaze tracking camera (460).

[0240] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable electronic device (300) to display the visual information to the user using the display module (160) based on recognizing that the wearable electronic device (300) is worn by the user.

[0241] According to one embodiment of the present disclosure, the operating cycle of the infrared light receiver (450) may be longer than the operating cycle of the gaze tracking camera (460).

[0242] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), cause the wearable electronic device (300) to operate the plurality of infrared light emitters (440) in a first operating cycle corresponding to an operating cycle of the infrared light receiver (450), and when the amount of reflected light detected through the infrared light receiver (450) is greater than a reference value, operate the plurality of infrared light emitters (440) in a second operating cycle corresponding to an operating cycle of the eye tracking camera (469), and the second operating cycle may be shorter than the first operating cycle.

[0243] According to one embodiment of the present disclosure, the plurality of infrared light emitters may include a left infrared light emitter configured to radiate infrared light toward the left eye, and a right infrared light emitter configured to radiate infrared light toward the right eye.

[0244] According to one embodiment of the present disclosure, the infrared light receiver (450) may include a left infrared light receiver and a right infrared light receiver corresponding to each of the user's eyes.

[0245] According to one embodiment of the present disclosure, the left infrared receiver may be configured to recognize the amount of reflected infrared light irradiated from the left infrared emitter.

[0246] According to one embodiment of the present disclosure, the right infrared light receiving body may be configured to recognize the amount of reflected infrared light irradiated from the right infrared light emitting body.

[0247] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable electronic device (300) to recognize the amount of reflected infrared light using either the left infrared receiver or the right infrared receiver.

[0248] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), cause the wearable electronic device (300) to recognize an amount of reflected light of infrared light using the other of the left infrared receiver and the right infrared receiver based on recognizing that the amount of reflected light recognized by one of the left infrared receiver and the right infrared receiver is greater than the reference value.

[0249] According to one embodiment of the present disclosure, the gaze tracking camera (460) may include a left gaze tracking camera configured to capture an image corresponding to the left eye, and a right gaze tracking camera configured to capture an image corresponding to the right eye.

[0250] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable electronic device (300) to activate either the left gaze tracking camera or the right gaze tracking camera to acquire an image corresponding to the left or right eye of the user, and control the at least one infrared light emitter (440) to irradiate infrared light based on recognizing that the amount of reflected light recognized by either the left infrared light receiver or the right infrared light receiver is greater than a reference value.

[0251] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable electronic device (300) to activate both the left gaze tracking camera and the right gaze tracking camera based on an image acquired by either one of the left gaze tracking camera and the right gaze tracking camera.

[0252] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), can cause the wearable electronic device (300) to radiate infrared light using at least one infrared light emitter among the plurality of infrared light emitters (440) and to recognize the amount of reflected light of infrared light radiated from the at least one infrared light emitter (440) using the infrared light receiver (450).

[0253] According to one embodiment of the present disclosure, the plurality of infrared light emitters (440), the infrared light receiver (450), and the gaze tracking camera (460) may be arranged along the edge of the lens (L).

[0254] According to one embodiment of the present disclosure, the infrared light receiver (450) may include a first infrared light receiver (451) positioned adjacent to the gaze tracking camera (461).

[0255] According to one embodiment of the present disclosure, the infrared light receiver (450) may include a second infrared light receiver (452) positioned on the opposite side to the gaze tracking camera (461) with respect to the central axis (LA) of the lens (L).

[0256] According to one embodiment of the present disclosure, the infrared light receiver (450) and the gaze tracking camera (460) may be positioned adjacent to the lower end of the lens (L).

[0257] According to one embodiment of the present disclosure, a wearable electronic device (300) may include a partition (459) surrounding the infrared light receiving body (450) when viewed from above the lens (L).

[0258] According to one embodiment of the present disclosure, a wearable electronic device (300) may include a substrate (470) on which the plurality of infrared light emitters (440) and the infrared light receiver (450) are mounted.

[0259] According to one embodiment of the present disclosure, the substrate (470) may extend at least partially along the edge of the lens (L).

[0260] According to one embodiment of the present disclosure, the substrate (2470) may include an outer bypass portion (2473) extending along the outer side of the gaze tracking camera (460) when viewed from above the lens (L).

[0261] According to one embodiment of the present disclosure, the substrate (1470) may include an inner bypass portion (1473) extending along the inner side of the gaze tracking camera (460) when viewed from above the lens (L).

[0262] According to one embodiment of the present disclosure, the display module (160) may include a display member (500) that overlaps the lens (L) when viewed from above the lens (L).

[0263] According to one embodiment of the present disclosure, in the axial direction of the lens (L), the infrared light emitters (440) and the gaze tracking camera (460) may be positioned in front of the display member (500), and the infrared light receiver (450) may be positioned in the rear of the lens (L).

[0264] According to one embodiment of the present disclosure, in the axial direction of the lens (L), the gaze tracking camera (460) may be positioned between the display member (500) and the lens (L), and the infrared light receiver (450) and the plurality of infrared light emitters (440) may be positioned at the rear of the lens (L).

[0265] According to one embodiment of the present disclosure, in the axial direction of the lens (L), the infrared light receiver (450) and the plurality of infrared light emitters (440) may be positioned between the display member (500) and the lens (L), and the gaze tracking camera (460) may be positioned at the rear of the lens (L).

[0266] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), can control the wearable electronic device (300) to irradiate infrared rays through some of the infrared emitters (440) among the plurality of infrared emitters (440) while the gaze tracking camera (460) is deactivated and the infrared receiver (450) is activated.

[0267] According to one embodiment of the present disclosure, the instructions, when individually or collectively executed by the at least one processor (120), may cause the wearable electronic device (300) to recognize the amount of reflected infrared light emitted from the part of the infrared emitters (440) using the infrared receiver (450).

[0268] According to one embodiment of the present disclosure, the instructions, when executed by the at least one processor (120), cause the wearable electronic device (300) to recognize the amount of reflected light of infrared rays irradiated from the infrared emitter (440) using the infrared receiver (450), and, if the amount of reflected light recognized using the infrared receiver (450) is greater than a reference value, display visual information using the display module (160).

[0269] Although the detailed description of this document has described specific embodiments, it will be apparent to those skilled in the art that various modifications are possible without departing from the scope of this document.

Claims

1. In a wearable electronic device (300) configured to be mounted on a user's head, A lens frame (410) in which a lens (430) is arranged; A display module (160) configured to display visual information to the user through the lens (430); A plurality of infrared light emitters (440) arranged around the lens (430) and configured to irradiate infrared rays toward the user; An infrared light receiving body (450) arranged around the lens (430) and configured to recognize the amount of infrared light reflected by the user; An eye tracking camera (460) arranged around the lens (430) and configured to capture an image corresponding to the user's eye; At least one processor (120); and Includes a memory (130) for storing commands, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable electronic device (300) to: While the above-mentioned gaze tracking camera is inactive, at least one infrared light emitter (440) among the plurality of infrared light emitters (440) is controlled to irradiate infrared rays, Recognize the amount of reflected infrared light irradiated from at least one infrared light emitter (440) using the above infrared light receiver (450), Based on recognizing that the amount of the reflected light is greater than a reference value, the eye tracking camera (460) is activated to obtain an image corresponding to the user's eye, and at least one infrared light emitter (440) among the plurality of infrared light emitters (440) is controlled to irradiate infrared light. A wearable electronic device that determines whether the wearable electronic device (300) is worn by the user based on an image acquired by the activated gaze tracking camera (460).

2. In paragraph 1, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable electronic device (300) to: A wearable electronic device that displays visual information to the user using the display module (160) based on recognizing that the wearable electronic device (300) is worn by the user.

3. In paragraph 1 or 2, A wearable electronic device in which the operating cycle of the above infrared light receiver (450) is longer than the operating cycle of the above eye tracking camera (460).

4. In paragraph 3, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable electronic device (300) to: Operate the above plurality of infrared light emitters (440) in a first operating cycle corresponding to the operating cycle of the infrared light receiver (450), If the amount of reflected light detected through the infrared light receiver (450) is greater than the reference value, the plurality of infrared light emitters (440) are operated in a second operating cycle corresponding to the operating cycle of the eye tracking camera (469), A wearable electronic device wherein the second operating cycle is shorter than the first operating cycle.

5. In any one of paragraphs 1 to 4, The above plurality of infrared light emitters (440) are, It includes a left infrared light emitter configured to irradiate infrared light toward the left eye, and a right infrared light emitter configured to irradiate infrared light toward the right eye. The above infrared light receiving body (450), It includes a left infrared receiver configured to recognize the amount of reflected infrared light irradiated from the left infrared light emitter, and a right infrared receiver configured to recognize the amount of reflected infrared light irradiated from the right infrared light emitter. The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable electronic device (300) to: A wearable electronic device that recognizes the amount of reflected infrared light using either the left infrared light receiver or the right infrared light receiver.

6. In paragraph 5, The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable electronic device (300) to: A wearable electronic device that recognizes the amount of reflected light of infrared rays using the other of the left infrared receiver and the right infrared receiver based on recognizing that the amount of reflected light recognized by one of the left infrared receiver and the right infrared receiver is greater than the reference value.

7. In paragraph 5, The above gaze tracking camera (460) A left gaze tracking camera configured to capture an image corresponding to the left eye and a right gaze tracking camera configured to capture an image corresponding to the right eye are included. The above instructions, when individually or collectively executed by the at least one processor (120), cause the wearable electronic device (300) to: Based on recognizing that the amount of reflected light recognized by either the left infrared receiver or the right infrared receiver is greater than a reference value, either the left gaze tracking camera or the right gaze tracking camera is activated to acquire an image corresponding to the left or right eye of the user, and the at least one infrared light emitter (440) is controlled to irradiate infrared light. A wearable electronic device that activates both the left gaze tracking camera and the right gaze tracking camera based on an image acquired by either the left gaze tracking camera or the right gaze tracking camera.

8. In any one of paragraphs 1 to 7, A wearable electronic device in which the plurality of infrared light emitters (440), the infrared light receiver (450), and the gaze tracking camera (460) are arranged along the edge of the lens (L).

9. In paragraph 8, The above infrared light receiver (450) is A wearable electronic device comprising a first infrared light receiver (451) positioned adjacent to the above-described gaze tracking camera (461).

10. In paragraph 9, The above infrared light receiver (450) is A wearable electronic device including a second infrared light receiver (452) positioned on the opposite side of the eye tracking camera (461) with respect to the central axis (LA) of the lens (L).

11. In any one of paragraphs 8 to 10, The above infrared light receiver (450) and the above gaze tracking camera (460) are, A wearable electronic device positioned adjacent to the lower portion of the above lens (L).

12. In any one of paragraphs 8 to 10, A wearable electronic device further comprising a partition (459) surrounding the infrared light receiving body (450) when viewed from above the lens (L).

13. In any one of paragraphs 8 to 10, A wearable electronic device further comprising a substrate (470) on which the plurality of infrared light emitters (440) and the infrared light receiver (450) are mounted, and which extends at least partially along the edge of the lens (L).

14. In paragraph 13, The above substrate (2470) is A wearable electronic device comprising an outer bypass portion (2473) extending along the outer side of the eye tracking camera (460) when viewed from above the lens (L).

15. In paragraph 13, The above substrate (1470) is A wearable electronic device comprising an inner bypass portion (1473) extending along the inner side of the eye tracking camera (460) when viewed from above the lens (L).

Images