Electronic device for minimizing differential space and virtual space and method for manufacturing the electronic device

Abstract

An electronic device according to an embodiment may include: a lens assembly including a first lens; and a camera module including a second lens and coupled to the lens assembly, the second lens having the same optical axis as the optical axis of the first lens, in which the lens assembly and the camera module are configured to move together while the optical axis of the first lens and the optical axis of the second lens coincide.

Description

Technical Field

[0001] The present disclosure relates to an electronic device for minimizing a difference between a real space and a virtual space and a method of manufacturing the electronic device. Background Art

[0002] Electronic devices are being developed that include user interfaces that provide virtual reality (VR), augmented reality (AR), mixed reality (MR), and / or extended reality (XR) experiences.

[0003] The above description is information obtained or already known by the inventor during the process of conceiving the present disclosure and is not necessarily known technology before the present application was filed. Summary of the invention

[0004] A wearable electronic device according to an embodiment may include a lens assembly including a first lens and a second lens, the second lens having an optical axis identical to that of the first lens. The wearable electronic device may include a camera module coupled to the lens assembly. The lens assembly and the camera module may be configured to move together while the optical axis of the first lens and the optical axis of the second lens are aligned.

[0005] The method of manufacturing a wearable electronic device according to an embodiment may include fixing a display module to a lens assembly including a first lens, wherein the display module may output image light toward the lens assembly. The method may include coupling a camera module including a second lens to the lens assembly, wherein the second lens has an optical axis that is the same as the optical axis of the first lens. The lens assembly and the camera module may be configured to move together while the optical axis of the first lens and the optical axis of the second lens are aligned.

[0006] The wearable electronic device according to the embodiment may further include a processor configured to construct a virtual space. The wearable electronic device may include a lens assembly, the lens assembly including a first lens. The wearable electronic device may include a camera module, the camera module including a second lens and connected to the lens assembly, the second lens having an optical axis identical to that of the first lens. The wearable electronic device may include a display module, the display module being disposed between the lens assembly and the camera module and configured to output image light toward the lens assembly. The processor may be configured to determine whether the pupil of the user is aligned with the optical axis of the first lens. The processor may be configured to: when it is determined that the pupil of the user is not aligned with the optical axis of the first lens, shift the second type of image generated by the processor related to the virtual space based on the first type of image related to the real space obtained from the camera module. The processor may be configured to output the first type of image and the shifted second type of image to the display module.

[0007] A method implemented by a processor according to an embodiment may include determining whether a user's pupil is aligned with an optical axis of a first lens included in a lens assembly. The method may include: in response to determining that the user's pupil is not aligned with the optical axis of the first lens, shifting a second type of image associated with a virtual space generated by the processor based on a first type of image associated with a real space obtained from a camera module, wherein the camera module includes a second lens having an optical axis identical to that of the first lens. The method may include outputting the first type of image and the shifted second type of image to a display module. The camera module may be coupled to the lens assembly. The display module may be disposed between the lens assembly and the camera module and configured to output image light toward the lens assembly.

[0008] A non-transitory computer-readable storage medium may store instructions that, when executed by a processor, cause the processor to perform the method as described above. BRIEF DESCRIPTION OF THE DRAWINGS

[0009] Figure 1 is a block diagram illustrating electronic devices in a network environment according to various embodiments.

[0010] Figure 2a is a front perspective view of a wearable electronic device according to an embodiment.

[0011] Figure 2b is a rear perspective view of a wearable electronic device according to an embodiment.

[0012] Figure 3 is a perspective view of a wearable electronic device according to an embodiment.

[0013] Figure 4 is a diagram illustrating coupling of a lens assembly corresponding to one of a user's left eye and right eye, a display panel, and a camera module according to an embodiment.

[0014] Figure 5 is a diagram illustrating coupling between lens components of a wearable electronic device according to an embodiment.

[0015] Figure 6 is a diagram illustrating an operation of a wearable electronic device to correct an image based on a distance between a user's pupil and an optical axis of a lens according to an embodiment.

[0016] Figure 7 is a diagram illustrating an operation of shifting a second type of image generated by a processor based on a first type of image. DETAILED DESCRIPTION

[0017] Hereinafter, the embodiments will be described in detail with reference to the accompanying drawings. When describing the embodiments with reference to the accompanying drawings, the same reference numerals refer to the same elements, and the related repeated description will be omitted.

[0018] Figure 1 1 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the above components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the above-described components (eg, sensor module 176, camera module 180, or antenna module 197) may be integrated into a single component (eg, display module 160).

[0019] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to an embodiment, as at least a part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or as part of the main processor 121.

[0020] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one of the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., ISP or CP) may be implemented as a part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., NPU) may include a hardware structure dedicated to artificial intelligence (AI) model processing. The AI ​​model may be generated through machine learning. For example, such learning may be performed by an electronic device 101 in which artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The AI ​​model may include multiple artificial neural network layers. The artificial neural network may include, for example, a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), and a bidirectional recurrent deep neural network (BRDNN), a deep Q network, or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the AI ​​model may include a software structure in addition to a hardware structure.

[0021] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a non-volatile memory 134.

[0022] The program 140 may be stored in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or an application 146 .

[0023] The input module 150 may receive commands or data to be used by other components (e.g., the processor 120) of the electronic device 101 from outside (e.g., a user) of the electronic device 101. The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0024] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker may be used for general purposes such as playing multimedia or playing records. The receiver may be used to receive incoming calls. Depending on the embodiment, the receiver may be implemented as a separate part from the speaker, or as part of the speaker.

[0025] The display module 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display module 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, or the projector. According to an embodiment, the display module 160 may include a touch sensor adapted to sense a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.

[0026] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an external electronic device (e.g., the electronic device 102, such as a speaker or earphone) directly or wirelessly connected to the electronic device 101.

[0027] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0028] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., via a line) or wirelessly with an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0029] The connection end 178 may include a connector, wherein the electronic device 101 may be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0030] The haptic module 179 may convert the electric signal into mechanical stimulation (eg, vibration or motion) or electric stimulation that can be recognized by the user via his or her sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electric stimulator.

[0031] The camera module 180 may capture still images and moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an ISP, or a flash.

[0032] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0033] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0034] The communication module 190 can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors that can operate independently of the processor 120 (e.g., AP) and support direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules may be implemented as a single component (e.g., a single chip), or may be implemented as multiple components (e.g., multiple chips) separated from each other. The wireless communication module 192 may identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the SIM 196.

[0035] The wireless communication module 192 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technologies). NR access technologies can support enhanced mobile broadband (eMBB), massive machine type communications (mMTC), or ultra-reliable low-latency communications (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less for a round trip).

[0036] The antenna module 197 may transmit a signal or power to the outside of the electronic device 101 (e.g., an external electronic device) or receive a signal or power from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element including a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190. A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via at least one selected antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as a part of the antenna module 197.

[0037] According to an embodiment, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a PCB, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., an array antenna), wherein the RFIC is disposed on a first surface (e.g., a bottom surface) of the PCB, or is adjacent to the first surface and is capable of supporting a specified high frequency band (e.g., a millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., a top surface or a side surface) of the PCB, or is adjacent to the second surface and is capable of transmitting or receiving signals of the specified high frequency band.

[0038] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transfer signals (e.g., commands or data) therebetween.

[0039] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the external electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed by the electronic device 101 may be executed at one or more external electronic devices (e.g., the external electronic device 102, the external electronic device 104, and the server 108). For example, if the electronic device 101 needs to automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least a portion of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least a portion of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute at least part of the requested function or service, or execute another function or another service related to the request, and may transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology, or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or MEC to provide ultra-low latency services. In an embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or health care) based on 5G communication technology or IoT-related technologies.

[0040] Figure 2a is a front perspective view of a wearable electronic device according to an embodiment. Figure 2b is a rear perspective view of a wearable electronic device according to an embodiment.

[0041] refer to Figure 2a and Figure 2b , a wearable electronic device 201 (eg, Figure 1The wearable electronic device 201 may be worn on a part of a user's body and may provide a user interface. For example, the wearable electronic device 201 may provide the user with an experience of augmented reality, virtual reality, mixed reality, and / or extended reality.

[0042] In an embodiment, the wearable electronic device 201 may include a housing 210. The housing 210 may be configured to accommodate at least one component. The housing 210 may include a first surface 211A (e.g., a front surface), a second surface 211B (e.g., a rear surface) opposite to the first surface 211A, and a third surface 211C (e.g., a side surface) between the first surface 211A and the second surface 211B.

[0043] In an embodiment, the housing 210 may include a plurality of housing parts. For example, the housing 210 may include a first housing part 211 and a second housing part 212. The first housing part 211 may form a first surface 211A of the housing 210. The first housing part 211 may form at least a portion of a third surface 211C of the housing 210. The second housing part 212 may form a second surface 211B of the housing 210. The second housing part 212 may form at least a portion of the third surface 211C of the housing 210. In an embodiment, the second housing part 212 may face a portion of a user's body (e.g., a face). In an embodiment, the first housing part 211 may be detachably coupled to the second housing part 212. In an embodiment, the first housing part 211 and the second housing part 212 may be seamlessly connected to each other as one body.

[0044] In an embodiment, the housing 210 may include a cover 213. The cover 213 may form a first surface 211A of the housing 210. The cover 213 may be configured to cover at least a portion of the first housing member 211.

[0045] In an embodiment, the housing 210 may include a bridge 214. The bridge 214 may be configured to face a portion of the user's body (e.g., a nose). For example, the bridge 214 may be supported by the user's nose. The bridge 214 may be formed in at least one or any combination of the first housing component 211, the second housing component 212, or the cover 213.

[0046] In an embodiment, the wearable electronic device 201 may include a lens structure 220. The lens structure 220 may include a plurality of lenses configured to adjust the focus of an image provided to a user. For example, the plurality of lenses may be configured to adjust the focus of an image output by the display 260. The plurality of lenses may be located at positions corresponding to the position of the display 260. The plurality of lenses may include, for example, a Fresnel lens, a pancake lens, a multi-channel lens, and / or other suitable lenses.

[0047] In an embodiment, the wearable electronic device 201 may include a display 260 (eg, Figure 1 The display module 160 of the housing 210 is shown in FIG. 1 . The display 260 may be configured to provide an image (e.g., a virtual image) to a user. In an embodiment, the display 260 may include a liquid crystal display (LCD), a digital mirror device (DMD), or a liquid crystal on silicon (LCoS), a light emitting diode on silicon (LEDoS), an organic light emitting diode (OLED), and / or a micro light emitting diode (micro LED). In an embodiment, the display 260 may include a light source (not shown) configured to emit a light signal to a region where an image is to be output. In an embodiment, the display 260 may provide an image to a user by generating a light signal by itself. In an embodiment, the display 260 may be disposed on the second surface 211B of the housing 210. In an embodiment, the display 260 may be disposed on the second housing component 212. In an embodiment, the display 260 may include a first display area 260A and a second display area 260B. The first display area 260A may be disposed to face the left eye of the user. The second display area 260B may be disposed to face the right eye of the user. In an embodiment, the first display area 260A and the second display area 260B may include glass, plastic, and / or polymer. In an embodiment, the first display area 260A and the second display area 260B may include a transparent material or a translucent material. In an embodiment, the first display area 260A and the second display area 260B may form a single display area. In an embodiment, the first display area 260A and the second display area 260B may form a plurality of display areas.

[0048] In an embodiment, the wearable electronic device 201 may include a sensor 276 (eg, Figure 1Sensor module 176). The sensor 276 may be configured to sense the depth of an object. The sensor 276 may be configured to transmit a signal to an object and / or receive a signal from an object. For example, the transmitted signal may include near infrared rays, ultrasound, and / or laser. The sensor 276 may be configured to measure the time of flight (ToF) of the signal to measure the distance between the wearable electronic device 201 and the object. In an embodiment, the sensor 276 may be disposed on the first surface 211A of the housing 210. In an embodiment, the sensor 276 may be disposed on the cover 213 and / or the central portion of the first housing component 211.

[0049] In an embodiment, the wearable electronic device 201 may include a plurality of first cameras 280A (eg, Figure 1 The plurality of first cameras 280A may be configured to obtain an image from an object. One of the plurality of first cameras 280A may be disposed in a first area (eg, Figure 2a , and another of the plurality of first cameras 280A may be disposed in a second area (eg, Figure 2a The plurality of first cameras 280A may be disposed on both sides of the sensor 276. The plurality of first cameras 280A may include an image stabilizer actuator (not shown) and / or an autofocus actuator (not shown). For example, the plurality of first cameras 280A may include at least one or any combination of a camera configured to obtain a color image, a global shutter camera, or a rolling shutter camera.

[0050] In an embodiment, the wearable electronic device 201 may include a plurality of second cameras 280B (eg, Figure 1 The plurality of second cameras 280B may be configured to recognize an object. The plurality of second cameras 280B may be configured to detect and / or track a space, or a 3-degree-of-freedom (DoF) or 6-DoF object (e.g., a head or hand of a human body). For example, the plurality of second cameras 280B may include a global shutter camera. The plurality of second cameras 280B may be configured to perform simultaneous localization and mapping (SLAM) using depth information of an object. The plurality of second cameras 280B may be configured to recognize gestures of an object. In an embodiment, the plurality of second cameras 280B may be disposed on the first surface 211A of the housing 210. In an embodiment, the plurality of second cameras 280B may be disposed on corner areas of the cover 213 and / or the first housing component 211, respectively.

[0051] In an embodiment, the wearable electronic device 201 may include a plurality of third cameras 280C (eg, Figure 1 The plurality of third cameras 280C may be configured to detect and track the user's pupils. The position information about the user's pupils may be used to move the center of the image displayed on the display 260 in the direction in which the user's pupils are looking. For example, the plurality of third cameras 280C may include a global shutter camera. One of the plurality of third cameras 280C may be set to correspond to the user's left eye, and another of the plurality of third cameras 280C may be set to correspond to the user's right eye.

[0052] In an embodiment, the wearable electronic device 201 may include a plurality of fourth cameras 280D (eg, Figure 1 The plurality of fourth cameras 280D may be configured to recognize the user's face. For example, the plurality of fourth cameras 280D may be configured to detect and track the user's facial expressions.

[0053] In an embodiment not shown, the wearable electronic device 201 may include a microphone (eg, Figure 1 Input module 150), a speaker (e.g., Figure 1 sound output module 155), a battery (eg, Figure 1 of battery 189), antenna (e.g., Figure 1 antenna module 197), sensors (e.g., Figure 1 sensor module 176 ) and / or any component suitable for the wearable electronic device 201 .

[0054] Figure 3 is a perspective view of a wearable electronic device according to an embodiment.

[0055] According to the wearable electronic device of the embodiment (for example, Figure 1 The electronic device 101 and / or Figure 2a and Figure 2b The wearable electronic device 201 may include a housing 301 (eg, Figure 2a and Figure 2b housing 210).

[0056] The wearable electronic device may include a first lens assembly 310-1 corresponding to a left eye of a user and a second lens assembly 310-2 corresponding to a right eye of the user.

[0057] The wearable electronic device may include a first camera module 330-1 corresponding to the left eye of the user and a second camera module 330-2 corresponding to the right eye of the user. The first camera module 330-1 and the second camera module 330-2 may be configured to obtain an image from an object. The first camera module 330-1 may be disposed in a first area (e.g., Figure 3 The second camera module 330-2 may be disposed in a second area (eg, Figure 3 - the part in the X direction).

[0058] The wearable electronic device may include a first display module 360-1 configured to output image rays toward the first lens assembly 310-1 and a second display module 360-2 configured to output image rays toward the second lens assembly 310-2.

[0059] The wearable electronic device may include a first display module 360-1 corresponding to the left eye of the user and a second display module 360-2 corresponding to the right eye of the user. The display modules 360-1 and 360-2 may be configured to provide an image (e.g., a virtual image) to the user. The first display module 360-1 may be arranged to face the left eye of the user, and the second display module 360-2 may be arranged to face the right eye of the user. The first display module 360-1 and the second display module 360-2 may include a transparent material or a translucent material.

[0060] The wearable electronic device may include a PCB (e.g., a printed board assembly (PBA), a flexible PCB (FPCB), or a rigid-flexible PCB (RFPCB)) disposed between the first camera module 330-1 and the first display module 360-1 and between the second camera module 330-2 and the second display module 360-2. The PCB may be connected to the first camera module 330-1 and the second camera module 330-2, and may be connected to the first display module 360-1 and the second display module 360-2.

[0061] According to an embodiment, the first display module 360-1 may provide the first lens assembly 310-1 with a scene image in which a first type of image related to the real space obtained from the first camera module 330-1 and a second type of image related to the virtual space generated by the processor overlap. The second display module 360-2 may provide the second lens assembly 310-2 with a scene image in which a first type of image related to the real space obtained from the second camera module 330-2 and a second type of image related to the virtual space generated by the processor overlap. Visual information related to the virtual space may be provided to the user based on the scene images provided by the camera modules 330-1 and 330-2, the display modules 360-1 and 360-2, and the lens assemblies 310-1 and 310-2.

[0062] Figure 4 is a diagram illustrating coupling of a lens assembly corresponding to one of a user's left eye and right eye, a display panel, and a camera module according to an embodiment.

[0063] According to an embodiment, a wearable electronic device (e.g., Figure 1 The electronic device 101 or Figure 2a and Figure 2b The wearable electronic device 201 may include a lens assembly 410, which includes a first lens. The wearable electronic device may also include a first bracket 420, which fixes the first lens of the lens assembly 410. The first bracket 420 may be connected to the lens assembly 410. The lens assembly 410 may include a plurality of lenses, but for convenience of description, the lens assembly 410 is described as including one lens. When the lens assembly 410 includes a plurality of lenses, the plurality of lenses may have substantially the same optical axis.

[0064] According to an embodiment, the wearable electronic device may include a second lens of the camera module 430, wherein the second lens has an optical axis that is the same as an optical axis 471 of the first lens included in the lens assembly 410. For example, the lens assembly 410 may be connected to the camera module 430. The wearable electronic device may include a second bracket 440 supporting the camera module 430.

[0065] According to an embodiment, the lens assembly 410 and the camera module 430 may be configured to move together while the optical axis 471 of the first lens and the optical axis 472 of the second lens are aligned. The lens assembly 410 may be configured to move in a first direction (e.g., +X direction) or a second direction (e.g., -X direction) opposite to the first direction, and the camera module 430 may be configured to move in the first direction (e.g., +X direction) or a second direction (e.g., -X direction) opposite to the first direction. Considering the coupling between the lens assembly 410 and the camera module 430, the lens assembly 410 and the camera module 430 may be configured to move in substantially the same direction, and the optical axis 471 of the first lens included in the lens assembly 410 and the optical axis 472 of the second lens of the camera module 430 may be aligned. Hereinafter, a method of coupling the lens assembly 410 and the camera module 430 is described.

[0066] According to an embodiment, the first bracket 420 may include a first surface facing the first lens and a second surface facing a direction opposite to the first surface (eg, +Z direction). The first bracket 420 may include first coupling portions 421 and 422 formed on the second surface opposite to the first surface. For example, Figure 4 As shown, the first bracket 420 may include a first connecting portion 421 and a second connecting portion 422. The first connecting portion 421 is formed on a first side (e.g., an upper side or a +Y direction side) on the second surface, and the second connecting portion 422 is formed on a second side (e.g., a lower side or a -Y direction side) on the second surface. The first side and the second side may be opposite sides based on the optical axis 471 of the first lens. The first connecting portion (e.g., the first connecting portion 421 or the first connecting portion 422) may include two fastening members that protrude a predetermined height on the second surface in a direction substantially parallel to the optical axis 471 of the first lens (e.g., the +Z direction). For example, the two fastening members may be spaced apart by a predetermined distance. As shown in FIG. Figure 4 As shown, the first bracket 420 may include two coupling parts 421 and 422 , but is not limited thereto, and the first bracket 420 may include one or three or more coupling parts.

[0067] According to an embodiment, the second bracket 440 supporting the camera module 430 may include: an extension member 443 substantially perpendicular to the optical axis 472 of the second lens; and a plurality of second coupling portions 441 and 442 formed at both ends of the extension member 443. Figure 4As shown, the second bracket 440 may include a second coupling portion 441 formed on one end of a first side (e.g., +Y direction side) of the extension member 443 and a second coupling portion 442 formed on the other end of a second side (e.g., -Y direction side) of the extension member 443. Similarly, the first side and the second side may be opposite sides based on the optical axis 472 of the second lens. The second coupling portion (e.g., the second coupling portion 441 or the second coupling portion 442) may include a fastening member that protrudes a predetermined height on one end and / or the other end of the extension member 443 in a direction substantially parallel to the optical axis 472 of the second lens (e.g., -Z direction).

[0068] According to an embodiment, the lens assembly 410 and the camera module 430 may be coupled by coupling the first bracket 420 fixing the first lens of the lens assembly 410 and the second bracket 440 fixing the camera module 430. Figure 4 , the first coupling portion 421 included in the first bracket 420 may be coupled with the second coupling portion 441 included in the second bracket 440, and the first coupling portion 422 included in the first bracket 420 may be coupled with the second coupling portion 442 included in the second bracket 440. The fastening member included in the second coupling portion 441 may be disposed between the two fastening members included in the first coupling portion 421. The fastening member included in the second coupling portion 442 may be disposed between the two fastening members included in the first coupling portion 422.

[0069] According to an embodiment, the first coupling portion 421 included in the first bracket 420 may be coupled to the second coupling portion 441 included in the second bracket 440 using the first shaft 451. The first coupling portion 422 included in the first bracket 420 may be coupled to the second coupling portion 442 included in the second bracket 440 using the second shaft 452. A fastening hole 21 for coupling with the second bracket 440 may be formed in the first coupling portion 421 formed on the first side (e.g., +Y direction side) included in the first bracket 420. The fastening hole 21 may be formed in a fastening member of the first coupling portion 421. Similarly, the fastening hole 22 may be formed in the first coupling portion 422 formed on the second side (e.g., -Y direction side) included in the first bracket 420. The fastening hole 41 may be formed in the second coupling portion 441 formed on the first side of the extension member 443 included in the second bracket 440 for coupling with the first bracket 420, and the fastening hole 42 may be formed in the second coupling portion 442 formed on the second side of the extension member 443. The first shaft 451 may be inserted into the fastening hole 21 formed in the first coupling portion 421 and the fastening hole 41 formed in the second coupling portion 441, and the second shaft 452 may be inserted into the fastening hole 22 formed in the first coupling portion 422 and the fastening hole 42 formed in the second coupling portion 442.

[0070] The first axis 451 and the second axis 452 may be substantially parallel to each other and may be disposed to be spaced apart from each other. The first axis 451 and the second axis 452 may extend along axes (eg, X-direction axes) skewed to the optical axes 471 and 472 of the first and second lenses, respectively.

[0071] According to an embodiment, the lens assembly 410 and the camera module 430 may be configured to be movable along the first axis 451 and the second axis 452. When the lens assembly 410 moves a predetermined distance along an axis (e.g., an X-direction axis) corresponding to the axis (e.g., the first axis 451 or the second axis 452), the camera module 430 coupled to the lens assembly 410 may move along the axis (e.g., the X-direction axis) corresponding to the axis (e.g., the first axis 451 or the second axis 452) by as much as the distance moved by the lens assembly 410.

[0072] According to an embodiment, the wearable electronic device may further include a display module 460 (eg, Figure 3The display module 460 is provided between the lens assembly 410 and the camera module 430 in a manner of being fixed to the lens assembly 410, and is configured to output image light toward the lens assembly 410. A connecting member may be formed on one side of the display module 460. The display module 460 and the lens assembly 410 may be connected to each other through coupling between the connecting member formed on one side of the display module 460 and the first bracket 420.

[0073] According to an embodiment, when manufacturing a wearable electronic device, the lens assembly 410 and the display module 460 may be first coupled. That is, the display module 460 configured to output image light toward the lens assembly 410 may be fixed to the lens assembly 410 including the first lens. The optical axis of the first lens may be checked and corrected using active alignment techniques. When manufacturing a wearable electronic device, after the lens assembly 410 and the display module 460 are coupled, the camera module 430 may be coupled to the lens assembly 410, the camera module 430 including a second lens having an optical axis substantially the same as the optical axis of the first lens of the lens assembly 410.

[0074] According to an embodiment, the wearable electronic device may further include a processor configured to construct a virtual space (eg, Figure 1 The processor 120 of the present invention may construct a virtual space by generating a virtual graphic representation or a virtual object. The display module 460 may overlap a first type of image related to the real space obtained from the camera module 430 and a second type of image related to the virtual space generated by the processor, and provide them to the lens assembly 410.

[0075] Figure 5 is a diagram illustrating coupling between lens components of a wearable electronic device according to an embodiment.

[0076] According to the wearable electronic device of the embodiment (for example, Figure 1 The electronic device 101 or Figure 2a and Figure 2b The wearable electronic device 201 may include a first lens assembly 510-1 corresponding to the left eye of the user and a second lens assembly 510-2 corresponding to the right eye of the user. The first lens assembly 510-1 and the second lens assembly 510-2 may be coupled by an axis and may be configured to be movable along the axis. The first lens assembly 510-1 and the second lens assembly 510-2 may be coupled by an axis 551 (e.g., Figure 4 The first axis 451 and the second axis 552 (eg, Figure 4The first lens assembly 510-1 and the second lens assembly 510-2 may be moved on substantially the same plane (eg, XY plane). Hereinafter, a method of coupling the first lens assembly 510-1 and the second lens assembly 510-2 is described.

[0077] The wearable electronic device may include a first bracket 520-1 coupled to a lens of a first lens assembly 510-1, and may also include a third bracket 520-2 coupled to a lens of a second lens assembly 510-2. The first bracket 520-1 may include coupling portions 521-1 and 522-1, and each of the coupling portions 521-1 and 522-1 may include two fastening members that protrude a predetermined height in a direction substantially parallel to the optical axis of the lens of the first lens assembly 510-1 (e.g., +Z direction). The third bracket 520-2 may include coupling portions 521-2 and 522-2, and each of the coupling portions 521-2 and 522-2 may include two fastening members that protrude a predetermined height in a direction substantially parallel to the optical axis of the lens of the second lens assembly 510-2 (e.g., +Z direction). A fastening hole may be formed in each of the coupling parts 521-1 and 522-1 included in the first bracket 520-1, and a fastening hole may be formed in each of the coupling parts 521-2 and 522-2 included in the third bracket 520-2. Figure 4 The first shaft 451 (eg, a first shaft 451) may be inserted into the fastening hole formed in the coupling portion 521-1 and the fastening hole formed in the coupling portion 521-2. The second shaft 552 (eg, Figure 4 The second shaft 552 of the first shaft 551 may be inserted into the fastening hole formed in the coupling portion 522-1 and the fastening hole formed in the coupling portion 522-2. The first shaft 551 and the second shaft 552 may be parallel to each other.

[0078] In an embodiment, the first bracket 520-1 may include a first gear 590-1. The first gear 590-1 may include a plurality of first teeth arranged along a first direction (e.g., +X direction) or a second direction (e.g., -X direction). The third bracket 520-2 may include a second gear 590-2. The second gear 590-2 may include a plurality of second teeth arranged along a first direction (e.g., +X direction) or a second direction (e.g., -X direction). The plurality of second teeth may face the plurality of first teeth.

[0079] In an embodiment, the wearable electronic device may include an adjustment structure 591. The adjustment structure 591 may be configured to adjust the distance between the first lens assembly 510-1 and the second lens assembly 510-2. The adjustment structure 591 may be configured to adjust the position of the lens of the first lens assembly 510-1 and / or the position of the lens of the second lens assembly 510-2 to be suitable for the user's individual interpupillary distance (IPD). The adjustment structure 591 may include an adjustment gear, and the adjustment gear may be configured to mesh with the first gear 590-1 and the second gear 590-2. In an embodiment, the adjustment gear may be configured to rotate.

[0080] Figure 6 is a diagram illustrating an operation of a wearable electronic device to correct an image based on a distance between a user's pupil and an optical axis of a lens according to an embodiment.

[0081] In an embodiment, it may be predetermined that the wearable electronic device (eg, Figure 1 The electronic device 101 or Figure 2a and Figure 2b According to an embodiment, the wearable electronic device may measure the IPD of the user. When the measured IPD of the user is less than a lower limit of the available IPD range of the wearable electronic device or exceeds an upper limit of the available IPD range of the wearable electronic device, the wearable electronic device may correct the image output from the display module. More specifically, according to the IPD of the user, the wearable electronic device may correct the position of the second type of image related to the virtual space to be output from the display module based on the first type of image related to the real space, thereby minimizing the cognitive gap between the real space expected by the user and the image output from the display module.

[0082] According to an embodiment, a wearable electronic device (e.g., Figure 1 The electronic device 101 or Figure 2a and Figure 2b The wearable electronic device 201) can correct the image to be viewed from the display module (eg, Figure 4 Hereinafter, a wearable electronic device that corrects an image to be output from a display module corresponding to a user's left pupil is mainly described.

[0083] According to an embodiment, the wearable electronic device may include a first lens assembly (eg, Figure 4 lens assembly 410) and a first camera module corresponding to the user's left eye 610 (eg, Figure 4 The first lens assembly may include a first lens, and the first camera module may include a second lens, and the wearable electronic device may be configured such that an optical axis of the first lens (eg, Figure 4 The optical axis of the first lens 471 and the optical axis of the second lens (eg, Figure 4 The first camera module may be coupled to the first lens assembly. The first lens assembly and the first camera module may be configured to move together while the optical axis of the first lens and the optical axis of the second lens are aligned. The wearable electronic device may also include a first display module (e.g., Figure 4 A display module 460 is provided, wherein the first display module is disposed between the first lens assembly and the first camera module and is configured to output image light toward the first lens assembly.

[0084] According to an embodiment, the wearable electronic device may further include a camera (eg, Figure 2a and Figure 2b The wearable electronic device may determine whether the user's pupil is aligned with the optical axis of the lens included in the lens assembly based on the image capturing the user's pupil.

[0085] refer to Figure 6 , the wearable electronic device can determine whether the left pupil of the user is aligned with the optical axis of the first lens included in the first lens assembly based on the image 601 that captures the left eye 610 of the user. The wearable electronic device can detect the center of the left pupil of the user based on the image 601. For example, the wearable electronic device can identify the left pupil of the user and cause an infrared (IR) light source (e.g., an IR LED) to emit light around the identified left pupil of the user. The wearable electronic device can detect a point 611 corresponding to the center of the left pupil of the user using points 631, 632, and 633 displayed on the image 601 due to the light emitted from the IR light source. In addition, the wearable electronic device can detect a point 621 corresponding to the optical axis of the first lens included in the first lens assembly from the image 601.

[0086] According to an embodiment, the wearable electronic device may determine whether the left pupil is aligned with the optical axis of the first lens based on the first axis (e.g., the +X direction axis). That is, the wearable electronic device may compare the first axis coordinate of the point 611 corresponding to the center of the left pupil and the first axis coordinate of the point 621 corresponding to the optical axis of the first lens. The wearable electronic device may determine whether the first axis coordinate of the point 611 corresponding to the center of the left pupil and the first axis coordinate of the point 621 corresponding to the optical axis of the first lens are substantially the same. When the first axis coordinate of the point 611 corresponding to the center of the left pupil and the first axis coordinate of the point 621 corresponding to the optical axis of the first lens are substantially the same, the wearable electronic device may determine that the left pupil is aligned with the optical axis of the first lens. When the first axis coordinate of the point 611 corresponding to the center of the left pupil and the first axis coordinate of the point 621 corresponding to the optical axis of the first lens are different, the wearable electronic device may determine that the left pupil is not aligned with the optical axis of the first lens.

[0087] According to an embodiment, when it is determined that the left pupil is aligned with the optical axis of the first lens, the wearable electronic device may not correct the image to be output from the first display module. That is, the wearable electronic device may not change the position of the second type of image related to the virtual space generated by the processor to be output from the first display module. For example, the first type of image related to the real space obtained from the first camera module may have a fixed position, and the first type of image will be output from the first display module at the fixed position.

[0088] According to an embodiment, when it is determined that the left pupil is not aligned with the optical axis of the first lens, the wearable electronic device may change the position of the second type of image related to the virtual space generated by the processor to be output from the first display module. That is, the wearable electronic device may shift the second type of image relative to the first type of image whose position to be output from the first display module is fixed along the first direction (e.g., +X direction) or the second direction (e.g., -X direction). The wearable electronic device may output to the first display module a scene image generated by overlapping the first type of image and the shifted second type of image.

[0089] According to an embodiment, the wearable electronic device may determine the direction along which to shift the second type of image by comparing the position of a point corresponding to the user's pupil and the position of a point corresponding to the optical axis of the lens included in the lens assembly. According to an embodiment, when the point corresponding to the user's pupil is located on a first side (e.g., the +X direction side) compared to the point corresponding to the optical axis of the lens, the wearable electronic device may shift the second type of image relative to the first type of image along a first direction (e.g., the +X direction). According to an embodiment, when the point corresponding to the user's pupil is located on a second side (e.g., the -X direction side) compared to the point corresponding to the optical axis of the lens, the wearable electronic device may shift the second type of image relative to the first type of image along a second direction (e.g., the -X direction). Reference Figure 6 , when the point 611 corresponding to the center of the left pupil is located on a first side (e.g., +X direction side) compared to the point 621 corresponding to the optical axis of the first lens, the wearable electronic device may shift the second type of image relative to the first type of image along the first direction (e.g., +X direction). When the point 611 corresponding to the center of the left pupil is located on a second side (e.g., -X direction side) compared to the point 621 corresponding to the optical axis of the first lens, the wearable electronic device may shift the second type of image relative to the first type of image along the second direction (e.g., -X direction).

[0090] Figure 7 is a diagram illustrating an operation of shifting a second type of image generated by a processor based on a first type of image.

[0091] According to an embodiment, from a first camera module (eg, Figure 4 The first type of image 731 obtained by the camera module 430) and the second type of image 761 generated by the processor may be overlapped and displayed from a display module (eg, Figure 4 As described above, the area where the first type of image 731 is output from the first display module may be fixed, and the area where the second type of image 761 is output may be variable. The area where the first type of image 731 is output from the first display module may include an area where the second type of image 761 is output. For example, referring to Figure 7 , the height of the area outputting the first type of image 731 may be substantially the same as the height of the area outputting the second type of image 761, and the width of the area outputting the first type of image 731 may be wider than the width of the area outputting the second type of image 761.

[0092] According to an embodiment, the wearable electronic device may calculate an error distance between a point corresponding to the pupil of the user and a point corresponding to the optical axis of the first lens based on the first axis, and shift the second type of image relative to the first type of image by a distance proportional to the calculated error distance. Figure 7 , the wearable electronic device may position the first type of image 731 so that: when it is determined that the left pupil is aligned with the optical axis of the first lens included in the first lens assembly, the center of the first type of image 731 is aligned with the center of the second type of image 761. When it is determined that the left pupil is not aligned with the optical axis of the first lens, the wearable electronic device may calculate a point corresponding to the center of the left pupil based on the first axis (e.g., the +X direction axis) (e.g., Figure 6 point 611) and a point corresponding to the optical axis of the first lens (eg, Figure 6 That is, the wearable electronic device may calculate the difference between the first axis (e.g., +X direction axis) coordinate of the point corresponding to the center of the left pupil and the first axis (e.g., +X direction axis) coordinate of the point corresponding to the optical axis of the first lens as the error distance. The wearable electronic device may shift the second type of image 761 by a distance proportional to the calculated error distance. Figure 7 In an example of , the wearable electronic device may determine that a point corresponding to the center of the left pupil of the user with respect to the first axis is located on the second side (e.g., the -X direction side) compared to a point corresponding to the optical axis of the first lens, and the point corresponding to the center of the left pupil of the user with respect to the first axis and the point corresponding to the optical axis of the first lens are separated by a first distance. In this case, the wearable electronic device may shift the second type of image 761 along the second direction (e.g., the -X direction) by a distance 751 proportional to the first distance. In another example, the wearable electronic device may determine that a point corresponding to the center of the left pupil of the user with respect to the first axis is located on the first side (e.g., the +X direction side) compared to a point corresponding to the optical axis of the first lens, and the point corresponding to the center of the left pupil of the user with respect to the first axis and the point corresponding to the optical axis of the first lens are separated by a second distance less than the first distance. In this case, the wearable electronic device may shift the second type of image 761 along the first direction (e.g., the +X direction) by a distance 752 proportional to the second distance. In this example, the distance 752 may be less than the distance 751.

[0093] According to the wearable electronic device of the embodiment (for example, Figure 1 The electronic device 101 and / or Figure 2a and Figure 2bThe wearable electronic device 201) may include a lens assembly 410 and a camera module 430, the lens assembly 410 including a first lens, the camera module 430 including a second lens having an optical axis the same as an optical axis 471 of the first lens and connected to the lens assembly 410, wherein the lens assembly 410 and the camera module 430 may be configured to move together while the optical axis 471 of the first lens and the optical axis 472 of the second lens are aligned.

[0094] According to an embodiment, a wearable electronic device (e.g., Figure 1 The electronic device 101 and / or Figure 2a and Figure 2b The wearable electronic device 201) may further include a first bracket 420 configured to fix the first lens and a second bracket 440 configured to support the camera module, wherein the lens assembly 410 and the camera module 430 may be coupled based on the first bracket 420 and the second bracket 440 being coupled.

[0095] According to an embodiment, the first bracket 420 may include first connecting portions 421 and 422 formed on a second surface opposite to the first surface facing the first lens, and the second bracket 440 may include an extension member 443 perpendicular to the optical axis 472 of the second lens and a plurality of second connecting portions 441 and 442 formed at both ends of the extension member 443.

[0096] According to an embodiment, the first shaft 451 can be inserted into the fastening hole 21 formed in the first connecting part 421 of the first side and the fastening hole 41 formed in the second connecting part 441 of the first side, and the second shaft 452 can be inserted into the fastening hole 22 formed in the first connecting part 422 of the second side and the fastening hole 42 formed in the second connecting part 442 of the second side.

[0097] According to an embodiment, the lens assembly 410 and the camera module 430 may be configured to be movable along the first axis 451 and the second axis 452 .

[0098] According to an embodiment, a wearable electronic device (e.g., Figure 1 The electronic device 101 and / or Figure 2a and Figure 2b The wearable electronic device 201 may further include a display module 460 , which is disposed between the lens assembly 410 and the camera module 430 in a manner of being fixed to the lens assembly 410 and is configured to output image light toward the lens assembly 410 .

[0099] According to an embodiment, a wearable electronic device (e.g., Figure 1 The electronic device 101 and / or Figure 2a and Figure 2b The wearable electronic device 201) may also include a processor configured to construct a virtual space, and the display module 460 may overlap a first type of image related to the real space obtained from the camera module 430 and a second type of image related to the virtual space generated by the processor to provide them to the lens assembly 410.

[0100] According to an embodiment, a wearable electronic device (e.g., Figure 1 The electronic device 101 and / or Figure 2a and Figure 2b The wearable electronic device 201) may also include another lens assembly and another camera module, the other lens assembly including a third lens, the other camera module including a fourth lens having an optical axis identical to that of the third lens and connected to the other lens assembly, wherein the lens assembly 410 and the other lens assembly may be connected by an axis and configured to be movable along the axis.

[0101] According to the wearable electronic device of the embodiment (for example, Figure 1 The electronic device 101 and / or Figure 2a and Figure 2b A manufacturing method of a wearable electronic device 201) may include: fixing a display module 460 to a lens assembly 410 including a first lens, wherein the display module 460 is configured to output image light toward the lens assembly 410; and connecting a camera module 430 to the lens assembly 410, wherein the camera module 430 includes a second lens having an optical axis that is the same as an optical axis 471 of the first lens, wherein the lens assembly 410 and the camera module 430 may be configured to move together while the optical axis 471 of the first lens and the optical axis 472 of the second lens are aligned.

[0102] According to an embodiment, coupling the camera module 430 with the lens assembly 410 may include coupling the camera module 430 with the lens assembly 410 in response to a first bracket 420 configured to fix the first lens and a second bracket 440 configured to support the camera module 430 being coupled.

[0103] According to an embodiment, the first bracket 420 may include first connecting portions 421 and 422 formed on a second surface opposite to the first surface facing the first lens, and the second bracket 440 may include an extension member 443 perpendicular to the optical axis 472 of the second lens and a plurality of second connecting portions 441 and 442 formed at both ends of the extension member 443.

[0104] According to an embodiment, connecting the camera module 430 with the lens assembly 410 may include: inserting the first axis 451 into the fastening hole 21 formed in the first connecting portion 421 of the first side and the fastening hole 41 formed in the second connecting portion 441 of the first side, and inserting the second axis 452 into the fastening hole 22 formed in the first connecting portion 422 of the second side and the fastening hole 42 formed in the second connecting portion 442 of the second side.

[0105] According to the wearable electronic device of the embodiment (for example, Figure 1 The electronic device 101 and / or Figure 2a and Figure 2b The wearable electronic device 201 may include: a processor configured to construct a virtual space; a lens assembly 410, the lens assembly 410 including a first lens; a camera module 430, the camera module 430 including a second lens having an optical axis that is the same as an optical axis 471 of the first lens and connected to the lens assembly 410; and a display module 460, the display module 460 being disposed between the lens assembly 410 and the camera module 430 and configured to output image light toward the lens assembly 410, wherein the processor may be configured to: determine whether a pupil of a user is aligned with the optical axis 471 of the first lens, in response to determining that the pupil of the user is not aligned with the optical axis 471 of the first lens, shift a second type of image associated with the virtual space generated by the processor based on a first type of image associated with the real space obtained from the camera module 430, and output the first type of image and the shifted second type of image to the display module 460.

[0106] According to an embodiment, the processor may be configured to determine whether the first axis coordinate of the point corresponding to the center of the pupil of the user and the first axis coordinate of the point corresponding to the optical axis of the first lens are the same.

[0107] According to an embodiment, the processor may be configured to: in response to a point corresponding to the user's pupil being located on a first side compared to a point corresponding to the optical axis of the first lens, shift the second type of image relative to the first type of image along a first direction, and in response to a point corresponding to the user's pupil being located on a second side opposite to the first side compared to the point corresponding to the optical axis of the first lens, shift the second type of image relative to the first type of image along a second direction opposite to the first direction.

[0108] According to an embodiment, the processor can be configured to: calculate an error distance between a point corresponding to the user's pupil and a point corresponding to the optical axis of the first lens based on the first axis, and shift the second type of image relative to the first type of image by a distance proportional to the calculated error distance.

[0109] According to an embodiment, a method implemented by a processor may include: determining whether a user's pupil is aligned with an optical axis 471 of a first lens included in a lens assembly 410, in response to determining that the user's pupil is not aligned with the optical axis 471 of the first lens, shifting a second type of image associated with a virtual space generated by the processor based on a first type of image associated with a real space obtained from a camera module 430, wherein the camera module 430 includes a second lens having an optical axis that is the same as the optical axis 471 of the first lens, and outputting the first type of image and the shifted second type of image to a display module 460, wherein the camera module 430 may be connected to the lens assembly 410, and the display module 460 may be disposed between the lens assembly 410 and the camera module 430 and configured to output image light toward the lens assembly 410.

[0110] According to an embodiment, determining whether there is alignment may include determining whether a first axis coordinate of a point corresponding to a center of a pupil of the user and a first axis coordinate of a point corresponding to an optical axis of the first lens are the same.

[0111] According to an embodiment, the shifting may include: in response to a point corresponding to the user's pupil being located on a first side compared to a point corresponding to the optical axis of the first lens, shifting the second type of image relative to the first type of image along a first direction; and in response to a point corresponding to the user's pupil being located on a second side opposite to the first side compared to the point corresponding to the optical axis of the first lens, shifting the second type of image relative to the first type of image along a second direction opposite to the first direction.

[0112] According to an embodiment, the shifting may include calculating an error distance between a point corresponding to the user's pupil and a point corresponding to the optical axis of the first lens based on the first axis, and shifting the second type of image relative to the first type of image by a distance proportional to the calculated error distance.

[0113] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance device. According to an embodiment of the present disclosure, the electronic device is not limited to the electronic device described above.

[0114] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalents or replacements of the corresponding embodiments. Regarding the description of the accompanying drawings, similar figure numerals may be used to refer to similar or related parts. It should be understood that the singular form of the noun corresponding to an item may include one or more things, unless the relevant context clearly indicates otherwise. As used herein, "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one of the items listed together in the corresponding phrase in the phrase, or all possible combinations thereof. Terms such as “1st” and “2nd”, or “first” and “second” may be used to simply distinguish the corresponding component from other components without limiting the components in other aspects (e.g., importance or order). It should be understood that if a component (e.g., a first component) is referred to as being “coupled with another component (e.g., a second component)”, “coupled to another component”, “connected with another component” or “connected to another component” with or without the term “operably” or “communicatively”, the component may be coupled with another component directly (e.g., by a line), wirelessly, or via a third component.

[0115] As used in conjunction with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component or minimum unit or a portion thereof suitable for performing one or more functions. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0116] The various embodiments set forth herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in the storage medium and data being temporarily stored in the storage medium.

[0117] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) the computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, a server of an application store, or a forwarding server).

[0118] According to various embodiments, each component (e.g., module or program) in the above-mentioned components may include a single entity or multiple entities, and some of the multiple entities may be detachably arranged in different components. According to various embodiments, one or more components or operations in the above-mentioned components or operations may be omitted, or one or more other components or operations may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. According to an embodiment, the operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

Claims

1. A wearable electronic device (101, 201), the wearable electronic device (101, 201) comprising: A lens assembly (410), wherein the lens assembly (410) comprises a first lens; as well as a camera module (430), the camera module (430) comprising a second lens and coupled to the lens assembly (410), the second lens having an optical axis that is the same as an optical axis (471) of the first lens, in, The lens assembly (410) and the camera module (430) are configured to move together while an optical axis (471) of the first lens and an optical axis (472) of the second lens are aligned.

2. The wearable electronic device according to claim 1, wherein: The wearable electronic device (101, 201) further includes: a first bracket (420), the first bracket (420) being configured to fix the first lens; and a second bracket (440), the second bracket (440) being configured to support the camera module, And the lens assembly (410) and the camera module (430) are coupled in response to the first bracket (420) and the second bracket (440) being coupled.

3. The wearable electronic device according to one of claims 1 and 2, wherein: The first bracket (420) includes a first coupling portion (421, 422), the first coupling portion (421, 422) being formed on a second surface opposite to a first surface facing the first lens, and The second bracket (440) includes an extending member (443) perpendicular to the optical axis (472) of the second lens and a plurality of second coupling portions (441, 442) formed at both ends of the extending member (443).

4. The wearable electronic device according to any one of claims 1 to 3, wherein: A first shaft (451) is inserted into a fastening hole (21) formed in the first connecting portion (421) of the first side and a fastening hole (41) formed in the second connecting portion (441) of the first side, and a second shaft (452) is inserted into a fastening hole (22) formed in the first connecting portion (422) of the second side and a fastening hole (42) formed in the second connecting portion (442) of the second side.

5. The wearable electronic device according to any one of claims 1 to 4, wherein: The lens assembly (410) and the camera module (430) are configured to be movable along the first axis (451) and the second axis (452).

6. The wearable electronic device according to any one of claims 1 to 5, further comprising: A display module (460) is disposed between the lens assembly (410) and the camera module (430) in a manner fixed to the lens assembly (410), and the display module (460) is configured to output image light toward the lens assembly (410).

7. The wearable electronic device according to any one of claims 1 to 6, wherein: The wearable electronic device (101, 201) further includes a processor configured to construct a virtual space. Furthermore, the display module (460) is configured to overlap a first type of image related to the real space obtained from the camera module (430) and a second type of image related to the virtual space generated by the processor to provide them to the lens assembly (410).

8. The wearable electronic device according to any one of claims 1 to 7, wherein: The wearable electronic device (101, 201) further includes: another lens assembly, the other lens assembly comprising a third lens; and another camera module, the other camera module comprising a fourth lens and coupled to the other lens assembly, the fourth lens having an optical axis that is the same as the optical axis of the third lens, Wherein, the lens assembly (410) and the other lens assembly are connected via an axis and are configured to be movable along the axis.

9. A method for manufacturing a wearable electronic device (101, 201), the method comprising: fixing a display module (460) to a lens assembly (410) including a first lens, wherein the display module (460) is configured to output image light toward the lens assembly (410); and A camera module (430) is coupled to the lens assembly (410), wherein the camera module comprises a second lens having an optical axis that is the same as the optical axis (471) of the first lens, in, The lens assembly (410) and the camera module (430) are configured to move together while an optical axis (471) of the first lens and an optical axis (472) of the second lens are aligned.

10. The method according to claim 9, wherein: Connecting the camera module (430) to the lens assembly (410) includes, In response to a first bracket (420) configured to fix the first lens and a second bracket (440) configured to support the camera module (430) being coupled, the camera module (430) is coupled to the lens assembly (410).

11. A wearable electronic device (101, 201), the wearable electronic device (101, 201) comprising: a processor configured to construct a virtual space; A lens assembly (410), wherein the lens assembly (410) comprises a first lens; a camera module (430), the camera module (430) comprising a second lens and coupled to the lens assembly (410), the second lens having an optical axis that is the same as an optical axis (471) of the first lens; as well as a display module (460), the display module (460) being arranged between the lens assembly (410) and the camera module (430) and being configured to output image light toward the lens assembly (410), Wherein, the processor is configured to: determining whether the user's pupil is aligned with the optical axis (471) of the first lens, In response to determining that the pupil of the user is not aligned with the optical axis (471) of the first lens, shifting a second type of image associated with a virtual space generated by the processor based on a first type of image associated with a real space obtained from the camera module (430), and The first type of image and the shifted second type of image are output to the display module (460).

12. The wearable electronic device according to claim 11, wherein: The processor is configured to, It is determined whether a first axis coordinate of a point corresponding to a center of a pupil of the user and a first axis coordinate of a point corresponding to an optical axis of the first lens are the same.

13. The wearable electronic device according to any one of claims 11 and 12, wherein: The processor is configured to, in response to a point corresponding to the pupil of the user being located on a first side relative to a point corresponding to the optical axis of the first lens, shifting the image of the second type relative to the image of the first type in a first direction, and In response to a point corresponding to the user's pupil being located on a second side opposite to the first side compared to a point corresponding to the optical axis of the first lens, the second type of image is shifted relative to the first type of image in a second direction opposite to the first direction.

14. The wearable electronic device according to any one of claims 11 to 13, wherein: The processor is configured to, An error distance between a point corresponding to the user's pupil and a point corresponding to the optical axis of the first lens based on a first axis is calculated, and the image of the second type is shifted relative to the image of the first type by a distance proportional to the calculated error distance.

15. A method implemented by a processor, the method comprising: determining whether a pupil of a user is aligned with an optical axis (471) of a first lens included in the lens assembly (410); In response to determining that the pupil of the user is not aligned with the optical axis (471) of the first lens, shifting a second type of image associated with the virtual space generated by the processor based on a first type of image associated with the real space obtained from a camera module (430), wherein the camera module includes a second lens having an optical axis that is the same as the optical axis (471) of the first lens; and outputting the first type of image and the shifted second type of image to a display module (460), The camera module (430) is connected to the lens assembly (410), and The display module (460) is disposed between the lens assembly (410) and the camera module (430), and is configured to output image light toward the lens assembly (410).

Images