Electronic device for controlling focus of camera according to temperature, and operating method thereof

Abstract

An electronic device for controlling the focus of a camera according to temperature, and an operating method thereof are disclosed. The electronic device comprises: a processor; a memory for storing instructions; and a first camera, wherein, when executed by the processor, the instructions can instruct the electronic device to: acquire temperature data on the first camera; determine a target focal length of the first camera on the basis of the temperature data on the first camera; and control the focal length of the first camera so as to match the target focal length of the first camera, the first camera being arranged on the front of the electronic device so as to capture an image or video of the front thereof.

Description

Electronic device for controlling the focus of a camera according to temperature and its operating method

[0001] The disclosure below relates to an electronic device for controlling the focus of a camera depending on temperature and a method of operating the same.

[0002] Recently, virtual reality (VR), augmented reality (AR), and mixed reality (MR) technologies, which utilize computer graphics technology, are being developed. VR technology uses computers to create virtual spaces that don't exist in the real world and then make them feel real, while AR or MR technologies superimpose computer-generated information on top of the real world. In other words, they combine the real and virtual worlds to enable real-time user interaction.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] An electronic device according to one embodiment includes a processor, a memory storing instructions, and a first camera, wherein the instructions, when individually or collectively executed by the one or more processors, cause the electronic device to obtain temperature data for the first camera, determine a target focal distance of the first camera based on the temperature data for the first camera, and control the focal distance of the first camera to match the target focal distance of the first camera, wherein the first camera is disposed on a front side of the electronic device and captures an image or video of the front side.

[0005] An operating method of an electronic device according to one embodiment includes an operation of acquiring temperature data for a first camera, an operation of determining a target focal distance of the first camera based on the temperature data for the first camera, and an operation of controlling a focal distance of the first camera to match the target focal distance of the first camera, wherein the first camera is disposed on a front side of the electronic device and captures an image or video of the front side.

[0006] FIG. 1 is a block diagram illustrating an exemplary configuration of an electronic device according to various embodiments.

[0007] FIGS. 2A and 2B are drawings showing examples of the front and back of an electronic device according to various embodiments.

[0008] FIG. 3A is a drawing for explaining the structure of a first camera and a second camera according to one embodiment.

[0009] FIG. 3b is a drawing for explaining an operation of controlling a focal distance according to one embodiment.

[0010] FIG. 4 is a diagram for explaining the resolution of a camera according to temperature and focal length according to one embodiment.

[0011] FIG. 5 is a drawing for explaining an operation method of an electronic device for controlling a focal distance according to one embodiment.

[0012] FIG. 6 is a diagram for explaining temperature changes over time of a first camera and a second camera according to one embodiment.

[0013] FIG. 7 is a drawing for explaining the resolution of a camera during foveation operation according to one embodiment.

[0014] FIG. 8 is a drawing for explaining an operation method of an electronic device during a foveation operation according to one embodiment.

[0015] FIG. 9 is a diagram illustrating an operation of an electronic device according to one embodiment to determine a distance to a target object.

[0016] FIG. 10 is a drawing for explaining an operation method of an electronic device using a distance to a target object according to one embodiment.

[0017] Fig. 11 is a schematic flowchart illustrating an operating method of an electronic device according to one embodiment.

[0018] Hereinafter, embodiments will be described in detail with reference to the attached drawings. In the description with reference to the attached drawings, identical components are assigned the same reference numerals regardless of the drawing numbers, and redundant descriptions thereof will be omitted.

[0019] In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" may include any one of the items listed together in that phrase, or all possible combinations thereof.

[0020]

[0021] FIG. 1 is a block diagram illustrating an exemplary configuration of an electronic device according to various embodiments.

[0022] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0023] According to one embodiment, the processor (120) may be implemented as a circuit (e.g., a processing circuit) such as a system on chip (SoC) or an integrated circuit (IC). The processor (120) may include one or more processors. For example, the processor (120) may include a combination of one or more processors such as a CPU, a GPU, an MPU, an AP, and a CP.

[0024] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0025] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0026] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0027] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0028] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0029] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0030] A display module (160) (e.g., a display) can visually provide information to an external device (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0031] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0032] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0033] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0034] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0035] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0036] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0037] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0038] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0039] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0040] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0041] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0042] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0043] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0044] According to one embodiment, commands or data can be transmitted or received between an electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199).

[0045] Each of the external electronic devices (102, 103) and the server (108) may be the same type of device as or different from the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 103) or the server (108). For example, when the electronic device (101) needs to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of executing the function or service itself or in addition, request one or more external electronic devices to execute at least a part of the function or service. The one or more external electronic devices that receive the request may execute at least a part of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a part of a response to the request. In this specification, an example is mainly described in which an electronic device (101) is an augmented reality device (e.g., the electronic device (201) of FIG. 2), and an external electronic device (102, 103) or a server (108) among servers (108) transmits the results of executing a virtual space and additional functions or services related to the virtual space to the electronic device (101).

[0046] The server (108) may include a processor (181), a communication module (182), and a memory (183). The processor (181), the communication module (182), and the memory (183) may be configured similarly to the processor (120), the communication module (190), and the memory (130) of the electronic device (101). For example, the processor (181) may provide a virtual space and interaction between users within the virtual space by executing instructions stored in the memory (183). The processor (181) may generate at least one of visual information, auditory information, or tactile information of the virtual space and objects within the virtual space. For example, as visual information, the processor (181) may generate rendering data (e.g., visual rendering data) that renders the appearance (e.g., shape, size, color, or texture) of the virtual space and the appearance (e.g., shape, size, color, or texture) of objects positioned within the virtual space. In addition, the processor (181) may generate rendering data that renders a change (e.g., a change in the appearance of an object, a sound generation, or a tactile generation) based on at least one of an interaction between objects (e.g., a physical object, a virtual object, or an avatar object) in a virtual space, or a user input to an object (e.g., a physical object, a virtual object, or an avatar object). The communication module (182) may establish communication with a first electronic device (e.g., an electronic device (101)) of a user and a second electronic device (e.g., an electronic device (102)) of another user. The communication module (182) may transmit at least one of the visual information, the tactile information, or the auditory information described above to the first electronic device and the second electronic device. For example, the communication module (182) may transmit rendering data.

[0047] For example, the server (108) renders content data executed in an application and transmits it to the electronic device (101), and the electronic device (101) receiving the data can output the content data to the display module (160). If the electronic device (101) detects user movement through an IMU sensor or the like, the processor (181) of the electronic device (101) can correct the rendering data received from the external electronic device (102) based on the movement information and output it to the display module (160). Alternatively, the movement information can be transmitted to the server (108) to request rendering so that the screen data is updated accordingly. However, the present invention is not limited thereto, and the rendering described above can be performed by various forms of external electronic devices (102, 103), such as a smartphone or a case device capable of storing and charging the electronic device (101). Rendering data corresponding to the virtual space described above created by the external electronic device (102, 103) can be provided to the electronic device (101). For another example, the electronic device (101) may receive virtual space information (e.g., vertex coordinates, texture, color defining the virtual space) and object information (e.g., vertex coordinates, texture, color defining the appearance of an object) from the server (108) and perform rendering on its own based on the received data.

[0048]

[0049] FIGS. 2A and 2B are diagrams illustrating examples of the front and back of an electronic device according to various embodiments. FIG. 2A may be an external appearance of the electronic device (201) as viewed from a first direction (①), and FIG. 2B may be an external appearance of the electronic device (201) as viewed from a second direction (②). When a user wears the electronic device (201), the external appearance viewed by the user's eyes may be FIG. 2B.

[0050] Referring to FIG. 2A, according to various embodiments, an electronic device (201) (e.g., the electronic device (101) of FIG. 1) may provide a service that provides an extended reality (XR) experience to a user. For example, an XR or XR service may be defined as a service that collectively refers to virtual reality (VR), augmented reality (AR), and / or mixed reality (MR).

[0051] According to one embodiment, the electronic device (201) may refer to a head-mounted device or a head-mounted display worn on the user's head, but may also be configured in the form of at least one of glasses, goggles, a helmet, or a hat. The electronic device (201) may be a VST (video see-through) type configured to block external light so that light emitted from the display reaches the user's eyes when worn, but external light does not reach the user's eyes.

[0052] According to one embodiment, the electronic device (201) may be worn on the user's head and may provide the user with an image related to an extended reality (XR) service. For example, the electronic device (201) may provide XR content (hereinafter referred to as an XR content image) that outputs at least one virtual object to be superimposed on a display area or an area determined to be the user's field of view (FoV). According to one embodiment, the XR content may refer to an image or image related to a real space acquired through a camera (e.g., a camera for taking pictures) or a virtual space in which at least one virtual object is superimposed. According to one embodiment, the electronic device (201) may provide XR content based on a function being performed by the electronic device (201) and / or a function being performed by one or more external electronic devices (e.g., the electronic devices (102, 104) of FIG. 1, the server (108) of FIG. 1).

[0053] According to one embodiment, the electronic device (201) is at least partially controlled by an external electronic device (e.g., electronic devices (102 or 104) of FIG. 1), and may perform at least one function under the control of the external electronic device, but may also perform at least one function independently.

[0054] Referring to FIG. 2A, a vision sensor may be placed on a first surface of a housing of a main body (210) of an electronic device (201). The vision sensor may include cameras (e.g., cameras for second functions (211, 212), cameras for first functions (215)) and / or a depth sensor (217) for obtaining information related to the surrounding environment of the electronic device (201).

[0055] In one embodiment, the second function cameras (211, 212) can obtain images related to the surrounding environment of the electronic device (201). The first function cameras (215) can obtain images when the wearable electronic device is worn by the user. The first function cameras (215) can be used for hand detection and tracking, and recognition of user gestures (e.g., hand movements). The first function cameras (215) can be used for 3DoF, 6DoF head tracking, position (spatial, environmental) recognition, and / or movement recognition. In one embodiment, the second function cameras (211, 212) can also be used for hand detection and tracking, and user gestures.

[0056] In one embodiment, the depth sensor (217) may be configured to transmit a signal and receive a signal reflected from a subject, and may be used for purposes such as time of flight (TOF) to determine the distance to an object. Instead of or in addition to the depth sensor (217), cameras (213, 214, 215, 216) may determine the distance to an object.

[0057] Referring to FIG. 2b, a camera (225, 226) for facial recognition and / or a display (221) (and / or lens) may be placed on the second surface (220) of the housing of the main body (210).

[0058] In one embodiment, a face recognition camera (225, 226) adjacent to the display may be used to recognize a user's face, or may recognize and / or track both eyes of the user.

[0059] In one embodiment, the display (221) (and / or lens) may be disposed on the second side (220) of the electronic device (201). In one embodiment, the electronic device (201) may not include some of the plurality of cameras (215).

[0060] According to one embodiment, the electronic device (201) may include a main body (210) that mounts at least some of the components of FIG. 1, a display (221) (e.g., a display module (160) of FIG. 1) disposed in a first direction (①) of the main body (210), a first function camera (e.g., a recognition camera) (215) disposed in a second direction (②) of the main body (210), a second function camera (e.g., a shooting camera) (211, 212) disposed in a second direction (②), a third function camera (e.g., a gaze tracking camera) (228) disposed in the first direction (①), a fourth function camera (e.g., a face recognition camera) (225, 226) disposed in the first direction (①), a depth sensor (217) disposed in the second direction (②), and a touch sensor (213) disposed in the second direction (②). Although not shown in the drawing, the main body (210) includes a memory (e.g., memory (130) of FIG. 1) and a processor (e.g., processor (120) of FIG. 1), and may further include other components shown in FIG. 1.

[0061] According to one embodiment, the display (221) may include a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), or a micro light emitting diode (micro LED).

[0062] In one embodiment, when the display (221) is formed of one of a liquid crystal display (LCD), a digital mirror display (DMD), or a silicon liquid crystal display (SiLCD), the electronic device (201) may include a light source that irradiates light to a screen output area of ​​the display (221). In another embodiment, when the display (221) can generate light on its own, for example, when the electronic device (201) is formed of one of an organic light-emitting diode (OLED) or a micro LED, the electronic device (201) may provide a good quality XR content image to the user even without including a separate light source. In one embodiment, when the display (221) is formed of an organic light-emitting diode (OLED) or a micro LED, a light source is unnecessary, and thus the electronic device (201) may be lightweight.

[0063] According to one embodiment, the display (221) may include a first transparent member (221a) and / or a second transparent member (221b). The user may use the electronic device (201) while wearing it on his or her face. The first transparent member (221a) and / or the second transparent member (221b) may be formed of a glass plate, a plastic plate, or a polymer, and may be manufactured to be transparent or translucent. According to one embodiment, the first transparent member (221a) may be arranged to face the user's right eye in the third direction (③), and the second transparent member (221b) may be arranged to face the user's left eye in the fourth direction (④). According to various embodiments, when the display (221) is transparent, it may be arranged at a position facing the user's eyes to form a display area.

[0064] According to one embodiment, the display (221) may include a lens including a transparent waveguide. The lens may serve to adjust the focus so that the screen (e.g., XR content image) output to the display (221) can be viewed by the user's eyes. For example, light emitted from the display panel may pass through the lens and be transmitted to the user through a waveguide formed within the lens. The lens may be configured as a Fresnel lens, a pancake lens, or a multi-channel lens.

[0065] An optical waveguide (e.g., a waveguide) may serve to transmit light generated by the display (221) to the user's eyes. The optical waveguide may be made of glass, plastic, or a polymer, and may include nano-patterns formed on a portion of the inner or outer surface, for example, a grating structure having a polygonal or curved shape. According to one embodiment, light incident on one end of the optical waveguide, that is, an output image of the display (221), may be propagated within the optical waveguide and provided to the user. In addition, an optical waveguide composed of a free-form prism may provide the incident light to the user through a reflective mirror. The optical waveguide may include at least one diffractive element (e.g., a diffractive optical element (DOE), a holographic optical element (HOE)) or at least one reflective element (e.g., a reflective mirror). The optical waveguide may guide an image output from the display (221) to the user's eyes by using at least one diffractive element or reflective element included in the optical waveguide.

[0066] According to one embodiment, the diffractive element may include an input optical member / output optical member (not shown). For example, the input optical member may mean an input grating region, and the output optical member (not shown) may mean an output grating region. The input grating region may serve as an input terminal that diffracts (or reflects) light output from a light source (e.g., a Micro LED) to transmit the light to a transparent member (e.g., a first transparent member (221a), a second transparent member (221b)) of the display area. The output grating region may serve as an outlet that diffracts (or reflects) light transmitted to a transparent member (e.g., a first transparent member, a second transparent member) of the optical waveguide to a user's eye.

[0067] In some embodiments, the reflective element may comprise a total internal reflection (TIR) ​​optical element or waveguide for total internal reflection. For example, total internal reflection may refer to a method of directing light such that light (e.g., a virtual image) entering through an input grating region is reflected substantially 100% from one surface (e.g., a specific surface) of the optical waveguide, thereby transmitting substantially 100% of the light to the output grating region at an angle of incidence.

[0068] In one embodiment, light emitted from the display (221) may be guided along an optical path through an input optical element into a waveguide. Light traveling within the optical waveguide may be guided toward the user's eyes through an output optical element. The display area may be determined based on the light emitted toward the user's eyes.

[0069] According to one embodiment, the electronic device (201) may include a plurality of cameras. For example, the cameras may include a first function camera (e.g., a recognition camera) (215) disposed in the second direction (②) of the main body (210), a second function camera (e.g., a shooting camera) (211, 212) disposed in the second direction (②), a third function camera (e.g., a gaze tracking camera) (225) disposed in the first direction (①), and / or a fourth function camera (e.g., a face recognition camera) (225, 226) disposed in the first direction (①), but may further include cameras for other functions not shown.

[0070] The first function camera (e.g., recognition camera) (215) can be used for the purpose of detecting user movement or recognizing user gestures. The first function camera (215) can support at least one of head tracking, hand detection and hand tracking, and spatial recognition. For example, the first function camera (215) mainly uses a GS (global shutter) camera, which has superior performance compared to an RS (rolling shutter) camera, to detect and track fine movements of hand movements and fingers, and can be configured as a stereo camera including two or more GS cameras for head tracking and spatial recognition. The first function camera (215) can perform a SLAM (simultaneous localization and mapping) function to recognize information (e.g., location and / or direction) related to the surrounding space through spatial recognition for 6DoF and depth shooting.

[0071] A second function camera (e.g., a shooting camera) (211, 212) can be used to capture the outside and generate an image or video corresponding to the outside and transmit it to a processor (e.g., a processor (120) of FIG. 1). The processor can display the image provided from the second function camera (211, 212) on a display (221). The second function camera (211, 212) may be referred to as HR (high resolution) or PV (photo video) and may include a high-resolution camera. For example, the second function camera (211, 212) may include a color camera equipped with functions for obtaining high-quality images, such as an AF (auto focus) function and an optical image stabilizer (OIS), but is not limited thereto, and the second function camera (211, 212) may also include a GS camera or an RS camera.

[0072] A third function camera (e.g., a gaze tracking camera) (225) may be positioned on the display (221) (or inside the main body) so that the camera lens faces the user's eyes when the user wears the electronic device (201). The third function camera (225) may be used for the purpose of detecting and tracking (ET: eye tracking) the pupil. The processor may track the movements of the user's left and right eyes in the images received from the third function camera (225) to determine the gaze direction. By tracking the position of the pupil in the images, the processor may ensure that the center of the XR content image displayed in the display area is positioned according to the direction in which the pupil is looking. As an example, a GS camera may be used as the third function camera (225) to detect the pupil and track the movement of the pupil. The third function cameras (225) may be installed respectively for the left and right eyes, and each camera having the same performance and specifications may be used.

[0073] A fourth functional camera (e.g., a camera for facial recognition) (225, 226) can be used to detect and track (FT: face tracking) the user's facial expression when the user wears the electronic device (201).

[0074] According to one embodiment, the electronic device (201) may include a lighting unit (e.g., LED) (not shown) as an auxiliary means for the cameras. For example, the third function camera (225) may use lighting included in the display to direct the emitted light (e.g., IR LED of infrared wavelength) toward the user's both eyes as an auxiliary means to facilitate gaze detection when tracking eye movements. As another example, the second function cameras (211, 212) may further include a lighting unit (e.g., flash) as an auxiliary means to supplement the surrounding brightness when taking external pictures.

[0075] According to one embodiment, a depth sensor (or depth camera) (217) may be used to determine the distance to an object (e.g., an object), such as time of flight (TOF). Time of flight (TOF) is a technology that measures the distance to an object using a signal (e.g., near-infrared, ultrasound, or laser). After a signal is transmitted from a transmitter, a signal is measured at a receiver, and the distance to an object can be measured based on the flight time of the signal.

[0076] According to one embodiment, the touch sensor (213) may be arranged in the second direction (②) of the main body (210). For example, when a user wears the electronic device (201), the user's eyes may look in the first direction (①) of the main body. The touch sensor (213) may be implemented as a single type or a left / right separated type depending on the shape of the main body (210), but is not limited thereto. For example, when the touch sensor (213) is implemented as a left / right separated type as illustrated in FIG. 2A, when a user wears the electronic device (201), the first touch sensor (213a) may be arranged at the user's right eye position, such as in the third direction (③), and the second touch sensor (213b) may be arranged at the user's left eye position, such as in the fourth direction (④).

[0077] The touch sensor (213) can recognize a touch input using at least one of, for example, a capacitive, pressure-sensitive, infrared, or ultrasonic method. For example, the capacitive touch sensor (213) can recognize a physical touch (or contact) input or a hovering input (or proximity) of an external object. According to some embodiments, the electronic device (201) may utilize a proximity sensor (not shown) to enable proximity recognition of an external object.

[0078] According to one embodiment, the touch sensor (213) has a two-dimensional surface and can transmit touch data (e.g., touch coordinates) of an external object (e.g., a user's finger) that comes into contact with the touch sensor (213) to the processor (120). The touch sensor (213) can detect a hovering input for an external object (e.g., a user's finger) that approaches within a first distance from the touch sensor (213), or detect a touch input that touches the touch sensor (213).

[0079] According to one embodiment, the touch sensor (213) may provide two-dimensional information about the point of contact as “touch data” to the processor (120) when an external object touches the touch sensor (213). The touch data may be described as a “touch mode.” The touch sensor (213) may provide hovering data about the time or location of hovering around the touch sensor (213) to the processor (120) when an external object is located within a first distance from the touch sensor (or in proximity, hovering above the touch sensor). The hovering data may be described as a “hovering mode / proximity mode.”

[0080] According to one embodiment, the electronic device (201) may obtain hovering data using at least one of a touch sensor (213), a proximity sensor (not shown), or / and a depth sensor (217) to generate information about a distance, location, or time point between the touch sensor (213) and an external object.

[0081] According to one embodiment, the interior of the main body (210) may include a processor (e.g., processor (120) of FIG. 1) and memory (e.g., memory (130) of FIG. 1).

[0082] Memory can store various instructions that can be executed by the processor. Instructions can include arithmetic and logical operations, data transfer, or control commands such as input / output that can be recognized by the processor. Memory can temporarily or permanently store various data, including volatile memory (e.g., volatile memory (132) of FIG. 1) and non-volatile memory (e.g., non-volatile memory (134) of FIG. 1).

[0083] The processor may be a configuration that is operatively, functionally, and / or electrically connected to each component of the electronic device (201) and can perform calculations or data processing related to control and / or communication of each component. The operations performed by the processor may be stored in memory and, when executed, executed by instructions that cause the processor to operate.

[0084] Hereinafter, the computational and data processing functions that the processor can implement on the electronic device (201) are not limited, but a series of operations related to the XR content service function will be described. The operations of the processor described below can be performed by executing instructions stored in memory.

[0085] According to one embodiment, the processor may generate a virtual object based on virtual information based on image information. The processor may output a virtual object related to an XR service together with background space information through the display (221). For example, the processor may capture an image related to a real space corresponding to the field of view of a user wearing the electronic device (201) through a second function camera (211, 212) to obtain image information or generate a virtual space for a virtual environment. For example, the processor may control the display (221) to display XR content (hereinafter referred to as an XR content screen) in which at least one virtual object is output so as to be overlapped in an area determined to be a field of view or a field of view (FoV) of the user.

[0086] According to one embodiment, the electronic device (201) may have a form factor for being worn on a user's head. The electronic device (201) may further include a strap and / or a wearable member for being secured on a body part of the user. The electronic device (201) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0087]

[0088] FIG. 3A is a drawing for explaining the structure of a first camera and a second camera according to one embodiment.

[0089] Referring to FIG. 3A, the electronic device may include a first camera. In one embodiment, the electronic device may further include a second camera. The first camera and the second camera may include one or more lenses (310) and an adhesive member (320). In one embodiment, the first camera may be positioned on the front of the electronic device and may capture an image or video of the front.

[0090] The first camera and the second camera may represent each camera included in the second function camera. In other words, the first camera and the second camera may capture images or videos of the outside world and transmit them to the processor. The first camera and the second camera may be, for example, PT (pass-through) cameras, but the embodiment is not limited thereto, and the first camera and the second camera may be various cameras capable of capturing images of the outside world.

[0091] In one embodiment, the first camera and the second camera may correspond to both eyes of a user wearing the electronic device. For example, the first camera and the second camera may correspond to the user's right and left eyes, respectively, such that the first camera may capture the exterior viewed by the user's right eye, and the second camera may capture the exterior viewed by the user's left eye. Conversely, the first camera and the second camera may correspond to the user's left and right eyes, respectively. For convenience of explanation, the first camera may be referred to as the right camera, and the second camera may be referred to as the left camera.

[0092] One or more lenses (310) can refract and transmit light received from the outside and transmit it to the image sensor. The one or more lenses (310) may include, for example, lenses (illustrated as L1, L2, L3, L4, L5, and L6) illustrated in FIG. 3. However, although the one or more lenses (310) in FIG. 3 are illustrated as six lenses for illustration purposes, the embodiment is not limited thereto, and the number of lenses may be determined differently depending on the embodiment. In addition, each lens included in the one or more lenses (310) may have a different shape, structure, and material depending on the embodiment.

[0093] The adhesive member (320) may be used to secure one or more lenses (310) of the camera. The adhesive member (320) may be positioned between one or more lenses (310) of the first camera and the second camera and the image sensor. The adhesive member (320) may be, for example, epoxy, but the embodiment is not limited thereto, and the adhesive member (320) may be implemented with various materials and configurations. In the present specification, for convenience of explanation, the adhesive member (320) may be referred to as bonding.

[0094] An electronic device may obtain temperature data for a first camera. In one embodiment, the electronic device may further obtain temperature data for a second camera. The temperature data may include data regarding the temperature of the camera or changes in temperature over time. According to one embodiment, the electronic device may obtain temperature data for the first camera and the second camera using temperature sensors included in each of the first camera and the second camera. Alternatively, the electronic device may obtain temperature data for the first camera and the second camera using temperature sensors attached to each of the first camera and the second camera.

[0095] The electronic device may determine the target focal distance of the first camera based on temperature data for the first camera. Furthermore, the electronic device may determine the target focal distance of the second camera based on temperature data for the second camera. According to one embodiment, the electronic device may determine the target focal distances of the first camera and the second camera based on temperature data for the first camera, or may determine the target focal distances of the first camera and the second camera respectively based on temperature data for each of the first camera and the second camera. According to one embodiment, the electronic device may determine the target focal distances of the first camera and the second camera respectively based on a predetermined reference focal distance according to a plurality of temperature sections. The electronic device may control the focal distance of the first camera to match the target focal distance of the first camera. In one embodiment, the electronic device may control the focal distances of the first camera and the second camera to match the target focal distances of the first camera and the second camera. In one embodiment, the electronic device may control the focal distances of the first camera and the second camera to match the target focal distances of the first camera and the second camera.

[0096] The specific operation of the electronic device is described in detail below with reference to FIGS. 5, 8 and 10.

[0097]

[0098] FIG. 3b is a drawing for explaining an operation of controlling a focal distance according to one embodiment.

[0099] Referring to FIG. 3B, an actuator (300) can control the distance between one or more lenses (310) and an image sensor (330) using a coil (340). The actuator (300) can control the focal length of the first camera and the second camera by controlling the distance between one or more lenses (310) and the image sensor (330). In one embodiment, the actuator (300) can be included in the first camera and the second camera.

[0100] In one embodiment, the actuator (300) can apply current to the coil (340) to move one or more lenses (310) upward. In one embodiment, the application of current to the coil (340) causes the one or more lenses (310) to move due to the force of polarity between the coil (340) and the magnet due to the magnetic field. The electronic device can control the focal length of each camera by adjusting the position of the one or more lenses (310) through the actuator (300).

[0101] However, the structure and shape of the actuator (300) illustrated in FIG. 3b are exemplary for explanation, and the embodiment is not limited thereto, and the actuator (300) may have various structures and shapes capable of controlling the distance between one or more lenses (310) and the image sensor (330).

[0102]

[0103] FIG. 4 is a diagram for explaining the resolution of a camera according to temperature and focal length according to one embodiment.

[0104] Referring to FIG. 4, an image (400) is illustrated as an example to show the change in resolution according to the temperature and focal length of the camera when the camera fixes the focal length in the FF (fixed focus) manner.

[0105] The way a camera controls its focal length can be divided into FF and AF (auto focus) methods. FF refers to a method of capturing images by fixing the focal length, while AF refers to a method of automatically controlling the focal length.

[0106] For example, referring to Case 1 of image (400), images of target objects captured at distances of 30 cm, 50 cm, and 80 cm, respectively, at 37˚C and 60˚C by the first camera and the second camera, whose focal lengths are fixed at 0.8 m and 1.5 m, respectively, are exemplarily shown.

[0107] Referring to the image depicted in the box in Figure 4, when capturing images using the FF method, the camera's resolution may decrease as its temperature increases. Furthermore, the further away the target object being captured, the greater the change in resolution due to camera temperature.

[0108] As the electronic device operates, the temperature of the first camera and the second camera may increase over time. As the number of pixels of the first camera and the second camera increases or the frame rate increases, the current of the image sensor increases, which may cause the temperature of the first camera and the second camera to change more quickly over time. As the temperature of the first camera and the second camera increases, the adhesive member (320) may expand, which may cause the distance between one or more lenses (310) and the image sensor to increase. As the distance between one or more lenses (310) and the image sensor increases, the focal lengths of the first camera and the second camera may increase, and the resolving power of the first camera and the second camera may decrease. Various embodiments may reduce the change in the resolving power of the first camera and the second camera by controlling the focal lengths of the first camera and the second camera based on temperature data of the first camera and / or the second camera.

[0109]

[0110] FIG. 5 is a drawing for explaining an operation method of an electronic device for controlling a focal distance according to one embodiment.

[0111] In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. Furthermore, some operations may be omitted according to some embodiments. The operations (510, 520, 530, 531, 540, 541, 550, 560) may be performed by at least one component of the electronic device (e.g., the processor (120) of FIG. 1). For example, instructions stored in a memory (e.g., the memory (130) of FIG. 1) may be executed by at least one processor, and the instructions may cause the electronic device to perform the following operations (510, 520, 530, 531, 540, 541, 550, 560).

[0112] In operation (510), the electronic device may operate the first camera. In one embodiment, the electronic device may further operate the second camera. For example, the electronic device may cause the first camera and the second camera to capture an external scene and generate an image or video corresponding to the external scene. In one embodiment, the electronic device may perform operations (520, 530, 531, 540, 541, 550, 560) when the user runs a camera application or operates the first camera and the second camera in pass-through mode.

[0113] In operation (520), the electronic device may obtain temperature data for the first camera. Alternatively, the electronic device may obtain temperature data for the first camera and / or the second camera.

[0114] In operation (530), the electronic device may determine whether the temperature of the first camera is higher than a predetermined reference temperature based on the acquired temperature data for the first camera. The predetermined reference temperature may be determined differently depending on the temperature at which the resolution of the camera changes, depending on the embodiment. For example, the predetermined reference temperature may be determined to be 50˚C, and the electronic device may determine whether the temperature of the first camera is higher than 50˚C.

[0115] In operation (531), if the temperature of the first camera is lower than a predetermined reference temperature, the electronic device can maintain a control state for the first camera. In one embodiment, if the temperature of the first camera is lower than a predetermined reference temperature, the electronic device can maintain a control state for the focus of the second camera. In other words, if the temperature of the first camera is lower than a predetermined reference temperature, the electronic device can constantly fix the focal lengths of the first camera and the second camera in a FF manner, or control the focal length using the distance to the target object through AF.

[0116] In operation (540), if the temperature of the first camera is equal to or higher than a predetermined reference temperature, the electronic device may determine whether the acceleration of the electronic device is less than the predetermined reference acceleration. Alternatively, according to an embodiment, the electronic device may determine whether the acceleration of the first camera is less than the predetermined reference acceleration. The electronic device may determine the acceleration of the electronic device using an acceleration sensor installed thereon. In one embodiment, the acceleration sensor may be implemented as a six-axis sensor including a three-axis geomagnetic sensor and a three-axis acceleration sensor, but the embodiment is not limited thereto, and the acceleration sensor may be implemented as various sensors capable of measuring acceleration in each axis direction. For example, the acceleration sensor may include an inertial measurement unit (IMU) sensor.

[0117] In operation (541), if the temperature of the first camera is equal to or greater than a predetermined reference acceleration, the electronic device may determine whether the acceleration of the electronic device after a predetermined time is less than the reference acceleration. At this time, if the acceleration of the electronic device after a predetermined time is equal to or greater than the reference acceleration, the electronic device may again determine whether the acceleration of the electronic device after a predetermined time is less than the reference acceleration. In other words, if the temperature of the first camera is equal to or greater than the predetermined reference acceleration, the operation of acquiring information about acceleration after a predetermined time and the operation of determining whether the acceleration of the electronic device is less than the reference acceleration may be repeatedly performed at predetermined time intervals until the acceleration of the electronic device is less than the reference acceleration. The reference acceleration may be determined differently depending on the embodiment. Depending on the embodiment, the electronic device may acquire the acceleration of the first camera, determine whether the acceleration of the first camera is less than the reference acceleration, and determine the target focal length.

[0118] In operation (550), if the temperature of the first camera is less than a predetermined reference acceleration, the electronic device may determine the target focal distance of the first camera based on the temperature data for the first camera. In one embodiment, if the temperature of the first camera is less than a predetermined reference acceleration, the electronic device may determine the target focal distances of the first camera and the second camera based on the temperature data for the first camera. Alternatively, according to an embodiment, if the electronic device obtains temperature data for the first camera and the second camera respectively in operation (520), the electronic device may determine the target focal distance of the first camera based on the temperature data for the first camera, and may determine the target focal distance of the second camera based on the temperature data for the second camera.

[0119] According to one embodiment, the electronic device may determine the target focal distance of the first camera based on a predetermined reference focal distance according to a plurality of temperature intervals. Furthermore, according to one embodiment, the electronic device may determine the target focal distances of the first camera and the second camera, respectively, based on a predetermined reference focal distance according to a plurality of temperature intervals for each of the first camera and the second camera. For example, the predetermined reference focal distances according to a plurality of temperature intervals as shown in Table 1 for the first camera and Table 2 for the second camera may be used.

[0120] Temperature-based focal length AF stroke 0~30˚C 1.5m 100μm 30~40˚C 1m 200μm 40~50˚C 60cm 300μm 50~70˚C 40cm 400μm

[0121] Temperature-based focal length AF stroke 0~40˚C 1.5m 100μm 40~50˚C 1m 200μm 50~60˚C 60cm 300μm 60~70˚C 40cm 400μm

[0122] Tables 1 and 2 may represent temperature-dependent reference focal lengths for the first camera and the second camera, respectively, and AF strokes for focusing the cameras at the reference focal length. For example, Tables 1 and 2 may represent reference focal lengths and AF strokes for the right camera and the left camera, respectively, based on a user of an electronic device. The reference focal length may represent the best focus of each camera. In one embodiment, the AF stroke may represent the distance between one or more lenses of the camera and the image sensor.

[0123] According to one embodiment, the electronic device may determine the reference focal distance corresponding to the temperature of the first camera and the second camera as the target focal distance of each of the first camera and the second camera based on the predetermined reference focal distance according to a plurality of temperature sections. For example, when the temperature of the first camera is 45˚C, the electronic device may determine the reference focal distance of 60 cm corresponding to the temperature section of 40 to 50˚C in Table 1 as the target focal distance. According to one embodiment, the target focal distance of the first camera and the target focal distance of the second camera may be determined differently depending on the temperature of the first camera and the temperature of the second camera.

[0124] Alternatively, according to one embodiment, the electronic device may determine the target focal distance of the first camera based on a predetermined reference focal point according to a plurality of temperature sections, and may determine the target focal distance of the second camera based on the target focal distance of the first camera. For example, when the temperature of the first camera is 35˚C, the electronic device may determine the reference focal distance of 1 m corresponding to the 30-40˚C temperature section of Table 1 as the target focal distance, and may also determine the target focal distance of the second camera to be 1 m, which is the same as the target focal distance of the first camera.

[0125] In one embodiment, the electronic device can determine the focal length of the first camera to match the target focal length of the first camera. Furthermore, in one embodiment, the electronic device can control the focal lengths of the first camera and the second camera to match the target focal lengths of the first camera and the second camera. For example, the electronic device can adjust the focal length of the first camera so that the first camera can clearly capture the target focal length of the first camera.

[0126] According to one embodiment, the electronic device can adjust the distance between a lens and an image sensor corresponding to a first camera so that the first camera focuses on the target focal distance of the first camera, and can adjust the distance between a lens and an image sensor corresponding to a second camera so that the second camera focuses on the target focal distance of the second camera. As the distance between the lens and the image sensor is adjusted, each camera can clearly capture its own target focal distance.

[0127] In operation (560), the electronic device can control the focal length to allow the resolution of the camera to operate within a normal range.

[0128] Since the matters described above through FIGS. 1 to 4 are applied to each operation illustrated in FIG. 5, a more detailed description is omitted.

[0129]

[0130] FIG. 6 is a diagram for explaining temperature changes over time of a first camera and a second camera according to one embodiment.

[0131] Referring to FIG. 6, a temperature change graph (600) over time for a right camera (610) and a left camera (620) of an electronic device is exemplarily illustrated. In one embodiment, the first camera may represent the right camera (610), and the second camera may represent the left camera (620). The temperature change graph (600) may be a graph obtained over time as heat is generated as the electronic device operates.

[0132] As in the temperature change graph (600), the temperature of the left camera (620) may be predetermined based on the temperature of the right camera (610). Accordingly, the electronic device may determine the temperature of the left camera (620) based on the temperature of the right camera (610). For example, if the electronic device determines the temperature of the right camera (610) to be 60˚C, the electronic device may determine the temperature of the left camera (620) to be 65˚C based on the temperature change graph (600). According to one embodiment, the electronic device may determine the temperature of the second camera and the target focal length of the second camera based on the temperature data for the first camera.

[0133]

[0134] FIG. 7 is a drawing for explaining the resolution of a camera during foveation operation according to one embodiment.

[0135] Referring to FIG. 7, an electronic device may perform a foveation operation according to an embodiment. The foveation operation may refer to an operation that outputs different resolutions for a central region, which is a portion of the screen output by the display, and a peripheral region, which represents the remaining area of ​​the central region, taking into account the user's field of view. The central region may be an area of ​​a predetermined size determined based on the point where the user's gaze is located on the display.

[0136] According to one embodiment, the electronic device can perform a foveation operation by outputting a resolution of a central region higher than that of a peripheral region. The foveation operation may be, for example, operations (710), (720), and (730) illustrated in FIG. 7, but the embodiment is not limited thereto, and the foveation operation may include various operations that output different resolutions of the central region and the peripheral region.

[0137] In operation (710), the electronic device may determine the pixels of the central region and the entire region to be the same, thereby determining the resolutions of the central region and the peripheral region differently. For example, as illustrated in FIG. 7, the electronic device may determine the pixels of the central region and the entire region to be 1500*1500, thereby determining the resolutions of the central region and the peripheral region differently.

[0138] In operation (720), the electronic device may determine the pixels of the central region and the entire region differently, thereby determining the resolutions of the central region and the peripheral region differently. For example, as illustrated in FIG. 7, the electronic device may determine the pixels of the central region as 1500*1500 and the pixels of the entire region as 3000*3000, thereby determining the resolutions of the central region and the peripheral region differently.

[0139] In operation (730), the electronic device may display a virtual object in the central area. For example, as illustrated in FIG. 7, the electronic device may output pixels of the entire area as 3000*3000 and display a virtual object generated in the virtual world in the central area.

[0140] In one embodiment, an electronic device may acquire multiple images or videos generated by a camera to perform a foveation operation. While performing the foveation operation, the electronic device may consume increased current and generate increased heat for processing the multiple images or videos.

[0141] According to one embodiment, an electronic device can determine whether a foveation operation is performed and control the focus of the camera based on the temperature of the camera. For example, the electronic device can output an image generated by pass-through operation through a first camera and a second camera to a display, and when a user views the output image, the electronic device can control the focus of the camera based on the temperature of the camera. In addition to general images or content, an image captured by pass-through can be displayed on part or the entire display. By controlling the focus of the camera based on the temperature of the camera when a foveation operation is performed, the electronic device can efficiently manage heat generation and control the focus of the camera in various scenarios. In addition, the electronic device can perform the focus control of the camera based on the temperature based on whether a foveation operation is performed, without determining whether the temperature of the camera is higher than a predetermined reference temperature. An operation of controlling the focus of the camera when the electronic device performs a foveation operation is described in detail below with reference to FIG. 8.

[0142]

[0143] FIG. 8 is a drawing for explaining an operation method of an electronic device during a foveation operation according to one embodiment.

[0144] In the following embodiments, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. Furthermore, some operations may be omitted according to some embodiments. The operations (810, 820, 821, 830, 831, 840, 850) may be performed by at least one component of the electronic device (e.g., the processor (120) of FIG. 1). For example, instructions stored in a memory (e.g., the memory (130) of FIG. 1) may be executed by at least one processor, and the instructions may cause the electronic device to perform the following operations (810, 820, 821, 830, 831, 840, 850).

[0145] In operation (810), the electronic device may operate the first camera. In one embodiment, the electronic device may further operate the second camera. For example, the electronic device may cause the first camera and the second camera to capture an external scene and generate an image or video corresponding to the external scene.

[0146] In one embodiment, the electronic device may obtain temperature data for the first camera. Alternatively, the electronic device may obtain temperature data for the first camera and / or the second camera.

[0147] In operation (820), the electronic device can determine whether the processor is performing a foveation operation.

[0148] In operation (821), if a foveation operation is not being performed, the electronic device may continue to execute the camera focus control algorithm that was previously being executed. For example, if the electronic device was executing a temperature-based focus control algorithm, the electronic device may control the camera focus through the algorithm that was being executed.

[0149] In operation (830), when a foveation operation is being performed, the electronic device can determine whether the acceleration of the electronic device is less than a predetermined reference acceleration.

[0150] In operation (830), the electronic device may determine a target focal distance of the first camera based on temperature data for the first camera. In one embodiment, the electronic device may further determine a target focal distance of the second camera based on temperature data for the first camera.

[0151] According to one embodiment, the electronic device may determine the target focal distances of the first camera and the second camera, respectively, based on a predetermined reference focal distance according to a plurality of temperature intervals. For example, the electronic device may utilize a predetermined reference focal distance according to a plurality of temperature intervals, such as Table 3 for the first camera and Table 4 for the second camera.

[0152] Temperature-based focal length AF stroke 0~30˚C 1.5m 0μm 30~40˚C 1m 200μm 40~50˚C 60cm 400μm 50~55˚C 40cm 500μm 55˚C ~30cm 600μm

[0153]

[0154] Temperature-based focal length AF stroke 0~40˚C 1.5m 0μm 40~50˚C 1m 200μm 50~55˚C 60cm 400μm 55~65˚C 40cm 500μm 65˚C~30cm 600μm

[0155] Tables 3 and 4 may represent temperature-dependent reference focal lengths for the first camera and the second camera, respectively, and AF strokes for focusing the camera at the reference focal length. Here, the multiple temperature ranges in Tables 3 and 4 may be distinguished in more detail than the multiple temperature ranges in Tables 1 and 2, as heat generation increases when performing a foveation operation.

[0156] Since the above-described matters through FIGS. 1 to 7 are applied to each operation illustrated in FIG. 8, a more detailed description is omitted.

[0157]

[0158] FIG. 9 is a diagram illustrating an operation of an electronic device according to one embodiment to determine a distance to a target object.

[0159] Referring to FIG. 9, the electronic device can use a depth sensor to determine the distance to objects (920, 930, 940) based on a user (910) wearing the electronic device. The objects may be, for example, a TV (television), a PC (personal computer), or a picture frame around the user (910), but the embodiment is not limited thereto.

[0160] In one embodiment, the electronic device can track the gaze of the user (910) to determine the distance to the target object that the user (910) is looking at. For example, when the user (910) looks at a point (931), the electronic device can track the gaze of the user (910) to determine the distance between the user (910) and the object (930). Alternatively, when the user looks at a point (941), the electronic device can track the gaze of the user (910) to determine the distance between the user (910) and the object (940).

[0161] According to one embodiment, the electronic device can track the gaze of the user (910) to determine the distance to a specific point of a target object that the user (910) is looking at. For example, when the user (910) looks at a point (921) of an object (920), the electronic device can track the gaze of the user (910) to determine the distance between the user (910) and the point (921). Similarly, when the user (910) looks at a point (922), a point (923), or a point (924) of an object (920), the electronic device can determine the distance between the user (910) and the point (922), the point (923), or the point (924), respectively.

[0162] According to one embodiment, the electronic device may determine the target focal distance of the first camera based on the distance to the target object viewed by the user. Furthermore, in one embodiment, the electronic device may further determine the target focal distance of the second camera based on the distance to the target object viewed by the user. Alternatively, the electronic device may determine the target focal distances of the first camera and the second camera based on the distance to a specific point of the target object viewed by the user. An operation of the electronic device controlling the focus of the camera based on the distance to the target object or a specific point of the target object is described in detail below with reference to FIG. 10.

[0163]

[0164] FIG. 10 is a drawing for explaining an operation method of an electronic device using a distance to a target object according to one embodiment.

[0165] In the embodiments below, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. Furthermore, some operations may be omitted according to some embodiments. Operations (1010 to 1050) may be performed by at least one component of the electronic device (e.g., the processor (120) of FIG. 1 ). For example, instructions stored in a memory (e.g., the memory (130) of FIG. 1 ) may be executed by at least one processor, and the instructions may cause the electronic device to perform the following operations (1010 to 1050).

[0166] In operation (1010), the electronic device may operate the first camera. In one embodiment, the electronic device may further operate the second camera. Additionally, the electronic device may perform an ET operation through the third functional camera and operate the depth sensor.

[0167] In operation (1020), the electronic device can perform scene understanding (SU) using the first camera and the depth sensor. The electronic device can use the depth sensor to obtain the distances to objects around the user in advance. In one embodiment, the electronic device can label objects around the user and recognize relationships and background information between each object.

[0168] In operation (1030), the electronic device can recognize objects around the user using images or videos acquired through the first camera. Furthermore, the electronic device can track the user's gaze to determine a target object or a specific point on the target object the user is looking at.

[0169] In operation (1040), the electronic device may determine the distance to a target object or a specific point of the target object that the user is looking at using a depth sensor. According to one embodiment, the electronic device may determine the distance using the distance to the object acquired in operation (1020) or using the depth sensor to accurately determine the distance to the object. For example, when a user views text on a screen or uses a video or computer, the distance between the user and a surrounding object does not change significantly, so the electronic device may acquire information about the distance to the surrounding object in advance using the depth sensor, and perform distance measurements one or more times when the user views a specific object to determine the distance.

[0170] In operation (1050), the electronic device can determine the target focal length of the first camera based on the distance to the target object or a specific point of the target object.

[0171] In one embodiment, the electronic device may control the focal length of the first camera so that the reference focal length matches the distance to the target object or a specific point of the target object. For example, the electronic device may adjust the AF stroke of the first camera so that the reference focal length matches the distance to the target object or a specific point of the target object. In another embodiment, the electronic device may further control the focal length of the second camera so that the reference focal length matches the distance to the target object or a specific point of the target object.

[0172] For example, as shown in Table 5 below, the electronic device can determine the reference focal length and the target focal length of the first camera based on the distance to or from the target object.

[0173] Standard focal length AF stroke 1.5m0um1m200um80cm250um60cm300um50cm400um40cm500um30cm600um

[0174] According to one embodiment, the electronic device may determine the target focal distance of the first camera based on the distance to the target object and temperature data. Furthermore, according to one embodiment, the electronic device may determine the target focal distances of the first camera and the second camera based on the distance to the target object and temperature data. According to one embodiment, the electronic device may determine the target focal distance of the first camera based on the temperature of each camera, control the focal distance of each camera, and then correct the target focal distance in consideration of the distance to the target object. For example, when the temperature of the first camera is 45˚C, the electronic device may determine the reference focal distance of 60cm corresponding to the temperature range of 40 to 50˚C in Table 1 as the target focal distance of the first camera, and control the focal distance of the first camera to 60cm. Thereafter, when the electronic device determines the distance to the target object to be 80cm, the electronic device may re-determine the target focal distance as 80cm, or re-determine a focal distance between 60cm and 80cm as the target focal distance. The electronic device may control the focal distance of the first camera to match the corrected target focal distance.

[0175] Since the matters described above through FIGS. 1 to 9 are applied to each operation illustrated in FIG. 10, a more detailed description is omitted.

[0176]

[0177] Fig. 11 is a schematic flowchart illustrating an operating method of an electronic device according to one embodiment.

[0178] In the embodiments below, the operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of the operations may be changed, and at least two operations may be performed in parallel. Operations (1110-1130) may be performed by at least one component (e.g., a processor) of the electronic device.

[0179] In operation (1110), the electronic device can obtain temperature data for the first camera. The electronic device can further obtain temperature data for the second camera.

[0180] In operation (1120), the electronic device may determine a target focal distance of the first camera based on temperature data for the first camera. The electronic device may determine a target focal distance of the second camera based on temperature data for the first camera. The electronic device may determine the target focal distances of the first camera and the second camera based on a predetermined reference focal distance according to a plurality of temperature sections. The electronic device may obtain temperature data for the second camera and determine the target focal distance of the second camera based on the temperature data for the second camera. The electronic device may determine whether the temperature of the first camera is equal to or higher than a predetermined reference temperature based on the temperature data for the first camera, and if the temperature of the first camera is equal to or higher than the reference temperature, the electronic device may determine the target focal distances of the first camera and the second camera based on the temperature data for the first camera. When the electronic device (101) is performing a foveation operation, the electronic device may determine the target focal distances of the first camera and the second camera. The electronic device can track the user's gaze to determine the distance to a target object the user is looking at, and determine the target focal distances of the first camera and the second camera based on the distance to the target object and temperature data.

[0181] In operation (1130), the electronic device may control the focal length of the first camera to match the target focal length of the first camera. The electronic device may control the focal length of the second camera to match the target focal length of the second camera. The electronic device may obtain information about the acceleration of the electronic device, determine whether the acceleration of the electronic device is less than a predetermined reference acceleration, and if the acceleration of the electronic device is less than the reference acceleration, control the focal lengths of the first camera and the second camera. The electronic device may adjust the distance between the lens and the image sensor corresponding to the first camera so that the first camera focuses on the target focal length of the first camera, and may adjust the distance between the lens and the image sensor corresponding to the second camera so that the second camera focuses on the target focal length of the second camera.

[0182] When the acceleration of the electronic device is greater than a predetermined reference acceleration, an operation of acquiring information about the acceleration after a predetermined time and an operation of determining whether the acceleration of the electronic device is less than the reference acceleration may be repeatedly performed.

[0183] The first camera is positioned on the front of the electronic device and can capture images or videos of the front. The first and second cameras may correspond to each eye of the user wearing the electronic device.

[0184] Since the matters described above through FIGS. 1 to 10 are applied to each operation illustrated in FIG. 11, a more detailed description is omitted.

[0185]

[0186] An electronic device according to one embodiment includes a processor, a memory storing instructions, and a first camera, wherein the instructions, when individually or collectively executed by the one or more processors, cause the electronic device to obtain temperature data for the first camera, determine a target focal distance of the first camera based on the temperature data for the first camera, and control the focal distance of the first camera to match the target focal distance of the first camera, wherein the first camera is disposed on a front side of the electronic device and captures an image or video of the front side.

[0187] The electronic device further includes a second camera, and the instructions, when individually or collectively executed by the one or more processors, cause the electronic device to determine a target focal distance of the second camera based on temperature data for the first camera, and control a focal distance of the second camera to match the target focal distance of the second camera, wherein the first camera and the second camera may correspond to each of both eyes of a user wearing the electronic device, respectively.

[0188] The instructions, when individually or collectively executed by the one or more processors, may cause the electronic device to determine target focal distances of the first camera and the second camera, respectively, based on a predetermined reference focal distance according to a plurality of temperature intervals.

[0189] The instructions, when individually or collectively executed by the one or more processors, may cause the electronic device to obtain temperature data for the second camera and determine a target focal distance of the second camera based on the temperature data for the second camera.

[0190] The instructions, when individually or collectively executed by the one or more processors, may cause the electronic device to determine, based on temperature data for the first camera, whether the temperature of the first camera is equal to or greater than a predetermined reference temperature, and, if the temperature of the first camera is equal to or greater than the reference temperature, determine target focal distances of the first camera and the second camera based on the temperature data for the first camera.

[0191] The instructions, when individually or collectively executed by the one or more processors, may cause the electronic device to obtain information about acceleration of the electronic device, determine whether the acceleration of the electronic device is less than a predetermined reference acceleration, and control the focal lengths of the first camera and the second camera when the acceleration of the electronic device is less than the reference acceleration.

[0192] When the acceleration of the electronic device is greater than or equal to a predetermined reference acceleration, an operation of acquiring information about the acceleration after a predetermined time and an operation of determining whether the acceleration of the electronic device is less than or equal to the reference acceleration may be repeatedly performed.

[0193] The instructions, when individually or collectively executed by the one or more processors, may cause the electronic device to adjust a distance between a lens and an image sensor corresponding to the first camera so that the first camera focuses at a target focal distance of the first camera, and to adjust a distance between a lens and an image sensor corresponding to the second camera so that the second camera focuses at a target focal distance of the second camera.

[0194] The instructions, when individually or collectively executed by the one or more processors, may cause the electronic device to determine target focal distances of the first camera and the second camera when the processor is performing a foveation operation.

[0195] The instructions, when individually or collectively executed by the one or more processors, may cause the electronic device to track the user's gaze to determine a distance to a target object viewed by the user, and determine a target focal distance of the first camera and the second camera based on the distance to the target object and the temperature data.

[0196] The target focal distance of the first camera and the target focal distance of the second camera may be determined differently depending on the temperature of the first camera and the temperature of the second camera.

[0197] An operating method of an electronic device according to one embodiment includes an operation of acquiring temperature data for a first camera, an operation of determining a target focal distance of the first camera based on the temperature data for the first camera, and an operation of controlling a focal distance of the first camera to match the target focal distance of the first camera, wherein the first camera is disposed on a front side of the electronic device and captures an image or video of the front side.

[0198] The operating method of the electronic device further includes an operation of determining a target focal distance of a second camera based on temperature data for the first camera and an operation of controlling a focal distance of the second camera to match the target focal distance of the second camera, wherein the first camera and the second camera may correspond to each of both eyes of a user wearing the electronic device.

[0199] The operation of determining the target focal distance may determine the target focal distances of the first camera and the second camera, respectively, based on a predetermined reference focal distance according to a plurality of temperature sections.

[0200] The operation of acquiring temperature data for the first camera may further acquire temperature data for the second camera, and the operation of determining the target focal distance may determine the target focal distance of the second camera based on the temperature data for the second camera.

[0201] The operation of determining the target focal distance may include determining whether the temperature of the first camera is equal to or higher than a predetermined reference temperature based on temperature data for the first camera, and, if the temperature of the first camera is equal to or higher than the reference temperature, determining the target focal distances of the first camera and the second camera based on the temperature data for the first camera.

[0202] The operation of controlling the focal length may include obtaining information about the acceleration of the electronic device, determining whether the acceleration of the electronic device is less than a predetermined reference acceleration, and controlling the focal lengths of the first camera and the second camera when the acceleration of the electronic device is less than the reference acceleration.

[0203] When the acceleration of the electronic device is greater than or equal to a predetermined reference acceleration, an operation of acquiring information about the acceleration after a predetermined time and an operation of determining whether the acceleration of the electronic device is less than or equal to the reference acceleration may be repeatedly performed.

[0204] The operation of controlling the focal length may include adjusting the distance between a lens and an image sensor corresponding to the first camera so that the first camera focuses on the target focal distance of the first camera, and adjusting the distance between a lens and an image sensor corresponding to the second camera so that the second camera focuses on the target focal distance of the second camera.

[0205] The operation of determining the target focal distance may determine the target focal distances of the first camera and the second camera when the electronic device is performing a foveation operation.

[0206] The operation of determining the target focal distance may include tracking the user's gaze to determine the distance to a target object viewed by the user, and determining the target focal distances of the first camera and the second camera based on the distance to the target object and the temperature data.

[0207]

[0208] The embodiments described above may be implemented using hardware components, software components, and / or a combination of hardware components and software components. For example, the devices, methods, and components described in the embodiments may be implemented using a general-purpose computer or a special-purpose computer, such as, for example, a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and software applications running on the operating system. Furthermore, the processing device may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0209] Software may include a computer program, code, instructions, or a combination of one or more of these, and may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be stored on any type of machine, component, physical device, virtual equipment, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on a computer-readable recording medium.

[0210] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. The computer-readable medium may store program commands, data files, data structures, etc., alone or in combination, and the program commands recorded on the medium may be those specially designed and configured for the embodiment or may be known and available to those skilled in the art of computer software. Examples of the computer-readable recording medium include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and hardware devices specially configured to store and execute program commands, such as ROMs, RAMs, and flash memories. Examples of program commands include not only machine language codes such as those generated by a compiler, but also high-level language codes that can be executed by a computer using an interpreter, etc.

[0211] The hardware devices described above may be configured to operate as one or more software modules to perform the operations of the embodiments, and vice versa.

[0212] Although the embodiments described above have been described with limited drawings, those skilled in the art will appreciate that various technical modifications and variations can be applied based on the described embodiments. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0213] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In an electronic device (101; 201), Processor (120); Memory (130) for storing instructions; and First camera Including, The above instructions, when individually or collectively executed by the one or more processors (120), cause the electronic device (101; 201) to: Obtain temperature data for the first camera, Based on the temperature data for the first camera, the target focal distance of the first camera is determined, Control the focal length of the first camera so as to match the target focal length of the first camera; The above first camera Placed on the front of the above electronic device (101; 201), to capture an image or video of the front, Electronic devices (101; 201).

2. In paragraph 1, Second camera Including more, The above instructions, when individually or collectively executed by the one or more processors (120), cause the electronic device (101; 201) to: Based on the temperature data for the first camera, the target focal distance of the second camera is determined, Control the focal length of the second camera to match the target focal length of the second camera, The above first camera and the above second camera Each corresponding to each eye of the user (910) wearing the electronic device (101; 201), Electronic devices (101; 201).

3. In either of paragraphs 1 and 2, The above instructions, when individually or collectively executed by the one or more processors (120), cause the electronic device (101; 201) to: Determine the target focal distances of the first camera and the second camera respectively based on a predetermined reference focal distance according to a plurality of temperature sections. Electronic devices (101; 201).

4. In any one of paragraphs 1 to 3, The above instructions, when individually or collectively executed by the one or more processors (120), cause the electronic device (101; 201) to: Obtain temperature data for the second camera, Based on the temperature data for the second camera, determining the target focal distance of the second camera, Electronic devices (101; 201).

5. In any one of paragraphs 1 to 4, The above instructions, when individually or collectively executed by the one or more processors (120), cause the electronic device (101; 201) to: Based on the temperature data for the first camera, it is determined whether the temperature of the first camera is higher than a predetermined reference temperature, When the temperature of the first camera is higher than the reference temperature, the target focal distances of the first camera and the second camera are determined based on the temperature data for the first camera. Electronic devices (101; 201).

6. In any one of paragraphs 1 to 5, The above instructions, when individually or collectively executed by the one or more processors (120), cause the electronic device (101; 201) to: Obtain information about the acceleration of the above electronic device (101; 201), Determine whether the acceleration of the above electronic device (101; 201) is less than a predetermined reference acceleration, When the acceleration of the electronic device (101; 201) is less than the reference acceleration, the focal length of the first camera and the second camera is controlled. Electronic devices (101; 201).

7. In any one of paragraphs 1 to 6, When the acceleration of the electronic device (101; 201) is greater than or equal to a predetermined reference acceleration, an operation of acquiring information about the acceleration after a predetermined time and an operation of determining whether the acceleration of the electronic device (101; 201) is less than or equal to the reference acceleration are repeatedly performed. Electronic devices (101; 201).

8. In any one of paragraphs 1 to 7, The above instructions, when individually or collectively executed by the one or more processors (120), cause the electronic device (101; 201) to: Adjusting the distance between the lens and the image sensor corresponding to the first camera so that the first camera focuses at the target focal distance of the first camera; Adjusting the distance between the lens and the image sensor corresponding to the second camera so that the second camera focuses on the target focal distance of the second camera. Electronic devices (101; 201).

9. In any one of paragraphs 1 to 8, The above instructions, when individually or collectively executed by the one or more processors (120), cause the electronic device (101; 201) to: When the above processor (120) is performing a foveation operation, to determine the target focal distance of the first camera and the second camera, Electronic devices (101; 201).

10. In any one of paragraphs 1 to 9, The above instructions, when individually or collectively executed by the one or more processors (120), cause the electronic device (101; 201) to: By tracking the gaze of the user (910), the distance to the target object that the user (910) is looking at is determined, Determine the target focal distances of the first camera and the second camera based on the distance to the target object and the temperature data for the first camera. Electronic devices (101; 201).

11. In any one of paragraphs 1 to 10, The target focal distance of the first camera and the target focal distance of the second camera which is determined differently depending on the temperature of the first camera and the temperature of the second camera, Electronic devices (101; 201).

12. In the operating method of an electronic device (101; 201), An action to acquire temperature data for the first camera; An operation of determining a target focal distance of the first camera based on temperature data for the first camera; and An operation of controlling the focal length of the first camera to match the target focal length of the first camera. Including, The above first camera Placed on the front of the above electronic device (101; 201), to capture an image or video of the front, Method of operating an electronic device (101; 201).

13. In paragraph 12, An operation of determining a target focal distance of a second camera based on temperature data for the first camera; and An operation of controlling the focal length of the second camera to match the target focal length of the second camera. Including more, The above first camera and the above second camera Each corresponding to each eye of the user (910) wearing the electronic device (101; 201), Electronic devices (101; 201).

14. In any one of paragraphs 12 and 13, The operation of determining the above target focal distance is Based on a predetermined reference focal length according to a plurality of temperature sections, the target focal distances of the first camera and the second camera are each determined. Method of operating an electronic device (101; 201).

15. In any one of paragraphs 12 to 14, The operation of acquiring temperature data for the above first camera is Acquire more temperature data for the second camera, The operation of determining the above target focal distance is Based on the temperature data for the second camera, determining the target focal distance of the second camera, Method of operating an electronic device (101; 201).

Images