Method for providing image and wearable electronic device supporting same

Abstract

A wearable electronic device, according to one embodiment, may comprise: an inertial sensor; a display; at least one processor including a processing circuit; and a memory storing instructions. The instructions, when executed individually or collectively by the at least one processor, may instruct the wearable electronic device to: by detecting an edge in an image frame, obtain a feature map distinguishing a first region including the edge within the image frame and a second region excluding the first region within the image frame; obtain, on the basis of the feature map, a first gain map for obtaining a first image frame and a second gain map for obtaining a second image frame; obtain the first image frame by applying the first gain map to the image frame, obtain the second image frame by applying the second gain map to the image frame, display, via the display, the first image frame and the second image frame on the basis of a speed of motion of the wearable electronic device obtained via the inertial sensor being greater than or equal to a threshold speed, and display the image frame via the display on the basis of the speed of the motion of the wearable electronic device being less than the threshold speed.

Description

Method for providing images and wearable electronic device supporting the same

[0001] The present disclosure relates to a method for providing an image and a wearable electronic device that supports the same.

[0002] Various services and additional functions provided through wearable electronic devices (hereinafter referred to as "wearable electronic devices"), such as AR glasses (augmented reality glasses), VR glasses (virtual reality glasses), and HMDs (head-mounted displays), are gradually increasing. In order to enhance the utility value of these wearable electronic devices and satisfy the needs of various users, telecommunications service providers or manufacturers of wearable electronic devices are competitively developing wearable electronic devices to provide various functions and differentiate themselves from other companies. Accordingly, the various functions provided through wearable electronic devices are also becoming increasingly sophisticated.

[0003] A wearable electronic device can display images (e.g., video) through a display. While the wearable electronic device displays images through the display, motion blur (or referred to as the "motion blur phenomenon") may occur due to the motion of the wearable electronic device. Motion blur may refer to a phenomenon in which image drag occurs because consecutive images appear overlapping without being clearly distinguishable. Motion blur mainly occurs in images containing moving objects, but it may also occur due to the motion of the wearable electronic device when displaying images containing stationary objects on the wearable electronic device.

[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.

[0005] A wearable electronic device may use AID dimming (AMOLED Impulse Drive Dimming) technology to reduce motion blur. AID dimming technology can provide the effect of inserting black frames between frames of video by controlling the AMOLED display such that, during one frame cycle of the AMOLED (Active-Matrix Organic Light-Emitting Diode) display, the pixels of the AMOLED display are turned on for a specified time (e.g., about 20% of one frame cycle) for displaying frames of video, and the pixels of the AMOLED display are turned off for the remaining time (e.g., about 80% of one frame cycle).

[0006] However, the method of reducing motion blur using AID dimming technology requires the processor to provide a signal for on / off control of the display to the display driver integrated circuit (DDI), and the DDI must also include registers and control structures to process the signal, and may require turning the power module on / off. Furthermore, the method of reducing motion blur using AID dimming technology may be difficult to apply to a wide variety of displays.

[0007] Various embodiments of the present disclosure relate to a method for providing images and a wearable electronic device supporting the same, wherein a processor (e.g., an application processor) generates images from an image of a video (e.g., an original image) that can reduce motion blur (e.g., minimize motion blur) when displayed through a display, and provides said generated images to a DDI of a display so that the display can display them.

[0008] The technical problems that the present disclosure aims to solve are not limited to those mentioned above, and other unmentioned technical problems will be clearly understood by those skilled in the art from the description below.

[0009] A wearable electronic device according to one embodiment may include at least one processor comprising an inertial sensor, a display, and a processing circuit; and a memory for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause to acquire a feature map that distinguishes a first region containing an edge within an image frame and a second region excluding the first region within the image frame by detecting an edge within the image frame. When the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause to acquire a first gain map based on the feature map for acquiring a first image frame that includes a third region corresponding to the first region and displayed at a minimum brightness, and a fourth region corresponding to the second region and displayed at the same brightness as the second region. When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may be caused to acquire a second gain map for acquiring a second image frame, comprising, based on the feature map, a fifth region corresponding to the first region and to be displayed with a brightness to compensate for the brightness reduced by the third region, and a sixth region to be displayed with the same brightness as the fourth region. When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may be caused to acquire the first image frame by applying the first gain map to the image frame and to acquire the second image frame by applying the second gain map to the image frame.When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause the first image frame and the second image frame to be displayed through the display based on the speed of the motion of the wearable electronic device obtained through the inertial sensor being greater than or equal to the threshold speed. When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause the image frame to be displayed through the display based on the speed of the motion of the wearable electronic device being less than the threshold speed.

[0010] A method for providing an image in a wearable electronic device according to one embodiment may include the operation of obtaining a feature map that distinguishes a first region containing an edge within an image frame and a second region excluding the first region within the image frame by detecting an edge within the image frame. The method may include the operation of obtaining a first gain map for obtaining a first image frame that includes a third region corresponding to the first region and to be displayed at a minimum brightness, and a fourth region corresponding to the second region and to be displayed at the same brightness as the second region, based on the feature map. The method may include the operation of obtaining a second gain map for obtaining a second image frame that includes a fifth region corresponding to the first region and to be displayed at a brightness to compensate for the brightness reduced by the third region, and a sixth region to be displayed at the same brightness as the fourth region, based on the feature map. The above method may include the operation of acquiring the first image frame by applying the first gain map to the image frame, and acquiring the second image frame by applying the second gain map to the image frame. The above method may include the operation of displaying the first image frame and the second image frame through the display of the wearable electronic device based on the speed of the motion of the wearable electronic device acquired through the inertial sensor of the wearable electronic device being greater than or equal to a threshold speed. The above method may include the operation of displaying the image frame through the display based on the speed of the motion of the wearable electronic device being less than the threshold speed.

[0011] A wearable electronic device according to one embodiment may include at least one processor comprising an inertial sensor, a display, and a processing circuit; and a memory for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause to obtain a feature map that distinguishes a first region containing an edge within an image frame and a second region excluding the first region within the image frame by detecting an edge for an image frame based on the speed of motion of the wearable electronic device obtained through the inertial sensor being greater than or equal to a threshold speed. When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may be caused to acquire a first gain map for acquiring a first image frame, which includes a third region corresponding to the first region and displayed at a minimum brightness, and a fourth region corresponding to the second region and displayed at the same brightness as the second region, based on the feature map and the image frame, based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed. When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may be caused to acquire a second gain map for acquiring a second image frame based on the feature map and the image frame, based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed, the second gain map including a fifth region corresponding to the first region and to be displayed with a brightness to compensate for the brightness reduced by the third region, and a sixth region to be displayed with the same brightness as the fourth region.When executed individually or collectively by the at least one processor, the above instructions may cause the wearable electronic device to acquire the first image frame by applying the first gain map to the image frame and to acquire the second image frame by applying the second gain map to the image frame, based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed. When executed individually or collectively by the at least one processor, the above instructions may cause the wearable electronic device to display the first image frame and the second image frame through the display, based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed. When executed individually or collectively by the at least one processor, the above instructions may cause the wearable electronic device to display the image frame through the display, based on the speed of the motion of the wearable electronic device being less than the threshold speed.

[0012] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.

[0013] FIG. 2 is a perspective view for explaining the internal configuration of a wearable electronic device according to one embodiment of the present disclosure.

[0014] FIG. 3a is a drawing showing the front of a wearable electronic device according to one embodiment.

[0015] FIG. 3b is a drawing showing the rear side of a wearable electronic device according to one embodiment.

[0016] FIG. 4 is a block diagram of a wearable electronic device according to one embodiment.

[0017] FIG. 5 is a drawing for explaining a processor according to one embodiment.

[0018] FIG. 6 is a flowchart illustrating a method for providing an image according to one embodiment.

[0019] FIG. 7 is a diagram illustrating a method for obtaining a feature map according to one embodiment.

[0020] FIG. 8 is a diagram illustrating a method for obtaining a gain map according to one embodiment.

[0021] FIG. 9 is a drawing for explaining a method for obtaining a first image frame and a second image frame according to one embodiment.

[0022] FIG. 10 is a drawing for explaining a method for obtaining a first image frame and a second image frame according to one embodiment.

[0023] FIG. 11 is a drawing for explaining a method for obtaining a first image frame and a second image frame according to one embodiment.

[0024] FIG. 12 is a drawing for explaining a method of providing an image according to one embodiment.

[0025] FIG. 13 is a drawing for explaining a method of providing an image according to one embodiment.

[0026] FIG. 14 is a flowchart illustrating a method for providing an image according to one embodiment.

[0027] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to one embodiment.

[0028] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0029] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0030] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0031] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0032] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0033] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0034] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0035] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0036] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0037] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0038] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0039] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0040] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0041] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0042] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0043] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0044] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0045] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0046] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0047] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0048] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0049] According to one embodiment, commands or data may be transmitted or received between an electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0050] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0051] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0052] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0053] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0054] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0055] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0056] FIG. 2 is a perspective view for explaining the internal configuration of a wearable electronic device (200) according to one embodiment of the present disclosure.

[0057] Referring to FIG. 2, a wearable electronic device (200) according to one embodiment of the present disclosure may include at least one of a light output module (211), a display member (201), and a camera module (250).

[0058] According to one embodiment of the present disclosure, the light output module (211) may include a light source capable of outputting an image and a lens that guides the image to a display member (201). According to one embodiment of the present disclosure, the light output module (211) may include at least one of a liquid crystal display (LCD), a digital mirror device (DMD), a liquid crystal on silicon (LCoS), an organic light emitting diode (OLED), an organic light emitting diode on silicon (OLEDoS), or a micro light emitting diode (micro LED).

[0059] According to one embodiment of the present disclosure, the display member (201) may include an optical waveguide (e.g., a waveguide). According to one embodiment of the present disclosure, an output image of an optical output module (211) incident on one end of the optical waveguide may propagate within the optical waveguide and be provided to a user. According to one embodiment of the present disclosure, the optical waveguide may include at least one diffractive element (e.g., a Diffractive Optical Element (DOE), a Holographic Optical Element (HOE)) or a reflective element (e.g., a reflective mirror). For example, the optical waveguide may guide the output image of the optical output module (211) to the user's eye using at least one diffractive element or reflective element.

[0060] According to one embodiment of the present disclosure, the camera module (250) can capture still images and / or video. According to one embodiment, the camera module (250) may be placed within a lens frame and around a display member (201).

[0061] According to one embodiment of the present disclosure, the first camera module (251) can capture and / or recognize the trajectory of the user's eye (e.g., pupil, iris) or gaze. According to one embodiment of the present disclosure, the first camera module (251) can periodically or non-periodically transmit information related to the trajectory of the user's eye or gaze (e.g., trajectory information) to a processor (e.g., processor (120) of FIG. 1).

[0062] According to one embodiment of the present disclosure, the second camera module (253) can capture an external image.

[0063] According to one embodiment of the present disclosure, a third camera module (255) may be used for hand detection and tracking and recognition of user gestures (e.g., hand movements). According to one embodiment of the present disclosure, a third camera module (255) may be used for 3 degrees of freedom (3DoF), 6DoF head tracking, position (space, environment) recognition, and / or movement recognition. According to one embodiment of the present disclosure, a second camera module (253) may be used for hand detection and tracking and recognition of user gestures. According to one embodiment of the present disclosure, at least one of the first camera module (251) to the third camera module (255) may be replaced with a sensor module (e.g., LiDAR sensor). For example, the sensor module may include at least one of a vertical cavity surface emitting laser (VCSEL), an infrared sensor, and / or a photodiode.

[0064] FIG. 3a is a drawing showing the front and rear of a wearable electronic device (300) according to one embodiment.

[0065] FIG. 3b is a drawing showing the front and rear of a wearable electronic device (300) according to one embodiment.

[0066] Referring to FIG. 3a and FIG. 3b, in one embodiment, camera modules (311, 312, 313, 314, 315, 316) and / or a depth sensor (317) for acquiring information related to the surrounding environment of the wearable electronic device (300) may be disposed on the first surface (310) of the housing.

[0067] In one embodiment, camera modules (311, 312) can acquire images related to the surrounding environment of a wearable electronic device.

[0068] In one embodiment, camera modules (313, 314, 315, 316) can acquire images while the wearable electronic device is worn by a user. Camera modules (313, 314, 315, 316) can be used for hand detection, tracking, and user gesture (e.g., hand movements) recognition. Camera modules (313, 314, 315, 316) can be used for 3DoF, 6DoF head tracking, position (space, environment) recognition, and / or movement recognition. In one embodiment, camera modules (311, 312) may be used for hand detection and tracking and user gestures.

[0069] In one embodiment, the depth sensor (317) may be configured to transmit a signal and receive a signal reflected from an object, and may be used for purposes such as time of flight (TOF) to determine the distance to an object.

[0070] According to one embodiment, a face recognition camera module (325, 326,) and / or a display (321) (and / or a lens) may be disposed on the second surface (320) of the housing.

[0071] In one embodiment, a face recognition camera module (325, 326) adjacent to the display may be used to recognize the user's face or to recognize and / or track both of the user's eyes.

[0072] In one embodiment, the display (321) (and / or lens) may be disposed on a second surface (320) of the wearable electronic device (300). In one embodiment, the wearable electronic device (300) may not include camera modules (315, 316) among a plurality of camera modules (313, 314, 315, 316). Although not illustrated in FIG. 3a and 3b, the wearable electronic device (300) may further include at least one of the configurations illustrated in FIG. 2.

[0073] As described above, according to one embodiment, the wearable electronic device (300) may have a form factor for being worn on a user's head. The wearable electronic device (300) may further include a strap and / or a wearing member for being secured on a part of the user's body. The wearable electronic device (101) may provide a user experience based on augmented reality, virtual reality, and / or mixed reality while being worn on the user's head.

[0074] FIG. 4 is a block diagram of a wearable electronic device (401) according to one embodiment.

[0075] Referring to FIG. 4, in one embodiment, the wearable electronic device (401) may be the electronic device (101) of FIG. 1, the wearable electronic device (200) of FIG. 2 (e.g., AR glasses), or the wearable electronic device (300) of FIG. 3a and FIG. 3b (e.g., VR glasses or VST (video see through) device).

[0076] In one embodiment, the wearable electronic device (401) may include an inertial sensor (410), a display (420), a memory (430), and a processor (440).

[0077] In one embodiment, an inertial sensor (410) (also referred to as a "motion sensor") may be included in the sensor module (176) of FIG. 1.

[0078] In one embodiment, the inertial sensor (410) can generate sensing data related to the motion of the wearable electronic device (401). For example, the inertial sensor (410) can generate sensing data related to the movement and / or rotation of the wearable electronic device (401) when the wearable electronic device (401) moves and / or rotates. The inertial sensor (410) can transmit the generated sensing data to a processor (440). In one embodiment, the inertial sensor (410) may include an accelerometer, a gyroscope, and / or a geomagnetic sensor.

[0079] In one embodiment, the display (420) may be the display module (160) of FIG. 1, the light output module (211) of FIG. 2, and / or the display (321) of FIG. 3a and FIG. 3b.

[0080] In one embodiment, the display (420) may include a display driver IC (421) (display driver integrated circuit; DDI) and a panel (422) (hereinafter also referred to as "display panel").

[0081] In one embodiment, the DDI (421) can store at least a portion of image data received from a main processor (e.g., the main processor (121) of FIG. 1) (e.g., an application processor) or an auxiliary processor (e.g., the auxiliary processor (123) of FIG. 1) that operates independently of the functions of the main processor (e.g., a graphics processing unit) in memory (430). The DDI (421) can display at least a portion of the image data through a panel (422).

[0082] In one embodiment, the memory (430) may be included in the memory (130) of FIG. 1.

[0083] In one embodiment, the memory (430) may store information for performing an operation to provide an image.

[0084] In one embodiment, the memory (430) may store instructions that cause the wearable electronic device (401) to perform an action of providing an image when executed individually or collectively by at least one processor (440) (e.g., processor (120)). The action of the wearable electronic device (401) to perform to provide an image when the instructions are executed will be described in detail later.

[0085] In one embodiment, the processor (440) may include the processor (120) of FIG. 1.

[0086] In one embodiment, the processor (440) can control the overall operation of providing an image. The processor (440) may include at least one processor for providing an image. The at least one processor may execute the instructions stored in memory (430) individually or collectively.

[0087] In one embodiment, the processor (440) may include an application processor. In one embodiment, the application processor controls the components included in the wearable electronic device (401) and may include at least one of a CPU (Central Processing Unit), a GPU (Graphic Processing Unit) configured to perform graphic processing, a DPU (Display Processing Unit) configured to perform image processing to output image data (e.g., an image) to fit the size of the display panel, or a NPU (Neural Processing Unit). The GPU may generate an image frame (e.g., RGB data of the image frame) to be displayed through the display (420) at every frame interval. The DPU may scale the image frame generated by the GPU to fit the display panel (422) and output it to the DDI (421).

[0088] In FIG. 4, the wearable electronic device (401) is illustrated as including an inertial sensor (410), a display (420), a memory (430), and a processor (440), but is not limited thereto. For example, the wearable electronic device (401) may further include at least one of the components of the electronic device (101) of FIG. 1, the components of the wearable electronic device (200) of FIG. 2 (e.g., AR glasses), or the components of the wearable electronic device (300) of FIG. 3a and FIG. 3b.

[0089] FIG. 5 is a drawing for explaining a processor (440) according to one embodiment.

[0090] Referring to FIG. 5, in one embodiment, a processor (440) (e.g., an application processor) may include a feature map generator (510), a gain map generator (520), a brightness compensator (530), a frame selector (540), a variable refresh ratio (VRR) controller (550), and / or a motion detector (560).

[0091] In one embodiment, the feature map generator (510) can obtain (e.g., generate) a feature map (hereinafter referred to as a "feature map") that distinguishes between an area containing an edge (hereinafter referred to as a "first area") and an area excluding the first area (hereinafter referred to as a "second area") within an image frame by detecting an edge (e.g., boundary) within an image frame (e.g., original image). For example, the feature map generator (510) can detect an edge (e.g., boundary) within an image frame by calculating the color difference (difference in color) between adjacent pixels for pixels included in the image frame. The feature map generator (510) can identify a first region including the detected edge (e.g., pixels representing the edge) and pixels located around the edge (e.g., pixels surrounding the pixels representing the edge and located within a specified pixel distance from the pixels representing the edge (e.g., pixels located within a distance determined by five consecutively arranged pixels)) and a second region excluding the first region within the image frame. The feature map generator (510) can generate a feature map by assigning a binary value of "1" to the pixels in the region corresponding to the first region in the feature map and assigning a binary value of "0" to the region corresponding to the second region in the feature map.

[0092] In one embodiment, the gain map generator (520) can generate a gain map including a first gain map and a second gain map based on a feature map.

[0093] In one embodiment, a first gain map (hereinafter referred to as the "first gain map") may include gains for obtaining a first image frame based on a feature map, comprising a third area corresponding to a first area and displayed at a minimum brightness, and a fourth area corresponding to a second area and displayed at the same brightness as the second area when the image frame is displayed. For example, the first image frame (hereinafter referred to as the "first image frame") may include a third area (hereinafter referred to as the "third area") having the same size as the first area of ​​the image frame and displayed at a minimum brightness (e.g., minimum luminance) when displayed through the display (420), and a fourth area (hereinafter referred to as the "fourth area") having the same size as the second area of ​​the image frame (original image) and displayed at the same brightness as the second area (e.g., luminance) when displayed through the display (420). The first gain map may include gains for generating the first image frame when applied to an image frame.

[0094] In one embodiment, a second gain map (hereinafter referred to as the "second gain map") may include gains for obtaining a second image frame, comprising a fifth area to be displayed with a brightness (hereinafter referred to as the "first brightness") to compensate for the brightness reduced by a third area (the third area of ​​the first image frame) corresponding to a first area (the first area of ​​the image frame), and a sixth area to be displayed with the same brightness as the brightness of the fourth area. For example, the second image frame (hereinafter referred to as the "second image frame") may include a fifth area (hereinafter referred to as the "fifth area") that has the same size as the first area of ​​the image frame and is displayed at a first brightness to compensate for (e.g., to maintain the average brightness) reduced by the third area that is displayed at a minimum brightness when displayed through the display (420), and a sixth area (hereinafter referred to as the "sixth area") that is displayed at the same brightness as the fourth area (e.g., the fourth area of ​​the first image frame). The second gain map may include gains for generating the second image frame when applied to the image frame.

[0095] In one embodiment, the brightness compensator (530) can generate a first image frame and a second image frame based on an image frame and a gain map (e.g., a first gain map and a second gain map). For example, the brightness compensator (530) can generate a first image frame by applying a first gain map to an image frame. The brightness compensator (530) can generate a second image frame by applying a second gain map to an image frame.

[0096] In one embodiment, the brightness compensator (530) can convert pixel values ​​of an image frame that correspond to (e.g., mapped) a brightness range (e.g., luminance range) of a display (420) that is targeted when creating an image frame into pixel values ​​that correspond to a brightness range of the display (420) (e.g., targeting the brightness range of the current display (420)). For example, if the range of pixel values ​​of the image frame (e.g., gray scale range) is 0 to 255 (e.g., each color value of the pixel of the image frame is represented by 8 bits), the image frame may have pixel values ​​such that the range of pixel values ​​0 to 255 corresponds to a luminance range of 0 (nit) to 250 (nit). A brightness compensator (530) can convert the pixel values ​​of an image frame so that, when the brightness range of the display (420) (e.g., a brightness range set on the display (420)) is 0 (nit) to 500 (nit), the range of pixel values ​​of the image frame corresponds to the brightness range of the display (420) from 0 (nit) to 500 (nit). In this case, the brightness of the image frame being displayed can be maintained. For example, the brightness when outputting an image frame having the brightness range based on the pixel values ​​of the image frame corresponding to the brightness range targeted when creating the image frame can be the same as the brightness when outputting an image frame through the display (420) based on the converted pixel values ​​of the image frame corresponding to the brightness range of the display (420).

[0097] In one embodiment, although not previously described, the pixel values ​​of the first image frame and the pixel values ​​of the second image frame may be pixel values ​​converted into a range of pixel values ​​corresponding to the luminance range of the display (420).

[0098] In one embodiment, the frame selector (540) may select an image frame, or a first image frame and a second image frame, based on information about the motion of the wearable electronic device (401) obtained from the motion detector (560) (e.g., the motion speed of the wearable electronic device (401)). For example, the frame selector (540) may select the first image frame and the second image frame based on the motion speed of the wearable electronic device (401) obtained from the motion detector (560) being greater than or equal to a threshold speed. The frame selector (540) may select an image frame based on the motion speed of the wearable electronic device (401) obtained from the motion detector (560) being less than a threshold speed.

[0099] In one embodiment, the frame selector (540) can provide the selected frame (e.g., frame (514)) to the display (420) (e.g., DDI (421)) so that the selected frame (e.g., frame (514)) is output through the display panel (422).

[0100] In one embodiment, the VRR control unit (550) can determine the refresh rate of the display (420).

[0101] In one embodiment, the VRR control unit (550) can determine the refresh rate of the display (420) based on information about the motion of the wearable electronic device (401) obtained from the motion detector (560) (e.g., the motion speed of the wearable electronic device (401)). For example, the VRR control unit (550) can determine the refresh rate of the display (420) to 60Hz, which is set by default, based on the fact that the motion speed of the wearable electronic device (401) obtained from the motion detector (560) is less than a threshold speed. The VRR control unit (550) can determine the refresh rate of the display (420) to 120Hz, which is obtained by multiplying the default 60Hz by an integer, based on the fact that the motion speed of the wearable electronic device (401) obtained from the motion detector (560) is greater than or equal to the threshold speed.

[0102] In one embodiment, the VRR control unit (550) can provide the determined refresh rate (513) to the display (420) (e.g., DDI (421)) so that the panel (422) of the display (420) operates at the determined refresh rate.

[0103] In FIG. 5, the processor (440) is illustrated as including, but is not limited to, a feature map generator (510), a gain map generator (520), a brightness compensator (530), a frame selector (540), a VRR controller (550), and a motion detector (560). For example, the processor (440) may further include an image frame generator (e.g., a GPU) configured to generate image frames. For example, the processor (440) may include a configuration in which at least some of the feature map generator (510), the gain map generator (520), the brightness compensator (530), the frame selector (540), the VRR controller (550), and the motion detector (560) are integrated.

[0104] In one embodiment, the processor transmits the first image frame and the second image frame generated by the aforementioned movements based on the motion of the wearable electronic device (e.g., speed of motion) to the DDI (421) of the display (420), thereby allowing the first image frame and the second image frame to be displayed through the display panel (422) under the control of the DDI (421). By doing so, motion blur that may occur when displaying image frames can be reduced. Since the method of providing images through the wearable electronic device (401) transmits data of image frames (e.g., a first image frame and a second image frame) capable of reducing motion blur to the DDI (421) of the display (420), unlike the method of reducing motion blur using AID dimming technology according to the comparative example, the processor does not need to provide a signal for on / off control of the display panel (422) to the DDI (421), and the DDI (421) may also not include a register and control structure for processing said signal. Furthermore, the power module may also need to be turned on / off. Additionally, the method of providing images through the wearable electronic device (401) can be applied to various displays (displays that do not support AID dimming technology).

[0105] FIG. 6 is a flowchart (600) for explaining a method of providing an image according to one embodiment.

[0106] Referring to FIG. 6, in operation 601, in one embodiment, the processor (440) can obtain (e.g., generate) a feature map that distinguishes a first region containing an edge within an image frame and a second region excluding the first region within an image frame by detecting an edge within an image frame.

[0107] In one embodiment, the image frame may be virtual content (e.g., virtual image) or augmented reality content. For example, if the wearable electronic device (401) is VR glasses, the image frame may refer to each of a plurality of image frames included in the virtual image. For example, if the wearable electronic device (401) is AR glasses, the image frame may be an augmented reality object displayed through a display member (e.g., display member (201)). For example, if the wearable electronic device (401) is a VST device, it may be an image of the surroundings of the wearable electronic device (401) acquired through a camera by executing a see-through function.

[0108] Referring to Fig. 7 below, the operation of acquiring the feature map of operation 601 will be described.

[0109] FIG. 7 is a diagram illustrating a method for obtaining a feature map according to one embodiment.

[0110] Referring to FIG. 7, in one embodiment, reference numeral 701 of FIG. 7 may represent an image frame (710) (e.g., original image).

[0111] In one embodiment, the image frame (710) may include an area (711) containing an object (hereinafter also referred to as the "object area") and an area (712) outside the object area (711) (hereinafter also referred to as the "background area").

[0112] In one embodiment, reference numeral 702 of FIG. 7 may represent a feature map (720) generated from an image frame (710).

[0113] In one embodiment, the processor (440) can generate a feature map (720) that distinguishes an area containing an edge (e.g., a boundary) within an image frame (710) (hereinafter referred to as the "first area") and an area excluding the first area within the image frame (hereinafter referred to as the "second area") by detecting an edge (e.g., a boundary) within the image frame (710). For example, the processor (440) can detect an edge (e.g., a boundary) within the image frame (710) by calculating a color difference (difference in color) between adjacent pixels for pixels included in the image frame (710). The processor (440) can identify a first area including the detected edge (e.g., pixels representing the edge) and pixels located around the edge (e.g., pixels surrounding the pixels representing the edge and located within a specified pixel distance from the pixels representing the edge), and a second area excluding the first area within the image frame. The processor (440) can generate a feature map (720) by assigning a binary value of "1" to the pixels of the region (721) corresponding to the first region in the feature map (720) and assigning a binary value of "0" to the region (722) corresponding to the second region in the feature map (720).

[0114] However, the method of generating a feature map is not limited to the examples described above. In one embodiment, the processor (440) can detect edges within an image frame (710). Based on the detected edges, the processor (440) can set an object region (711) of the image frame (710) as a first region and a background region (712) as a second region. The processor (440) can generate a feature map by assigning a binary value of "1" to pixels in the region corresponding to the object region (711) as the first region in the feature map, and assigning a binary value of "0" to pixels in the region corresponding to the background region (712) as the second region in the feature map.

[0115] In one embodiment, the processor (440) may set a first region and a second region based on the number of objects included in an image frame. For example, the processor (440) may set an area including pixels of an edge and pixels located around an edge as the first region based on the number of objects included in the image frame being less than or equal to a threshold value, and set an area excluding the set first region as the second region. The processor (440) may set an object region (e.g., object region (711)) as the first region and a background region (e.g., background region (712)) as the second region based on the number of objects included in the image frame being greater than a threshold value.

[0116] In one embodiment, the size of the image frame (710) (e.g., the resolution of the image frame (710), or the number of pixels of the image frame (710)) and the size of the feature map (720) (e.g., the size of the feature map (720), or the number of pixels of the feature map (720)) may be the same.

[0117] In operation 603 of FIG. 6, in one embodiment, the processor (440) may acquire (e.g., generate) a gain map including a first gain map and a second gain map based on a feature map (e.g., feature map (720)). Hereinafter, a method for acquiring a gain map will be described with reference to FIG. 8.

[0118] In one embodiment, the first gain map may include gains for obtaining a first image frame based on a feature map (e.g., feature map (720)), a third area corresponding to a first area (e.g., a first area of ​​an image frame) and displayed at a minimum brightness (e.g., 0 nit), and a fourth area corresponding to a second area and displayed at the same brightness as the second area when the image frame is displayed. For example, the first image frame (hereinafter referred to as the "first image frame") may include a third area (hereinafter referred to as the "third area") having the same size as the first area of ​​the image frame and displayed at a minimum brightness (e.g., minimum luminance) when displayed through the display (420), and a fourth area (hereinafter referred to as the "fourth area") having the same size as the second area of ​​the image frame and displayed at the same brightness as the second area (e.g., luminance) when displayed through the display (420). The first gain map may include gains for generating the first image frame when applied to an image frame.

[0119] In one embodiment, the second gain map may include gains for obtaining a second image frame, which includes a fifth area corresponding to a first area (a first area of ​​the image frame) and a brightness (hereinafter referred to as "first brightness") to compensate for the brightness reduced by a third area (a third area of ​​the first image frame), and a sixth area identical to the fourth area. For example, the second image frame (hereinafter referred to as the "second image frame") may include a fifth area (hereinafter referred to as the "fifth area") that has the same size as the first area of ​​the image frame and is displayed at a first brightness to compensate for (e.g., average brightness) reduced by the third area displayed at minimum brightness when displayed through the display (420) (e.g., to maintain average brightness), and a sixth area (hereinafter referred to as the "sixth area") that is the same as the fourth area (e.g., the fourth area of ​​the first image frame). The second gain map may include gains for generating the second image frame when applied to the image frame.

[0120] In one embodiment, a first gain map for acquiring a first image frame may include gains (hereinafter referred to as "first gains") located at positions (e.g., pixel positions) corresponding to each of the positions of pixels in a third region (a third region of the first image frame) and for displaying the pixels of the third region at a minimum brightness (e.g., 0 nit), and gains (hereinafter referred to as "second gains") generated such that the brightness of a second region (a second region of the image frame) and the brightness of a fourth region (e.g., a fourth region of the first image frame) are the same.

[0121] In one embodiment, reference numeral 801 of FIG. 8 may represent a first gain map (810).

[0122] In one embodiment, the first gain map (810) may include an area (811) representing first gains corresponding to a first area of ​​an image frame and for displaying pixels of a third area of ​​the first image frame at minimum brightness (e.g., 0 nit), and an area (812) representing second gains such that the brightness of a second area of ​​the image frame and the brightness of a fourth area of ​​the first image frame are the same.

[0123] In one embodiment, the first gain (e.g., each of the first gains) may have "0" as a value to be calculated (e.g., multiplied) with the pixel values ​​of the first region of the image frame in the light domain described below in order to display the pixels of the third region of the first image frame at minimum brightness (e.g., 0 nit).

[0124] In one embodiment, the second gain (e.g., each of the second gains) may have "1" as a value to be calculated with the pixel values ​​of the second region of the image frame in the light domain so that the fourth region of the first image frame is displayed with the same brightness as the brightness of the second region of the image frame.

[0125] In one embodiment, the second gain map may include gains (hereinafter referred to as "third gains") generated such that the average brightness (e.g., average luminance) of the minimum brightness of the third region of the first image frame and the first brightness of the fifth region of the second image frame is the same as the brightness (e.g., luminance) of the first region of the image frame, and gains (hereinafter referred to as "fourth gains") generated such that the brightness of the second region of the image frame and the brightness of the sixth region of the second image frame are the same.

[0126] In one embodiment, reference numeral 802 of FIG. 8 may represent a second gain map (820).

[0127] In one embodiment, the second gain map (820) may include an area (821) representing third gains and an area (822) representing fourth gains.

[0128] In one embodiment, to compensate for the brightness reduced by the minimum brightness (e.g., 0 nit) of the third region of the first image frame, the first brightness of the fifth region of the second image frame may be about twice the brightness of the first region of the image frame. However, it is not limited thereto. For example, when the motion speed of the wearable electronic device (401) is greater than or equal to a threshold speed and when the motion speed of the wearable electronic device (401) is less than a threshold speed, if the duty cycle of the display (420) (e.g., the rate at which the display (420) is turned on in one frame cycle of the display (420), the first image frame or the time at which the first image frame is displayed in one frame cycle) is maintained at the same value, the first brightness of the fifth region of the second image frame may be about twice the brightness of the first region of the image frame. When the motion speed of the wearable electronic device (401) is greater than or equal to a threshold speed and when the motion speed of the wearable electronic device (401) is less than a threshold speed, and when the duty cycle of the display (420) is set to different values, the first brightness of the fifth region of the second image frame can be determined based on the ratio between the duty cycles set to different values ​​and the brightness of the first region.

[0129] In one embodiment, the third gain (e.g., each of the third gains) may have "2" as a value to be calculated (e.g., multiplied) with the pixels of the first region of the image frame in the light domain, such that the average brightness (e.g., average luminance) of the minimum brightness (e.g., 0 nit) of the third region of the first image frame and the first brightness (e.g., brightness about twice the brightness of the first region of the image frame) of the fifth region of the second image frame is the same as the brightness (e.g., luminance) of the first region of the image frame.

[0130] In one embodiment, the fourth gain (e.g., each of the fourth gains) may have "1" as a value to be calculated with the pixel values ​​of the second region of the image frame in the light domain so that the sixth region of the second image frame is displayed with the same brightness as the brightness of the second region of the image frame (and the brightness of the fourth region of the first image frame).

[0131] In operation 605, in one embodiment, the processor (440) may acquire (e.g., generate) a first image frame and a second image frame based on an image frame, a first gain map, and a second gain map. For example, the processor (440) may generate a first image frame by applying a first gain map to an image frame and generate a second image frame by applying a second gain map to an image frame. Hereinafter, a method for acquiring a first image frame and a second image frame will be described with reference to FIGS. 9 to 11.

[0132] FIG. 9 is a drawing for explaining a method for obtaining a first image frame and a second image frame according to one embodiment.

[0133] Referring to FIG. 9, in one embodiment, the processor (440) can convert pixel values ​​of an image frame in the digital domain into brightness values ​​(also referred to as “luminance values”) in the light domain.

[0134] In one embodiment, the processor (440) can convert the YCbCr data into RGB data if the data of the image frame (901) is YCbCr data.

[0135] In one embodiment, the image frame (901) may be generated such that the values ​​of the pixels of the image frame (901) have values ​​within a range of pixel values ​​(e.g., a gray scale range) (e.g., 0 to 255) corresponding to a first luminance range (e.g., 0 (nit) to 250 (nit)). For example, if each color value of the pixels of the image frame (901) is represented by 8 bits, the values ​​of the pixels of the image frame (901) may be values ​​within a range of pixel values ​​from 0 to 255. The image frame (901) may be an image frame generated such that the range of pixel values ​​of the image frame (901) corresponds to a first luminance range (e.g., 0 (nit) to 250 (nit)).

[0136] In one embodiment, the processor (440) can convert pixel values ​​of an image frame (901) in the digital domain into brightness values ​​in the light domain for each color channel using a DeGamma function (or Electro to Optical Transfer Function (EOTF)). For example, the processor (440) can convert R (red) values ​​of pixels of the image frame (901) (e.g., R in FIG. 9) into luminance values ​​in the light domain (e.g., R light in FIG. 9) using a DeGamma function (910-1) (also referred to as the "decoding gamma function"). The processor (440) can convert G (green) values ​​of pixels of the image frame (901) (e.g., G in FIG. 9) into luminance values ​​in the light domain (e.g., G light in FIG. 9) using a DeGamma function (910-2). The processor (440) can convert the B (blue) values ​​of the pixels of the image frame (901) (e.g., B in FIG. 9) into luminance values ​​in the light domain (e.g., B light in FIG. 9) using the DeGamma function (910-3).

[0137] In one embodiment, each of the DeGamma functions (910-1, 910-2, 910-3) may be a function for converting a range of pixel values ​​from 0 to 255 into a first luminance range (e.g., 0 (nit) to 250 (nit)) set to correspond to a range of pixel values ​​from 0 to 255 when generating an image frame (901). For example, in FIG. 9, the DeGamma functions (910-1, 910-2, 910-3) may correspond to graphs (911-1, 911-2, 911-3). For example, in graph (911-1), the X-axis may represent a range of pixel values ​​from 0 to 255, and the Y-axis may represent a first luminance range (e.g., 0 (nit) to 250 (nit)).

[0138] In one embodiment, the processor (440) can obtain the luminance values ​​of the first image frame and the luminance values ​​of the second image frame by applying a gain map (902) (e.g., a first gain map and a second gain map) to the converted luminance values.

[0139] In one embodiment, the processor (440) can obtain luminance values ​​of a first image frame (e.g., a first image frame in an optical domain) by applying a first gain map to luminance values ​​converted based on pixel values ​​of the image frame. For example, the processor (440) can convert pixel values ​​of a first region of the image frame (901) into luminance values ​​of the first region by using DeGamma functions (910-1, 910-2, 910-3). The processor (440) can obtain a third region (e.g., a third region in an optical domain) having a minimum luminance value of 0 nit by performing operations (920-1, 920-2, 920-3) (e.g., multiplication operation) (referred to as "muxing") on the luminance values ​​of the first region and the first gain (e.g., "0") for each corresponding pixel. The processor (440) can convert pixel values ​​of a second region of an image frame (901) into luminance values ​​of a second region using DeGamma functions (910-1, 910-2, 910-3). The processor (440) can obtain a fourth region (e.g., a fourth region of the light domain) having luminance values ​​identical to the luminance values ​​of the second region by performing operations (920-1, 920-2, 920-3) on the luminance values ​​of the second region and the second gain (e.g., "1") for each corresponding pixel.

[0140] In one embodiment, the processor (440) can obtain luminance values ​​of a second image frame by applying a second gain map to luminance values ​​converted based on pixel values ​​of the image frame. For example, the processor (440) can convert pixel values ​​of a first region of the image frame (901) into luminance values ​​of the first region by using DeGamma functions (910-1, 910-2, 910-3). The processor (440) can obtain a fifth region (e.g., a fifth region of the light domain) having a luminance value greater than the luminance value of the first region (e.g., a luminance value twice the luminance value of the first region) by performing operations (920-1, 920-2, 920-3) on the luminance values ​​of the first region and a third gain (e.g., "2") for each corresponding pixel. The processor (440) can convert pixel values ​​of a second region of an image frame (901) into luminance values ​​of a second region using DeGamma functions (910-1, 910-2, 910-3). The processor (440) can obtain a sixth region (e.g., a sixth region of the light domain) having luminance values ​​identical to the luminance values ​​of the second region by performing operations (920-1, 920-2, 920-3) on the luminance values ​​of the second region and a fourth gain (e.g., "1") for each corresponding pixel.

[0141] In one embodiment, in FIG. 9, R' light, G' light, and B' light may represent the result after the operation (920-1, 920-2, 920-3).

[0142] In one embodiment, the processor (440) can convert the luminance values ​​of the first image frame and the luminance values ​​of the second image frame into pixel values ​​of the first image frame and the second image frame in the digital domain within a range of pixel values ​​(e.g., 0 to 255) corresponding to a luminance range of the display (420) (hereinafter referred to as the "second luminance range") (e.g., a luminance range set on or supported by the display (420)) (e.g., 0 nit to 500 nit). For example, the processor (440) can convert the luminance values ​​of the first image frame into pixel values ​​of the first image frame in the digital domain using Gamma functions (930-1, 930-2, 930-3). The processor (440) can convert the luminance values ​​of the second image frame into pixel values ​​of the second image frame in the digital domain using Gamma functions (930-1, 930-2, 930-3).

[0143] In one embodiment, each of the Gamma functions (930-1, 930-2, 930-3) may be a function for converting luminance values ​​in the optical domain into pixel values ​​in the digital domain so that the luminance range (second luminance range) of the display (420) from 0 nit to 500 nit corresponds to a range of pixel values ​​from 0 to 255 in the digital domain. For example, in FIG. 9, the Gamma functions (930-1, 930-2, 930-3) may correspond to graphs (931-1, 931-2, 931-3), respectively. For example, in graph (931-1), the X' axis may represent the second luminance range (e.g., 0 nit to 500 nit), and the Y' axis may represent a range of pixel values ​​(e.g., 0 to 255).

[0144] In one embodiment, in FIG. 9, R', G', and B' represent pixel values ​​of each color channel in the digital domain (also referred to as "display (420) reference code values"), and the frame (903) may represent an image frame composed of R', G', and B'.

[0145] In one embodiment, the processor (440) can obtain luminance values ​​of the entire area of ​​the image frame (901) by converting the pixel values ​​of the entire area of ​​the image frame (901) into the light domain using DeGamma functions (910-1, 910-2, 910-3). The processor (440) can obtain pixel values ​​of the entire area of ​​the image frame to be provided to a display (420) (e.g., DDI (421)) by converting the obtained luminance values ​​into the digital domain using Gamma functions (930-1, 930-2, 930-3).

[0146] In one embodiment, the operations described through FIG. 9 may be performed according to the Gamma-2.2 standard, but are not limited thereto.

[0147] In one embodiment, although not illustrated in FIG. 9, the processor (440) may transmit pixel values ​​of a frame in the digital domain (e.g., frame (903)) obtained through FIG. 9 to the DDI (421). The DDI (421) may convert the pixel values ​​of the frame (e.g., frame (903)) obtained through FIG. 9 into luminance values ​​using a DeGamma function (e.g., an inverse function of a Gamma function (930-1, 930-2, 930-3) which outputs luminance values ​​within a second luminance range of 0 nit to 500 nit as inputs) and control the display panel (422) so that the converted luminance values ​​are output through the display (420) panel (422).

[0148] FIG. 10 is a drawing for explaining a method for obtaining a first image frame and a second image frame according to one embodiment.

[0149] Referring to FIG. 10, in one embodiment, the processor (440) can obtain a first image frame and a second image frame by applying a gain map to an image frame (e.g., original image) for each corresponding pixel.

[0150] In one embodiment, in FIG. 10, the processor (440) can obtain a second image frame (1030) by applying a second gain map (1010) to the image frame (1020) for each corresponding pixel. For example, the processor (440) can obtain the value of a pixel (1031) located at a position corresponding to the position of the pixel (1021) (and the position of the pixel (1011)) within the second image frame (1030) by applying the value (gain) of a pixel (1011) located at a position corresponding to the position of the pixel (1021) within the second gain map (1010) to the value of a pixel (1021) in the first region of the image frame (1020). The processor (440) can obtain the value of a pixel (1032) located at a position corresponding to the position of the pixel (1022) (and the position of the pixel (1012)) within the second image frame (1030) by applying the value (gain) of a pixel (1012) located at a position corresponding to the position of the pixel (1022) within the second gain map (1010) to the value of a pixel (1022) in the second region of the image frame (1020). Although not illustrated in FIG. 10, the processor (440) can obtain the first image frame (1030) by applying the first gain map to the image frame (1020) for each corresponding pixel.

[0151] FIG. 11 is a drawing for explaining a method for obtaining a first image frame and a second image frame according to one embodiment.

[0152] Referring to FIG. 11, in one embodiment, reference numeral 1101 of FIG. 11 represents a first image frame (1110), reference numeral 1102 of FIG. 11 represents a second image frame (1120), and reference numeral 1103 of FIG. 11 represents an image frame (1130). The image frame (1130) may represent the same image frame as the image frame (710) of FIG. 7.

[0153] In one embodiment, the average brightness (average luminance) of the brightness of the third region (1111) of the first image frame (1110) (e.g., 0 nit as minimum brightness) and the brightness of the fifth region (1121) of the second image frame (1120) (first brightness) may be the same as the brightness of the first region of the image frame (1130). The brightness of the fourth region (1112) of the first image frame (1110), the brightness of the sixth region (1122) of the second image frame (1120), and the brightness of the second region of the image frame (1130) may be the same. Through this, when the first image frame (1110) and the second image frame (1120) are displayed through the display (420) and when the image frame (1130) is displayed through the display (420) for the same period of time, the average brightness (e.g., average luminance) output through the display (420) may be the same.

[0154] In operation 607, in one embodiment, the processor (440) can display a first image frame and a second image frame through the display (420) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being greater than or equal to a threshold speed.

[0155] In operation 609, in one embodiment, the processor (440) may display an image frame (e.g., original image) through the display (420) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being less than a threshold speed.

[0156] In one embodiment, the processor (440) may increase the refresh rate of the display (420) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being greater than or equal to a threshold speed. For example, the processor (440) may set the refresh rate of the display (420) to a default refresh rate (e.g., 60Hz) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being less than a threshold speed. The processor (440) may set the refresh rate of the display (420) to a refresh rate obtained by multiplying the default refresh rate (e.g., 60Hz) by an integer (e.g., 120Hz or 240Hz) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being greater than or equal to a threshold speed.

[0157] In one embodiment, the processor (440) can increase the refresh rate of the display (420) as the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) increases. For example, the processor (440) can set the refresh rate of the display (420) to 60Hz based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being less than a first threshold speed. The processor (440) can set the refresh rate of the display (420) to 120Hz based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being greater than or equal to a first threshold speed and less than a second threshold speed (a second threshold speed greater than the first threshold speed). The processor (440) can set the refresh rate of the display (420) to 240Hz based on the fact that the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) is greater than or equal to the second threshold speed.

[0158] In one embodiment, the processor (440) may alternately display a first image frame and a second image frame through the display (420) at an increased refresh rate of the display (420) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being greater than or equal to a threshold speed. For example, the processor (440) may display an image frame (e.g., original image) through the display (420) at a refresh rate of 60 Hz of the display (420) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being less than a threshold speed. The processor (440) can display a first image frame (or a second image frame) through the display (420) for one frame period at a refresh rate of 120Hz of the display (420), based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being greater than or equal to a threshold speed, and then display a second image frame (or a first image frame) through the display (420) for the next frame period.

[0159] In one embodiment, the above examples describe displaying the first image frame and the second image frame through the display (420) at the same ratio (e.g., 1:1) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being greater than or equal to a threshold speed, but are not limited thereto. For example, the processor (440) may display the first image frame and the second image frame through the display (420) at different ratios (e.g., 2:1), such as sequentially displaying the second image frame, the first image frame, and the first image frame through the display (420) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being greater than or equal to a threshold speed. For example, the processor (440) can control the display (420) such that as the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) increases, the rate at which the first image frame is displayed (e.g., number of displays or display time) increases and the rate at which the second image frame is displayed (e.g., number of displays or display time) decreases.

[0160] In one embodiment, the processor (440) may increase the refresh rate of the display (420) and decrease the duty cycle of the display (420) (e.g., the rate at which the display (420) is turned on in one frame cycle of the display (420)) based on the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) being greater than or equal to a threshold speed when displaying the first image frame and the second image frame. In this case, the processor (440) may determine the brightness of the fifth area of ​​the second image frame (first brightness) (and the third gain of the second gain map) such that the average brightness between the third area of ​​the first image frame and the fifth area of ​​the second image frame is equal to the brightness of the first area of ​​the image frame.

[0161] FIG. 12 is a drawing for explaining a method of providing an image according to one embodiment.

[0162] Referring to FIG. 12, in one embodiment, the operations of FIG. 6 are described as being performed on one image frame (e.g., one original image) in the examples described above, but are not limited thereto. For example, the processor (440) may perform the operations of FIG. 6 on each of the multiple image frames when displaying an image including multiple image frames.

[0163] In one embodiment, FIG. 12 may illustrate an action of providing an image, which is performed when the wearable electronic device (401) rotates as a user (1311) wearing the wearable electronic device (401) rotates their head.

[0164] In one embodiment, in FIG. 12, the stopping intervals (1221, 1223, 1225) may represent time intervals in which the speed at which a user (1211) wearing the wearable electronic device (401) rotates their head (e.g., the motion speed of the wearable electronic device (401)) is less than a threshold speed. In FIG. 12, the motion detection intervals (1222, 1224) may represent time intervals in which the speed at which a user (1211) wearing the wearable electronic device (401) rotates their head is greater than or equal to a threshold speed.

[0165] In one embodiment, the processor (440) can sequentially display image frames (1223-1, 1223-2, 1223-3) through the display (420) at a refresh rate of 60Hz of the display (420) in each of the stop intervals (1221, 1223, 1225).

[0166] In one embodiment, the processor (440) can alternately display the second image frames (1222-1, 1222-3, 1222-5) and the first image frames (1222-2, 1222-4) through the display (420) at a refresh rate of 120 Hz in the motion detection interval (1222). The processor (440) can alternately display the second image frames (1224-1, 1224-3, 1224-5) and the first image frames (1224-2, 1224-4) through the display (420) at a refresh rate of 120 Hz in the motion detection interval (1224).

[0167] FIG. 13 is a drawing for explaining a method of providing an image according to one embodiment.

[0168] Referring to FIG. 13, in one embodiment, the processor (440) can increase the refresh rate of the display (420) based on the motion speed of the wearable electronic device (401) being greater than or equal to a threshold speed. The processor (440) can display a first image frame and a second image frame through the display (420) at the increased refresh rate of the display (420).

[0169] In one embodiment, the processor (440) can change the refresh rate of the display (420) by sequentially (or gradually) increasing the refresh rate of the display (420) and then sequentially decreasing it, based on the motion speed of the wearable electronic device (401) being greater than or equal to a threshold speed. For example, in reference numeral 1301 of FIG. 13, the processor (440) can display an image frame (1311) through the display (420) at a refresh rate of 60 Hz during a stop interval (t1) (e.g., a time interval during which the motion speed of the wearable electronic device (401) is less than a threshold speed). The processor (440) can display the first image frame (1313) and the second image frame (1314) at a refresh rate of 120Hz through the display (420) during the motion detection interval (t2) (e.g., a time interval during which the motion speed of the wearable electronic device (401) is greater than or equal to a threshold speed), display the first image frame (1315) and the second image frame (1316) at a refresh rate of 240Hz, and display the first image frame and the second image frame at a refresh rate of 120Hz. The processor (440) can display the image frame (1318) through the display (420) at a refresh rate of 60Hz during the stop interval (t3).

[0170] In one embodiment, the processor (440) can change the refresh rate of the display (420) by sequentially (or gradually) decreasing the refresh rate of the display (420) and then sequentially increasing it, based on the motion speed of the wearable electronic device (401) being greater than or equal to a threshold speed. For example, in reference numeral 1302 of FIG. 13, the processor (440) can display an image frame (1321) through the display (420) at a refresh rate of 60Hz during a stop interval (t1). The processor (440) can display the first image frame (1323) and the second image frame (1324) at a refresh rate of 240Hz through the display (420) during the motion detection interval (t2), display the first image frame (1325) and the second image frame (1326) at a refresh rate of 120Hz, and display the first image frame and the second image frame at a refresh rate of 240Hz. The processor (440) can display the image frame (1328) through the display (420) at a refresh rate of 60Hz during the stop interval (t3).

[0171] FIG. 14 is a flowchart (1400) for explaining a method of providing an image according to one embodiment.

[0172] Referring to FIG. 14, in one embodiment, it was described that after generating a first image frame and a second image frame from an image frame in FIG. 6, the first image frame and the second image frame are displayed through a display (420) based on whether the motion speed of the wearable electronic device (401) is greater than or equal to a threshold speed, and the image frame is displayed through a display (420) based on whether the motion speed of the wearable electronic device (401) is less than or equal to a threshold speed, but this is not limited thereto. For example, the processor (440) may generate a first image frame and a second image frame from an image frame only when the motion speed of the wearable electronic device (401) is greater than or equal to a threshold speed. This will be explained with reference to FIG. 14.

[0173] In operation 1401, in one embodiment, the processor (440) can determine whether the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) is greater than or equal to a threshold speed.

[0174] Based on the fact that the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) in operation 1401 is greater than or equal to a threshold speed, in operation 1403, in one embodiment, the processor (440) can obtain (e.g., generate) a feature map that distinguishes a first region containing an edge within an image frame and a second region excluding the first region within an image frame by detecting an edge within an image frame.

[0175] Since operation 1403 is at least partially identical or similar to operation 601 of FIG. 6, a redundant description will be omitted.

[0176] In operation 1405, in one embodiment, the processor (440) may obtain (e.g. generate) a gain map including a first gain map and a second gain map based on a feature map.

[0177] Since operation 1405 is at least partially identical or similar to operation 603 of FIG. 6, a redundant description will be omitted.

[0178] In operation 1407, in one embodiment, the processor (440) may acquire (e.g., generate) a first image frame and a second image frame based on an image frame, a first gain map, and a second gain map.

[0179] Since operation 1407 is at least partially identical or similar to operation 605 of FIG. 6, a redundant description will be omitted.

[0180] In operation 1409, in one embodiment, the processor (440) can display a first image frame and a second image frame through a display (420).

[0181] Since operation 1409 is at least partially identical or similar to operation 607 of FIG. 6, a redundant description will be omitted.

[0182] Based on the fact that the speed of motion of the wearable electronic device (401) obtained through the inertial sensor (410) in operation 1401 is less than a threshold speed, in operation 1411, in one embodiment, the processor (440) can display an image frame through the display (420).

[0183] Since operation 1409 is at least partially identical or similar to operation 609 of FIG. 6, a redundant description will be omitted.

[0184] A wearable electronic device according to one embodiment may include at least one processor comprising an inertial sensor, a display, and a processing circuit; and a memory for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause to acquire a feature map that distinguishes a first region containing an edge within an image frame and a second region excluding the first region within the image frame by detecting an edge within the image frame. When the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause to acquire a first gain map based on the feature map for acquiring a first image frame that includes a third region corresponding to the first region and displayed at a minimum brightness, and a fourth region corresponding to the second region and displayed at the same brightness as the second region. When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may be caused to acquire a second gain map for acquiring a second image frame, which includes a fifth region corresponding to the first region and indicated by a brightness to compensate for the brightness reduced by the third region, and a sixth region identical to the fourth region, based on the feature map. When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may be caused to acquire the first image frame by applying the first gain map to the image frame and to acquire the second image frame by applying the second gain map to the image frame.When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause the first image frame and the second image frame to be displayed through the display based on the speed of the motion of the wearable electronic device obtained through the inertial sensor being greater than or equal to the threshold speed. When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause the image frame to be displayed through the display based on the speed of the motion of the wearable electronic device being less than the threshold speed.

[0185] In one embodiment, when the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause the refresh rate of the display to increase based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed. When the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause the first image frame and the second image frame to be displayed alternately through the display at the increased refresh rate.

[0186] In one embodiment, the second gain map may include first gains such that the average brightness of the minimum brightness of the third region and the first brightness of the fifth region is equal to the brightness of the first region, and second gains such that the brightness of the sixth region is equal to the brightness of the second region.

[0187] In one embodiment, the first gains may include a third gain and a fourth gain. The third gain may be such that the average brightness between the minimum brightness of a pixel located at a first position among the pixels of the third region and the brightness of a pixel located at a second position corresponding to the first position among the pixels of the fifth region is equal to the brightness of a pixel located at a third position corresponding to the first position among the pixels of the first region. The fourth gain may be such that the average brightness between the minimum brightness of a pixel located at a fourth position among the pixels of the third region and the brightness of a pixel located at a fifth position corresponding to the fourth position among the pixels of the fifth region is equal to the brightness of a pixel located at a sixth position corresponding to the fourth position among the pixels of the first region.

[0188] In one embodiment, the first gains may be changed by changing the duty cycle of the display.

[0189] In one embodiment, the first gain map may include fifth gains located at positions corresponding to each of the positions of the pixels of the third region and for displaying the pixels of the third region at minimum brightness, and sixth gains for making the brightness of the fourth region equal to the brightness of the second region.

[0190] In one embodiment, the instructions may cause the wearable electronic device to convert pixel values ​​of the image frame in the digital domain into brightness values ​​in the light domain when executed individually or collectively by the at least one processor. The instructions may cause the wearable electronic device to obtain brightness values ​​of the first image frame and brightness values ​​of the second image frame by applying the first gain map and the second gain map to the converted brightness values ​​when executed individually or collectively by the at least one processor. The instructions may cause the wearable electronic device to convert the brightness values ​​of the first image frame and the brightness values ​​of the second image frame into pixel values ​​of the first image frame and pixel values ​​of the second image frame in the digital domain when executed individually or collectively by the at least one processor.

[0191] In one embodiment, the first region may include a surrounding region of the edge or an object region determined by the edge within the image frame.

[0192] In one embodiment, when the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may increase the refresh rate of the display as the speed of motion of the wearable electronic device increases. When the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause the refresh rate of the display to decrease as the speed of motion of the wearable electronic device decreases.

[0193] A method for providing an image in a wearable electronic device according to one embodiment may include the operation of obtaining a feature map that distinguishes a first region containing an edge within an image frame and a second region excluding the first region within the image frame by detecting an edge within the image frame. The method may include the operation of obtaining a first gain map for obtaining a first image frame that includes a third region corresponding to the first region and to be displayed at a minimum brightness, and a fourth region corresponding to the second region and to be displayed at a brightness equal to the brightness of the second region, based on the feature map. The method may include the operation of obtaining a second gain map for obtaining a second image frame that includes a fifth region corresponding to the first region and to be displayed at a brightness to compensate for the brightness reduced by the third region, and a sixth region equal to the fourth region, based on the feature map. The above method may include the operation of acquiring the first image frame by applying the first gain map to the image frame, and acquiring the second image frame by applying the second gain map to the image frame. The above method may include the operation of displaying the first image frame and the second image frame through the display of the wearable electronic device based on the speed of the motion of the wearable electronic device acquired through the inertial sensor of the wearable electronic device being greater than or equal to a threshold speed. The above method may include the operation of displaying the image frame through the display based on the speed of the motion of the wearable electronic device being less than the threshold speed.

[0194] In one embodiment, the operation of displaying the first image frame and the second image frame may include an operation of increasing the refresh rate of the display based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed. The operation of displaying the first image frame and the second image frame may include an operation of alternately displaying the first image frame and the second image frame through the display at the increased refresh rate.

[0195] In one embodiment, the second gain map may include first gains that make the minimum brightness of the third region and the average brightness of the brightness of the fifth region equal to the brightness of the first region, and second gains that make the brightness of the sixth region equal to the brightness of the second region.

[0196] In one embodiment, the first gains may include a third gain and a fourth gain. The third gain may be such that the average brightness between the minimum brightness of a pixel located at a first position among the pixels of the third region and the brightness of a pixel located at a second position corresponding to the first position among the pixels of the fifth region is equal to the brightness of a pixel located at a third position corresponding to the first position among the pixels of the first region. The fourth gain may be such that the average brightness between the minimum brightness of a pixel located at a fourth position among the pixels of the third region and the brightness of a pixel located at a fifth position corresponding to the fourth position among the pixels of the fifth region is equal to the brightness of a pixel located at a sixth position corresponding to the fourth position among the pixels of the first region.

[0197] In one embodiment, the first gains may be changed by changing the duty cycle of the display.

[0198] In one embodiment, the first gain map may include fifth gains located at positions corresponding to each of the positions of the pixels of the third region and for displaying the pixels of the third region at minimum brightness, and sixth gains for making the brightness of the fourth region equal to the brightness of the second region.

[0199] In one embodiment, the operation of acquiring the first image frame and the second image frame may include the operation of converting pixel values ​​of the image frame in the digital domain into brightness values ​​in the optical domain. The operation of acquiring the first image frame and the second image frame may include the operation of acquiring brightness values ​​of the first image frame and brightness values ​​of the second image frame by applying the first gain map and the second gain map to the converted brightness values. The operation of acquiring the first image frame and the second image frame may include the operation of converting the brightness values ​​of the first image frame and the brightness values ​​of the second image frame into pixel values ​​of the first image frame and pixel values ​​of the second image frame in the digital domain.

[0200] In one embodiment, the first region may include a surrounding region of the edge or an object region determined by the edge within the image frame.

[0201] In one embodiment, the method may further include an operation of increasing the refresh rate of the display as the speed of motion of the wearable electronic device increases. The method may further include an operation of decreasing the refresh rate of the display as the speed of motion of the wearable electronic device decreases.

[0202] A wearable electronic device according to one embodiment may include at least one processor comprising an inertial sensor, a display, and a processing circuit; and a memory for storing instructions. When the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause to obtain a feature map that distinguishes a first region containing an edge within an image frame and a second region excluding the first region within the image frame by detecting an edge for an image frame based on the speed of motion of the wearable electronic device obtained through the inertial sensor being greater than or equal to a threshold speed. When executed individually or collectively by the at least one processor, the above instructions may cause the wearable electronic device to acquire a first gain map for acquiring a first image frame, comprising a third region corresponding to the first region and displayed at a minimum brightness, and a fourth region corresponding to the second region and displayed at the same brightness as the second region, based on the feature map and the image frame, based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed. When executed individually or collectively by the at least one processor, the above instructions may cause the wearable electronic device to acquire a second gain map for acquiring a second image frame, comprising a fifth region corresponding to the first region and displayed at a brightness to compensate for the brightness reduced by the third region, and a sixth region identical to the fourth region, based on the feature map and the image frame, based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed.When executed individually or collectively by the at least one processor, the above instructions may cause the wearable electronic device to acquire the first image frame by applying the first gain map to the image frame and to acquire the second image frame by applying the second gain map to the image frame, based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed. When executed individually or collectively by the at least one processor, the above instructions may cause the wearable electronic device to display the first image frame and the second image frame through the display, based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed. When executed individually or collectively by the at least one processor, the above instructions may cause the wearable electronic device to display the image frame through the display, based on the speed of the motion of the wearable electronic device being less than the threshold speed.

[0203] In one embodiment, when the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause the refresh rate of the display to increase based on the speed of the motion of the wearable electronic device being greater than or equal to the threshold speed. When the instructions are executed individually or collectively by the at least one processor, the wearable electronic device may cause the first image frame and the second image frame to be displayed alternately through the display at the increased refresh rate.

[0204] According to one embodiment, in a non-transient computer-readable storage medium storing computer-executable instructions, the computer-executable instructions may cause a wearable electronic device, when executed individually or collectively by at least one processor, to obtain a feature map that distinguishes a first region containing an edge within an image frame and a second region excluding the first region within the image frame by detecting an edge within the image frame. The computer-executable instructions may cause a wearable electronic device, when executed individually or collectively by at least one processor, to obtain a first gain map for obtaining a first image frame, based on the feature map, comprising a third region corresponding to the first region and to be displayed at a minimum brightness, and a fourth region corresponding to the second region and to be displayed at the same brightness as the second region. When the above computer-executable instructions are executed individually or collectively by at least one processor, the wearable electronic device may cause to acquire a second gain map for acquiring a second image frame, which includes a fifth region corresponding to the first region and indicated by a brightness to compensate for the brightness reduced by the third region, and a sixth region identical to the fourth region, based on the feature map. When the above computer-executable instructions are executed individually or collectively by at least one processor, the wearable electronic device may cause to acquire the first image frame by applying the first gain map to the image frame and to acquire the second image frame by applying the second gain map to the image frame.When the above computer-executable instructions are executed individually or collectively by at least one processor, the wearable electronic device may cause the first image frame and the second image frame to be displayed through the display of the wearable electronic device based on the speed of the motion of the wearable electronic device obtained through the inertial sensor of the wearable electronic device being greater than or equal to a threshold speed. When the above computer-executable instructions are executed individually or collectively by at least one processor, the wearable electronic device may cause the image frame to be displayed through the display based on the speed of the motion of the wearable electronic device being less than the threshold speed.

[0205] In addition, the structure of the data used in the embodiments of the present disclosure described above may be recorded on a computer-readable recording medium through various means. The computer-readable recording medium includes storage media such as magnetic storage media (e.g., ROM, floppy disk, hard disk, etc.) and optical reading media (e.g., CD-ROM, DVD, etc.).

Claims

1. In a wearable electronic device (401), Inertial sensor (410); Display (420): At least one processor (440) including processing circuitry; and It includes memory (430) for storing instructions, When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device: By detecting an edge within an image frame, a feature map is obtained that distinguishes a first region including the edge within the image frame and a second region excluding the first region within the image frame. Based on the above feature map, a first gain map is obtained for obtaining a first image frame comprising a third region corresponding to the first region and to be displayed at a minimum brightness, and a fourth region corresponding to the second region and to be displayed at the same brightness as the second region. Based on the above feature map, a second gain map is obtained for obtaining a second image frame comprising a fifth region corresponding to the first region and to be displayed with a brightness to compensate for the brightness reduced by the third region, and a sixth region to be displayed with the same brightness as the fourth region. The first image frame is obtained by applying the first gain map to the image frame, and the second image frame is obtained by applying the second gain map to the image frame. Based on the fact that the speed of the motion of the wearable electronic device obtained through the inertial sensor is greater than or equal to a threshold speed, the first image frame and the second image frame are displayed through the display, and A wearable electronic device that causes the image frame to be displayed through the display based on the speed of the motion of the wearable electronic device being less than the threshold speed.

2. In Paragraph 1, When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device: Based on the fact that the speed of the motion of the wearable electronic device is greater than or equal to the threshold speed, the refresh rate of the display is increased, and A wearable electronic device that causes the first image frame and the second image frame to be displayed alternately through the display at the above increased refresh rate.

3. In Paragraph 1 or 2, A wearable electronic device comprising: a second gain map, wherein the second gain map comprises first gains such that the minimum brightness of the third region and the average brightness of the brightness of the fifth region are equal to the brightness of the first region, and second gains such that the brightness of the sixth region is equal to the brightness of the second region.

4. In Paragraph 3, The above first gains include third gains and fourth gains, and The third gain is such that the average brightness between the minimum brightness of a pixel located at a first position among the pixels of the third region and the brightness of a pixel located at a second position corresponding to the first position among the pixels of the fifth region is equal to the brightness of a pixel located at a third position corresponding to the first position among the pixels of the first region, and A wearable electronic device wherein the above-mentioned fourth gain is such that the average brightness between the minimum brightness of a pixel located at a fourth position among the pixels of the third region and the brightness of a pixel located at a fifth position corresponding to the fourth position among the pixels of the fifth region is equal to the brightness of a pixel located at a sixth position corresponding to the fourth position among the pixels of the first region.

5. In Paragraph 3, The above first gains are wearable electronic devices that can be changed by changing the duty cycle of the display.

6. In Paragraph 3, A wearable electronic device comprising: a first gain map, positioned at locations corresponding to each of the positions of the pixels of the third region, fifth gains for displaying the pixels of the third region at minimum brightness, and sixth gains for making the brightness of the fourth region equal to the brightness of the second region.

7. In any one of paragraphs 1 through 6, When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device: Converts the pixel values ​​of the image frame in the digital domain into brightness values ​​in the light domain, and By applying the first gain map and the second gain map to the converted brightness values, the brightness values ​​of the first image frame and the brightness values ​​of the second image frame are obtained, and A wearable electronic device that causes the brightness values ​​of the first image frame and the brightness values ​​of the second image frame to be converted into pixel values ​​of the first image frame and pixel values ​​of the second image frame in the digital domain.

8. In any one of paragraphs 1 through 7, A wearable electronic device wherein the first region includes a peripheral region of the edge or an object region determined by the edge within the image frame.

9. In any one of paragraphs 1 through 8, When the above instructions are executed individually or collectively by the at least one processor, the wearable electronic device: As the speed of motion of the above-mentioned wearable electronic device increases, the refresh rate of the above-mentioned display is increased, and A wearable electronic device that causes the refresh rate of the display to decrease as the speed of motion of the wearable electronic device decreases.

10. A method for providing an image in a wearable electronic device, An operation of obtaining a feature map that distinguishes a first region including the edge within the image frame and a second region excluding the first region within the image frame by detecting an edge within the image frame; Based on the above feature map, the operation of acquiring a first gain map for acquiring a first image frame comprising a third region corresponding to the first region and to be displayed at a minimum brightness, and a fourth region corresponding to the second region and to be displayed at the same brightness as the second region; Based on the above feature map, the operation of acquiring a second gain map for acquiring a second image frame comprising a fifth region corresponding to the first region and to be displayed with a brightness to compensate for the brightness reduced by the third region, and a sixth region to be displayed with a brightness equal to the brightness of the fourth region; The operation of acquiring the first image frame by applying the first gain map to the image frame, and acquiring the second image frame by applying the second gain map to the image frame; An operation of displaying the first image frame and the second image frame through the display of the wearable electronic device based on the fact that the speed of the motion of the wearable electronic device obtained through the inertial sensor of the wearable electronic device is greater than or equal to a threshold speed; and A method including the operation of displaying the image frame through the display based on the speed of the motion of the wearable electronic device being less than the threshold speed.

11. In Paragraph 10, The operation of displaying the first image frame and the second image frame is, An operation to increase the refresh rate of the display based on the fact that the speed of the motion of the wearable electronic device is greater than or equal to the threshold speed; and A method comprising the operation of alternately displaying the first image frame and the second image frame through the display at the increased refresh rate.

12. In Article 10 or Article 11, A method comprising: the second gain map including first gains such that the minimum brightness of the third region and the average brightness of the brightness of the fifth region are equal to the brightness of the first region, and second gains such that the brightness of the sixth region is equal to the brightness of the second region.

13. In Paragraph 12, The above first gains include third gains and fourth gains, and The third gain is such that the average brightness between the minimum brightness of a pixel located at a first position among the pixels of the third region and the brightness of a pixel located at a second position corresponding to the first position among the pixels of the fifth region is equal to the brightness of a pixel located at a third position corresponding to the first position among the pixels of the first region, and The above-mentioned fourth gain is a method in which the average brightness between the minimum brightness of a pixel located at a fourth position among the pixels of the third region and the brightness of a pixel located at a fifth position corresponding to the fourth position among the pixels of the fifth region is equal to the brightness of a pixel located at a sixth position corresponding to the fourth position among the pixels of the first region.

14. In Paragraph 12, The above first gains are a method that can be changed by changing the duty cycle of the display.

15. In Paragraph 12, A method comprising the first gain map, which is located at positions corresponding to each of the positions of the pixels of the third region, fifth gains for displaying the pixels of the third region at minimum brightness, and sixth gains for making the brightness of the fourth region equal to the brightness of the second region.

Images