Electronic device comprising display, operation method thereof, and computer program
By identifying dynamic range changes and applying a dimming ratio, the electronic device stabilizes brightness transitions between SDR and HDR content, improving user experience.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-12-09
- Publication Date
- 2026-07-16
AI Technical Summary
Electronic devices experience sudden changes in brightness when switching between standard dynamic range (SDR) and high dynamic range (HDR) content, leading to user misperception of image darkness until vision adapts.
The electronic device identifies changes in dynamic range and adjusts brightness using a dimming ratio to maintain consistent content brightness, minimizing sudden changes and user discomfort.
This approach reduces sudden brightness changes and enhances user experience by maintaining consistent image brightness during transitions between SDR and HDR content.
Smart Images

Figure KR2025021117_16072026_PF_FP_ABST
Abstract
Description
Electronic device including a display, method of operation thereof, and computer program
[0001] The present disclosure relates to an electronic device including a display, a method of operating the same, and a computer program.
[0002] Dynamic range represents the ratio between the maximum and minimum values for which a quantity can be estimated. In image signal processing, dynamic range can represent the ratio between the brightest and darkest parts. In the field of image processing, dynamic range can affect the brightness and fine details of dark areas that can be displayed on the screen. Therefore, dynamic range can influence the quality and realism of the image displayed on the screen. In image processing and display technologies, dynamic range is related to contrast ratio. For example, a system with a wide dynamic range can distinguish and represent more brightness levels, allowing for more accurate reproduction of details in dark areas and highlights in bright areas.
[0003] Standard Dynamic Range (SDR) systems can provide a relatively limited dynamic range. In SDR systems, detail may be lost in bright or dark areas displayed on the screen. In contrast, High Dynamic Range (HDR) systems have an expanded dynamic range compared to SDR systems, allowing for the representation of more distinct brightness levels. For example, SDR systems use 8-bit color depth to distinguish the brightness of each color in 256 steps. In SDR systems, in scenes requiring high contrast, bright areas may appear excessively white, or dark areas may be displayed as indistinct black, resulting in a loss of detail. High Dynamic Range systems utilize color depth of 10 bits or more to represent more brightness levels and a wider color range. Combined with display technologies that support high brightness (e.g., 1000 nits or more), High Dynamic Range systems can reproduce a relatively wide range of brightness levels on the screen.
[0004] High dynamic range systems can be designed to express high brightness and a color depth of 10 bits or more to provide a wider brightness range and finer contrast distinction to expand the dynamic range. Among video content, high dynamic range content played on high dynamic range systems is created with high contrast and high brightness levels in mind from the time of content production; therefore, in order to reproduce high dynamic range content, a display device is required to implement a function to play such content.
[0005] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art in relation to the present disclosure.
[0006] In one embodiment, the electronic device may include a display module, memory, and at least one processor. The display module may include a display that displays visual information. The memory may store a computer program that includes computer-executable instructions. The instructions may be executed individually or collectively by the at least one processor to enable the electronic device to identify a change in the dynamic range of image content displayed through a first area of the display. The instructions may be executed individually or collectively by the at least one processor to enable the electronic device to control the brightness of the display based on the change in the dynamic range. The instructions may be executed individually or collectively by the at least one processor to enable the electronic device to display the image content through the first area based on the content brightness determined by applying a first dimming ratio to the brightness of the display while the brightness of the display is changing.
[0007] In one embodiment, a method of operating an electronic device may include an operation of identifying a change in the dynamic range of image content displayed through a first area of a display that displays visual information. The method may include an operation of controlling the brightness of the display based on the change in the dynamic range. The method may include an operation of displaying the image content through the first area based on the content brightness determined by applying a first dimming ratio to the brightness of the display while the brightness of the display is changing.
[0008] In one embodiment, a computer-readable non-transient recording medium may store a computer program comprising computer-executable instructions. The instructions may be executed by an electronic device to enable the electronic device to identify a change in the dynamic range of image content displayed through a first area of the display. The instructions may be executed by the electronic device to enable the electronic device to control the brightness of the display based on the change in the dynamic range. The instructions may be executed by the electronic device to enable the electronic device to display the image content through the first area based on the content brightness determined by applying a first dimming ratio to the brightness of the display while the brightness of the display is changing.
[0009] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments of the present disclosure.
[0010] FIG. 2 is a block diagram of a display module according to various embodiments of the present disclosure.
[0011] FIG. 3 is a flowchart illustrating a process in which an electronic device displays content according to one embodiment of the present disclosure.
[0012] FIG. 4 illustrates an example of a screen in which an electronic device according to one embodiment of the present disclosure displays image content.
[0013] Figure 5 illustrates the definitions of standard dynamic range and high dynamic range.
[0014] FIG. 6 illustrates an example of a display brightness curve representing the brightness of a display controlled by an electronic device according to one embodiment of the present disclosure as video content is switched.
[0015] FIG. 7 illustrates an example of a brightness curve of high dynamic range content displayed by an electronic device according to one embodiment of the present disclosure.
[0016] FIG. 8 shows an example of brightness in which an electronic device according to one embodiment of the present disclosure applies a dimming rate to display standard dynamic range content.
[0017] Figure 9 shows an example of the brightness of the output content when the electronic device changes the dynamic range of the displayed content.
[0018] FIG. 10 shows examples of brightness curves and dimming rates for displaying standard dynamic range content when an electronic device according to one embodiment of the present disclosure converts the dynamic range.
[0019] FIG. 11 shows an example of a content brightness curve for an area where the dynamic range of content displayed on an electronic device according to one embodiment of the present disclosure changes.
[0020] FIG. 12 is a block diagram illustrating the components of a display control system of an electronic device according to one embodiment of the present disclosure.
[0021] FIG. 13 is a flowchart illustrating a process in which an electronic device according to one embodiment of the present disclosure determines a dimming rate and displays content.
[0022] Hereinafter, embodiments are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the contents of this disclosure. However, the disclosed embodiments may be implemented in various different forms and are not limited to the embodiments described herein.
[0023] One embodiment of the present disclosure is to provide an electronic device, a method of operation, and a computer program that eliminates or reduces a sudden change in brightness that occurs when an electronic device displaying standard dynamic range content and high dynamic range content displays standard dynamic range content after displaying high dynamic range content.
[0024] One embodiment of the present disclosure is to provide an electronic device, a method of operation, and a computer program that solves the problem of a user misperceiving an image or perceiving an image as darker than it actually is until the user's vision adapts.
[0025] The technical problems to be solved in this document are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.
[0026] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0027] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0028] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0029] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0030] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0031] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0032] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0033] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0034] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0035] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0036] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0037] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0038] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0039] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0040] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0041] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0042] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0043] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.
[0044] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0045] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0046] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0047] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0048] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0049] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0050] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0051] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0052] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0053] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0054] FIG. 2 is a block diagram (200) of a display module (160) according to various embodiments. Referring to FIG. 2, the display module (160) may include a display (210) and a display driver IC (DDI) (230) for controlling the display. The DDI (230) may include an interface module (231), a memory (233) (e.g., a buffer memory), an image processing module (235), or a mapping module (237). The DDI (230) may receive image information, for example, image data or an image control signal corresponding to a command for controlling the image data, from another component of the electronic device 101 through the interface module (231). For example, according to one embodiment, image information may be received from a processor (120) (e.g., main processor (121) (e.g., application processor)) or an auxiliary processor (123) (e.g., graphics processing unit) that operates independently of the functions of the main processor (121). The DDI (230) may communicate with the touch circuit (250) or sensor module (176), etc., through the interface module (231). Additionally, the DDI (230) may store at least a portion of the received image information in memory (233), for example, in frame units. An image processing module (235) may perform preprocessing or postprocessing (e.g., resolution, brightness, or size adjustment) on at least a portion of the image data based at least on the characteristics of the image data or the characteristics of the display (210), for example. A mapping module (237) may generate voltage values or current values corresponding to the image data preprocessed or postprocessed through the image processing module (135). According to one embodiment, voltage values or current The generation of values can be performed, for example, based on at least some of the attributes of the pixels of the display (210) (e.g., array of pixels (RGB stripe or pentile structure), or size of each subpixel).At least some pixels of the display (210) are driven, for example, based on at least some of the voltage value or current value, so that visual information (e.g., text, image, or icon) corresponding to the image data can be displayed through the display (210).
[0055] According to one embodiment, the display module (160) may further include a touch circuit (250). The touch circuit (250) may include a touch sensor (251) and a touch sensor IC (253) for controlling the same. The touch sensor IC (253) may control the touch sensor (251) to detect a touch input or hovering input for a specific location on the display (210), for example. For example, the touch sensor IC (253) may detect a touch input or hovering input by measuring a change in a signal (e.g., voltage, light intensity, resistance, or charge) for a specific location on the display (210). The touch sensor IC (253) may provide information regarding the detected touch input or hovering input (e.g., location, area, pressure, or time) to the processor (120). According to one embodiment, at least a part of the touch circuit (250) (e.g., touch sensor IC (253)) may be included as part of the display driver IC (230) or the display (210), or as part of another component (e.g., auxiliary processor (123)) placed outside the display module (160).
[0056] According to one embodiment, the display module (160) may further include at least one sensor of the sensor module (176) (e.g., fingerprint sensor, iris sensor, pressure sensor, or light sensor) or a control circuit for the same. In this case, the at least one sensor or the control circuit for the same may be embedded in a part of the display module (160) (e.g., display (210) or DDI (230)) or a part of the touch circuit (250). For example, if the sensor module (176) embedded in the display module (160) includes a biometric sensor (e.g., fingerprint sensor), the biometric sensor may obtain biometric information (e.g., fingerprint image) associated with a touch input through a part of the display (210). As another example, if the sensor module (176) embedded in the display module (160) includes a pressure sensor, the pressure sensor may obtain pressure information associated with a touch input through a part or the entire area of the display (210). According to one embodiment, a touch sensor (251) or a sensor module (176) may be placed between pixels of a pixel layer of a display (210), or on top of or below the pixel layer.
[0057] FIG. 3 is a flowchart (300) illustrating a process in which an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure displays content.
[0058] The operation of the electronic device described in the present disclosure may be understood as being performed by at least one processor (e.g., processor (120) of FIG. 1) executing computer-executable instructions stored in memory (e.g., memory (130) of FIG. 1) to perform operations or control components of the electronic device.
[0059] According to one embodiment, in operation 310, the electronic device may display image content (e.g., still image or video) through a display (e.g., a display (210) included in the display module (160) of FIG. 2). In one embodiment, the display may be configured to support content having a standard dynamic range and content having a high dynamic range, respectively. The electronic device may control the brightness of the display based on the dynamic range of the displayed image content. For example, when displaying high dynamic range content, the electronic device may display the image content by increasing the brightness of the display compared to when not displaying high dynamic range content. In the present disclosure, "brightness of the display" may mean the brightness of the screen displayed by the electronic device according to the settings of the electronic device.
[0060] According to one embodiment, in operation 320, the electronic device can determine whether the dynamic range of the image content displayed through the display has changed. For example, the electronic device can determine whether the dynamic range of the image content displayed through the display has changed from a standard dynamic range to a high dynamic range. In the present disclosure, at least a portion of the display displaying the image content may be referred to as a "first area." For example, the electronic device can determine whether the dynamic range of the image content displayed through the display has changed from a high dynamic range to a standard dynamic range.
[0061] In one embodiment, if the dynamic range of the displayed content is not changed, the electronic device can maintain the brightness of the display set in operation 310. If the dynamic range of the displayed content is changed, in operation 330, the electronic device can control the brightness of the display.
[0062] According to one embodiment, in operation 330, the electronic device may increase the brightness of the display. For example, when the dynamic range of image content changes from a standard dynamic range to a high dynamic range, the electronic device may increase the brightness of the display. For example, the electronic device may increase the brightness of the display from a first target brightness to a second target brightness. In the present disclosure, the first target brightness may mean the brightness of the display for displaying standard dynamic range content. In the present disclosure, the second target brightness may mean the brightness of the display for displaying high dynamic range content. In the present disclosure, standard dynamic range content may mean image content having a standard dynamic range. In the present disclosure, high dynamic range content may mean image content having a dynamic range greater than the standard dynamic range. When the electronic device increases the brightness of the display, the brightness of the display may increase gradually or stepwise from the first target brightness to the second target brightness.
[0063] According to one embodiment, in operation 330, the electronic device may reduce the brightness of the display. For example, when the dynamic range of the image content changes from a high dynamic range to a standard dynamic range, the electronic device may reduce the brightness of the display. For example, the electronic device may reduce the brightness of the display from a second target brightness to a first target brightness. When the electronic device reduces the brightness of the display, the brightness of the display may be reduced gradually or in steps from the second target brightness to the first target brightness.
[0064] According to one embodiment, in operation 340, the electronic device may display video content based on the brightness of the changed display. When the video content displayed through the display changes from standard video content to high-dynamic video content, the high-dynamic video content may be displayed based on the brightness of the changed display. When standard dynamic video content is displayed together with high-dynamic video content, the brightness of the standard dynamic video content may be displayed at a brightness different from the brightness that should originally be expressed due to the increased brightness of the display. In order to ensure that the standard dynamic video content is displayed at its original brightness while the brightness of the display is increased, a dimming operation may be performed for the standard dynamic video content to reduce the brightness of the content according to a dimming ratio. Here, the dimming ratio may include a value that causes the standard dynamic video content to be displayed at a brightness corresponding to a first target brightness while the brightness of the display is increased. Here, in order to maintain the content brightness of the standard dynamic video content, the dimming ratio may be changed as the brightness of the display changes. In the present disclosure, content brightness may refer to the brightness at which the content is actually output by applying a dimming rate when the content is output. When video content displayed through a display changes from high-dynamic video content to standard dynamic video content, and when the standard dynamic video content is displayed based on the dimming rate, the brightness of the first area, where the high-dynamic video content was displayed based on a second target brightness, may rapidly change to the first target brightness. Accordingly, the electronic device may display standard dynamic range content displayed in the first area based on a first dimming rate different from the dimming rate. For example, the first dimming rate may have a static value that does not change even if the brightness of the display changes. However, it is not limited thereto.The first dimming rate may indicate a brightness reduction range smaller than the dimming rate (hereinafter referred to as the 'second dimming rate') which causes standard dynamic video content to be displayed at a brightness corresponding to the first target brightness while the brightness of the display is increased.
[0065] According to one embodiment, in operation 340, the electronic device may control the physical brightness of the display based on the brightness to which the first dimming rate is applied, instead of applying the first dimming rate to the content.
[0066] FIG. 4 illustrates an example of a screen in which an electronic device (101) (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure displays video content.
[0067] In one embodiment, the electronic device (101) may display a screen configured based on an application running by the electronic device (101). For example, referring to FIG. 4, the electronic device (101) may display a screen configured by a camera application. The electronic device (101) may display a screen in a first area (410) and a second area (420) of a display (e.g., the display (210) of FIG. 2). However, it is not limited thereto. For example, the first area (410) may be the entire area of the display, and the second area (420) may be omitted. Referring to FIG. 4, the electronic device (101) may display an image (e.g., a preview image) obtained through a camera module (e.g., the camera module (180) of FIG. 1) in the first area (410). The dynamic range of the image displayed in the first area (410) may be changed. As the electronic device (101) performs a specified operation (e.g., initiation of shooting of high dynamic range video, entry into a specified mode), the dynamic range of the video displayed in the first area (410) may change. For example, when the electronic device (101) operates based on SDR mode or displays a preview video without shooting video, standard dynamic range content may be displayed in the first area (410). When the electronic device (101) enters HDR mode or starts shooting HDR video, high dynamic range content may be displayed in the first area (410). When the electronic device (101) exits HDR mode (or enters SDR mode) or the shooting of HDR video is terminated, standard dynamic range content may be displayed again in the first area (410). For example, SDR mode may be an operation mode in which the electronic device (101) does not save the captured video and displays a preview video through a display based on an SDR video obtained through a camera module.When video recording is initiated in SDR mode through user input (e.g., touch input for the second area (420)), the electronic device (101) may enter HDR mode. The electronic device (101) may display the HDR video recorded in HDR mode through a display and store the recorded HDR video in memory. When video recording ends, the electronic device (101) may exit HDR mode and display a preview video based on the SDR video through a display. However, it is not limited to the examples described above.
[0068] In one embodiment, the electronic device (101) may display standard dynamic range content in a second area (420). The electronic device (101) may display standard dynamic range content in the second area (420) separately from the dynamic range of the content displayed in the first area (410). For example, referring to FIG. 4, the electronic device (101) may display user interface elements (e.g., a shooting button, a menu button, a thumbnail, a camera switch button) for controlling the operation of a camera application in the second area (420). The content displayed in the second area (420) may be displayed based on a standard dynamic range.
[0069] In one embodiment, the type of application executed by the electronic device (101) to display a screen may vary. For example, the electronic device (101) may display a screen configured by a gallery application that displays images stored in the memory of the electronic device (101) (e.g., memory (130) of FIG. 1) or images provided from an external server (e.g., server (108) of FIG. 1). The electronic device may display a list of thumbnails of images or image frames of SDR images in the first area (410). Based on the selection of HDR images, the electronic device may display HDR images in the first area (410). The electronic device may display user interface elements for controlling the functions of the gallery application in the second area (420).
[0070] Figure 5 illustrates the definitions of standard dynamic range and high dynamic range.
[0071] Referring to FIG. 5, standard dynamic range content (513) configured based on a standard dynamic range can express color (514) or brightness (515) of the actual environment at a relatively limited level. In contrast, high dynamic range content (523) configured based on a high dynamic range can express color (524) or brightness (525) of the actual environment at a relatively large level. Thus, high dynamic range content (523) can express color (511) or brightness (512) of the actual environment at a more detailed level. Here, since the high dynamic range content (523) expresses color (524) or brightness (525) over a wider range, the display device displaying the high dynamic range content (523) needs to support a higher maximum brightness value.
[0072] FIG. 6 illustrates an example of a display brightness curve (600) representing the brightness of a display controlled by an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) according to one embodiment of the present disclosure in accordance with the switching of image content.
[0073] Referring to FIG. 6, the electronic device may display a first standard dynamic range (SDR) mode content in a first area (e.g., a first area (410) in FIG. 4) of a display (e.g., a display (210) in FIG. 2) before a first time point (T1) at which the display of high dynamic range (HDR) mode content begins. The electronic device may display the first standard dynamic range mode content based on a first target brightness (tb1) before the first time point (T1).
[0074] In one embodiment, based on identifying that high dynamic range mode content is displayed on the display (e.g., content displayed in a first area changes from a first standard dynamic range content to high dynamic range mode content), the electronic device may increase the brightness of the display from a first target brightness (tb1) to a second target brightness (tb2). Referring to FIG. 6, the brightness of the display of the electronic device may increase gradually or in steps from a first time point (T1) to a second time point (T2) at which the brightness of the display reaches the second target brightness (tb2). The electronic device may display high dynamic range mode content in the first area based on the brightness of the display from the first time point (T1) to the second time point (T2). The electronic device may display high dynamic range mode content based on the second target brightness (tb2) from the second time point (T2) to a third time point (T3) at which the display of high dynamic range mode content ends.
[0075] In one embodiment, based on ending the display of high dynamic range mode content (e.g., content displayed in a first area changes from high dynamic range mode content to second standard mode content), the electronic device may change the brightness of the display from a second target brightness (tb2) to a first target brightness (tb1). Referring to FIG. 6, the brightness of the display of the electronic device may gradually or stepwise decrease from a third time point (T3) at which the display of high dynamic range mode content ends until a fourth time point (T4) at which the brightness of the display reaches the first target brightness (tb1). The brightness of the display may be maintained at the first target brightness (tb2) from the fourth time point (T4) onwards.
[0076] FIG. 7 illustrates an example of a brightness curve (700) of high dynamic range content displayed by an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) according to one embodiment of the present disclosure.
[0077] In one embodiment, high dynamic range content may be displayed based on content brightness corresponding to a display brightness curve (600) from a first time point (T1) at which the display of high dynamic range content begins to be displayed until a third time point (T3) at which the display ends.
[0078] FIG. 8 shows an example of content brightness (800) in which an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) according to one embodiment of the present disclosure displays standard dynamic range content by applying a second dimming rate.
[0079] In one embodiment, the electronic device may display standard dynamic range content in a second area. The electronic device may display high dynamic range images in a first area while displaying standard dynamic range content in the second area. The display of the electronic device may operate based on a display brightness higher than a first target brightness (tb1) from a first time point (T1) to a fourth time point (T4) based on a display brightness curve (600) to display high dynamic range images in the first area. To prevent the standard dynamic range content displayed in the second area from being displayed based on a brightness higher than the original first target brightness (tb1), the electronic device may apply a second dimming rate (810) to the standard dynamic range content displayed in the second area. By applying the second dimming rate (810), the brightness of the standard dynamic range content displayed in the second area may be maintained at a content brightness (800) corresponding to the first target brightness (tb1).
[0080] FIG. 9 illustrates an example of the brightness of the content output when the electronic device changes the dynamic range of the content being displayed. In particular, FIG. 9 illustrates the content brightness (910) of the content displayed in the first area when a second dimming rate (810) is applied to the second standard dynamic range content.
[0081] Referring to FIG. 9, the electronic device can display high dynamic range content based on increased display brightness from a first time point (T1) to a third time point (T3). The electronic device can change the content displayed in the first area to a second standard dynamic range content from the third time point (T3). Here, when a second dimming rate (e.g., the second dimming rate (810) of FIG. 8) is applied to compensate for a display brightness higher than the first target brightness (tb1), a section (910) in which the brightness of the display changes rapidly may occur. When a section (910) in which the brightness of the display changes rapidly occurs, the user may perceive the second dynamic range content displayed as darker than the actual content or feel a sense of unfamiliarity, while the user's vision was focused on the high dynamic range content that was output based on the second target brightness (tb2) prior to the third time point (T3).
[0082] FIG. 10 shows an example of a brightness curve (1000) and a first dimming rate (1010) for displaying standard dynamic range content when an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) according to one embodiment of the present disclosure converts the dynamic range.
[0083] In one embodiment, the electronic device may display content based on a brightness curve (1000) with a first dimming rate (1010) applied from a point in time (e.g., a third point in time (T3)) when switching from a high dynamic range mode to a standard dynamic range mode. Referring to FIG. 10, when standard dynamic range content is displayed based on display brightness (600) between the third point in time (T3) and the fourth point in time (T4), the standard dynamic range content may be displayed abnormally because the display brightness (600) is excessively high at the third point in time (T3). Therefore, the electronic device may determine a brightness curve (1000) with a first dimming rate (1010) applied to the display brightness (600). The electronic device may display standard dynamic range content in a first area based on the content brightness determined by applying the first dimming rate (1010) to the display brightness (600). After high dynamic range content is displayed in the first area, the electronic device can display standard dynamic range content displayed in the first area based on the brightness curve (1000).
[0084] In one embodiment, the first dimming rate (1010) may be a static value having a constant value to determine the brightness curve (1000) with a brightness reduced by a constant ratio with respect to the display brightness (600). However, it is not limited thereto. For example, the electronic device may be determined to have a different value depending on the magnitude of the display brightness (600).
[0085] In one embodiment, the brightness curve (1000) may be determined such that the display brightness (600) has a value higher than the first target brightness (tb1) during the interval in which the display brightness (600) is higher than the first target brightness (tb1). For example, the brightness curve (1000) may have a value higher than the first target brightness (tb1) during the fourth interval (T4) from the first interval (T1).
[0086] In one embodiment, the brightness curve (1000) may be determined such that its value decreases during the interval in which the display brightness (600) decreases. For example, the brightness curve (1000) may be determined such that its value decreases from a third time point (T3) to a fourth time point (T4). By applying the brightness curve (1000), the brightness of the display may decrease gradually or in steps from a third time point (T3), at which the display of high dynamic range mode content ends, to a fourth time point (T4), at which the brightness of the display reaches a first target brightness (tb1).
[0087] FIG. 11 shows an example of a content brightness curve (1100) for an area where the dynamic range of content displayed by an electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment of the present disclosure changes.
[0088] Referring to FIG. 11, an electronic device according to one embodiment may display a first standard dynamic range content up to a first time point (T1). The electronic device may display the first standard dynamic range content based on a first target brightness (tb1). The electronic device may display the first standard dynamic range content in a first area (e.g., the first area (410) in FIG. 4) and may further display a third standard dynamic range content in a second area (e.g., the second area (420) in FIG. 4, but is not limited thereto).
[0089] In one embodiment, based on identifying that the content displayed in the first area at a first time point (T1) changes from the first standard dynamic range content to the high dynamic range content, the electronic device may increase the brightness of the display from the first target brightness (tb1) to the second target brightness (tb2). The electronic device may display the high dynamic range content based on the brightness curve (700) of the high dynamic range content of FIG. 7 from the first time point (T1) until the third time point (T3) at which the display of the high dynamic range image content ends.
[0090] In one embodiment, based on identifying that the content displayed in the first area at a third time point (T3) changes from high dynamic range content to second standard dynamic range content, the electronic device may reduce the brightness of the display from a second target brightness (tb2) to a first target brightness (tb1). The electronic device may display the second standard dynamic range content based on the brightness curve (1000) of the standard dynamic range content of FIG. 10 from the third time point (T3) until a fourth time point (T4) in which the brightness of the display reaches the first target brightness (tb1) from the second target brightness (tb2). At the third time point (T3), the second standard dynamic range content may be displayed at a content brightness lower than the second target brightness (tb2) by a dimming amount (dmr) according to the second dimming rate. The electronic device can control the display so that the content brightness of the second standard dynamic range content is gradually or stepwise reduced from a content brightness lower than the second target brightness (tb2) by a dimming amount (dmr) according to the second dimming rate to a fourth point in time (T4) where it reaches the first target brightness (tb1). From the fourth point in time (T4) onwards, the content brightness of the second standard dynamic range content can be maintained at the first target brightness (tb1).
[0091] In one embodiment, from a third time point (T3) to a fourth time point (T4), the electronic device may apply a first dimming rate (e.g., the first dimming rate (1010) of FIG. 10) to cause the content to be displayed along the brightness curve (1100). In one embodiment, from a third time point (T3) to a fourth time point (T4), the electronic device may adjust the physical brightness of the display by referring to the brightness curve (1100) instead of applying the first dimming rate.
[0092] FIG. 12 is a block diagram illustrating the components of a display control system of an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) according to one embodiment of the present disclosure.
[0093] In one embodiment, the display control system of an electronic device may include an application (1210), a dynamic range determination unit (1220), a dimming rate determination unit (1230), a display control unit (1240), and a content dimming control unit (1250).
[0094] In one embodiment, an application (1210) may provide content to be displayed on a display (e.g., the display (210) of FIG. 2). The application (1210) may transmit information to a dynamic range determination unit (1220) for determining the dynamic range of the content to be displayed on the display. For example, if the application is a camera application, at least one of information regarding whether a still image or a video is being captured through the camera or information regarding the shooting mode may be transmitted to the dynamic range determination unit (1220). Although the application (1210) and the dynamic range determination unit (1220) are shown as separate components in FIG. 12, the dynamic range determination unit (1220) may be configured to be included in the application (1210). The application (1210) may obtain display information related to the display from a display control unit (1240). For example, the display control unit (1240) may provide at least one of information about the brightness curve of the display or information about the brightness value set on the display to the application (1210). The application (1210) may provide the display information to the dimming rate determining unit (1230) to determine the dimming rate.
[0095] In one embodiment, the dimming rate determining unit (1230) can determine the dimming rate for video content to be displayed on the display. For example, the dimming rate determining unit (1230) can determine the dimming rate based on the dynamic range of the video content provided by the dynamic range determining unit (1220) and display information provided by the application (1210).
[0096] In one embodiment, the content dimming control unit (1250) can perform dimming for video content to be displayed on the display. For example, the content dimming control unit (1250) can perform dimming for the video content based on a dimming rate provided by the dimming rate determination unit (1230). For example, the content dimming control unit (1250) may automatically perform dimming for the content based on display information provided by the display control unit (1240).
[0097] FIG. 13 is a flowchart (1300) illustrating a process in which an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) according to one embodiment of the present disclosure determines a dimming rate and displays content.
[0098] According to one embodiment, in operation 1310, the electronic device may obtain information regarding a dynamic range for displaying image content. For example, the electronic device may obtain information regarding a dynamic range required to display image content based on the camera application initiating a shooting operation. For example, the electronic device may obtain information regarding a dynamic range required to display image content based on the electronic device entering a specified operation mode. However, the above examples are not limited. For example, the electronic device may obtain information regarding a dynamic range of image content that is periodically displayed.
[0099] According to one embodiment, in operation 1320, the electronic device can determine whether the acquired dynamic range has changed from the previous dynamic range. For example, if the screen displayed through the display (e.g., the display (210) of FIG. 2) is switched from a screen configured based on standard dynamic range content to a screen containing high dynamic range content, the electronic device can determine that the dynamic range has changed. For example, if the screen displayed through the display is changed from a screen containing high dynamic range content to a screen configured based on standard dynamic range content, the electronic device can determine that the dynamic range has changed. Based on the determination that the dynamic range has not changed, the electronic device can maintain the brightness previously set for the display. Based on the determination that the dynamic range has not changed, operation 1310 can be performed again.
[0100] According to one embodiment, based on the determination that the dynamic range has changed, in operation 1330, the electronic device may set the brightness of the display based on the changed dynamic range. For example, if the dynamic range changes from a standard dynamic range to a high dynamic range, the electronic device may increase the brightness of the display. For example, if the dynamic range changes from a high dynamic range to a standard dynamic range, the electronic device may decrease the brightness of the display.
[0101] According to one embodiment, in operation 1340, the electronic device may determine a dimming rate for content to be displayed on the display. For example, if the content to be displayed is high dynamic range content, the electronic device may not apply a dimming rate to the content. For example, if the content to be displayed is standard dynamic range content, the electronic device may determine a first dimming rate. For example, the first dimming rate may include a specified static value. For example, the first dimming rate may include a value determined based on the brightness of the display and the dynamic range of the image. In one embodiment, the electronic device may determine different dimming rates for each area where the content is displayed. For example, within a single screen, the electronic device may apply a dimming rate of 0 to a first area where high dynamic range content is displayed, and apply a second dimming rate that is not 0 to a second area where standard dynamic range content is displayed.
[0102] According to one embodiment, in operation 1350, the electronic device can control the dimming operation of the content being displayed based on a determined dimming rate. In operation 1350, the electronic device can display the dimmed content according to the brightness of the display. In operation 1360, if the operation of displaying the image has not ended, the electronic device can repeat operation 1310. In operation 1360, if the operation of displaying the image has ended, the electronic device can terminate the process.
[0103] In one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) may include a display module (e.g., the display module (160) of FIG. 1 or 2), a memory (e.g., the memory (130) of FIG. 1 or the memory (233) of FIG. 2), and at least one processor (e.g., the processor (120) of FIG. 1, the image processing module (235) of FIG. 2). The display module (e.g., the display module (160) of FIG. 1 or 2)) may include a display (e.g., the display (210) of FIG. 2) that displays visual information. The memory (e.g., the memory (130) of FIG. 1 or the memory (233) of FIG. 2)) may store a computer program containing computer-executable instructions. The above commands may be executed individually or collectively by the at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) to enable the electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) to identify a change in the dynamic range of image content displayed through a first area (e.g., first area (410) of FIG. 4) of the display (e.g., display (210) of FIG. 2). The above commands may be executed individually or collectively by the at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) to enable the electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) to control the brightness of the display (e.g., display (210) of FIG. 2) based on the change in the dynamic range.The above commands may be executed individually or collectively by at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) to enable the electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) to display the image content through the first area (e.g., first area (410) of FIG. 4) based on the content brightness determined by applying a first dimming ratio to the brightness of the display (e.g., display (210) of FIG. 2) while the brightness of the display (e.g., display (210) of FIG. 2) is being changed.
[0104] In one embodiment, the instructions may be executed individually or collectively by the at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) so that the electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) may display a first standard dynamic range (SDR) content based on a first target brightness through the first area (e.g., first area (410) of FIG. 4). The above commands are executed individually or collectively by at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) and, based on identifying that the content displayed in the first area (e.g., first area (410) of FIG. 4) changes from the first standard dynamic range content to the high dynamic range (HDR) content, the brightness of the display (e.g., display (210) of FIG. 2) can be gradually or stepwise increased from the first target brightness to the second target brightness.The above commands may be executed individually or collectively by at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) to cause the electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) to gradually or stepwise decrease the brightness of the display (e.g., display (210) of FIG. 2) from the second target brightness to the first target brightness based on identifying that the content displayed in the first area (e.g., first area (410) of FIG. 4) is changed from the HDR content to the second SDR content, and to display the second SDR content based on the content brightness until the brightness of the display (e.g., display (210) of FIG. 2) reaches the first target brightness. The content brightness may be gradually or stepwise decreased.
[0105] In one embodiment, the instructions may be executed individually or collectively by at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) so that while the electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) displays the HDR content or the second SDR content in the first area (e.g., first area (410) of FIG. 4) based on the first target brightness, a third SDR content in the second area of the display (e.g., display (210) of FIG. 2) is displayed by applying a second dimming rate different from the first dimming rate. The first dimming rate may indicate a smaller reduction in brightness than the second dimming rate.
[0106] In one embodiment, the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) may further include a camera module (e.g., the camera module (180) of FIG. 1). The first region (e.g., the first region (410) of FIG. 4) may include an area where an image acquired through the camera module (e.g., the camera module (180) of FIG. 1) by a camera application executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image processing module (235) of FIG. 2) is displayed. The second region may include an area where user interface elements for controlling the camera module (e.g., the camera module (180) of FIG. 1) through the camera application are displayed.
[0107] In one embodiment, the first region (e.g., the first region (410) of FIG. 4) may include an area where an image frame is displayed by a gallery application executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image processing module (235) of FIG. 2). The second region may include an area where user interface elements for controlling the functions of the gallery application are displayed.
[0108] In one embodiment, the instructions may be executed individually or collectively by the at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) so that the electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) may output the second SDR content based on an initial brightness determined by applying the first dimming rate to the second target brightness, based on identifying that the content displayed in the first area (e.g., first area (410) of FIG. 4) is changed from the HDR content to the second SDR content. The above commands may be executed individually or collectively by at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) to cause the electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) to output the second SDR content based on the content brightness that is gradually or stepwise reduced from the initial brightness to the first target brightness.
[0109] In one embodiment, the instructions may be executed individually or collectively by the at least one processor (e.g., processor (120) of FIG. 1, image processing module (235) of FIG. 2) to enable the electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) to determine the first dimming rate based on the brightness of the display (e.g., display (210) of FIG. 2) and the changed dynamic range.
[0110] In one embodiment, the first dimming rate may have a static value while the brightness of the display (e.g., the display (210) of FIG. 2) is changed.
[0111] In one embodiment, a method of operation of an electronic device (e.g., electronic device (101) of FIG. 1 or FIG. 4) may include an operation of identifying a change in the dynamic range of image content displayed through a first area (e.g., first area (410) of FIG. 4) of a display (e.g., display (210) of FIG. 2) that displays visual information. The method may include an operation of controlling the brightness of the display (e.g., display (210) of FIG. 2) based on the change in the dynamic range. The method may include an operation of displaying the image content through the first area (e.g., first area (410) of FIG. 4) based on the content brightness determined by applying a first dimming ratio to the brightness of the display (e.g., display (210) of FIG. 2) while the brightness of the display (e.g., display (210) of FIG. 2) is changing.
[0112] In one embodiment, the method may include an operation of displaying a first standard dynamic range (SDR) content based on a first target brightness through the first area (e.g., the first area (410) of FIG. 4). An operation of identifying that the dynamic range is changed may include an operation of identifying that the content displayed in the first area (e.g., the first area (410) of FIG. 4) is changed from the first standard dynamic range content to high dynamic range (HDR) content. An operation of displaying the image content may include an operation of gradually or stepwise increasing the brightness of the display (e.g., the display (210) of FIG. 2) from the first target brightness to the second target brightness based on identifying that the content displayed in the first area (e.g., the first area (410) of FIG. 4) is changed from the first standard dynamic range content to high dynamic range (HDR) content. The operation of identifying that the dynamic range is changed may further include an operation of identifying that the content displayed in the first area (e.g., the first area (410) of FIG. 4) is changed from the HDR content to the second SDR content. The operation of displaying the image content may include an operation of gradually or stepwise decreasing the brightness of the display (e.g., the display (210) of FIG. 2) from the second target brightness to the first target brightness based on identifying that the content displayed in the first area (e.g., the first area (410) of FIG. 4) is changed from the HDR content to the second SDR content. The operation of displaying the image content may include an operation of displaying the second SDR content based on the content brightness until the brightness of the display (e.g., the display (210) of FIG. 2) reaches the first target brightness. The content brightness may be gradually or stepwise decreased.
[0113] In one embodiment, the method may further include an operation of displaying a third SDR content based on the first target brightness by applying a second dimming rate different from the first dimming rate to a second area of the display (e.g., the display (210) in FIG. 2) while the HDR content or the second SDR content is displayed in the first area (e.g., the first area (410) in FIG. 4). The first dimming rate may indicate a smaller reduction in brightness than the second dimming rate.
[0114] In one embodiment, the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) may include a camera module (e.g., the camera module (180) of FIG. 1). The first region (e.g., the first region (410) of FIG. 4) may include an area where an image acquired through the camera module (e.g., the camera module (180) of FIG. 1) by a camera application executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image processing module (235) of FIG. 2) is displayed. The second region may include an area where user interface elements for controlling the camera module (e.g., the camera module (180) of FIG. 1) through the camera application are displayed.
[0115] In one embodiment, the first region (e.g., the first region (410) of FIG. 4) may include an area where an image frame is displayed by a gallery application executed by the at least one processor (e.g., the processor (120) of FIG. 1, the image processing module (235) of FIG. 2). The second region may include an area where user interface elements for controlling the functions of the gallery application are displayed.
[0116] In one embodiment, the operation of displaying the second SDR content based on the content brightness until the brightness of the display (e.g., the display (210) of FIG. 2) reaches the first target brightness may include the operation of initially outputting the second SDR content based on an initial brightness determined by applying the first dimming rate to the second target brightness. The operation of displaying the second SDR content based on the content brightness until the brightness of the display (e.g., the display (210) of FIG. 2) reaches the first target brightness may include the operation of outputting the second SDR content based on the content brightness that is gradually or stepwise reduced from the initial brightness to the first target brightness.
[0117] In one embodiment, the operation of determining the first dimming rate based on the brightness of the display (e.g., the display (210) of FIG. 2) and the changed dynamic range may be further included.
[0118] In one embodiment, the first dimming rate may have a static value while the brightness of the display (e.g., the display (210) of FIG. 2) is changed.
[0119] In one embodiment, a computer-readable non-transient recording medium may store a computer program comprising computer-executable instructions. The instructions may be executed by an electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to enable the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to identify a change in the dynamic range of image content displayed through a first area (e.g., the first area (410) of FIG. 4) of the display (e.g., the display (210) of FIG. 2). The instructions may be executed by the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to enable the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to control the brightness of the display (e.g., the display (210) of FIG. 2) based on the change in the dynamic range. The above commands can be executed by the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to display the image content through the first area (e.g., the first area (410) of FIG. 4) based on the content brightness determined by applying a first dimming ratio to the brightness of the display (e.g., the display (210) of FIG. 2) while the brightness of the display (e.g., the display (210) of FIG. 2) is changing.
[0120] In one embodiment, the commands are executed by the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) so that the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) displays a first standard dynamic range (SDR) content based on a first target brightness through the first area (e.g., the first area (410) of FIG. 4). The above commands are executed by the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) and, based on the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) identifying that the content displayed in the first area (e.g., the first area (410) of FIG. 4) is changed from the first standard dynamic range content to the high dynamic range (HDR) content, the brightness of the display (e.g., the display (210) of FIG. 2) can be gradually or stepwise increased from the first target brightness to the second target brightness. The above commands may be executed by the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to gradually or stepwise decrease the brightness of the display (e.g., the display (210) of FIG. 2) from the second target brightness to the first target brightness based on the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) identifying that the content displayed in the first area (e.g., the first area (410) of FIG. 4) is changed from the HDR content to the second SDR content. The above commands may be executed by the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to cause the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to display the second SDR content based on the content brightness until the brightness of the display (e.g., the display (210) of FIG. 2) reaches the first target brightness.A recording medium in which the brightness of the above-mentioned content is gradually or stepwise reduced.
[0121] In one embodiment, the commands may be executed by the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) so that while the HDR content or the second SDR content is displayed in the first area (e.g., the first area (410) of FIG. 4), the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) may display the third SDR content in the second area of the display (e.g., the display (210) of FIG. 2) based on the first target brightness by applying a second dimming rate different from the first dimming rate. The first dimming rate may indicate a smaller reduction in brightness than the second dimming rate.
[0122] In one embodiment, the commands may be executed by the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to cause the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to initially output the second SDR content based on an initial brightness determined by applying the first dimming rate to the second target brightness, based on identifying that the content displayed in the first area (e.g., the first area (410) of FIG. 4) changes from the HDR content to the second SDR content. The commands may be executed by the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to cause the electronic device (e.g., the electronic device (101) of FIG. 1 or FIG. 4) to output the second SDR content based on the content brightness that is gradually or stepwise reduced from the initial brightness to the first target brightness.
[0123] An electronic device, a method of operation thereof, and a computer program according to various embodiments can reduce or eliminate abrupt changes in brightness that occur when standard dynamic range content is displayed after high dynamic range content is displayed.
[0124] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs from the description of the present disclosure.
[0125] Methods according to the claims or embodiments described in the specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.
[0126] When implemented in software, a computer-readable storage medium may be provided for storing one or more programs (software modules). One or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. One or more programs include instructions that cause the electronic device to execute methods according to the claims or embodiments described in the specification of this disclosure.
[0127] In the present disclosure, the function or operation performed by an electronic device may be performed by one or more processors executing one or more instructions stored in memory. The function or operation of the electronic device mentioned in the present disclosure may be performed by a single processor executing one or more instructions, or by a combination of multiple processors executing one or more instructions. A processor mentioned in the present disclosure is understood to include a circuit for performing operations or controlling other components of the electronic device. For example, the one or more processors may include a central processing unit (CPU), a micro-processor unit (MPU), an application processor (AP), a communication processor (CP), a neural processing unit (NPU), a system on chip (SoC), or an integrated circuit (IC) configured to execute one or more instructions. The one or more processors may be configured to perform the operation of the electronic device described above.
[0128] In the present disclosure, a program (software module, software) may be stored in a random access memory, a non-volatile memory including flash memory, a read-only memory (ROM), an electrically erasable programmable read-only memory (EEPROM), a magnetic disc storage device, a compact disc-ROM (CD-ROM), digital versatile discs (DVDs), or other forms of optical storage devices, or a magnetic cassette. Alternatively, it may be stored in a memory composed of some or all of these. The memory may be composed of a single storage medium or a combination of multiple storage media. The one or more instructions may be stored in a single storage medium or distributed across multiple storage media.
[0129] Additionally, the above program may be stored on an attachable storage device that can be accessed via a communication network such as the Internet, Intranet, LAN (local area network), WLAN (wide LAN), or SAN (storage area network), or a combination thereof. Such a storage device may be connected to a device performing an embodiment of the present disclosure through an external port. Additionally, a separate storage device on a communication network may be connected to a device performing an embodiment of the present disclosure.
[0130] In the specific embodiments of the present disclosure described above, the components included in the disclosure are expressed in a singular or plural form according to the specific embodiments presented. However, the singular or plural expression is selected to suit the situation presented for convenience of explanation, and the present disclosure is not limited to singular or plural components; even if a component is expressed in the plural form, it may be composed of a singular form, and even if a component is expressed in the singular form, it may be composed of a plural form.
[0131] Additionally, in the present disclosure, terms such as “part,” “module,” etc. may be a hardware component, such as a processor or circuit, and / or a software component executed by a hardware component, such as a processor.
[0132] "Parts" and "modules" may be implemented by a program that is stored on an addressable storage medium and can be executed by a processor. For example, "parts" and "modules" may be implemented by components such as software components, object-oriented software components, class components, and task components, as well as by processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuits, data, databases, data structures, tables, arrays, and variables.
[0133] The specific embodiments described in this disclosure are merely examples and do not limit the scope of this disclosure in any way. For the sake of brevity, descriptions of prior electronic configurations, control systems, software, and other functional aspects of said systems may be omitted.
[0134] Additionally, in the present disclosure, “comprising at least one of a, b, or c” may mean “comprising only a, comprising only b, comprising only c, or comprising a combination of two or more (comprising a and b, comprising b and c, comprising a and c, or comprising all of a, b, and c).”
[0135] Meanwhile, although specific embodiments have been described in the detailed description of the present disclosure, it is understood that various modifications are possible within the scope of the present disclosure. Therefore, the scope of the present disclosure should not be limited to the described embodiments, but should be defined by the claims set forth below as well as equivalents thereof.
[0136] In the present disclosure, the term “if” will be understood, depending on the context, to mean “when, upon,” “in response to a decision,” or “in response to a detection.” Similarly, “when decided to,” or “when [mentioned condition or event] is detected” will be understood, optionally, to mean “when decided,” or “in response to a decision,” “when [mentioned condition or event] is detected,” or “in response to a detection.”
[0137] The device described above may be implemented as a hardware component, a software component, and / or a combination of a hardware component and a software component. For example, the device and components described in the embodiments may be implemented using one or more general-purpose or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing and responding to instructions. The processing unit (or processing circuit) may execute an operating system (OS) and one or more software applications executed on said operating system. Additionally, the processing unit may access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing unit may be described as being used as a single unit, but those skilled in the art will understand that the processing unit may include multiple processing elements and / or multiple types of processing elements. For example, the processing unit may include multiple processors or one processor and one controller. Additionally, other processing configurations, such as parallel processors, are also possible.
[0138] Software may include computer programs, code, instructions, or a combination of one or more of these, and may configure a processing unit to operate as desired or instruct the processing unit independently or collectively. Software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device so as to be interpreted by the processing unit or to provide instructions or data to the processing unit. Software may be distributed over networked computer systems and may be stored or executed in a distributed manner. Software and data may be stored on one or more computer-readable recording media.
[0139] The method according to the embodiment may be implemented in the form of program instructions that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may continuously store a program executable by a computer, or temporarily store it for execution or download. Additionally, the medium may be various recording or storage means in the form of a single or several hardware combined, and may not be limited to a medium directly connected to a computer system but may exist distributed over a network. Examples of media may include magnetic media such as hard disks, floppy disks, and magnetic tapes; optical recording media such as CD-ROMs and DVDs; magneto-optical media such as floptical disks; and media configured to store program instructions, including ROM, RAM, and flash memory. Additionally, other examples of media may include recording or storage media managed by an app store that distributes applications or a site or server that supplies or distributes various other software.
[0140] Although the embodiments have been described above with reference to limited examples and drawings, those skilled in the art can make various modifications and variations from the description above. For example, suitable results can be achieved even if the described techniques are performed in a different order than described, and / or the components of the described system, structure, device, circuit, etc. are combined or assembled in a form different from described, or replaced or substituted by other components or equivalents.
Claims
1. In an electronic device, A display module including a display that displays visual information; Memory storing a computer program containing computer-executable instructions; and It includes at least one processor, The above instructions are executed individually or collectively by the above at least one processor, and the electronic device: Identifying that the dynamic range of the image content displayed through the first area of the above display changes, and Based on the change in the above dynamic range, the brightness of the display is controlled, and An electronic device that displays the image content through the first area based on the content brightness determined by applying a first dimming ratio to the brightness of the display while the brightness of the display is changing.
2. In Claim 1, The above instructions are executed individually or collectively by the above at least one processor, and the electronic device: Displaying first standard dynamic range (SDR) content based on a first target brightness through the first area above, and Based on identifying that the content displayed in the first area changes from the first standard dynamic range content to high dynamic range (HDR) content, the brightness of the display is gradually or stepwise increased from the first target brightness to the second target brightness, and Based on identifying that the content displayed in the first area is changed from the HDR content to the second SDR content: The brightness of the above display is gradually or stepwise reduced from the second target brightness to the first target brightness, and The second SDR content is displayed based on the brightness of the content until the brightness of the display reaches the first target brightness, and An electronic device in which the brightness of the above-mentioned content is gradually or stepwise reduced.
3. In Claim 2, The above instructions are executed individually or collectively by the above at least one processor, and the electronic device: While the HDR content or the second SDR content is displayed in the first area, the third SDR content is displayed in the second area of the display based on the first target brightness by applying a second dimming rate different from the first dimming rate. An electronic device in which the first dimming rate indicates a smaller decrease in brightness than the second dimming rate.
4. In Claim 3, The above electronic device further includes a camera module, and The first region above includes a region where an image acquired through the camera module by a camera application executed by the at least one processor is displayed. The electronic device, wherein the second area above includes an area in which a user interface element for controlling the camera module through the camera application is displayed.
5. In Claim 3, The first area above includes an area where an image frame is displayed by a gallery application executed by the at least one processor, and The electronic device, wherein the second area above includes an area where user interface elements for controlling the functions of the gallery application are displayed.
6. In Claim 2, The above instructions are executed individually or collectively by the above at least one processor, and the electronic device: Based on identifying that the content displayed in the first area is changed from the HDR content to the second SDR content: Initially, the second SDR content is output based on an initial brightness determined by applying the first dimming rate to the second target brightness, and An electronic device that outputs the second SDR content based on the brightness of the content, which is gradually or stepwise reduced from the initial brightness to the first target brightness.
7. In Claim 1, The above instructions are executed individually or collectively by the above at least one processor, and the electronic device: An electronic device for determining the first dimming rate based on the brightness of the display and the changed dynamic range.
8. In Claim 1, An electronic device in which the first dimming rate has a static value while the brightness of the above display is changed.
9. In a method of operating an electronic device, An action of identifying a change in the dynamic range of image content displayed through a first area of a display that displays visual information; An operation to control the brightness of the display based on a change in the dynamic range; and A method comprising the operation of displaying the image content through the first area based on the content brightness determined by applying a first dimming ratio to the brightness of the display while the brightness of the display is being changed.
10. In claim 9, the method comprises the operation of displaying a first standard dynamic range (SDR) content based on a first target brightness through the first region, and The operation of identifying that the dynamic range is changed includes the operation of identifying that the content displayed in the first area is changed from the first standard dynamic range content to high dynamic range (HDR) content, and The operation of displaying the above video content includes, based on identifying that the content displayed in the first area changes from the first standard dynamic range content to the high dynamic range (HDR) content, the operation of gradually or stepwise increasing the brightness of the display from the first target brightness to the second target brightness. The operation of identifying that the dynamic range is changed further includes the operation of identifying that the content displayed in the first area is changed from the HDR content to the second SDR content. The operation of displaying the above video content is based on identifying that the content displayed in the first area is changed from the HDR content to the second SDR content: The operation of gradually or stepwise decreasing the brightness of the display from the second target brightness to the first target brightness, and The method includes an operation of displaying the second SDR content based on the brightness of the content until the brightness of the display reaches the first target brightness. A method in which the brightness of the above content is gradually or stepwise reduced.
11. In Claim 10, While the HDR content or the second SDR content is displayed in the first area, the operation of displaying the third SDR content in the second area of the display based on the first target brightness by applying a second dimming rate different from the first dimming rate is further included. A method in which the first dimming rate indicates a smaller decrease in brightness than the second dimming rate.
12. In Claim 11, The above electronic device includes a camera module, and The first region above includes a region where an image acquired through the camera module by a camera application executed by the at least one processor is displayed. A method in which the second area above includes an area where user interface elements for controlling the camera module through the camera application are displayed.
13. In Claim 11, The first area above includes an area where an image frame is displayed by a gallery application executed by the at least one processor, and A method in which the second area above includes an area where user interface elements for controlling the functions of the gallery application are displayed.
14. In Claim 10, The operation of displaying the second SDR content based on the content brightness until the brightness of the display reaches the first target brightness is: An operation of initially outputting the second SDR content based on an initial brightness determined by applying the first dimming rate to the second target brightness, and A method comprising the operation of outputting the second SDR content based on the brightness of the content which is gradually or stepwise reduced from the initial brightness to the first target brightness.
15. A computer-readable, non-transient recording medium storing a computer program comprising computer-executable instructions, The above commands are executed by an electronic device, and the electronic device: Identifying that the dynamic range of the image content displayed through the first area of the above display changes, and Based on the change in the above dynamic range, the brightness of the display is controlled, and A recording medium that displays the image content through the first area based on the content brightness determined by applying a first dimming ratio to the brightness of the display while the brightness of the display is changing.