Electronic device including flexible display and method of operating the same

By estimating the display area size after a delay time in a flexible display and forming a corresponding frame, the problem of discrepancies between display area changes and output image frames is solved, improving the display consistency and accuracy.

CN114527949BActive Publication Date: 2026-06-09SAMSUNG ELECTRONICS CO LTD

Patent Information

Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
SAMSUNG ELECTRONICS CO LTD
Filing Date
2021-05-19
Publication Date
2026-06-09

AI Technical Summary

Technical Problem

When the display area size of a flexible display changes, there is a delay between the actual size of the display area and the size of the output image frame, which causes a difference and affects the display effect.

Method used

By estimating the size after a delay time when a change in the display area size is detected, and forming a corresponding frame, the difference between the display area change and the output image frame is reduced. The processor detects the change in the display area size at the first moment, estimates the size after a delay time, forms a second frame, and decides whether to update the screen display based on the difference after identifying the actual size of the display area.

Benefits of technology

It effectively reduces the difference between display area variations and output image frames, improves display consistency and accuracy, and reduces display mismatch issues caused by latency.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114527949B_ABST
    Figure CN114527949B_ABST
Patent Text Reader

Abstract

An electronic device and a display area updating method thereof are provided. The electronic device includes a flexible display and a processor operatively connected to the flexible display. The processor is configurable to estimate a size of a display area after a delay time when a size change of the display area is detected at a first time, form a second frame with the estimated size of the display area, identify the size of the display area at a second time when the second frame is completely formed, obtain a first difference value which is a difference between the size of the second frame and the size of the display area at the second time, obtain a second difference value which is a difference between a size of a first frame output to the display area at the second time and the size of the display area at the second time, output the second frame to the display area of the flexible display when the first difference value is less than the second difference value, and maintain output of the first frame in the display area when the first difference value is not less than the second difference value.
Need to check novelty before this filing date? Find Prior Art

Description

[0001] Cross-references to related applications

[0002] This application is based on and claims priority to Korean Patent Application No. 10-2020-0148046, filed with the Korean Intellectual Property Office on November 6, 2020, and Korean Patent Application No. 10-2020-0166848, filed with the Korean Intellectual Property Office on December 2, 2020, the disclosures of which are incorporated herein by reference in their entirety. Technical Field

[0003] This disclosure relates to an electronic device including a flexible display with a variable screen display area and a method of operating the same. Background Technology

[0004] Currently, various types of electronic devices are being developed to ensure expanded display areas without causing portability inconvenience. For example, flexible display electronic devices can include sliding, rollable, or foldable devices. Sliding electronic devices can be designed such that when at least one side surface of the device's housing slides, the display is pulled out, and the screen area exposed to the outside of the device is expanded. Rollable electronic devices can be designed such that when the display, which is wrapped inside or outside the housing, is unfolded, the screen area exposed to the outside of the device is expanded. Foldable electronic devices can be designed such that when the folded housing is unfolded, the display's screen area is expanded.

[0005] Electronic devices with flexible displays can detect changes in the size of the display area (e.g., the area of ​​the display area) and then generate an image frame to be displayed on the screen by using the changed size as input. The generated image frame can then wait for the screen to refresh before it can be displayed on the actual display. Therefore, there may be a delay before the image frame, formed based on the input used to change the size of the display area, is actually displayed on the screen.

[0006] The above information is presented as background information only to aid in understanding this disclosure. No determination is made, and no assertion is made, regarding whether any of the above can be used as prior art in relation to this disclosure. Summary of the Invention

[0007] When there is a delay between the time when an electronic device, including a flexible display, detects a change in the size of the display area and the time when an image frame formed based on the input used to change the size of the display area is actually displayed on the screen, the size of the display area of ​​the flexible display may change (expand or shrink) during the delay time. Therefore, when the formed image frame is actually displayed on the screen, there may be a difference between the size of the output image frame and the size of the current display area.

[0008] The present disclosure is intended to address at least the aforementioned problems and / or disadvantages, and to provide at least the following advantages. Therefore, one aspect of the present disclosure is to provide an electronic device including a flexible display and a method of operating the same, said electronic device being capable of reducing the difference between the varying size of the display area and the size of the output image frame.

[0009] Other aspects will be set forth in part in the description which follows, and in part will be apparent from the description or may be learned by practice of the presented embodiments.

[0010] According to one aspect of this disclosure, an electronic device is provided. The electronic device includes a flexible display and a processor operatively connected to the flexible display. The processor is configured to: at a first time, when a change in the size of a display area is detected, estimate the size of the display area after a delay time; form a second frame with the estimated size of the display area; at a second time when the second frame is fully formed, identify the size of the display area; obtain a first difference, the first difference being the difference between the size of the second frame and the size of the display area at the second time; obtain a second difference, the second difference being the difference between the size of the first frame output to the display area at the second time and the size of the display area at the second time; output the second frame in the display area of ​​the flexible display when the first difference is less than the second difference; and maintain the output of the first frame in the display area when the first difference is not less than the second difference.

[0011] According to another aspect of this disclosure, a method for updating the display area of ​​an electronic device including a flexible display is provided. The method includes: at a first time, when a change in the size of the display area is detected, estimating the size of the display area after a delay time; forming a second frame with the estimated size of the display area; at a second time when the second frame is fully formed, identifying the size of the display area; obtaining a first difference, the first difference being the difference between the size of the second frame and the size of the display area at the second time; obtaining a second difference, the second difference being the difference between the size of a first frame output to the display area at the second time and the size of the display area at the second time; outputting the second frame in the display area of ​​the flexible display when the first difference is less than the second difference; and maintaining the output of the first frame in the display area when the first difference is not less than the second difference.

[0012] Other aspects, advantages and salient features of this disclosure will become apparent to those skilled in the art from the following detailed description taken in conjunction with the accompanying drawings, which disclose various embodiments of this disclosure. Attached Figure Description

[0013] The above and other aspects, features, and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0014] Figure 1 This is a block diagram of an electronic device 101 in a network environment 100 according to an embodiment of the present disclosure;

[0015] Figure 2 This is a flowchart illustrating the operation of an electronic device according to an embodiment of the present disclosure;

[0016] Figure 3 This is a diagram illustrating the operation of the electronic device up to the point where the screen is updated, according to an embodiment of the present disclosure;

[0017] Figure 4 This is a diagram illustrating a method for estimating the size of the display area of ​​an electronic device according to embodiments of the present disclosure;

[0018] Figure 5 These are diagrams illustrating the effects of an electronic device according to embodiments of the present disclosure;

[0019] Figure 6 It is a graph illustrating the effect of an electronic device according to embodiments of the present disclosure;

[0020] Figure 7 It is a graph illustrating the effect of an electronic device according to embodiments of the present disclosure;

[0021] Figure 8 It is a graph illustrating the effect of an electronic device according to embodiments of the present disclosure;

[0022] Figure 9 It is a graph illustrating the effect of an electronic device according to embodiments of the present disclosure;

[0023] Figure 10 It is a graph illustrating the effect of an electronic device according to embodiments of the present disclosure;

[0024] Figure 11 A diagram of an electronic device according to embodiments of the present disclosure; and

[0025] Figure 12 A diagram of an electronic device according to an embodiment of the present disclosure.

[0026] In all the accompanying drawings, it should be noted that the same reference numerals are used to describe the same or similar elements, features and structures. Detailed Implementation

[0027] The following description, with reference to the accompanying drawings, is provided to aid in a full understanding of the various embodiments of this disclosure as defined by the claims and their equivalents. It includes various specific details to aid understanding, but these are merely exemplary. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of this disclosure. Furthermore, for clarity and brevity, descriptions of well-known functions and structures may be omitted.

[0028] The terms and words used in the following description and claims are not limited to their literal meaning, but are used by the inventors only to enable a clear and consistent understanding of this disclosure. Therefore, it will be clear to those skilled in the art that the following description providing various embodiments of this disclosure is for illustrative purposes only and is not intended to limit the disclosure as defined by the appended claims and their equivalents.

[0029] It should be understood that the singular forms “a,” “an,” and “the” include plural indicators unless the context clearly specifies otherwise. Thus, for example, a reference to “component surface” includes a reference to one or more such surfaces.

[0030] In the following description, various embodiments of the present disclosure may be referenced to the accompanying drawings. Therefore, those skilled in the art will recognize that various modifications, equivalents, and / or substitutions may be made to the various embodiments described herein without departing from the scope and spirit of the present disclosure.

[0031] Figure 1 This is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments.

[0032] Reference Figure 1In network environment 100, electronic device 101 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with at least one of electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, memory 130, input module 150, sound output module 155, display module 160, audio module 170, sensor module 176, interface 177, connection terminal 178, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, user identification module (SIM) 196, or antenna module 197. In some embodiments, at least one of the above components (e.g., connection terminal 178) may be omitted from electronic device 101, or one or more other components may be added to electronic device 101. In some embodiments, some of the components described above (e.g., sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (e.g., display module 160).

[0033] Processor 120 may run software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of electronic device 101 connected to processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, processor 120 may store commands or data received from another component (e.g., sensor module 176 or communication module 190) in volatile memory 132, process the commands or data stored in volatile memory 132, and store the resulting data in non-volatile memory 134. According to embodiments, processor 120 may include a main processor 121 (e.g., central processing unit (CPU) or application processor (AP)) or an auxiliary processor 123 (e.g., graphics processing unit (GPU), neural processing unit (NPU), image signal processor (ISP), sensor central processor, or communication processor (CP)) that is operationally independent of or combined with the main processor 121. For example, when electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or may be implemented as part of the main processor 121.

[0034] When the main processor 121 is inactive (e.g., in sleep) state, the auxiliary processor 123 (rather than the main processor 121) can control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190), or when the main processor 121 is active (e.g., running an application), the auxiliary processor 123 can work with the main processor 121 to control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display module 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) functionally associated with the auxiliary processor 123. According to embodiments, the auxiliary processor 123 (e.g., a neural processing unit) may include hardware architecture dedicated to artificial intelligence model processing. Artificial intelligence models can be generated through machine learning. For example, such learning can be performed via electronic device 101 where artificial intelligence is performed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning. The artificial intelligence model may include multiple layers of artificial neural networks. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q-network, or a combination of two or more thereof, but is not limited thereto. Additionally or optionally, the artificial intelligence model may include software structures in addition to hardware structures.

[0035] Memory 130 may store various data used by at least one component of electronic device 101 (e.g., processor 120 or sensor module 176). The various data may include, for example, software (e.g., program 140) and input or output data for commands associated with it. Memory 130 may include volatile memory 132 or non-volatile memory 134.

[0036] The program 140 may be stored as software in the memory 130, and the program 140 may include, for example, an operating system (OS) 142, middleware 144, or application 146.

[0037] The input module 150 can receive commands or data from outside the electronic device 101 (e.g., a user) that will be used by other components of the electronic device 101 (e.g., processor 120). The input module 150 may include, for example, a microphone, mouse, keyboard, keys (e.g., buttons), or digital pen (e.g., stylus).

[0038] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. According to an embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0039] Display module 160 can visually provide information to the outside of electronic device 101 (e.g., to a user). Display device 160 may include, for example, a display, a holographic device, or a projector, and control circuitry for controlling a respective one of the display, holographic device, and projector. According to an embodiment, display module 160 may include a touch sensor adapted to detect touch or a pressure sensor adapted to measure the intensity of the force caused by touch.

[0040] The audio module 170 can convert sound into electrical signals and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input module 150, or output sound via the sound output module 155 or headphones of an external electronic device (e.g., electronic device 102) that is directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0041] Sensor module 176 can detect the operating state of electronic device 101 (e.g., power or temperature) or the environmental state outside electronic device 101 (e.g., user state), and then generate an electrical signal or data value corresponding to the detected state. According to embodiments, sensor module 176 may include, for example, a gesture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.

[0042] Interface 177 may support one or more specific protocols used to enable electronic device 101 to connect directly (e.g., wired) or wirelessly to external electronic devices (e.g., electronic device 102). According to embodiments, interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital Card (SD) interface, or an audio interface.

[0043] Connection 178 may include a connector, through which electronic device 101 may be physically connected to an external electronic device (e.g., electronic device 102). According to embodiments, connection 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0044] The haptic module 179 can convert electrical signals into mechanical stimuli (e.g., vibration or motion) or electrical stimuli that can be recognized by a user through his touch or kinesthesia. According to embodiments, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0045] Camera module 180 can capture still or moving images. According to an embodiment, camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0046] The power management module 188 manages the power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).

[0047] Battery 189 can power at least one component of electronic device 101. According to an embodiment, battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable rechargeable battery, or a fuel cell.

[0048] Communication module 190 can support the establishment of a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. Communication module 190 may include one or more communication processors capable of operating independently of processor 120 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or Global Navigation Satellite System (GNSS) communication module) or wired communication module 194 (e.g., local area network (LAN) communication module or power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, 5G network, next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components separate from each other (e.g., multiple chips). The wireless communication module 192 can identify and verify the electronic device 101 in the communication network (such as the first network 198 or the second network 199) using user information (e.g., the International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0049] Wireless communication module 192 can support 5G networks following 4G networks and next-generation communication technologies (such as new radio (NR) access technologies). NR access technologies can support enhanced mobile broadband (eMBB), massive machine-type communication (mMTC), or ultra-reliable low-latency communication (URLLC). Wireless communication module 192 can support high-frequency bands (e.g., millimeter-wave bands) to achieve, for example, high data transmission rates. Wireless communication module 192 can support various technologies used to ensure performance in high-frequency bands, such as, for example, beamforming, massive MIMO, full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. Wireless communication module 192 can support various requirements specified in electronic device 101, external electronic devices (e.g., electronic device 104), or network systems (e.g., second network 199). According to an embodiment, the wireless communication module 192 may support peak data rates (e.g., 20 Gbps or greater) for implementing eMBB, lost coverage (e.g., 164 dB or less) for implementing mMTC, or U-plane latency (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip) for implementing URLLC.

[0050] Antenna module 197 can transmit or receive signals or power to or from the exterior of electronic device 101 (e.g., external electronic device). According to an embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, antenna module 197 may include multiple antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 198 or a second network 199) can be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally incorporated into antenna module 197.

[0051] According to various embodiments, antenna module 197 may form a millimeter-wave antenna module. According to embodiments, the millimeter-wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and multiple antennas (e.g., an array antenna), wherein the RFIC is disposed on or adjacent to a first surface (e.g., a bottom surface) of the printed circuit board and is capable of supporting a specified high-frequency band (e.g., a millimeter-wave band), and the multiple antennas are disposed on or adjacent to a second surface (e.g., a top surface or a side surface) of the printed circuit board and are capable of transmitting or receiving signals in the specified high-frequency band.

[0052] At least some of the aforementioned components can be interconnected and communicate signals (e.g., commands or data) between them via an inter-peripheral communication scheme (e.g., bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI)).

[0053] According to an embodiment, commands or data can be sent or received between electronic devices 101 and 104 via a server 108 connected to a second network 199. Each of electronic devices 102 or 104 can be a device of the same type as electronic device 101, or a device of a different type. According to an embodiment, all or some operations that would be performed on electronic device 101 can be performed on one or more of electronic devices 102, electronic device 104, or server 108. For example, if electronic device 101 is required to automatically perform a function or service, or is required to perform a function or service in response to a request from a user or another device, electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service, instead of running the function or service, or electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. Upon receiving the request, the one or more external electronic devices may perform at least a portion of the requested function or service, or perform additional functions or services related to the request, and transmit the result of the execution to electronic device 101. Electronic device 101 may provide the result as at least a partial response to the request, with or without further processing of the result. For this purpose, technologies such as cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing may be used. Electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, electronic device 104 may include an Internet of Things (IoT) device. Server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, electronic device 104 or server 108 may be included in a second network 199. Electronic device 101 may be applied to intelligent services based on 5G communication technology or IoT-related technologies (e.g., smart homes, smart cities, smart cars, or healthcare).

[0054] The electronic device according to various embodiments can be one of a variety of types of electronic devices. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. According to embodiments of this disclosure, the electronic device is not limited to those described above.

[0055] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the specific embodiments, but rather to include various changes, equivalents, or substitutions to the respective embodiments. In the description of the drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that nouns in the singular form corresponding to terms may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include any one or all possible combinations of the items enumerated together with the corresponding phrase among the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish the respective component from another component and do not limit the component in other respects (e.g., importance or order). It will be understood that, whether the terms “operably” or “communically” are used or not, if an element (e.g., a first element) is referred to as “combined with another element (e.g., a second element),” “combined to another element (e.g., a second element),” “connected to another element (e.g., a second element),” or “connected to another element (e.g., a second element)”, it means that the element can be directly (e.g., wiredly) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0056] As used in connection with various embodiments of this disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms such as "logic," "logic block," "part," or "circuit." A module may be a single integrated component adapted to perform one or more functions, or the smallest unit or part of such a single integrated component. For example, according to embodiments, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0057] The various embodiments set forth herein can be implemented as software (e.g., program 140) containing one or more instructions readable by a machine (e.g., electronic device 101) stored in a storage medium (e.g., internal memory 136 or external memory 138). For example, under the control of a processor, the processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. Machine-readable storage media may be provided in the form of non-transitory storage media. The term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium.

[0058] According to embodiments, methods according to various embodiments of this disclosure may be included and provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)) or via an app store (e.g., the Play Store). TM The computer program product may be published online (e.g., downloaded or uploaded), or may be distributed directly between two user devices (e.g., smartphones) (e.g., downloaded or uploaded). If published online, at least a portion of the computer program product may be temporarily generated, or at least a portion of the computer program product may be temporarily stored in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).

[0059] According to various embodiments, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities, and some of the multiple entities may be separately disposed in different components. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding component of the multiple components performed one or more functions before integration. According to various embodiments, the operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.

[0060] In the following text, reference will be made to Figure 2 , Figure 3 and Figure 4 The operation of the electronic device according to an embodiment is described.

[0061] Figure 2 This is a flowchart 200 illustrating the operation of an electronic device according to an embodiment of the present disclosure.

[0062] Figure 3 Figure 300 illustrates the operation of the electronic device up to the point that the screen is updated, according to an embodiment of the present disclosure.

[0063] Figure 4 Figure 400 illustrates a method for estimating the size of the display area of ​​an electronic device according to embodiments of the present disclosure.

[0064] In this specification, the display area may refer to one of a plurality of display areas that displays content by being exposed to the front surface of the electronic device.

[0065] Reference Figures 2 to 4 Electronic devices (e.g.) Figure 1 The display module of the electronic device 101 in the middle can be a flexible display module (e.g., Figure 1 The flexible display module (160) can correspond to a sliding, rollable, or foldable type. A sliding type can refer to a display that is pulled out when at least one side surface of the housing of the electronic device slides, thus expanding the screen area exposed to the outside of the electronic device. A rollable type can refer to a display in which the screen area exposed to the outside of the electronic device is expanded when the display, which is wrapped inside or outside the housing, is unfolded. A foldable type can refer to a display in which the screen area of ​​the display expands as the folded housing unfolds.

[0066] Reference Figure 3 The current time (e.g., the reference time when the electronic device identifies the size of the display area and then begins rendering a frame at the top of the software) can be referred to as the first time t0. The time when a frame for the corresponding signal is fully formed through multiple operations 320 on the software stack upon detecting a signal for a change in the size of the display area (e.g., the first signal 301) can be referred to as the second time tx. The elapsed time td required until the frame for the corresponding signal is reflected on the screen after the signal for changing the size of the display area (e.g., the first signal 301) is detected at the first time t0 can be referred to as the third time "t0 + td". According to embodiments of this disclosure, the electronic device has a screen refresh rate tr (e.g., the difference between the first screen update time rr1 and the second screen update time rr2), the size of the display area of ​​the electronic device at the first time t0 is a first size, the size of the display area of ​​the electronic device at the second time tx is a second size, and the size of the first frame displayed in the display area of ​​the electronic device at the second time tx is a third size.

[0067] Reference Figure 2 and Figure 3 In operation 201, the electronic device can detect changes in the size of the display area at a first time t0, which is the current time. The electronic device can periodically detect changes in the size of the display area. The electronic device can detect a signal 301 for changing the size of the display area at the first time t0.

[0068] In operation 202, the electronic device can estimate a fourth dimension, which is the predicted size of the display area at the third time 't0 + td' after the delay time td. (See below for reference.) Figure 4 A method is described in which the electronics of a flexible display module acquire the size of the display area after a specific period of time.

[0069] Reference Figure 4 When the size of the display area at the first time t0 is the first size w0, and the size of the display area at the fourth time tn, which is a specific time before the first time t0, is the fifth size wn, the electronic device can predict the fourth size wp, which is the size of the display area at the third time 't0 + td' after a delay time td from the first time t0.

[0070] If the rate of change of the size of the display area is constant, the electronic device can estimate the slope "a" between points F0 and Fn as "a = (w0-wn) / (t0-tn)". The electronic device can then estimate the fourth dimension wp using the slope "a" as "wp = a". (t0+td)". The estimated fourth size wp may be larger than the maximum size of the display area of ​​the electronic device. In this case, the electronic device can adjust the fourth size wp to the maximum size of the area that can be displayed. The estimated fourth size wp may be smaller than the minimum size of the display area of ​​the electronic device. In this case, the electronic device can adjust the fourth size wp to the minimum size of the display area. In an embodiment, the electronic device can estimate the size of the display area after a delay time based on the average rate of change of the size of the display area over a specific past time period.

[0071] When electronic devices include semi-automatic displays (which use elasticity, such as springs, to expand the screen, and the change in the size of the display area is initiated by an external force (pushing or pulling) from the user), the accuracy of predicting the size of the display area after a certain period of time can be increased because a constant acceleration acts in the elastic component. Furthermore, when an electronic device uses an electric motor or similar device to automatically change the size of the display area, the accuracy of predicting the size of the display area can be improved because the rate of change is uniform.

[0072] Back Figure 2 and Figure 3 In operation 203, the electronic device can form a second frame having the fourth size obtained in operation 202. Operations 202 and 203 can be included in... Figure 3 In multiple operations 320. The time it takes for the second frame to be fully formed can be the second time tx. Multiple operations 320 on the software stack can change according to the strategy of the operating system or architecture. The operating system can periodically retrieve the display area size value input by the input firmware from memory and can add input / output interrupt events. Runtime can refer to the time required to pass the events registered by the operating system to the architecture. The architecture can process the events and pass the processed events to the appropriate applications. The application can receive the display area size value of the event, perform calculations such as memory allocation, layout adjustment, etc., and generate images through the rendering process. During compositing, images displayed on the screen and generated by the architecture such as the application, system interface (UI), etc., can be composited into a single image. The composited image can be displayed on the screen at the display refresh rate.

[0073] In operation 204, the electronic device can measure the size of the display area at a second time tx, which is the current time. The screen size measured at the second time tx can be a second size. The size of the display area of ​​the electronic device from the first time t0 to the second time tx can be changed manually, semi-automatically, or automatically.

[0074] In operation 205, the electronic device can obtain a first difference between the fourth dimension of the second frame formed in operation 203 and the second dimension of the display area measured in operation 204.

[0075] In operation 206, the electronic device can obtain a second difference between the third size of the first frame currently displayed on the screen and the second size of the display area measured in operation 204. The first frame can be displayed on the screen after the screen update time rr3 prior to the second time tx has been updated. Alternatively, the first frame can be displayed on the screen after the screen has been updated prior to the screen update time rr3.

[0076] In operation 207, the electronic device can determine whether the first difference is less than the second difference. The electronic device can compare the first difference and the second difference, and thus determine a frame with a size similar to the size of the currently displayed area from the first frame that is currently being displayed and the second frame formed by estimating the size of the display area at the third time 't0+ td'.

[0077] When the first difference is less than the second difference, in operation 208, the electronic device can update the screen using the second frame formed in operation 203 at the screen update time rr4 after the second time tx.

[0078] When the first difference is not less than the second difference, in operation 209, at the next screen update time rr4, the electronic device can maintain the current screen and display the first frame on the current screen without updating to the second frame.

[0079] In operation 210, the electronic device can determine whether a continuous change in the size of the display area is detected within a specific time period. The specific time period can be the cycle of detecting signals used to change the size of the display area. When a continuous change in the size of the display area is detected, the process can be repeated after returning to operation 202, which retrieves the size of the display area after the specific time period. Figure 2 Flowchart 200. When no continuous change in the size of the display area is detected, the electronic device can terminate the screen update process based on the change in the size of the display area.

[0080] Instead of forming frames where the size of the display area at the time a size change is detected is reflected in the frame, the electronic device can form frames by predicting the size of the display area after a delay from the time the size change is detected. Therefore, the electronic device can reduce the difference between the size of the display area and the frame to be updated during the actual screen update time.

[0081] Furthermore, while the delay time may differ between each electronic device, it can be uniform or nearly uniform within a single device. Therefore, the accuracy of predicting the size of the display area of ​​the electronic device can be further improved.

[0082] Furthermore, the rate of change of the display area size in electronic devices with semi-automatic or fully automatic flexible displays is uniform or nearly uniform, and thus the accuracy of predicting the size of the display area of ​​the electronic device can be further improved.

[0083] Furthermore, even when the size of the display area in an electronic device with a fully automatic flexible display changes at a uniform rate and then stops changing, the size of the display area after a specific time can be predicted. Therefore, frames with sizes corresponding to the actual display area can be displayed on the screen.

[0084] The electronic device can compare the size of the display area at the point in time when the frame corresponding to the signal used to change the size of the display area is fully formed with the size of the frame to be updated, thereby minimizing the difference between the size of the display area and the size of the frame to be updated at the actual screen update time.

[0085] In the following text, the effects of the electronic device according to the embodiments will be referred to below. Figure 5 Describe it.

[0086] Figure 5 Figure 500 illustrates the effect of an electronic device according to an embodiment of the present disclosure.

[0087] Reference Figure 5 The display screen of electronic device 101 may have a first size 510 at the current time t0. Electronic device 101 may detect a change in the size of the display area at the current time t0. At the current time t0, electronic device 101 may detect that the display screen has changed to a second size 520.

[0088] When a change in the size of the display area is detected, the electronic device 101 can form a frame corresponding to the second size 520. However, a delay time td can elapse from the current time t0 until the frame is actually formed and displayed on the screen, and the display area of ​​the screen of the electronic device 101 continues to increase as the delay time td elapses. Therefore, after the delay time td, the size of the display area of ​​the electronic device 101 can be a third size 530. Therefore, when the frame formed in response to the second size 520 is displayed on the screen, there may be a difference between the size of the formed frame and the third size 530, which is the size of the actual display area. At this time, the screen may be in a black state or an off state, in which case the frame cannot be displayed at the size 540 where the difference in the display area occurs.

[0089] On the other hand, when a change in the size of the display area is detected, based on the above reference... Figure 2 , Figure 3 and Figure 4 The electronic device 101 of the described embodiment can predict the size of the display area at time "t0 + td", where time "t0 + td" is the expected time when a frame will be output. The electronic device 101 can form a frame corresponding to the predicted size of the display area, and thus can reduce the difference between the size of the formed frame and the third size 530 (which is the size of the actual display area at the time the frame is actually displayed). Therefore, a frame corresponding to the size of the display area can be displayed instead of displaying the screen when it is off.

[0090] As referenced above Figure 2 , Figure 3 and Figure 4 The electronic device 101 can determine, from the frames displayed at the corresponding time and the frames corresponding to the third size 530 at the time point when the frame corresponding to the predicted third size 530 is fully formed, a frame with a size similar to the size of the display area at the corresponding time, thereby reducing the difference between the size of the display area and the size of the frame to be updated at the actual screen update time.

[0091] In the following text, please refer to the reference below. Figure 6 Describe the effects of the electronic device according to the embodiments.

[0092] Figure 6 This is a graph 600 illustrating the effects of an electronic device according to embodiments of the present disclosure.

[0093] Reference Figure 6 , Figure 6 The x-axis of the 600 graph can indicate time (milliseconds); Figure 6The y-axis of the 600 graph indicates the ratio of the current display area size to the total display area size. In the following text, in... Figure 6 , Figure 7 , Figure 8 , Figure 9 and Figure 10 In the graph, the ratio of the current display area size to the total display area size, represented by the y-axis, can be based solely on the variable display area of ​​the electronic device's display. The total display area size can refer to the variable display area extended to its maximum size, based solely on the variable display area within the display, rather than the immutable display area, and the current display area size can refer to the current size of the variable display area. The first line 610 can indicate the size of the display area of ​​the electronic device's display as it changes over time. Figure 6 In the curve 600, the electronic device includes a semi-automatic flexible display. Figure 6 The curve 600 can be the result of simulating a situation where the screen expands slowly when initiated by an external force from the user, and then expands at a high speed by using the elasticity of an elastic component (e.g., a spring) in the electronic device.

[0094] The second line 620 can indicate the updated screen size when a change in screen size is detected. (This is in accordance with the above reference.) Figure 2 , Figure 3 and Figure 4 In the described embodiment, the third line 630 may indicate the predicted updated screen size when a change in screen size is detected.

[0095] like Figure 6 The curve graph 600 is shown above, and it is consistent with the application reference above. Figure 2 , Figure 3 and Figure 4 In the described embodiment, the difference between the third line 630 and the first line 610, which indicates the actual size of the display area of ​​the display, is smaller than the difference with the second line 620. When applying the above references... Figure 2 , Figure 3 and Figure 4 In the described embodiments, the difference between the size of the display area and the size of the frame being displayed at the actual screen update time can be reduced.

[0096] In the following text, see references Figure 7 This describes the reduction in the display area of ​​an electronic device's display.

[0097] Figure 7 This is a graph 700 illustrating the effects of an electronic device according to an embodiment of the present disclosure.

[0098] Reference Figure 7The x-axis of graph 700 can indicate time (milliseconds); the y-axis of graph 700 can indicate the ratio of the current display area size to the total display area size. First graph 710 can indicate the size of the display area of ​​the electronic device's display over time. In graph 700, it is assumed that the electronic device includes a semi-automatic flexible display. Graph 700 can be a simulation of a situation where, when screen reduction is initiated by an external force from the user, the screen reduces slowly, and then rapidly reduces the screen using the elasticity of an elastic component (e.g., a spring) in the electronic device.

[0099] The second line 720 can indicate the updated screen size when a change in screen size is detected. (This is in accordance with the above reference.) Figure 2 , Figure 3 and Figure 4 In the described embodiment, the third line 730 may indicate the updated screen size predicted when a change in screen size is detected.

[0100] Similarly, it can be seen that, compared with the application of the above references Figure 2 , Figure 3 and Figure 4 In the described embodiment, the difference between the third line 730 and the first line 710 is less than the difference between the second line 720, wherein the first line 710 indicates the actual size of the display area of ​​the display. When applying the above references... Figure 2 , Figure 3 and Figure 4 In the case of the described embodiments, the difference between the size of the display area and the size of the frame being displayed at the actual screen update time can be reduced.

[0101] In the following text, see below for reference. Figure 9 Describes the expansion of the display area of ​​an electronic device's display.

[0102] Figure 8 This is a graph 800 illustrating the effects of an electronic device according to an embodiment of the present disclosure.

[0103] Reference Figure 8 The x-axis of graph 800 can indicate time (milliseconds); the y-axis can indicate the ratio of the current display area size to the total display area size. The first line 810 can indicate the size of the display area of ​​the electronic device's display over time. In graph 800, it is assumed that the electronic device includes a fully automatic flexible display using motors, etc. Graph 800 can be the result of simulating a scenario where the size of the display area expands at a specific rate and then stops expanding before the screen reaches its maximum size.

[0104] The second line 820 can indicate the updated screen size when a change in screen size is detected. (This is in accordance with the above reference.) Figure 2 , Figure 3 and Figure 4 In the described embodiment, the third line 830 may indicate the updated screen size predicted when a change in screen size is detected.

[0105] Referring to curve 800, it can be seen that, compared with the application of the above reference... Figure 2 , Figure 3 and Figure 4 In the described embodiment, the difference between the third line 830 and the first line 810 is smaller than the difference between the third line 830 and the second line 820, wherein the difference in the actual size of the display area of ​​the display is smaller, as indicated by the first line 810. When applying the above references... Figure 2 , Figure 3 and Figure 4 In the described embodiment, the event that the expansion of the display area size is stopped can be quickly reflected in the frame size, thereby reducing the difference between the size of the display area and the size of the frame being displayed at the actual screen update time.

[0106] In the following text, see references Figure 9 Describes the expansion of the display area of ​​an electronic device's display.

[0107] Figure 9 Graph 900 is a graph describing the effect of an electronic device according to an embodiment of the present disclosure.

[0108] Reference Figure 9 The x-axis of graph 900 can indicate time (milliseconds), while the y-axis of graph 900 can indicate the ratio of the current display area size to the total display area size. The first line 910 can indicate the size of the display area of ​​the electronic device changing over time. Graph 900 can be a result of simulating a scenario where the size of the display area of ​​the electronic device is expanded, the change in the size of the display area is stopped during a specific period of time, and then the size of the display area is expanded again.

[0109] The second line 920 can indicate the updated screen size when a change in screen size is detected. (This is in accordance with the above reference.) Figure 2 , Figure 3 and Figure 4 In the described embodiment, the third line 930 may indicate the updated screen size predicted when a change in screen size is detected.

[0110] Referring to curve 900, it can be seen that, compared with the application of the above reference... Figure 2 , Figure 3 and Figure 4In the described embodiment, the difference between the third line 930 and the first line 910 is less than the difference between the second line 920, wherein the first line 910 indicates the actual size of the display area of ​​the display. When applying the above references... Figure 2 , Figure 3 and Figure 4 In the case of the described embodiments, the difference between the size of the display area and the size of the frame being displayed at the actual screen update time can be reduced.

[0111] In the following text, we will refer to... Figure 10 This describes a situation where the size of the display area of ​​an electronic device's screen is expanded, reduced, and then expanded again.

[0112] Figure 10 This is a graph 1000 illustrating the effects of an electronic device according to an embodiment of the present disclosure.

[0113] Reference Figure 10 The x-axis of graph 1000 can indicate time (milliseconds), while the y-axis of graph 1000 can indicate the ratio of the current display area size to the total display area size. The first line 1010 can indicate the size of the display area of ​​the electronic device's display as it changes over time. Figure 10 The graphic 1000 can be the result of the display area of ​​an analog electronic device being expanded, reduced, and then expanded again.

[0114] The second line 1020 indicates the updated screen size when a change in screen size is detected. This applies when the above reference is applied. Figure 2 , Figure 3 and Figure 4 In the described embodiment, the third line 1030 may indicate the updated screen size predicted when a change in screen size is detected.

[0115] Referring to Figure 1000, it can be seen that, compared with the application of the above references Figure 2 , Figure 3 and Figure 4 In the described embodiment, the difference between the third line 1030 and the first line 1010 is less than the difference between the second line 1020, wherein the first line 1010 indicates the actual size of the display area of ​​the display. When applying the above references... Figure 2 , Figure 3 and Figure 4 In the case of the described embodiments, the difference between the size of the display area and the size of the frame being displayed at the actual screen update time can be reduced.

[0116] Figure 11 A diagram of an electronic device according to an embodiment of the present disclosure. Figure 11This is a diagram showing a portion of the flexible display housed within a second structure.

[0117] Figure 12 This is a diagram of an electronic device according to an embodiment of the present disclosure. Figure 12 This is a diagram showing the state in which most of the flexible display is exposed to the outside of the second structure.

[0118] Figure 11 The state shown can be defined as the first structure 1101 being closed relative to the second structure 1102. Figure 12 The state shown can be defined as the first structure 1101 being open relative to the second structure 1102. A "closed state" or "open state" can be defined as the closed or open state of the electronic device.

[0119] Reference Figure 11 and Figure 12 The electronic device 1100 may include a first structure 1101 and a second structure 1102. The first structure 1101 may be configured to be movable within the second structure 1102. The first structure 1101 may be interpreted as a structure arranged to slide on the second structure 1102. The first structure 1101 may be arranged to perform a reciprocating motion of a specific distance based on the direction shown by the second structure 1102 (e.g., the direction indicated by arrow ①).

[0120] The first structure 1101 may be referred to, for example, as a first housing, a sliding portion, or a sliding shell. The first structure 1101 may be configured to perform reciprocating motion on the second structure 1102. The second structure 1102 may be referred to, for example, as a second housing, a main component, or a main housing. The second structure 1102 may house various electrical components and various electronic components such as a main circuit board and a battery. A portion of the display 1103 (e.g., a first area A1) may be located on the first structure 1101. When the first structure 1101 moves relative to the second structure 1102 (e.g., slides), another portion of the display 1103 (e.g., a second area A2) may be accommodated (e.g., slides in) inside the second structure 1102 or exposed (e.g., slides out) to the outside of the second structure 1102.

[0121] The first structure 1101 may include a first plate 1111a (e.g., a sliding plate). The first structure 1101 may include a first structural surface F1 formed to include at least a portion of the first plate 1111a and a second structural surface F2 facing a direction opposite to the first structural surface F1. According to one embodiment, the second structure 1102 may include a second plate (e.g., Figure 11The structure includes a second plate 1121a (e.g., a rear shell), a first sidewall 1123a extending from the second plate 1121a, a second sidewall 1123b extending from the first sidewall 1123a and the second plate 1121a, a third sidewall 1123c extending from the first sidewall 1123a and the second plate 1121a and parallel to the second sidewall 1123b, and / or a back plate 1121b (e.g., a rear window). The second sidewall 1123b and the third sidewall 1123c may be formed perpendicular to the first sidewall 1123a. The second plate 1121a, the first sidewall 1123a, the second sidewall 1123b, and the third sidewall 1123c may be formed such that one side (e.g., the front surface) is open to receive (or surround) at least a portion of the first structure 1101. For example, the first structure 1101 may be coupled to the second structure 1102 when the first structure 1101 at least partially surrounds the second structure 1102. While being guided by the second structure 1102, the first structure 1101 can slide in a direction parallel to the first surface F1 or the second surface F2 (e.g., the direction of arrow ①).

[0122] The second sidewall 1123b or the third sidewall 1123c may be omitted. The second plate 1121a, the first sidewall 1123a, the second sidewall 1123b, and / or the third sidewall 1123c may be formed as separate structures for connection or assembly with each other. The back plate 1121b may be coupled to surround at least a portion of the second plate 1121a. The back plate 1121b may be substantially integrated with the second plate 1121a. The second plate 1121a or the back plate 1121b may cover at least a portion of the flexible display 1103. For example, the flexible display 1103 may be at least partially housed within the second structure 1102. The second plate 1121a or the back plate 1121b may cover a portion of the flexible display 1103 housed within the second structure 1102.

[0123] The first structure 1101 can be moved relative to the second structure 1102 in a direction parallel to the second plate 1121a (e.g., the rear shell) and the second sidewall 1123b (e.g., direction ①) to be in an open state and a closed state. In the closed state, the first structure 1101 can be located within a first distance from the first sidewall 1123a. In the open state, the first structure 1101 can be located within a second distance from the first sidewall 1123a greater than the first distance. In the closed state, the first structure 1101 can be positioned as a part surrounding the first sidewall 1123a.

[0124] According to various embodiments, electronic device 1100 may include at least one of a display 1103, a key input device 1141, a connector hole 1143, audio modules 1145a, 1145b, 1147a and 1147b, or a camera module 1149. Although in Figure 11 or Figure 12 Not shown, but the electronic device 1100 may also include indicators (e.g., LED devices) or various sensor modules.

[0125] The display 1103 may include a first region A1 and a second region A2. The first region A1 may extend substantially through at least a portion of a first structural surface F1 to be disposed on the first structural surface F1. The second region A2 may extend from the first region A1 and may be inserted into or received in a second structure 1102 (e.g., a housing) depending on the sliding of the first structure 1101, or may be exposed to the outside of the second structure 1102. As will be described below, the second region A2 may be movable while being guided by rollers mounted on the second structure 1102, and may then be received inside the second structure 1102 or exposed to the outside of the second structure 1102. For example, when the first structure 1101 slides in or out, a portion of the second region A2 may deform into a curved shape at a position corresponding to the roller.

[0126] When viewed from above the first plate 1111a (e.g., a skateboard), as the first structure 1101 moves from a closed state to an open state, a plane can be formed substantially together with the first region A1, while the second region A2 is gradually exposed to the outside of the second structure 1102. The display 1103 can be coupled to touch sensing circuitry, a pressure sensor capable of measuring the intensity (or pressure) of a touch, and / or a digitizer for detecting a magnetic pen, or can be positioned adjacent to them. In embodiments, the second region A2 can be at least partially contained within the second structure 1102. Even... Figure 11 In the indicated state (e.g., the closed state), a portion of the second region A2 may also be exposed to the outside. In an embodiment, regardless of whether the state is closed or open, the exposed portion of the second region A2 may be positioned on the roller, and a portion of the second region A2 may maintain a curved shape at a position corresponding to the roller.

[0127] The key input device 1141 may be disposed on the second sidewall 1123b or the third sidewall 1123c of the second structure 1102. Depending on appearance and usage conditions, the shown key input device 1141 may be omitted, or the electronic device 1100 may be designed to include an additional key input device. The electronic device 1100 may include a key input device (not shown), such as a home button or a touchpad disposed around the home button. At least a portion of the key input device 1141 may be located in an area of ​​the first structure 1101.

[0128] Connector hole 1143 can be omitted and can accommodate a connector (e.g., a USB connector) for sending and receiving power and / or data with external electronic devices. Although in Figure 11Or, as not shown in 12, electronic device 1100 may include a plurality of connector holes 1143. Some of the plurality of connector holes 1143 may be used as connector holes for sending or receiving audio signals with external electronic devices. Figure 11 and Figure 12 In the illustrated embodiment, connector hole 1143 is disposed on the third sidewall 1123c, but this disclosure is not limited thereto. For example, connector hole 1143 or a connector hole not shown may be disposed on the first sidewall 1123a or the second sidewall 1123b.

[0129] Audio modules 1145a, 1145b, 1147a, and 1147b may include speaker holes 1145a and 1145b, or microphone holes 1147a and 1147b. One of the speaker holes 1145a and 1145b may be configured as a receiver hole for making voice calls, while the other may be configured as an external speaker hole. Microphone holes 1147a and 1147b may include microphones for obtaining external sound therein. In embodiments, microphone holes 1147a and 1147b may include multiple microphones to detect the direction of sound. In any embodiment, speaker holes 1145a and 1145b and microphone holes 1147a and 1147b may be implemented with a single hole, or may include a speaker (e.g., a piezoelectric speaker) without speaker holes 1145a and 1145b. Speaker hole 1145b is disposed on the first structure 1101 and can be used as a receiver hole for making voice calls. A speaker hole (e.g., an external speaker hole) 1145a or microphone holes 1147a and 1147b may be provided on the second structure 1102 (e.g., one of the sidewalls 1123a, 1123b and 1123c).

[0130] Camera module 1149 may be disposed in the second structure 1102 and may capture an object in a direction opposite to the first area A1 of the display 1103. Electronic device 1100 may include multiple camera modules 1149. For example, electronic device 1100 may include a wide-angle camera, a telephoto camera, or a close-up camera. Electronic device 1100 may measure the distance to the object by including an infrared projector and / or an infrared receiver. Camera module 1149 may include one or more lenses, an image sensor, and / or an image signal processor. Although in Figure 11 or Figure 12Although not shown, the electronic device 1100 may also include a camera module (e.g., a front camera) for capturing an object in the same direction as the first region A1 of the display 1103. For example, the front camera may be positioned around the first region A1 or in the region where the front camera overlaps with the display 1103. When the front camera is located in the region where the front camera overlaps with the display 1103, the front camera can capture an object by penetrating the display 1103.

[0131] An indicator (not shown) of the electronic device 1100 may be disposed on the first structure 1101 or the second structure 1102. The indicator of the electronic device 1100 may provide the status information of the electronic device 1100 as a visual signal by including a light-emitting diode. A sensor module (not shown) of the electronic device 1100 may generate electrical signals or data values ​​corresponding to the internal operating state or external environmental state of the electronic device 1100. For example, the sensor module may include a proximity sensor, a fingerprint sensor, or a biometric sensor (e.g., an iris / face recognition sensor or an HRM sensor). The sensor module may also include at least one of, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer, a grip sensor, a color sensor, an infrared (IR) sensor, a temperature sensor, a humidity sensor, or a lighting sensor.

[0132] According to embodiments of this disclosure, an electronic device may include a flexible display and a processor operatively connected to the flexible display. The processor is configured to: at a first time, when a change in the size of a display area is detected, estimate the size of the display area after a delay time; form a second frame with the estimated size of the display area; at a second time when the second frame is fully formed, identify the size of the display area; obtain a first difference, which is the difference between the size of the second frame and the size of the display area at the second time; obtain a second difference, which is the difference between the size of the first frame output to the display area at the second time and the size of the display area at the second time; output the second frame in the display area of ​​the flexible display when the first difference is less than the second difference; and maintain the output of the first frame in the display area when the first difference is not less than the second difference.

[0133] According to embodiments of this disclosure, the delay time may correspond to the time required from the point in time when the electronic device detects a signal for changing the size of the display area until the frame corresponding to the signal is reflected in the display area.

[0134] According to embodiments of this disclosure, the processor may be configured to estimate the size of the display area after a delay time based on the average rate of change of the size of the display area over a specific past time period.

[0135] According to an embodiment of this disclosure, the processor may be configured to output a second frame in the display area of ​​the flexible display at a screen update time after the second time when the first difference is less than the second difference.

[0136] According to an embodiment of this disclosure, the processor may be configured to: when the first difference is not less than the second difference, not update the display area during the screen update time after the second time.

[0137] According to embodiments of this disclosure, the processor may be configured to: when the estimated size of the display area is greater than the maximum size of the display area, correct the estimated size of the display area to the maximum size.

[0138] According to embodiments of this disclosure, the processor may be configured to: when the estimated size of the display area is less than the minimum size of the display area, correct the estimated size of the display area to the minimum size.

[0139] According to embodiments of this disclosure, the first frame may be a frame that is updated at a display area update time prior to the second time and then output to the display area.

[0140] According to embodiments of this disclosure, the size of the display area can be changed manually, semi-automatically, or automatically.

[0141] According to embodiments of this disclosure, the processor may be configured to detect signals for changing the size of the display area at specific intervals.

[0142] According to another aspect of this disclosure, a method for updating the display area of ​​an electronic device including a flexible display may include: at a first time, when a change in the size of the display area is detected, estimating the size of the display area after a delay time; forming a second frame with the estimated size of the display area; at a second time when the second frame is fully formed, identifying the size of the display area; obtaining a first difference, the first difference being the difference between the size of the second frame and the size of the display area at the second time; obtaining a second difference, the second difference being the difference between the size of the first frame output to the display area at the second time and the size of the display area at the second time; outputting the second frame in the display area of ​​the flexible display when the first difference is less than the second difference; and maintaining the output of the first frame in the display area when the first difference is not less than the second difference.

[0143] According to embodiments of this disclosure, the delay time may correspond to the time required from the point in time when the electronic device detects a signal for changing the size of the display area until the frame corresponding to the signal is reflected in the display area.

[0144] According to embodiments of this disclosure, the method may further include: estimating the size of the display area after a delay time based on the average rate of change of the size of the display area over a specific past time period.

[0145] According to embodiments of this disclosure, the method may further include: when the first difference is less than the second difference, at a screen update time after the second time, outputting a second frame in the display area of ​​the flexible display.

[0146] According to embodiments of this disclosure, the method may further include: when the first difference is not less than the second difference, the display area is not updated during the screen update time after the second time.

[0147] According to embodiments of this disclosure, the method may further include: when the estimated size of the display area is greater than the maximum size of the display area, correcting the estimated size of the display area to the maximum size.

[0148] According to embodiments of this disclosure, the method may further include: when the estimated size of the display area is less than the minimum size of the display area, correcting the estimated size of the display area to the minimum size.

[0149] According to embodiments of this disclosure, the first frame may be a frame whose display area update time is updated before the second time and then output to the display area.

[0150] According to embodiments of this disclosure, the size of the display area can be changed manually, semi-automatically, or automatically.

[0151] According to embodiments of this disclosure, the method may further include: detecting a signal for changing the size of the display area at a specific period.

[0152] According to embodiments of the present disclosure, an electronic device including a flexible display and a method of operating the same may be provided, the electronic device being able to reduce the difference between the varying size of the display area and the size of the output image frame.

[0153] In addition, it can provide various effects that can be understood directly or indirectly through the instruction manual.

[0154] Although this disclosure has been shown and described with reference to various embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made without departing from the spirit and scope of this disclosure as defined by the appended claims and their equivalents.

Claims

1. An electronic device comprising: Flexible displays; as well as The processor is operatively connected to the flexible display. The processor is configured as follows: In the first instance, when a change in the size of the display area is detected, the size of the display area after a delay time is estimated; The second frame is formed using the estimated size of the display area; The size of the display area is identified at a second time when the second frame is fully formed; Obtain a first difference, which is the difference between the size of the second frame and the size of the display area at the second time. Obtain a second difference, which is the difference between the size of the first frame output to the display area at the second time and the size of the display area at the second time; When the first difference is less than the second difference, the second frame is output in the display area; and When the first difference is not less than the second difference, the output of the first frame in the display area is maintained.

2. The electronic device according to claim 1, wherein, The delay time corresponds to the time required from the point when the electronic device detects a signal for changing the size of the display area until the frame corresponding to the signal is reflected in the display area.

3. The electronic device according to claim 2, wherein, The processor is also configured to: The size of the display area after the delay time is estimated based on the average rate of change of the display area size during a specific past time period.

4. The electronic device according to claim 1, wherein, The processor is also configured to: When the first difference is less than the second difference, the second frame is output in the display area of ​​the flexible display at the screen update time after the second time.

5. The electronic device according to claim 1, wherein, The processor is also configured to: When the first difference is not less than the second difference, the display area will not be updated during the screen update time after the second time.

6. The electronic device according to claim 1, wherein, The processor is also configured to: When the estimated size of the display area is greater than the maximum size of the display area, the estimated size of the display area is corrected to the maximum size.

7. The electronic device according to claim 1, wherein, The processor is also configured to: When the estimated size of the display area is less than the minimum size of the display area, the estimated size of the display area is corrected to the minimum size.

8. The electronic device according to claim 1, wherein, The first frame is the frame that is updated at the display area update time prior to the second time and then output to the display area.

9. The electronic device according to claim 1, wherein, The size of the display area can be changed manually, semi-automatically, or automatically.

10. The electronic device according to claim 1, wherein, The processor is also configured to: Signals used to change the size of the display area are detected at specific intervals.

11. A method for updating the display area of ​​an electronic device including a flexible display, the method comprising: In the first instance, when a change in the size of the display area is detected, the size of the display area after a delay time is estimated; The second frame is formed using the estimated size of the display area; The size of the display area is identified at a second time when the second frame is fully formed; Obtain a first difference, which is the difference between the size of the second frame and the size of the display area at the second time. Obtain a second difference, which is the difference between the size of the first frame output to the display area at the second time and the size of the display area at the second time; When the first difference is less than the second difference, the second frame is output in the display area of ​​the flexible display. as well as When the first difference is not less than the second difference, the output of the first frame in the display area is maintained.

12. The display area update method according to claim 11, wherein, The delay time corresponds to the time required from the point when the electronic device detects a signal for changing the size of the display area until the frame corresponding to the signal is reflected in the display area.

13. The display area update method according to claim 11, further comprising: The size of the display area after the delay time is estimated based on the average rate of change of the display area size during a specific past time period.

14. The display area update method according to claim 11, further comprising: When the first difference is less than the second difference, the second frame is output in the display area of ​​the flexible display at the screen update time after the second time.

15. The display area update method according to claim 11, further comprising: When the first difference is not less than the second difference, the display area will not be updated during the screen update time after the second time.

16. The display area update method according to claim 11, further comprising: When the estimated size of the display area is greater than the maximum size of the display area, the estimated size of the display area is corrected to the maximum size.

17. The display area update method according to claim 11, further comprising: When the estimated size of the display area is less than the minimum size of the display area, the estimated size of the display area is corrected to the minimum size.

18. The display area update method according to claim 11, wherein, The first frame is the frame that is updated at the display area update time prior to the second time and then output to the display area.

19. The display area update method according to claim 11, wherein, The size of the display area can be changed manually, semi-automatically, or automatically.

20. The display area update method according to claim 11, further comprising: Signals used to change the size of the display area are detected at specific intervals.