Electronic device for seamlessly displaying an image and operating method thereof
By using first and second displays and a processor to generate snapshot images in foldable electronic devices, the latency problem during state changes is solved, enabling seamless image display and improving the user experience.
Patent Information
- Authority / Receiving Office
- CN · China
- Patent Type
- Patents(China)
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2020-09-22
- Publication Date
- 2026-04-28
AI Technical Summary
When foldable electronic devices switch between folded and unfolded states, image display may be delayed because it takes a long time to draw new images, resulting in a poor user experience.
By employing first and second displays, combined with memory and processor, a snapshot image is generated and stored when a folding state change is detected, and then displayed on another display, reducing latency during state changes.
Snapshot imaging technology reduces latency when electronic devices change between folded and unfolded states, providing a seamless image display experience.
Smart Images

Figure CN114514501B_ABST
Abstract
Description
Technical Field
[0001] This disclosure relates to electronic devices for seamlessly displaying images and methods of operating thereof. Background Technology
[0002] With the development of digital technology, electronic devices are available in various forms, such as smartphones, tablet PCs, or personal digital assistants (PDAs). Electronic devices are evolving into portable or wearable devices to improve user portability and accessibility.
[0003] Recently, portable electronic devices such as smartphones and tablets have become increasingly lighter and thinner for portability and have expanded into many fields for user convenience. In particular, foldable electronic devices equipped with flexible displays offer relatively larger screens than ordinary candybar electronic devices, and their size decreases when folded, making them easy to carry. Therefore, such electronic devices are becoming increasingly popular as they cater to consumer tastes.
[0004] The above information is provided as background information only to aid in understanding this disclosure. No determination or assertion is made as to whether any of the above constitutes prior art with respect to this disclosure. Summary of the Invention
[0005] Technical issues
[0006] A foldable electronic device may include a hinge structure and can enter a folded or unfolded state based on user operation. Depending on the folded or unfolded state, the foldable electronic device may have different display resolutions. Therefore, when changing states between folded and unfolded, the foldable electronic device may require images of different resolutions. However, the time required to render a new image may be longer than the time required to change states between folded and unfolded. Therefore, when changing states between folded and unfolded, the user may experience a delay where no image is displayed on the foldable electronic device's display.
[0007] The present disclosure is intended to at least address the aforementioned problems and / or disadvantages, and to provide at least the following advantages. Therefore, one aspect of the present disclosure provides an electronic device for seamlessly displaying images and a method of operating thereon.
[0008] Technical solution
[0009] Other aspects will be set forth in part in the description which follows, and will be apparent in part from the description, or may be learned by practice of the proposed embodiments.
[0010] According to one aspect of this disclosure, an electronic device is provided. The electronic device includes: a first display disposed on a first surface of the electronic device; a second display disposed on a second surface of the electronic device and having at least a portion invisible to a user depending on the folded state of the electronic device; a memory configured to store instructions; and a processor electrically connected to the first display, the second display, and the memory, the processor being configured to execute the instructions to: detect a change in the folded state of the electronic device when a first image is displayed on one of the first or second displays. For example, the operation can be performed when a predetermined degree (or angle) or greater unfolding or closing operation occurs. When the unfolding degree is less than the predetermined degree, the operation may not be performed. For example, when the folding operation is repeated at high speed, a snapshot image generated by the initial change in folded state may remain unchanged. The processor can: generate a second image to be displayed on the first display or the other of the second displays; while generating the second image, store a snapshot image of the first image in the memory and display the snapshot image on the first display or the other of the second displays; and after the second image is generated, display the second image instead of the snapshot image on the first display or the other of the second displays.
[0011] According to another aspect of this disclosure, an electronic device is provided. The electronic device includes: a display, wherein an area facing a user changes according to a folded state of the electronic device; a memory storing instructions; and a processor electrically connected to the display and the memory. The processor can execute the instructions to: detect a change in the folded state of the electronic device when a first image is displayed on a first area of the display; when the change in folded state is detected, identify a second area of the display corresponding to the changed folded state; generate a second image to be displayed on the identified second area; while generating the second image, store a snapshot image of the first image in the memory and display the snapshot image on the identified second area of the display; and when the second image is generated, display the second image on the identified second area of the display instead of the snapshot image.
[0012] Technical effect
[0013] According to various embodiments, the electronic device and its operating method can take a snapshot of an existing image when the state changes between a folded state and an unfolded state, and can display the snapshot image on a new display area of the display, thereby reducing the user's latency experience.
[0014] Other aspects, advantages, and key features of this disclosure will be apparent to those skilled in the art from the following detailed description of various embodiments disclosed in conjunction with the accompanying drawings. Attached Figure Description
[0015] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following description taken in conjunction with the accompanying drawings, in which:
[0016] Figure 1 This is a block diagram of an electronic device in a network environment according to embodiments of the present disclosure;
[0017] Figure 2 This is a block diagram illustrating a procedure of an electronic device according to an embodiment of the present disclosure;
[0018] Figure 3 This is a view illustrating an example of an electronic device for an outward folding method according to an embodiment of the present disclosure;
[0019] Figure 4 This is a view illustrating an example of an electronic device for an inward folding method according to an embodiment of the present disclosure;
[0020] Figure 5 This is a block diagram of an electronic device according to embodiments of the present disclosure;
[0021] Figure 6 This is a block diagram illustrating a processor of an electronic device according to an embodiment of the present disclosure;
[0022] Figure 7 This is a block diagram illustrating a procedure of an electronic device according to an embodiment of the present disclosure;
[0023] Figure 8 This is a block diagram illustrating a display controller of an electronic device according to an embodiment of the present disclosure;
[0024] Figure 9 This is a flowchart illustrating the operation of an electronic device according to an embodiment of the present disclosure;
[0025] Figure 10 This is a flowchart illustrating the operation of a snapshot image of a display electronic device according to an embodiment of the present disclosure;
[0026] Figure 11 This is a flowchart illustrating the operation of a processing electronic device for a new image according to an embodiment of the present disclosure.
[0027] Throughout the accompanying drawings, it should be noted that similar reference numerals are used to describe the same or similar elements, features, and structures. Detailed Implementation
[0028] The following description with reference to the accompanying drawings is intended to aid in a full understanding of the various embodiments of this disclosure as defined by the claims and their equivalents. Various embodiments include various specific details to aid understanding, but these details should be considered exemplary only. Therefore, those skilled in the art will recognize that various changes and modifications can be made to the various embodiments described herein without departing from the scope and spirit of this disclosure. Furthermore, for clarity and conciseness, descriptions of well-known functions and structures may be omitted.
[0029] The terms and words used in the following description and claims are not limited to their literal meaning, but are merely the inventor's choice to ensure a clear and consistent understanding of this disclosure. Therefore, it will be apparent to those skilled in the art that the following description of various embodiments of this disclosure is for illustrative purposes only and not intended to limit the disclosure as defined by the appended claims and their equivalents.
[0030] It should be understood that, unless the context explicitly states otherwise, the singular forms of “a,” “an,” and “the” include plural references. Thus, for example, a reference to “a component surface” includes a reference to one or more such surfaces.
[0031] Figure 1 This is a block diagram illustrating an electronic device 101 in a network environment 100 according to an embodiment of the present disclosure.
[0032] Reference Figure 1In network environment 100, electronic device 101 can communicate with electronic device 102 via a first network 198 (e.g., a short-range wireless communication network), or with electronic device 104 or server 108 via a second network 199 (e.g., a long-range wireless communication network). According to an embodiment, electronic device 101 can communicate with electronic device 104 via server 108. According to an embodiment, electronic device 101 may include a processor 120, memory 130, input device 150, sound output device 155, display device 160, audio module 170, sensor module 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, user identification module (SIM) 196, or antenna module 197. In some embodiments, at least one of these components (e.g., display device 160 or camera module 180) may be omitted from electronic device 101, or one or more other components may be added to electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit. For example, the sensor module 176 (e.g., a fingerprint sensor, an iris sensor, or an illuminance sensor) may be implemented as embedded in the display device 160 (e.g., a display).
[0033] Processor 120 may run software (e.g., program 140) to control at least one other component (e.g., hardware or software component) of electronic device 101 connected to processor 120, and may perform various data processing or calculations. According to embodiments, as at least part of the data processing or calculations, processor 120 may load commands or data received from another component (e.g., sensor module 176 or communication module 190) into volatile memory 132, process the commands or data stored in volatile memory 132, and store the resulting data in non-volatile memory 134. According to embodiments, processor 120 may include a main processor 121 (e.g., central processing unit (CPU) or application processor (AP)) and an auxiliary processor 123 (e.g., graphics processing unit (GPU), image signal processor (ISP), sensor hub processor, or communication processor (CP)) that is operationally independent of or combined with the main processor 121. Additionally or alternatively, auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted specifically for a given function. The auxiliary processor 123 can be implemented separately from the main processor 121, or it can be implemented as part of the main processor 121.
[0034] When the main processor 121 is inactive (e.g., in sleep mode), the auxiliary processor 123 may control at least some of the functions or states associated with at least one component of the electronic device 101 (other than the main processor 121) (e.g., display device 160, sensor module 176, or communication module 190), or when the main processor 121 is enabled (e.g., running an application), the auxiliary processor 123 may work with the main processor 121 to control at least some of the functions or states associated with at least one component of the electronic device 101 (e.g., display device 160, sensor module 176, or communication module 190). According to embodiments, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) functionally associated with the auxiliary processor 123.
[0035] Memory 130 may store various data used by at least one component of electronic device 101 (e.g., processor 120 or sensor module 176). The various data may include, for example, software (e.g., program 140) and input or output data for commands associated with it. Memory 130 may include volatile memory 132 or non-volatile memory 134.
[0036] The program 140 may be stored as software in the memory 130, and the program 140 may include, for example, an operating system (OS) 142, middleware 144, or application 146.
[0037] Input device 150 can receive commands or data from outside electronic device 101 (e.g., a user) that will be used by other components of electronic device 101 (e.g., processor 120). Input device 150 may include, for example, a microphone, mouse, keyboard, or digital pen (e.g., stylus).
[0038] The sound output device 155 can output sound signals to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used for incoming calls. According to an embodiment, the receiver may be implemented separately from the speaker or as part of the speaker.
[0039] Display device 160 can visually provide information to the outside of electronic device 101 (e.g., to a user). Display device 160 may include, for example, a display, a holographic device, or a projector, and control circuitry that controls a corresponding one of the display, holographic device, and projector. According to an embodiment, display device 160 may include touch circuitry adapted to detect touch, or sensor circuitry adapted to measure the intensity of the force caused by a touch (e.g., a pressure sensor).
[0040] The audio module 170 can convert sound into electrical signals and vice versa. According to an embodiment, the audio module 170 can obtain sound via the input device 150, or output sound via the sound output device 155 or headphones of an external electronic device (e.g., electronic device 102) that is directly (e.g., wired) or wirelessly connected to the electronic device 101.
[0041] Sensor module 176 can detect the operating state of electronic device 101 (e.g., power or temperature) or the environmental state outside electronic device 101 (e.g., user state), and then generate an electrical signal or data value corresponding to the detected state. According to embodiments, sensor module 176 may include, for example, a gesture sensor, gyroscope sensor, atmospheric pressure sensor, magnetic sensor, accelerometer, grip sensor, proximity sensor, color sensor, infrared (IR) sensor, biometric sensor, temperature sensor, humidity sensor, or illuminance sensor.
[0042] Interface 177 may support one or more specific protocols used to enable electronic device 101 to connect directly (e.g., wired) or wirelessly to external electronic devices (e.g., electronic device 102). According to embodiments, interface 177 may include, for example, a High Definition Multimedia Interface (HDMI), a Universal Serial Bus (USB) interface, a Secure Digital Card (SD) interface, or an audio interface.
[0043] Connection end 178 may include a connector, through which electronic device 101 can be physically connected to an external electronic device (e.g., electronic device 102). According to embodiments, connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0044] The haptic module 179 can convert electrical signals into mechanical stimuli (e.g., vibration or motion) or electrical stimuli that can be recognized by a user through his touch or kinesthesia. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.
[0045] Camera module 180 can capture still or moving images. According to an embodiment, camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.
[0046] The power management module 188 manages the power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as at least part of, for example, a power management integrated circuit (PMIC).
[0047] Battery 189 can power at least one component of electronic device 101. According to an embodiment, battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable rechargeable battery, or a fuel cell.
[0048] Communication module 190 can support the establishment of a direct (e.g., wired) or wireless communication channel between electronic device 101 and external electronic devices (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. Communication module 190 may include one or more communication processors capable of operating independently of processor 120 (e.g., application processor (AP)) and support direct (e.g., wired) or wireless communication. According to embodiments, communication module 190 may include wireless communication module 192 (e.g., cellular communication module, short-range wireless communication module, or Global Navigation Satellite System (GNSS) communication module) or wired communication module 194 (e.g., local area network (LAN) communication module or power line communication (PLC) module). One of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wi-Fi Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip) or as multiple components (e.g., multiple chips) that are separate from each other. The wireless communication module 192 can identify and verify the electronic device 101 in the communication network (such as the first network 198 or the second network 199) using user information (e.g., the International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.
[0049] Antenna module 197 can transmit or receive signals or power to or from the exterior of electronic device 101 (e.g., external electronic device). According to an embodiment, antenna module 197 may include an antenna comprising a radiating element formed of a conductive material or conductive pattern formed in or on a substrate (e.g., a printed circuit board PCB). According to an embodiment, antenna module 197 may include multiple antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (such as a first network 198 or a second network 199) can be selected from the multiple antennas by, for example, communication module 190 (e.g., wireless communication module 192). Signals or power can then be transmitted or received between communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, additional components besides the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally incorporated into antenna module 197.
[0050] At least some of the aforementioned components can be interconnected and communicate signals (e.g., commands or data) between them via an inter-peripheral communication scheme (e.g., bus, general purpose input / output (GPIO), serial peripheral interface (SPI), or mobile industrial processor interface (MIPI)).
[0051] According to an embodiment, commands or data can be sent or received between electronic device 101 and external electronic device 104 via server 108 connected to a second network 199. Each of electronic device 102 and electronic device 104 can be a device of the same type as electronic device 101, or a device of a different type. According to an embodiment, all or some operations that would be performed on electronic device 101 can be performed on one or more of external electronic devices 102, external electronic devices 104, or server 108. For example, if electronic device 101 is required to automatically perform a function or service, or is required to perform a function or service in response to a request from a user or another device, electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service, instead of running the function or service, or electronic device 101 may request the one or more external electronic devices to perform at least a portion of the function or service in addition to running the function or service. Upon receiving the request, the one or more external electronic devices may perform at least a portion of the requested function or service, or perform additional functions or services related to the request, and transmit the result of the execution to electronic device 101. Electronic device 101 may provide the result as at least a partial response to the request, either with further processing or without further processing. For this purpose, technologies such as cloud computing, distributed computing, or client-server computing may be used.
[0052] Figure 2 This is a block diagram 200 illustrating a procedure 140 according to an embodiment of the present disclosure.
[0053] refer to Figure 2 According to an embodiment, program 140 may include an operating system (OS) 142, middleware 144, or an application 146 that can run in OS 142 for controlling one or more resources of electronic device 101. OS 142 may include, for example, Android. TM iOS TM Windows TM Symbian TM Tizen TM Or Bada TM For example, at least a portion of program 140 may be preloaded onto electronic device 101 during manufacturing, or at least a portion of program 140 may be downloaded from or updated by an external electronic device (e.g., electronic device 102 or electronic device 104, or server 108) during user use.
[0054] OS 142 can control the management (e.g., allocation or deallocation) of one or more system resources (e.g., processes, memory, or power) of electronic device 101. Alternatively or additionally, OS 142 may include one or more drivers for driving other hardware devices of electronic device 101 (e.g., input device 150, sound output device 155, display device 160, audio module 170, sensor module 176, interface 177, haptic module 179, camera module 180, power management module 188, battery 189, communication module 190, user identification module 196, or antenna module 197).
[0055] Middleware 144 may provide various functions to application 146, enabling application 146 to use functions or information provided from one or more resources of electronic device 101. Middleware 144 may include, for example, application manager 201, window manager 203, multimedia manager 205, resource manager 207, power manager 209, database manager 211, package manager 213, connection manager 215, notification manager 217, location manager 219, graphics manager 221, security manager 223, telephone manager 225, or voice recognition manager 227.
[0056] Application manager 201, for example, manages the lifecycle of application 146. Window manager 203, for example, manages one or more graphical user interface (GUI) resources used on the screen. Multimedia manager 205, for example, identifies one or more formats that will be used to play media files and can encode or decode corresponding media files within the media files using a codec suitable for the appropriate format selected from the one or more formats. Resource manager 207, for example, manages the source code of application 146 or the storage space of memory 130. Power manager 209, for example, manages the capacity, temperature, or power of battery 189 and can determine or provide relevant information for the operation of electronic device 101 based at least in part on the corresponding information of battery 189's capacity, temperature, or power. According to an embodiment, power manager 209 may work in conjunction with the basic input / output system (BIOS) (not shown) of electronic device 101.
[0057] Database manager 211, for example, can create, search, or modify databases that will be used by application 146. Package manager 213, for example, can manage the installation or updates of applications distributed in the form of package files. Connection manager 215, for example, can manage wireless or direct connections between electronic device 101 and external electronic devices. Notification manager 217, for example, can provide functionality for notifying the user of specific events (e.g., incoming calls, messages, or alarms). Location manager 219, for example, can manage location information about electronic device 101. Graphics manager 221, for example, can manage one or more graphical effects to be provided to the user or user interfaces related to said one or more graphical effects.
[0058] Security manager 223 may provide system security or user authentication, for example. Telephone manager 225 may manage voice or video calling functions provided by electronic device 101, for example. Voice recognition manager 227 may send user voice data to server 108 and receive commands from server 108 corresponding to functions that operate on electronic device 101 based at least partially on voice data or text data converted from at least partially on voice data. According to an embodiment, middleware 144 may dynamically remove some existing components or add new components. According to an embodiment, at least a portion of middleware 144 may be included as part of OS 142, or at least a portion of middleware 144 may be implemented as separate software independent of OS 142.
[0059] Application 146 may include, for example, a homepage 251, a dialer 253, a Short Message Service (SMS) / Multimedia Messaging Service (MMS) 255, an Instant Messaging (IM) 257, a browser 259, a camera 261, an alarm clock 263, contacts 265, voice recognition 267, email 269, a calendar 271, a media player 273, a photo album 275, a watch 277, a health 279 (e.g., for measuring exercise intensity or biometric information such as blood sugar) or an environmental information 281 (e.g., for measuring barometric pressure, humidity, or temperature information). According to an embodiment, application 146 may also include an information exchange application (not shown) capable of supporting information exchange between electronic device 101 and external electronic devices. The information exchange application may, for example, include a notification forwarding application suitable for transmitting specified information (e.g., calls, messages, or alarms) to external electronic devices or a device management application suitable for managing external electronic devices. The notification forwarding application can send notification information to an external electronic device corresponding to a specific event (e.g., receiving an email) that has occurred in another application (e.g., email application 269) on electronic device 101. Alternatively or additionally, the notification forwarding application can receive notification information from an external electronic device and provide the notification information to the user of electronic device 101.
[0060] Device management applications can control the power (e.g., turning on or off) or functions (e.g., adjusting brightness, resolution, or focus) of external electronic devices or some components of external electronic devices (e.g., the display device or camera module of the external electronic device). Additionally or optionally, device management applications can support the installation, removal, or updating of applications running on external electronic devices.
[0061] The electronic device according to various embodiments can be one of a variety of types of electronic devices. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. According to embodiments of this disclosure, the electronic device is not limited to those described above.
[0062] It should be understood that the various embodiments of this disclosure and the terminology used therein are not intended to limit the technical features set forth herein to the specific embodiments, but rather to include various changes, equivalents, or substitutions to the respective embodiments. In the description of the drawings, the same reference numerals may be used to refer to the same or related elements. As used herein, each of the phrases such as “A or B,” “at least one of A and B,” “at least one of A or B,” “A, B, or C,” “at least one of A, B, and C,” and “at least one of A, B, or C” may include any one or all possible combinations of the items enumerated together with the corresponding phrase among the plurality of phrases. As used herein, terms such as “first” and “second” or “first” and “second” may be used to simply distinguish the respective component from another component and do not limit the component in other respects (e.g., importance or order). It will be understood that, whether the terms “operably” or “communically” are used or not, if an element (e.g., a first element) is referred to as “combined with another element (e.g., a second element),” “combined to another element (e.g., a second element),” “connected to another element (e.g., a second element),” or “attached to another element (e.g., a second element)”, it means that the first element can be directly (e.g., wiredly) connected to the second element, wirelessly connected to the second element, or connected to the second element via a third element.
[0063] As used herein, the term "module" can include a unit implemented in hardware, software, or firmware, and is used interchangeably with other terms (e.g., "logic," "logic block," "part," or "circuit"). A module can be a single integrated component adapted to perform one or more functions, or the smallest unit or part of such a single integrated component. For example, according to an embodiment, a module can be implemented in the form of an application-specific integrated circuit (ASIC).
[0064] The various embodiments set forth herein can be implemented as software (e.g., program 140) containing one or more instructions readable by a machine (e.g., electronic device 101) stored in a storage medium (e.g., internal memory 136 or external memory 138). For example, under the control of a processor, the processor (e.g., processor 120) of the machine (e.g., electronic device 101) can invoke and execute at least one of the one or more instructions stored in the storage medium, with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the invoked at least one instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. Machine-readable storage media may be provided in the form of non-transitory storage media. The term "non-transitory" simply means that the storage medium is a tangible device and does not include signals (e.g., electromagnetic waves), but this term does not distinguish between data being stored semi-permanently in the storage medium and data being temporarily stored in the storage medium.
[0065] According to embodiments, methods according to various embodiments of this disclosure may be included and provided in a computer program product. The computer program product can be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)) or via an app store (e.g., the Play Store). TM The computer program product may be published online (e.g., downloaded or uploaded), or may be distributed directly between two user devices (e.g., smartphones) (e.g., downloaded or uploaded). If published online, at least a portion of the computer program product may be temporarily generated, or at least a portion of the computer program product may be temporarily stored in a machine-readable storage medium (such as the memory of a manufacturer's server, an app store's server, or a forwarding server).
[0066] According to various embodiments, each of the above-described components (e.g., a module or program) may include a single entity or multiple entities. According to various embodiments, one or more of the above-described components may be omitted, or one or more other components may be added. Optionally or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding component of the multiple components performed one or more functions prior to integration. According to various embodiments, the operations performed by a module, program, or other component may be performed sequentially, in parallel, repeatedly, or heuristically, or one or more of the operations may be run in a different order or omitted, or one or more other operations may be added.
[0067] Figure 3 An example of an electronic device 101 for an outward folding method according to an embodiment of the present disclosure is shown. Figure 3 Part (a) shows the unfolded state of the electronic device 101. Figure 3 Parts (b) and (c) show the folded state of the electronic device 101.
[0068] Reference Figure 3 In portions (a) to (c), electronic device 101 may include a foldable housing 301 and a flexible display 340. In an embodiment, when electronic device 101 is in an unfolded state, the front surface of electronic device 101 may be the surface on which the flexible display 340 is disposed. In an embodiment, when electronic device 101 is in an unfolded state, the rear surface of electronic device 101 may be the surface opposite to the surface on which the flexible display 340 is disposed. In an embodiment, when electronic device 101 is in a folded state, the front surface of electronic device 101 may be the surface on which a first region 341 of the flexible display 340 is disposed. In an embodiment, when electronic device 101 is in a folded state, the rear surface of electronic device 101 may be the surface on which a second region 345 of the flexible display 340 is disposed.
[0069] Reference Figure 3 As shown in portions (a) to (c), the foldable housing 301 may include a first housing portion 310, a second housing portion 320, and a folding portion 330. In an embodiment, the first housing portion 310 and the second housing portion 320 may have a shape substantially symmetrical about a folding axis 335 of the folding portion 330. In an embodiment, the folding portion 330 may connect the first housing portion 310 and the second housing portion 320 so that they are rotatable relative to each other. In an embodiment, the folding portion 330 may provide pivoting movement for the first housing portion 310 and the second housing portion 320.
[0070] refer to Figure 3 In part (a), when the folding portion 330 is unfolded, the first housing portion 310 and the second housing portion 320 can be parallel to each other. In an embodiment, the electronic device 101 can be in an unfolded state when the first housing portion 310 and the second housing portion 320 are parallel to each other.
[0071] Reference Figure 3 In part (a), when the folded part 330 is unfolded, all areas 341, 345 of the flexible display 340 can face the user.
[0072] refer to Figure 3 In portions (b) and (c), when the folding portion 330 is folded, the rear surfaces of the first housing portion 310 and the second housing portion 320 can face each other. In an embodiment, the electronic device 101 can be in a folded state when the first housing portion 310 and the second housing portion 320 face each other.
[0073] Reference Figure 3 In part (b), when the folding portion 330 is folded, the first area 341 of all areas 341 and 345 of the flexible display 340 can face the user, while the second area 345 can not face the user. (See reference...) Figure 3 In part (c), when the folding part 330 is folded, the second area 345 of all areas 341 and 345 of the flexible display 340 can face the user, and the first area 341 can not face the user.
[0074] In an embodiment, when the folding portion 330 is partially unfolded and partially folded, the first outer shell portion 310 and the second outer shell portion 320 may have a predetermined angle relative to the folding axis 335. In an embodiment, when the first outer shell portion 310 and the second outer shell portion 320 have a predetermined angle relative to the folding axis 335, the electronic device 101 may be in an intermediate state.
[0075] Figure 4 An example of an electronic device 101 for an inward folding method according to an embodiment of the present disclosure is shown. Figure 4 Part (a) shows the unfolded state of the electronic device 101. Figure 4 Parts (b) and (c) show the folded state of the electronic device 101.
[0076] Reference Figure 4In portions (a) to (c), electronic device 101 may include a foldable housing 401, a first display 440, and a second display 450. In an embodiment, when electronic device 101 is in an unfolded state, the front surface of electronic device 101 may be the surface on which the first display 440 is disposed. In an embodiment, when electronic device 101 is in an unfolded state, the rear surface of electronic device 101 may be the opposite surface to which the first display 440 is disposed. In an embodiment, when electronic device 101 is in a folded state, the front surface of electronic device 101 may be the surface on which the second display 450 is disposed. In an embodiment, when electronic device 101 is in a folded state, the rear surface of electronic device 101 may be the opposite surface to which the second display 450 is disposed. In an embodiment, when electronic device 101 is in a folded state, the front and rear surfaces of electronic device 101 may correspond to the rear surface of electronic device 101 when electronic device 101 is in an unfolded state.
[0077] Reference Figure 4 As shown in portions (a) to (c), the foldable housing 401 may include a first housing portion 410, a second housing portion 420, and a folding portion 430. In an embodiment, the first housing portion 410 and the second housing portion 420 may have a shape substantially symmetrical about a folding axis 435 of the folding portion 430. In an embodiment, the second housing portion 420 may include a sensor region 460. In an embodiment, the folding portion 430 may connect the first housing portion 410 and the second housing portion 420 so that they are rotatable relative to each other. In an embodiment, the folding portion 430 may provide pivoting movement for the first housing portion 410 and the second housing portion 420.
[0078] refer to Figure 4 In part (a), when the folding portion 430 is unfolded, the first housing portion 410 and the second housing portion 420 can be parallel to each other. In an embodiment, the electronic device 101 can be in an unfolded state when the first housing portion 410 and the second housing portion 420 are parallel to each other.
[0079] refer to Figure 4 In part (a), when the folded portion 430 is unfolded, either the first display 440 or the second display 450 can be seen by the user. In an embodiment, the first display 440 is visible to the user when the user views the front surface of the electronic device 101 in the unfolded state. In an embodiment, the sensor area 460 is visible to the user when the user views the front surface of the electronic device 101 in the unfolded state. In an embodiment, the second display 450 is visible to the user when the user views the rear surface of the electronic device 101 in the unfolded state.
[0080] refer to Figure 4 In portions (b) and (c), when the folding portion 430 is folded, the front surfaces of the first housing portion 410 and the second housing portion 420 can face each other. In an embodiment, the electronic device 101 can be in a folded state when the first housing portion 410 and the second housing portion 420 face each other.
[0081] refer to Figure 4 Parts (b) and (c) are provided, and the first display 440 can be folded when the folding part 430 is folded.
[0082] refer to Figure 4 Parts (b) and (c) of the first display 440 are such that, when the folding portion 430 is folded, at least a portion of the first display 440 is invisible to the user. In this embodiment, reference is made to... Figure 4 Parts (b) and (c) are provided, and the second display 450 is visible to the user when the folding portion 430 is folded. In this embodiment, the second display 450 is visible to the user when the user is viewing the front surface of the electronic device 101 in the folded state.
[0083] In an embodiment, when the folding portion 430 is partially unfolded and partially folded, the first outer shell portion 410 and the second outer shell portion 420 may have a predetermined angle relative to the folding axis 435. In an embodiment, when the first outer shell portion 410 and the second outer shell portion 420 have a predetermined angle relative to the folding axis 435, the electronic device 101 may be in an intermediate state.
[0084] Figure 5 This is a block diagram of an electronic device 501 according to an embodiment of the present disclosure. In the embodiment, Figure 5 The electronic device 501 can correspond to Figure 1 Electronic device 101.
[0085] refer to Figure 5 The electronic device 501 may include a processor 510, a display 520, a sensor module 530, a memory 540, or a combination thereof. In an embodiment, Figure 5 The processor 510, display 520, display driver integrated circuit (DDI) 525, sensor module 530, or memory 540 can respectively correspond to Figure 1 The processor 120, display device 160, sensor module 176, or memory 130. Figure 5 The diagram shows an electronic device 501 including a display 520, but this is merely an example. In embodiments, the electronic device 501 may include two or more displays.
[0086] In an embodiment, the processor 510 can use a program stored in the memory 540 (e.g., Figure 1 The processor 510 generates images for display on the display 520 using a program 140. In an embodiment, the processor 510 can generate images using an application installed in the electronic device 101. In an embodiment, the processor 510 can generate images at pre-specified intervals. In an embodiment, images generated at pre-specified intervals may be referred to as an image stream.
[0087] In one embodiment, processor 510 may draw images on a layer assigned to an application installed in electronic device 101. In another embodiment, drawing may be an operation of writing images (or graphics data) to memory 540 (e.g., a buffer) allocated to the application layer. In another embodiment, a layer may be information for managing screen regions (e.g., layer regions or surface regions) corresponding to the application. In another embodiment, a layer may be an object or instance corresponding to a specified data structure and may be created and deleted according to application requests. In another embodiment, the layer may include the address of a graphics buffer for the application to draw images (or graphics data), and information about the frame region (the position the layer occupies within the entire area of the frame buffer). In another embodiment, the layer may be referred to as a surface or window.
[0088] In one embodiment, the processor 510 can generate an image for display on the display 520 by compositing layers on a specific application, a layer on the status bar, a launcher layer, a wallpaper layer, a layer on a notification, or a combination thereof.
[0089] In one embodiment, processor 510 can send the generated image to DDI 525. In another embodiment, DDI 525 can send the image to display 520 via an interface operatively connecting or coupling DDI 525 and display 520. In yet another embodiment, DDI 525 can package the received image according to the protocol of each interface and can send the packaged image to display 520. In this embodiment, the interface may include Mobile Industrial Processor Interface (MIPI), High Definition Multimedia Interface (HDMI), Display Port (DP), or a combination thereof.
[0090] In an embodiment, the processor 510 may display an image on a display area of a display 520 corresponding to the state of the electronic device 501 (e.g., a folded state or an unfolded state). In an embodiment, the display area of the display 520 may indicate an enabled area within the entire area of the display 520. For example, the entire area of the display 520 may correspond to... Figure 3 The area of the flexible display 340. For example, the entire area of the display 520 can correspond to... Figure 4 The area of the first display 440 and the area of the second display 450.
[0091] In an embodiment, when the electronic device 501 uses an outward folding method and is in an unfolded state, the display area of the display 520 can correspond to the entire area of the display 520 (e.g., Figure 3 The flexible display 340 area). In an embodiment, when the electronic device 501 uses an outward folding method and is in a folded state, the display area of the display 520 may correspond to a specific area of the display 520 (e.g., Figure 3 The first region 341 or the second region 345 of the flexible display 340.
[0092] In an embodiment, when the electronic device 501 uses an inward folding method and is in an unfolded state, the display area of the display 520 may correspond to the first display of the display 520 (e.g., Figure 4 The area of the first display 440). In an embodiment, when the electronic device 501 uses an inward folding method and is in a folded state, the display area of the display 520 may correspond to the area of the second display of the display 520 (e.g., the area of the first display 440). Figure 4 The area of the second display (450).
[0093] In an embodiment, processor 510 may generate instructions to execute an ongoing application (e.g., Figure 1 The processor 510 can generate an image of the result of application 146) and display the generated image on display 520. In an embodiment, the processor 510 can generate an image of a first resolution corresponding to the state of electronic device 501 and corresponding to a first display area of display 520, and can display the image of the first resolution on the first display area of display 520. In an embodiment, when the electronic device is in a first state (e.g., a folded state), the first display area may be a pre-defined display area. In an embodiment, the first resolution may correspond to the resolution of the first display area. In an embodiment, displaying an image on display 520 indicating the result of executing the application may indicate that the application is displayed on display 520.
[0094] In one embodiment, the processor 510 can recognize state changes of the electronic device 501 during the display of an image at a first resolution on a first display area of the display 520. In another embodiment, the processor 510 can recognize state changes of the electronic device 501 based on the sensor module 530. In another embodiment, the processor 510 can recognize a first state change from a folded state to an unfolded state of the electronic device 501 based on the sensor module 530. In yet another embodiment, the processor 510 can determine the state change of the electronic device 501 from an open state to a folded state by utilizing two or more sensors, based on the sensor module 530. For example, after a touch operation (a grip for folding or unfolding) occurs via a touch sensor, the processor 510 can determine a fully folded or unfolded state by recognizing the progress toward folding or unfolding using an angular velocity sensor.
[0095] In one embodiment, when a change in the state of electronic device 501 is detected, processor 510 may enable (e.g., turn on) a new display area of display 520 corresponding to the changed state of electronic device 501. In another embodiment, when a change in the state of electronic device 501 is detected, processor 510 may deactivate a first display area of display 520. In yet another embodiment, the new display area corresponding to the changed state of electronic device 501 may be a second display area.
[0096] In this embodiment, when a change in the state of the electronic device 501 is detected, the processor 510 can identify the application being displayed on the first display area of the display 520 (e.g., Figure 1 The continuity information (application 146) may be information indicating whether an already displayed application will be displayed when the state of the electronic device 501 changes. In an embodiment, the continuity information may be information indicating whether an already displayed application will be displayed when a first state change occurs in the electronic device 501, and information indicating whether an already displayed application will be displayed when a second state change occurs in the electronic device 501. In an embodiment, for a specific application, the continuity during the first state change and the continuity during the second state change may be set to be the same as or different from each other. For example, for a specific application, the continuity during the first state change and the continuity during the second state change may be set. For example, for a certain application, the continuity during the first state change and the continuity during the second state change may be disabled. For example, for a certain application, the continuity during the first state change may be set, while the continuity during the second state change may be disabled.
[0097] In an embodiment, when a specific state change (e.g., a first state change) is set for a specific application displayed in the folded state of the electronic device 501, the specific application can also be displayed in the second state (e.g., the unfolded state) when the electronic device 501 changes from the first state (e.g., the folded state) to the second state (e.g., the unfolded state).
[0098] In one embodiment, when continuity during a specific state change (e.g., a first state change) is disabled for a specific application displayed in the folded state of the electronic device 501, and when the electronic device 501 changes from the first state (e.g., folded state) to the second state (e.g., unfolded state), the display of the specific application can be stopped. In another embodiment, when continuity during a specific state change (e.g., a first state change) is disabled for all applications displayed in the folded state of the electronic device 501, and when the electronic device 501 changes from the first state (e.g., folded state) to the second state (e.g., unfolded state), the display 520 can be deactivated (e.g., turned off). In yet another embodiment, when continuity during a specific state change (e.g., a first state change) is disabled for all applications displayed in the folded state of the electronic device 501, and when the electronic device 501 changes from the first state (e.g., folded state) to the second state (e.g., unfolded state), the display 520 can display a pre-specified screen (e.g., a home screen, a lock screen).
[0099] In an embodiment, when the continuity of an application being displayed on the first display area of the display 520 is set, the processor 510 can generate a new application indicating that it should run (e.g., Figure 1 An image showing the execution result of application 146. In an embodiment, the image indicates the running application (e.g., ...). Figure 1 The new image resulting from the execution of application 146) can correspond to the resolution of the second display area of display 520. In an embodiment, processor 510 can generate a new image by redrawing a layer on a specific application, a layer on the status bar, a launcher layer, a wallpaper layer, a layer on a notification, or a combination thereof.
[0100] In an embodiment, the processor 510 may display an application indicating its operation (e.g., on a second display area of the display 520) on the display 520. Figure 1 A new image of the execution result of application 146).
[0101] In one embodiment, when a change in the state of the electronic device 501 is detected, the processor 510 can take a snapshot of the existing image displayed on the first display area and store it in the memory 540. In another embodiment, when a change in the state of the electronic device 501 is detected, the processor 510 can display a snapshot image of the existing image displayed on the first display area on the second display area of the display 520. In yet another embodiment, the processor 510 can display the snapshot image on the second display area of the display 520 until a new image is generated.
[0102] In one embodiment, the processor 510 may perform image processing (e.g., scaling, rotation, blurring, or a combination thereof) on the snapshot image based on the resolution of the second display area, and then display the image-processed snapshot image on the second display area of the display 520.
[0103] In one embodiment, when a new image is generated, the processor 510 may display the new image on the second display area of the display 520 instead of an existing image. In another embodiment, the processor 510 may perform image processing on the new image and may display the processed new image on the second display area of the display 520 for a predetermined time. Alternatively, the processor 510 may display the processed new image for a predetermined time, and then display a new image without image processing on the second display area of the display 520.
[0104] The illustration shows a snapshot image being displayed only when the state of electronic device 501 changes, until a new image is generated. However, this is merely an example, and this disclosure is not limited to the above example. In embodiments, a snapshot image of an existing image may be displayed even when the display area of display 520 changes, until a new image is generated. In embodiments, changes in the display area of display 520 may include enabled display changes (e.g., Figure 4 The changes can be between the first display 440 and the second display 450, changes in the enabled area across the entire area of the display, changes in resolution, or a combination thereof. In embodiments, changes in the enabled area of the display can include changes in size, changes in the position of the enabled area across the entire area of the display, or a combination thereof.
[0105] Figure 6 This illustrates an electronic device according to an embodiment of the present disclosure (e.g., Figure 1 The program of the electronic device 101 (e.g., Figure 1 The flowchart of program 140.
[0106] refer to Figure 6The processor 510 may include a window manager 610, a state management module 620, a snapshot image processing module 630, an application 650, a window compositor 660, or a combination thereof. In an embodiment, the display controller 640 may correspond to... Figure 5 The DDI 525. In an embodiment, components of processor 510 may be implemented at the hardware level or at the software level. In an embodiment, Figure 6 The sensor module 530 and the display 520 can respectively correspond to Figure 5 The sensor module 530 and the display 520.
[0107] In this embodiment, when a state change of electronic device 501 is detected by sensor module 530, window manager 610 can send information about the display area corresponding to the changed state of electronic device 501 to application 650. In this embodiment, when a state change of electronic device 501 is detected, window manager 610 can send information about the display area corresponding to the changed state of electronic device 501 to application 650, which has a continuity setting between running applications. In this embodiment, the display area of display 520 based on the state of electronic device 501 before the state change can be referred to as a first display area, and the display area of display 520 based on the state of electronic device 501 after the state change can be referred to as a second display area. In this embodiment, the information about the display area may include information about the resolution of the second display area.
[0108] In one embodiment, when the sensor module 530 detects a state change in the electronic device 501, the state management module 620 can enable the second display area of the display 520. In another embodiment, the state management module 620 can enable the second display area of the display 520 via the display controller 640. In another embodiment, when the state of the electronic device 501 changes from a folded state to an unfolded state, the state management module 620 can enable the display area of the display 520 corresponding to the unfolded state. In another embodiment, when the state of the electronic device 501 changes from an open state to a folded state, the state management module 620 can enable the display area of the display 520 corresponding to the folded state. In yet another embodiment, in the case of an outward folding method, the display area of the display 520 corresponding to the folded state can be... Figure 3 The first region 341 of the flexible display 340. In an embodiment, in the case of the inward folding method, the display area of the display 520 corresponding to the folded state can be Figure 4 The area of the second display 450. In an embodiment, in the case of the outward folding method, the display area of the display 520 corresponding to the unfolded state can be Figure 3The entire area of the flexible display 340. In an embodiment, in the case of the inward folding method, the display area of the display 520 corresponding to the unfolded state can be... Figure 4 The first display area is 440.
[0109] In this embodiment, when the sensor module 530 detects a change in the state of the electronic device 501, the snapshot image processing module 630 can take a snapshot of the image displayed on the first display area of the display 520, and can store the snapshot image in a memory (e.g., ...). Figure 5 In an embodiment, the snapshot image processing module 630 can select an image stored in the display controller 640 and can store the image in the memory (e.g., memory 540). Figure 5 In the memory (540).
[0110] In an embodiment, the snapshot image processing module 630 may process (e.g., scale, rotate, blur, or a combination thereof) the snapshot image based on the second display area of the display 520.
[0111] In one embodiment, the snapshot image processing module 630 can scale the snapshot image to correspond to the resolution of the second display area of the display 520. In another embodiment, when the resolution of the snapshot image is lower than the resolution of the second display area of the display 520, the snapshot image processing module 630 can enlarge the resolution of the snapshot image. In yet another embodiment, when the resolution of the snapshot image is higher than the resolution of the second display area of the display 520, the snapshot image processing module 630 can reduce the resolution of the snapshot image.
[0112] In one embodiment, the snapshot image processing module 630 can rotate the snapshot image to correspond to the aspect ratio of the second display area of the display 520. In another embodiment, the snapshot image processing module 630 can rotate the snapshot image so that its major and minor axes correspond to the major and minor axes of the second display area of the display 520. In yet another embodiment, the snapshot image processing module 630 can rotate the snapshot image according to changes in the state of the electronic device 501 to correspond to the rotation direction and / or rotation angle of the display 520.
[0113] In one embodiment, the snapshot image processing module 630 can blur (or smooth) scaled and / or rotated snapshot images.
[0114] In one embodiment, the display controller 640 may display a snapshot image processed based on the second display area of the display 520 on the second display area of the display 520. In another embodiment, the display controller 640 may display the snapshot image on the second display area of the display 520 until a new image is generated.
[0115] In one embodiment, application 650 may draw at least one layer based on the resolution of the second display area of display 520. Alternatively, application 650 may draw at least one layer based on the resolution of the second display area of display 520 using a drawing library (e.g., a view).
[0116] In one embodiment, window compositor 660 can generate a new image by combining the layers of application 650.
[0117] In one embodiment, the display controller 640 may display a new image from the window compositor 660 on a second display area of the display 520. In another embodiment, the display controller 640 may display an image on the second display area of the display 520 with a pre-specified image effect (e.g., blur) applied to the new image, and then display a new image on the second display area of the display 520 without the pre-specified image effect applied.
[0118] Figure 7 This illustrates an electronic device (e.g., according to embodiments of the present disclosure) Figure 1 A block diagram of the structure of the electronic device 101.
[0119] refer to Figure 7 Electronic devices (e.g.) Figure 1 The structure of the electronic device 101 may include a kernel, libraries, framework, and application layer. (See reference...) Figure 7 The hardware layer may include a sensor module 530, a display 520, or a combination thereof. (See reference...) Figure 7 The kernel layer may include a state management module 620, a snapshot image processing module 630, a display controller 640, or a combination of these modules. (See reference) Figure 7 The library layer may include a surface flipper 765. (See reference...) Figure 7 The frame layer may include a window manager 610, a view 761, or a combination thereof. (See reference) Figure 7 The application layer may include application 650. In one embodiment, some functions of the window compositer 660 may be implemented by the display controller 640. In another embodiment, some functions of the window compositer 660 may be implemented by the surface flipper 765.
[0120] In an embodiment, Figure 7 The display 520, sensor module 530, window manager 610, state management module 620, snapshot image processing module 630, application 650, and display controller 640 can respectively correspond to Figure 6 The display 520, sensor module 530, window manager 610, status management module 620, snapshot image processing module 630, application 650, and display controller 640.
[0121] In one embodiment, view 761 may be a program for drawing at least one layer based on the resolution of a second display area of display 520. In another embodiment, application 650 may draw at least one layer using view 761 based on the resolution of the second display area of display 520.
[0122] In one embodiment, the surface flipper 765 can synthesize multiple layers. In another embodiment, the surface flipper 765 can provide data indicative of the synthesized multiple layers to the display controller 640.
[0123] Figure 8 This illustrates an electronic device (e.g., according to embodiments of the present disclosure) Figure 1 Block diagram of the display controller 640 of the electronic device 101.
[0124] refer to Figure 8 Electronic devices (e.g.) Figure 1 The display controller 640 of the electronic device 101 may include at least one plane 821, 823, at least one scaler 831, 833, mixer 840, interface 850, write-back plane 825, or a combination thereof.
[0125] In an embodiment, at least one plane 821, 823 can read images recorded on graphics buffers 811, 813 corresponding to at least one plane 821, 823, respectively.
[0126] In an embodiment, at least one scaler 831, 833 may perform graphics processing (e.g., scaling) on image data read by at least one plane 821, 823.
[0127] In an embodiment, the mixer 840 can generate a final image by synthesizing image data that has been graphically processed by at least one scaler 831, 833.
[0128] In one embodiment, interface 850 can package the final image according to its protocol and send the packaged image to display 520. In another embodiment, the interface may include MIPI, HDMI, DP, or a combination thereof.
[0129] In one embodiment, the write-back plane 825 can select the final image recorded on the mixer 840 and can record the image on the write-back buffer 815 of the memory 540.
[0130] Figure 9 This is a flowchart illustrating the operation of an electronic device (e.g., electronic device 101) according to an embodiment of the present disclosure.
[0131] Reference Figure 9In operation 910, the processor of electronic device 101 (e.g., processor 510) can identify state changes of electronic device 101. In an embodiment, processor 510 can identify state changes of electronic device 501 based on sensor module 530. In an embodiment, processor 510 can identify a first state change from a folded state to an unfolded state of electronic device 501 based on sensor module 530. In an embodiment, processor 510 can identify a second state change from an unfolded state to a folded state of electronic device 501 based on sensor module 530.
[0132] In an embodiment, when a change in the state of electronic device 501 is detected, processor 510 may enable (e.g., turn on) a new display area of display 520 corresponding to the changed state of electronic device 501.
[0133] Reference Figure 9 In operation 920, the processor 510 can identify whether continuity has been set for the application. In an embodiment, when a change in the state of the electronic device 501 is detected, the processor 510 can identify the application being displayed on the first display area of the display 520 (e.g., Figure 1 The processor 510 can identify continuity information based on the first state change of the application being displayed on the first display area when a first state change is detected. In another embodiment, when a second state change is detected, the processor 510 can identify continuity information based on the second state change of the application being displayed on the first display area.
[0134] Reference Figure 9 The processor 510 can process the operations according to operation 930 and operation 940 in parallel.
[0135] Reference Figure 9 In operation 930, processor 510 can generate a new image. In an embodiment, when the continuity of an application being displayed on the first display area of display 520 is set, processor 510 can generate a new image indicating the execution result of the running application. In an embodiment, the image indicating the running application (e.g., Figure 1 The new image resulting from the execution of application 146) can correspond to the resolution of the second display area of display 520. In an embodiment, processor 510 can generate a new image by redrawing a layer on a specific application, a layer on the status bar, a launcher layer, a wallpaper layer, a layer on a notification, or a combination thereof.
[0136] refer to Figure 9In operation 940, the processor 510 can take a snapshot of the existing image. In an embodiment, when a change in the state of the electronic device 501 is detected, the processor 510 can take a snapshot of the existing image displayed on the first display area and store the snapshot image in the memory 540.
[0137] Reference Figure 9 In operation 950, processor 510 may display a snapshot image. In an embodiment, processor 510 may display the snapshot image on a second display area of display 520 until a new image is generated.
[0138] Reference Figure 9 In operation 960, processor 510 may display a new image. In an embodiment, when a new image is generated, processor 510 may display the new image on a second display area of display 520 instead of an existing image.
[0139] Figure 10 This illustrates a display electronic device (e.g., according to embodiments of the present disclosure) Figure 1 A flowchart of the operation of a snapshot image of an electronic device 101. Figure 10 The operation can be included in Figure 9 In operation.
[0140] In an embodiment, Figure 10 The operation can be performed in Figure 9 The operation is executed after 940. In the embodiment, Figure 10 The operation can be performed in Figure 9 The operation was executed before 960.
[0141] Reference Figure 10 During operation 945, the processor of electronic device 101 (e.g., processor 510) can perform image processing (e.g., scaling, rotation, blurring, or a combination thereof) on the snapshot image. In an embodiment, processor 510 can perform image processing (e.g., scaling, rotation, blurring, or a combination thereof) on the snapshot image based on the resolution of a second display area of display 520.
[0142] Reference Figure 10 During operation 950, processor 510 can display the image-processed snapshot image. In an embodiment, processor 510 can display the image-processed snapshot image on a second display area of display 520.
[0143] Figure 11 This illustrates a processing electronic device (e.g., according to embodiments of the present disclosure) Figure 1 A flowchart of the operation of the new image of the electronic device 101. Figure 11 The operation can be included in Figure 9 In operation.
[0144] In an embodiment, Figure 11 The operation can be performed in Figure 9 It is executed after operations 930 and 950. In the embodiment, Figure 11 The operation can be performed in Figure 9 The operation was executed before 960.
[0145] Reference Figure 11 In operation 951, the processor of electronic device 101 (e.g., processor 510) can perform image processing (e.g., blurring) on the new image.
[0146] Reference Figure 11 During operation 955, processor 510 can display the new image after image processing. In an embodiment, processor 510 can display the new image after image processing on a second display area of display 520 for a predetermined time.
[0147] Subsequently, in operation 960, the processor 510 can display a new image without applied image processing on the second display area of the display 520.
[0148] As described above, when the state of the display 520 changes between a folded state and an unfolded state, the electronic device 501 and its operating method can take a snapshot of the existing image and display the snapshot image on a new display area of the display 520, thereby reducing the user's latency experience.
[0149] As described above, according to an embodiment, the electronic device may include: a first display disposed on a first surface of the electronic device; a second display disposed on a second surface of the electronic device and having at least a portion that is not visible to a user depending on the folded state of the electronic device; a memory configured to store instructions; and a processor electrically connected to the first display, the second display, and the memory, and the processor may be configured to execute instructions to: detect a change in the folded state of the electronic device when a first image is displayed on one of the first or second displays; when a change in the folded state is detected, generate a second image to be displayed on the other of the first or second displays where the first image is not displayed; store a snapshot image of the first image in the memory while the second image is being generated; display the snapshot image on the other of the first or second displays; and, after the second image is generated, display the second image on the other of the first or second displays instead of the snapshot image.
[0150] In an embodiment, the processor may also be configured to execute instructions to: identify settings regarding the continuity of a running application when a change in folding state is detected; and, when settings regarding the continuity of a running application are identified, generate a second image to be displayed on another display in the first or second display.
[0151] In an embodiment, the processor may also be configured to execute instructions to display a pre-specified image on another of the first or second displays when no settings regarding the continuity of the running application are identified.
[0152] In an embodiment, the processor may also be configured to execute instructions to generate a second image to be displayed on another display of the first or second display when a setting regarding the continuity of the running application corresponding to a change in the folded state is identified.
[0153] In an embodiment, the processor may also be configured to execute instructions to perform image processing on the snapshot image and display the image-processed snapshot image on another display of the first or second display.
[0154] In an embodiment, image processing may be at least one of scaling, rotation, or blurring.
[0155] In an embodiment, the processor may also be configured to execute instructions to perform image processing on a second image and display the processed second image on a first display or another of the second displays for a preset time.
[0156] In an embodiment, the electronic device may further include a display controller to provide data indicating an image to be displayed on a first display, a second display, or a combination thereof, and the display controller may further include a write-back plane to store a snapshot image of the first image in memory by checking data temporarily stored in the display controller.
[0157] In an embodiment, the processor may also be configured to execute instructions to turn off one of the first or second displays and turn on the other of the first or second displays when a change in folding state is detected.
[0158] In this embodiment, the resolution of the first display and the resolution of the second display may be different from each other.
[0159] As described above, according to an embodiment, the electronic device may include: a display, wherein the area facing the user changes according to the folded state of the electronic device; a memory configured to store instructions; and a processor electrically connected to the display and the memory. The processor may be configured to execute instructions to: detect a change in the folded state of the electronic device while displaying a first image on a first area of the display; when a change in the folded state is detected, identify a second area of the display corresponding to the changed folded state; generate a second image displayed on the identified second area; while the second image is being generated, store a snapshot image of the first image in the memory and display the snapshot image on the identified second area of the display; and, after the second image is generated, display the second image on the identified second area of the display instead of the snapshot image.
[0160] In an embodiment, the processor may also be configured to execute instructions to: identify settings regarding the continuity of a running application when a change in folding state is detected, and, when settings regarding the continuity of a running application are identified, generate a second image to be displayed on the identified second region.
[0161] In an embodiment, the processor may also be configured to execute instructions to display a pre-specified screen on the identified second area when no settings regarding the continuity of the running application are identified.
[0162] In an embodiment, the processor may also be configured to execute instructions to generate a second image to be displayed on the identified second region when a setting relating to the continuity of a running application corresponding to a change in folded state is identified.
[0163] In an embodiment, the processor may also be configured to execute instructions to perform image processing on the snapshot image and display the image-processed snapshot image on the identified second region.
[0164] In an embodiment, image processing may be at least one of scaling, rotation, or blurring.
[0165] In one embodiment, the processor may be configured to execute instructions to perform image processing on a second image and display the processed second image on the identified second region for a preset time.
[0166] In an embodiment, the electronic device may further include a display controller configured to provide data indicating an image to be displayed on the display, and the display controller may further include a write-back plane configured to store a snapshot image of the first image in memory by checking data temporarily stored in the display controller.
[0167] In an embodiment, the processor may also be configured to execute instructions to open a second region in the area of the display when a change in folding state is detected.
[0168] In this embodiment, the resolution of the first region and the resolution of the second region may be different from each other.
[0169] The methods based on the claims or embodiments disclosed in this disclosure can be implemented in hardware, software, or a combination of both.
[0170] When implemented in software, a non-transitory computer-readable storage medium may be provided for storing one or more programs (software modules). One or more programs stored in the computer-readable storage medium are configured to be executed by one or more processors in an electronic device. One or more programs include instructions for allowing the electronic device to perform methods based on the claims or embodiments disclosed in this disclosure.
[0171] The program (software module or software) can be stored in random access memory, including non-volatile memory such as flash memory, read-only memory (ROM), electrically erasable programmable read-only memory (EEPROM), magnetic disk storage devices, optical disc ROM (CD-ROM), digital versatile disc (DVD), or other forms of optical storage devices, as well as magnetic tape. Optionally, the program can be stored in a memory configured to combine all or some of these storage media. Furthermore, there can be multiple configured memories.
[0172] Furthermore, the program can be stored in an attachable storage device that can be accessed via a communication network such as the Internet, intranet, local area network (LAN), wide area network (WLAN), or storage area network (SAN), or a communication network configured by combining these networks. The storage device can access the apparatus executing embodiments of this disclosure via an external port. Additionally, an additional storage device on the communication network can access the apparatus executing embodiments of this disclosure.
[0173] In the specific embodiments described above, the elements included in this disclosure are represented in singular or plural form according to the specific embodiments. However, for ease of explanation, the singular or plural form may be appropriately selected as suggested, and this disclosure is not limited to a single element or multiple elements. Elements expressed in plural form may be configured in singular form, or elements expressed in singular form may be configured in plural form.
[0174] Although this disclosure has been shown and described with reference to various embodiments thereof, those skilled in the art will understand that various changes in form and detail may be made therein without departing from the spirit and scope of this disclosure as defined by the appended claims or their equivalents.
Claims
1. An electronic device, the electronic device comprising: The housing includes a first housing and a second housing; A hinge unit rotatably connects the first housing and the second housing; A first display is disposed on a first side of the first housing and a second side of the second housing; The second display is disposed on the second side of the first housing, which is located opposite to the first side; At least one sensor; processor; as well as The memory stores instructions that, when executed by the processor, cause the electronic device to: When the first image is displayed on one of the first or second displays, the change in the folding angle of the electronic device is detected via the at least one sensor. Upon detecting a change in the folding angle, a snapshot of the first image is displayed on the other of the first and second displays, and a second image corresponding to the resolution of the first image and the other of the first and second displays is generated. After the second image is generated, the second image is displayed on the first display or another display of the second display, instead of the snapshot image.
2. The electronic device according to claim 1, wherein, When the instruction is executed by the processor, it also causes the electronic device to: Upon detecting a change in the folding angle, identify settings related to the continuity of the running application; as well as Upon identifying the settings regarding the continuity of the running application, the second image is generated to be displayed on the first display or the other of the second displays.
3. The electronic device according to claim 2, wherein, When executed by the processor, the instructions also cause the electronic device to display a pre-specified image on another of the first or second displays when no settings regarding the continuity of the running application are recognized.
4. The electronic device according to claim 2, wherein, When executed by the processor, the instructions also cause the electronic device to generate the second image to be displayed on the first display or the other of the second displays, upon recognizing the settings regarding the continuity of the running application corresponding to the change in the folding angle.
5. The electronic device according to claim 1, wherein, When the instruction is executed by the processor, it also causes the electronic device to perform image processing on the snapshot image and display the image-processed snapshot image on the first display or the other of the second display.
6. The electronic device according to claim 1, wherein, When the instruction is executed by the processor, it also causes the electronic device to perform image processing on the second image and display the image-processed second image on the first display or another display of the second display for a preset time.
7. The electronic device of claim 1, further comprising a display controller configured to provide data indicating an image to be displayed on the first display, the second display, or a combination of the first and second displays. in, The display controller includes a write-back plane configured to store the snapshot image of the first image in the memory by selecting data temporarily stored in the display controller.
8. The electronic device according to claim 1, wherein, When the instruction is executed by the processor, it also causes the electronic device to turn off one of the first display or the second display and turn on the other of the first display or the second display when it detects a change in the folding angle.
9. An electronic device, the electronic device comprising: The housing includes a first housing and a second housing; A hinge unit rotatably connects the first housing and the second housing; A display in which the area facing the user varies depending on the folding angle of the electronic device; At least one sensor; processor; as well as The memory stores instructions that, when executed by the processor, cause the electronic device to: When a first image is displayed on a first area of the display, the change in the folding angle of the electronic device is detected via the at least one sensor; When a change in the folding angle is detected, a snapshot of the first image is displayed on a second region of the display corresponding to the changed folding angle, and a second image corresponding to the resolution of the first image and the second region is generated. as well as After the second image is generated, the second image is displayed on the second area of the display instead of the snapshot image.
10. The electronic device according to claim 9, wherein, When executed by the processor, the instructions also cause the electronic device to identify settings regarding the continuity of the running application when a change in the folding angle is detected, and to generate the second image to be displayed on the second area when the settings regarding the continuity of the running application are identified.
11. The electronic device according to claim 10, wherein, When executed by the processor, the instruction also causes the electronic device to display a pre-specified screen on the second area when no settings regarding the continuity of the running application are recognized.
12. The electronic device according to claim 10, wherein, When executed by the processor, the instructions also cause the electronic device to generate the second image to be displayed on the second region when it recognizes the settings regarding the continuity of the running application corresponding to the change in the folding angle.
13. The electronic device according to claim 9, wherein, When the instruction is executed by the processor, it also causes the electronic device to: Perform image processing on the snapshot image; and Display the processed snapshot image in the second region, and The image processing described herein includes at least one of scaling, rotation, or blurring.
14. The electronic device according to claim 9, wherein, When the instruction is executed by the processor, it also causes the electronic device to: Perform image processing on the second image; and The processed second image is displayed in the second area for a preset time.
15. The electronic device according to claim 9, further comprising: A display controller, configured to provide data indicating an image to be displayed on the display. The display controller includes a write-back plane configured to store the snapshot image of the first image in the memory by selecting data temporarily stored in the display controller.
Citation Information
Patent Citations
Low Latency Screen Mirroring
CN107660280A
Display adjusting method of foldable display screen and display device
CN108196807A
Foldable device and method of controlling the same
US20150338888A1