Electronic device and display control method thereof

Abstract

A mobile communication device is provided. The mobile communication device includes: a first touch display forming a part of a first surface of the mobile communication device; a second touch display forming a part of a second surface of the mobile communication device; and a processor, and a controller configured to display a first screen corresponding to an application running in a first folded state in the first touch display while the state of the device is the first folded state, identify that the state of the mobile communication device is changed to a second folded state, and displaying a second screen corresponding to the application and an image partially overlapping the second screen in a second touch display based on the recognition, a touch input on the second touch display being configured not to be processed as an input while the second screen and the image are displayed as overlapping in the second touch display.

Description

[0001] This case is a divisional application of the invention patent application with the application date of February 19, 2020, application number 202010101721.7, and invention name "Electronic device and display control method thereof". Technical Field

[0002] The present disclosure relates to electronic devices. More particularly, the present disclosure relates to electronic devices including one or more displays. Background Art

[0003] With the development of relevant technologies, electronic devices such as smart phones have evolved to provide users with various necessary functions or optional functions. In order to allow users to easily access these functions, electronic devices include touch-sensitive displays such as touch screens and can provide screens of various applications through the display.

[0004] Recently, in order to increase portability, flexible displays and fully foldable displays as a more improved form have been developed. An electronic device with such a foldable display can utilize a large display size in an unfolded state, and can also reduce its overall volume in a folded state. Therefore, both usability and portability can be increased. Alternatively, the electronic device may include a plurality of displays separated from each other.

[0005] In the case where the electronic device includes a foldable display or multiple separate displays, the user takes an action of folding or unfolding the electronic device while directly holding the housing of the electronic device. During this action, the user may often touch a part of the display. Because the display and its touch sensor are in an activated state, the touch sensor can detect the user's unintentional touch on the display, thereby causing any operation of the application.

[0006] The above information is provided as background information only to assist in understanding the present disclosure. No determination has been made, and no assertion has been made, as to whether any of the above content is applicable as prior art with respect to the present disclosure. Summary of the invention

[0007] Aspects of the present disclosure will solve at least the above-mentioned problems and / or disadvantages and will provide at least the advantages described below. Therefore, one aspect of the present disclosure is to provide an electronic device and a control method thereof, the control method being used to process a touch event caused by a touch input generated during a folding action or an unfolding action to adapt to a user's intention.

[0008] Another aspect of the present disclosure is to provide an electronic device and a control method thereof for appropriately configuring an application screen according to state information of the application during a folding action or an unfolding action.

[0009] Additional aspects will be set forth in part in the description which follows and, in part, will be obvious from the description, or may be learned by practice of the presented embodiments.

[0010] A mobile communication device may include: a first touch display, forming at least a portion of a first surface of the mobile communication device; a second touch display, forming at least a portion of a second surface of the mobile communication device; and a processor, configured to display a first screen corresponding to an application running in the first folded state in the first touch display while the state of the mobile communication device is in the first folded state, identify that the state of the mobile communication device has changed to the second folded state, and based on the identification, display a second screen corresponding to the application and an image that at least partially overlaps the second screen in the second touch display, wherein touch input input on the second touch display while the second screen and the image are displayed as overlapping in the second touch display is configured not to be processed as input on at least the portion of the second screen.

[0011] Other aspects, advantages, and salient features of the disclosure will become apparent to those skilled in the art from the following detailed description, which, taken in conjunction with the annexed drawings, discloses various embodiments of the disclosure. BRIEF DESCRIPTION OF THE DRAWINGS

[0012] The above and other aspects, features and advantages of certain embodiments of the present disclosure will become more apparent from the following detailed description taken in conjunction with the accompanying drawings, in which:

[0013] Figure 1A is a block diagram of an electronic device in a network environment according to an embodiment of the present disclosure;

[0014] Figure 1B is a block diagram showing an electronic device according to an embodiment of the present disclosure;

[0015] Figure 2A and Figure 2B are views showing an unfolded state and a folded state of an electronic device according to various embodiments of the present disclosure;

[0016] Figure 3 is an exploded perspective view showing an electronic device according to an embodiment of the present disclosure;

[0017] Figure 4A , Figure 4B , Figure 4C , Figure 4D , Figure 4E and Figure 4F is a perspective view showing a use state of an electronic device in a folding operation or an unfolding operation according to various embodiments of the present disclosure;

[0018] Figure 5is a block diagram showing an electronic device according to an embodiment of the present disclosure;

[0019] Figure 6 is a block diagram showing a configuration related to a display of an electronic device according to an embodiment of the present disclosure;

[0020] Figure 7 is a block diagram illustrating a software layer of an electronic device according to an embodiment of the present disclosure.

[0021] Figure 8 is a block diagram showing a drawing engine of an electronic device according to an embodiment of the present disclosure;

[0022] Fig. 9 is a diagram illustrating a method of processing a touch event detected in a folding operation at an electronic device according to an embodiment of the present disclosure;

[0023] Fig. 10A , Fig. 10B , Fig. 10C , Fig. 10D , Fig.10E and Fig.10F are screenshots showing a touch lock screen displayed on an electronic device according to various embodiments of the present disclosure;

[0024] Fig.11A , Fig. 11B , Fig. 11C , Fig.11D and Fig.11E are screenshots showing a screen displayed on each display of an electronic device in a folding operation according to various embodiments of the present disclosure;

[0025] Fig. 12A , Fig. 12B , Fig. 12C and Fig.12D are screenshots showing a screen displayed on each display of an electronic device in a folding operation according to various embodiments of the present disclosure;

[0026] Fig.13A , Fig. 13B , Fig. 13C and Fig.13D are screenshots showing a screen displayed on each display of an electronic device in a folding operation according to various embodiments of the present disclosure;

[0027] Fig.14 is a screenshot showing a screen displayed on each display of an electronic device in an expansion operation according to an embodiment of the present disclosure;

[0028] Fig.15is a screenshot showing a screen displayed on each display of an electronic device in an expansion operation according to an embodiment of the present disclosure;

[0029] Fig.16 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure;

[0030] Fig.17 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure;

[0031] Fig.18 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure;

[0032] Fig.19A , Fig.19B and Fig.19C is a perspective view showing a use state of a vertical folding type electronic device in a folding operation or an unfolding operation according to various embodiments of the present disclosure;

[0033] Fig. 20A , Fig. 20B and Fig. 20C are screenshots showing a screen displayed on each display of an electronic device in a folding operation according to various embodiments of the present disclosure;

[0034] Fig.21A , Fig.21B and Fig. 21C is a perspective view showing a use state of an external foldable electronic device in a folding operation or an unfolding operation according to various embodiments of the present disclosure;

[0035] Fig. 22 is a block diagram showing an electronic device according to an embodiment of the present disclosure;

[0036] Fig.23 is a block diagram showing a drawing engine of an electronic device according to an embodiment of the present disclosure;

[0037] Fig.24A and Fig. 24B is a block diagram illustrating a drawing engine of an electronic device according to various embodiments of the present disclosure;

[0038] Fig.25A , Fig.25B , Fig.25C and Fig.25D are screenshots showing a screen displayed on a display of an electronic device in an out-folding operation according to various embodiments of the present disclosure;

[0039] Fig.26is a diagram illustrating a method of processing a touch event detected in a folding operation at an electronic device according to an embodiment of the present disclosure;

[0040] Fig. 27 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure;

[0041] Fig.28 is a perspective view showing an electronic device in which a portion of a housing structure is rotatable 360 ​​degrees according to an embodiment of the present disclosure;

[0042] Fig.29A and Fig.29B is a perspective view showing an electronic device having a plurality of displays on one surface of a housing according to various embodiments of the present disclosure;

[0043] Fig.30 is a block diagram showing an electronic device according to an embodiment of the present disclosure;

[0044] Fig.31A and Fig.31B is a view showing a G-shaped foldable electronic device according to various embodiments of the present disclosure;

[0045] Fig.32A , Fig.32B and Fig.32C is a view showing an S-shaped foldable electronic device according to various embodiments of the present disclosure;

[0046] Fig.33A and Fig.33B is a view showing an electronic device having a rollable display according to various embodiments of the present disclosure; and

[0047] Fig.34 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.

[0048] The same reference numerals are used throughout the drawings to denote the same elements. DETAILED DESCRIPTION

[0049] The following description with reference to the accompanying drawings is provided to assist in a comprehensive understanding of the various embodiments of the present disclosure as defined by the claims and their equivalents. It includes various specific details to assist in this understanding, but these specific details are to be considered as merely exemplary. Therefore, it will be appreciated by those of ordinary skill in the art that various changes and modifications to the various embodiments described herein may be made without departing from the scope and spirit of the present disclosure. In addition, descriptions of well-known functions and configurations may be omitted for clarity and brevity.

[0050] The terms and words used in the following description and claims are not limited to the bibliographical meanings, but are merely used by the inventor to enable a clear and consistent understanding of the present disclosure. Therefore, it should be apparent to those skilled in the art that the following description of various embodiments of the present disclosure is provided for illustrative purposes only and not for the purpose of limiting the present disclosure as defined by the appended claims and their equivalents.

[0051] It will be understood that the singular forms "a," "an," and "the" include plural referents unless the context clearly dictates otherwise. Thus, for example, reference to "a component surface" includes reference to one or more of such surfaces.

[0052] Figure 1A is a block diagram illustrating an electronic device in a network environment according to an embodiment of the present disclosure.

[0053] Reference Figure 1A , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to one embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to one embodiment, the electronic device 101 may include a processor 120, a memory 130, an input device 150, a sound output device 155, a display device 160, an audio module 170, a sensor module 176, an interface 177, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the display device 160 or the camera module 180) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components may be implemented as a single integrated circuit.For example, the sensor module 176 (eg, a fingerprint sensor, an iris sensor, or an illumination sensor) may be implemented to be embedded in the display device 160 (eg, a display).

[0054] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may load a command or data received from another component (e.g., sensor module 176 or communication module 190) into the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to one embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is independent of or combined with the main processor 121 in operation. Additionally or alternatively, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a specified function. The auxiliary processor 123 may be implemented separately from the main processor 121 , or as part of the main processor 121 .

[0055] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 (not the main processor 121), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component (e.g., display device 160, sensor module 176, or communication module 190) among the components of the electronic device 101 together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., image signal processor or communication processor) may be implemented as part of another component (e.g., camera module 180 or communication module 190) that is functionally related to the auxiliary processor 123.

[0056] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

[0057] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0058] The input device 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, or a digital pen (e.g., a stylus).

[0059] The sound output device 155 can output a sound signal to the outside of the electronic device 101. The sound output device 155 may include, for example, a speaker or a receiver. The speaker may be used for general purposes such as playing multimedia or playing records, and the receiver may be used for incoming calls. According to one embodiment, the receiver may be implemented as a separate part from the speaker, or as part of the speaker.

[0060] The display device 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display device 160 may include a touch circuit adapted to detect a touch or a sensor circuit (e.g., a pressure sensor) adapted to measure the strength of a force caused by a touch.

[0061] The audio module 170 may convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module 170 may obtain sound via the input device 150, or output sound via the sound output device 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0062] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a user's state) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0063] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to one embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0064] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to one embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0065] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user through his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0066] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0067] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0068] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0069] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0070] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to one embodiment, the antenna module 197 may include an antenna including a radiating element composed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a PCB). According to one embodiment, the antenna module 197 may include a plurality of antennas. In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to one embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module 197.

[0071] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0072] According to one embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 and the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to one embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices that receive the request may execute the requested at least part of the function or service, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request with or without further processing the result. To this end, for example, cloud computing technology, distributed computing technology, or client-server computing technology may be used.

[0073] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0074] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or replacement forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include all possible combinations of items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., the second element)”, “combined to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” when the terms “operably” or “communicatively” are used or when the terms “operably” or “communicatively” are not used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0075] As used herein, the term "module" may include units implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to one embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0076] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in a storage medium and data being temporarily stored in a storage medium.

[0077] According to one embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded through an application store (e.g., PlayStore). TM ) The computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).

[0078] According to various embodiments, each of the above-mentioned components (e.g., module or program) may include a single entity or multiple entities. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as a corresponding component in the multiple components before integration. According to various embodiments, the operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

[0079] Figure 1B is a block diagram illustrating an electronic device according to an embodiment of the present disclosure.

[0080] Reference Figure 1B , the electronic device 101 according to various embodiments may include at least one display 160, a processor 120, and a memory 130. Some of such components of the electronic device 101 may be omitted or replaced.

[0081] According to various embodiments, components of the electronic device 101 are disposed in a housing of the electronic device 101 , and at least one display 160 is visible from outside the housing.

[0082] According to various embodiments, the housing may be folded by a hinge structure. In the region of the housing separated by folding, each display 160 or each region of the display 160 may be provided.

[0083] According to various embodiments, the electronic device 101 may include one or more displays 160 , at least one of which may include a touch sensor.

[0084] According to various embodiments, the electronic device 101 may be configured with various form factors. For example, the electronic device 101 may have an inner-foldable foldable display structure, an outer-foldable foldable display structure, a dual display structure, a G-folding structure, an S-folding structure, or a rollable display structure.

[0085] In an inner-folding foldable display structure, the electronic device includes a foldable display having a first area and a second area that are separated from each other and face each other based on a folding axis when the electronic device is folded. Therefore, when the folding is completed, most (or all) of the display may not be exposed to the user. In an inner-folding foldable display structure, the foldable display may be disposed on a first surface of the housing, and a non-foldable display may be disposed on a second surface of the housing. Therefore, in a folded state, the foldable display may not be visible from the outside, and the non-foldable display may be visible from the outside. According to some embodiments, an electronic device having an inner-folding foldable display structure may include only a foldable display on the first surface, and may not include a separate display on the second surface.

[0086] The inward foldable display structure will refer to Figures 2A to 4F Describe in detail.

[0087] In an external folding foldable display structure, the electronic device includes a foldable display having a first area and a second area that are separated from each other based on a folding axis and are respectively arranged on opposite sides to be seen from the outside when the electronic device is folded. In the folded state, the user can see the screen through the first area or the second area. Also in the external folding foldable display structure, the foldable display may be arranged on the first surface of the housing, and a separate display may or may not be arranged on the second surface.

[0088] The external folding display structure will refer to FIG. 21A to FIG. 21C Describe in detail.

[0089] In a dual display structure, the electronic device includes two displays that are physically separated from each other on one surface of a housing. For example, the housing of the electronic device may include a first housing structure and a second housing structure that are foldable to each other, and the first display and the second display may be respectively arranged in the first housing structure and the second housing structure. Each of the first housing structure and the second housing structure may be folded in an inner folding manner or an outer folding manner. When folded, the first display and the second display may face each other in the case of an inner folding, and may be seen through opposite sides in the case of an outer folding. In addition, the electronic device with a dual display structure may also include a separate display on another surface of the housing opposite to a surface on which the first display and the second display are arranged.

[0090] The dual display configuration will refer to Fig.29A and Fig.29B Describe in detail.

[0091] The G-type folding structure is one of the structures that can be folded based on two folding axes. The electronic device of the G-type folding structure may include a display that can be folded into three layers based on two folding axes on one surface of the housing. The display may be divided into a first area, a second area, and a third area based on the two folding axes. When the electronic device is folded, the first area may face the second area, and the third area may face the opposite side of the first area. Therefore, in the folded state, the display cannot be seen from the outside.

[0092] The G-type folding structure will refer to Fig.31A and Fig.31B Describe in detail.

[0093] The S-type folding structure is a structure that can be folded based on two folding axes like the G-type folding structure, but unlike the G-type folding structure, a portion of the display can be seen from the outside in the folded state.

[0094] The electronic device of the S-shaped folding structure includes a first shell structure, a second shell structure and a third shell structure distinguished based on two folding axes. The foldable first display can be set on one surface of the first shell structure and the second shell structure, and the non-foldable second display can be set on one surface of the third shell structure. In the unfolded state of the electronic device, the surface on which the second display is set can be opposite to the surface on which the first display is set. When the electronic device is folded, the first area and the second area of ​​the first display divided based on one folding axis can face each other, and the second display can be seen from the outside.

[0095] The S-shaped folding structure will refer to FIG. 32A to FIG. 32C Describe in detail.

[0096] A rollable display structure refers to a structure in which an electronic device can be rolled up.

[0097] The rollable display structure will refer to Fig.33A and Fig.33B Describe in detail.

[0098] The electronic device according to various embodiments may have a transverse folding structure (or horizontal folding structure) or a longitudinal folding structure (or vertical folding structure). The transverse folding structure refers to a structure capable of folding a foldable display in a left-right direction based on a vertically extending folding axis, and the longitudinal folding structure refers to a structure capable of folding a foldable display in an up-down direction based on a horizontally extending folding axis.

[0099] In the present disclosure, the description will focus on the horizontal folding structure. However, various embodiments regarding the inner folding foldable display structure, the outer folding foldable display structure, the dual display structure, etc. can also be implemented as a vertical folding structure. The vertical (i.e., vertical) folding structure will be described, for example, with reference to FIG. 19A to FIG. 19C Give a description.

[0100] According to various embodiments, the memory 130 may include volatile memory and non-volatile memory as known in the art and not limited to a particular implementation. The memory 130 may include Figure 1A At least some of the configuration and / or functions of the memory 130 shown. In addition, the memory 130 may store Figure 1A At least a portion of the procedure 140 shown.

[0101] The memory 130 may store various instructions executable by the processor 120. These instructions may include various control commands recognizable by the processor 120 in combination with arithmetic and logical operations, data transmission, input / output, and the like.

[0102] According to various embodiments, the processor 120 is configured to perform operations or data processing related to control and / or communication of components of the electronic device 101, and may include Figure 1A At least some of the configurations and / or functions of the processor 120 are shown. The processor 120 may be functionally connected, operatively connected, and / or electrically connected to internal components of the electronic device 101 including at least one display 160 and a memory 130 .

[0103] The operations and data processing functions that can be implemented by the processor 120 in the electronic device 101 are not limited. However, in the present disclosure, the description will focus on the operation of processing touch events and the operation of seamlessly displaying the application screen when a folding gesture or an unfolding gesture occurs. The operations of the processor 120 described below can be performed by loading instructions stored in the memory 130.

[0104] According to various embodiments, while the electronic device 101 is in the unfolded state, the processor 120 may display a screen of an application on at least one display 160. For example, when the electronic device 101 includes a foldable display (e.g., an inner-folding foldable display or an outer-folding foldable display), the processor 120 may display an application screen on the foldable display that is in the folded state. When the electronic device 101 includes a dual display, the processor 120 may display an application screen on a portion of the dual display, or divide the screen and display the divided portions through the first display and the second display, respectively.

[0105] According to various embodiments, when the electronic device 101 is in an unfolded state, the processor 120 may detect a folding gesture. A folding gesture may refer to an action in which a user folds a portion of the electronic device 101 based on a folding axis by applying force to the electronic device 101 that is in an unfolded state. For example, when the electronic device 101 has an inner foldable foldable display structure consisting of a first shell structure and a second shell structure, the user may fold the electronic device inward while holding the front and rear sides of the first shell structure with his right hand and also holding the front and rear sides of the second shell structure with his left hand. The electronic device 101 may include a sensor (not shown) for sensing the folding of the electronic device 101. The sensor may detect a folding gesture by the rotation angle of the portion of the shell on the folding axis.

[0106] According to various embodiments, the processor 120 may determine the folding state based on the angle formed by the folding axis. For example, when the angle formed by the first region and the second region separated based on the folding axis is close to the fully folded angle (e.g., 0° or 10°), the processor determines that the device is in the folded state (or the first folded state). If the angle is close to the fully unfolded angle (e.g., 170° or 180°), the processor determines that the device is in the unfolded state (or the second folded state).

[0107] According to various embodiments, when the folding gesture starts, the processor 120 may stop sending touch events to each display 160. This is because the touch on the display 160 during the folding gesture is not the user's intention. In some embodiments, when the folding gesture starts, the processor 120 may ignore the received touch events instead of requesting the touch sensor to stop sending touch events. That is, even if a touch event is received, it may not be provided to the application.

[0108] According to various embodiments, the processor 120 may cancel a touch event (e.g., a press event or a release event) provided to the application before the folding gesture begins. For example, the processor 120 may cancel the application execution that is to be implemented in response to the touch event, or cancel the application execution that has been implemented in response to the touch event.

[0109] According to various embodiments, when the folding gesture begins, the processor 120 may provide the application with a cancel event corresponding to the previously provided touch event. For example, even if a press event actually occurs during the folding gesture, it is not the user's intention. Therefore, even if a press event is received from the touch sensor, the processor 120 may provide the cancel event to the application. This prevents the application from being erroneously operated by recognizing the touch for folding as a touch event.

[0110] According to various embodiments, when the electronic device 101 is folded, the processor 120 may change the area of ​​the display 160 to display an application. For example, when the electronic device 101 has an inner-folding foldable display structure, both a foldable first display disposed on one housing surface and a non-foldable second display disposed on another housing surface may be used to display an application screen. When the electronic device has an outer-folding foldable display structure, the application screen may be displayed on any one of the first and second areas separated based on the folding axis of the foldable display. In the case where the user cannot see most of the display among the various form factors described above (for example, in the case where there is no rear display in an inner-folding foldable display structure or in a dual display structure), when the electronic device is folded, the application is no longer displayed and the application may be run in the background.

[0111] According to various embodiments, as the area in which the application is displayed is changed, the processor 120 may generate an application screen based on the attributes of the changed area (e.g., size, ratio, resolution, etc.). The processor 120 may provide a folding event to the application, and also provide the application with attribute information of the area in which the application will be displayed after folding.

[0112] For example, in the case where the electronic device 101 has an inner-folding foldable display structure, the processor 120 can generate an application screen based on the properties of the second display (e.g., size, ratio, resolution) when folded. In the case where the electronic device has an outer-folding foldable display structure, the processor 120 can generate an application screen based on the properties of an area selected from the first area and the second area (e.g., being placed in the user's gaze direction) when folded.

[0113] According to various embodiments, the processor 120 may determine whether the execution screen of the application is resizable.

[0114] When the application displayed on the display 160 in the unfolded state is a resizable application (eg, an Internet browser), and when a folding gesture is detected, the processor 120 may adjust the screen size of the application based on the properties of the changed display area.

[0115] When an application displayed on the display 160 in the expanded state is a non-resizable application (e.g., a game application), and when a folding gesture is detected, the processor 120 may output a menu for selecting restart (i.e., rerun) or continuation (i.e., continue running) of the application.

[0116] According to various embodiments, the processor 120 may generate a touch lock screen in response to the folding gesture, and display the touch lock screen in the area where the application screen is displayed after folding. The touch lock screen may be determined based on the state information of the running application (e.g., security level and / or whether the size can be adjusted).

[0117] According to various embodiments, the processor 120 may display a touch lock screen on the upper layer of the screen to be displayed on the changed area when folded. The processor 120 may display the touch lock screen in the foreground to cover the screen of the top application in the z order, thereby preventing unintentional touch events from being sent to the application.

[0118] According to various embodiments, after displaying the touch lock screen, the processor 120 may process a touch event received from a touch sensor of the display 160 on which the application execution screen is displayed. After displaying the touch lock screen, the processor 120 may release the touch lock screen in response to the touch event received from the display 160 and provide the touch event to the running application.

[0119] According to various embodiments, the processor 120 may operate in a non-secure mode, a weak security mode, or a strong security mode, depending on the security level assigned to the application. When folded, the processor 120 may generate and display a touch lock screen corresponding to the security level of the running application. Alternatively, based on the attributes of the folding gesture, the processor 120 may determine the security level or the operating mode.

[0120] Figure 2A is a view showing an unfolded state of an electronic device according to an embodiment of the present disclosure.

[0121] According to various embodiments, the electronic device may include a first display and a second display separated from each other. The first display may be foldable, and the second display may be non-foldable.

[0122] Reference Figure 2A , the electronic device 200 may include a hinge structure (eg, Figure 3 The electronic device 200 includes a pair of housing structures 210 and 220 rotatably coupled to each other (a hinge structure 264 in the housing structure 210 and the housing structure 220), a hinge cover 265 covering the foldable portion of the pair of housing structures 210 and 220, and a first display 230 (e.g., a flexible display or a foldable display) disposed in a space formed by the pair of housing structures 210 and 220. In the present disclosure, a surface on which the display 230 is disposed is defined as a front surface (or first surface) of the electronic device 200, and a surface opposite to the front surface is defined as a rear surface (or second surface) of the electronic device 200. In addition, a surface surrounding the space between the front surface and the rear surface is defined as a side surface of the electronic device 200.

[0123] In one embodiment, the pair of housing structures 210 and 220 may include a first housing structure 210 having a sensor region 231d, a second housing structure 220, a first rear cover 240, and a second rear cover 250. The pair of housing structures 210 and 220 of the electronic device 200 are not limited to Figure 2A and Figure 2B The shapes and configurations shown in the drawings may be implemented with any other shapes and configurations. For example, in another embodiment, the first housing structure 210 and the first rear cover 240 may be integrally formed, and the second housing structure 220 and the second rear cover 250 may also be integrally formed.

[0124] In one embodiment, the first housing structure 210 and the second housing structure 220 are arranged on both sides relative to the folding axis (indicated by "A"), and may have a generally symmetrical shape relative to the folding axis (A). As will be described later, depending on whether the electronic device 200 is in an unfolded state (also referred to as a flat state or an open state), a folded state (also referred to as a closed state) or an intermediate state, the first housing structure 210 and the second housing structure 220 may have different angles or distances therebetween. In the illustrated embodiment, in contrast to the second housing structure 220, the first housing structure 210 has a sensor area 231d in which various sensors are arranged. In addition, the two housing structures may be symmetrical in shape. In another embodiment, the sensor area 231d may be optionally or additionally arranged in the second housing structure 220.

[0125] In one embodiment, the first housing structure 210 is connected to a hinge structure (eg, Figure 3 The hinge structure 264 in the electronic device 200 may include a first surface 211 corresponding to a portion of the front surface of the electronic device 200 and facing a first direction, a second surface 212 corresponding to a portion of the rear surface of the electronic device 200 and facing a second direction opposite to the first direction, and a first side member 213 partially surrounding a space between the first surface 211 and the second surface 212. In one embodiment, the first side member 213 may include a first side surface 213a arranged parallel to the folding axis (A), a second side surface 213b extending from one end of the first side surface 213a perpendicular to the folding axis (A), and a third side surface 213c extending from the other end of the first side surface 213a perpendicular to the folding axis (A).

[0126] In one embodiment, the second housing structure 220 is connected to a hinge structure (eg, Figure 3The second side member 213 may include a hinge structure 264 in the electronic device 200, and may include a third surface 221 corresponding to a portion of the front surface of the electronic device 200 and facing a third direction, a fourth surface 222 corresponding to a portion of the rear surface of the electronic device 200 and facing a fourth direction opposite to the third direction, and a second side member 223 partially surrounding a space between the third surface 221 and the fourth surface 222. In one embodiment, the second side member 213 may include a fourth side surface 223a arranged parallel to the folding axis (A), a fifth side surface 223b extending from one end of the fourth side surface 223a perpendicular to the folding axis (A), and a sixth side surface 223c extending from the other end of the fourth side surface 223a perpendicular to the folding axis (A). In the folded state, the first surface 211 and the third surface 221 may face each other.

[0127] In one embodiment, the electronic device 200 may include a recess 201 formed by coupling the structural shapes of the first housing structure 210 and the second housing structure 220 to accommodate the display 230 therein. The recess 201 may have substantially the same size as the display 230. In one embodiment, due to the sensor area 231d, the recess 201 may have two or more different widths in a direction perpendicular to the folding axis (A). For example, the recess 201 may have a first width (w1) between a first portion 220a of the second housing structure 220 parallel to the folding axis (A) and a first portion 210a of the first housing structure 210 formed at one edge of the sensor area 231d, and a second width (w2) between a second portion 220b of the second housing structure 220 parallel to the folding axis (A) and a second portion 210b of the first housing structure 210 not corresponding to the sensor area 231d and parallel to the folding axis (A). In this case, the second width (w2) may be greater than the first width (w1). That is, the first portion 210a of the first shell structure 210 and the first portion 220a of the second shell structure 220 having an asymmetric shape form a first width (w1) of the recess 201, while the second portion 210b of the first shell structure 210 and the second portion 220b of the second shell structure 220 having a symmetric shape form a second width (w2) of the recess 201. In one embodiment, the first portion 210a and the second portion 210b of the first shell structure 210 may have different distances from the folding axis (A). The width of the recess 201 is not limited to the example shown. In various embodiments, depending on the shape of the sensor area 231d or the asymmetric shape of the first shell structure 210 and the second shell structure 220, the recess 201 may have two or more different widths.

[0128] In one embodiment, at least a portion of the first housing structure 210 and the second housing structure 220 may be formed of a metal material or a non-metal material having a selected stiffness value to support the display 230 .

[0129] In one embodiment, the sensor area 231d may be formed to occupy a certain area adjacent to one corner of the first housing structure 210. The arrangement, shape and size of the sensor area 231d are not limited to the example shown. In another embodiment, the sensor area 231d may be formed at any other corner of the first housing structure 210 or at any position between the top corner and the bottom corner. In yet another embodiment, the sensor area 231d may be formed in a portion of the second housing structure 220. In yet another embodiment, the sensor area 231d may be formed in a portion of both the first housing structure 210 and the second housing structure 220. In various embodiments, components for performing various functions may be embedded in the electronic device 200 and exposed to the front surface of the electronic device 200 through the sensor area 231d or through one or more openings formed in the sensor area 231d. In an embodiment, such a component may include at least one of a front camera device, a receiver, a proximity sensor, an illumination sensor, an iris recognition sensor, an ultrasonic sensor or an indicator.

[0130] In one embodiment, the first back cover 240 may be disposed on the second surface 212 of the first housing structure 210 and may have a substantially rectangular perimeter. The perimeter may be at least partially surrounded by the first housing structure 210. Similarly, the second back cover 250 may be disposed on the fourth surface 222 of the second housing structure 220 and its substantially rectangular perimeter may be at least partially surrounded by the second housing structure 220.

[0131] In the illustrated embodiment, the first rear cover 240 and the second rear cover 250 may have substantially symmetrical shapes with respect to the folding axis (A). In another embodiment, the first rear cover 240 and the second rear cover 250 may have various shapes. In yet another embodiment, the first rear cover 240 may be integrally formed with the first housing structure 210, and the second rear cover 250 may be integrally formed with the second housing structure 220.

[0132] In one embodiment, the first back cover 240, the second back cover 250, the first housing structure 210 and the second housing structure 220 can provide together a space in which various components (e.g., PCB, antenna module, sensor module or battery) of the electronic device 200 are arranged. In one embodiment, one or more components can be arranged near the rear surface of the electronic device 200 and visually exposed to the rear surface of the electronic device 200. For example, one or more components or sensors can be visually exposed by the first rear area 241 of the first back cover 240. In various embodiments, such sensors can include proximity sensors, rear camera devices and / or flashlights. In another embodiment, at least a portion of the secondary display 252 can be visually exposed by the second rear area 251 of the second back cover 250.

[0133] The display 230 may be disposed in a space formed by a pair of housing structures 210 and 220. For example, the display 230 may be installed in a recess 201 formed by a pair of housing structures 210 and 220 while occupying a majority of the front surface of the electronic device 200. Thus, the front surface of the electronic device 200 may include the display 230, a portion of the first housing structure 210 adjacent to the display 230 (e.g., periphery), and a portion of the second housing structure 220 (e.g., periphery). In addition, the rear surface of the electronic device 200 may include a first back cover 240, a portion of the first housing structure 210 adjacent to the first back cover 240 (e.g., periphery), a second back cover 250, and a portion of the second housing structure 220 adjacent to the second back cover 250 (e.g., periphery).

[0134] In one embodiment, the display 230 may refer to a display that allows at least a portion thereof to be deformed into a curved surface. In one embodiment, the display 230 may include a folding area 231c, a first area 231a disposed on one side (e.g., the right side) relative to the folding area 231c, and a second area 231b disposed on the other side (e.g., the left side) relative to the folding area 231c. For example, the first area 231a may be disposed on the first surface 211 of the first shell structure 210, and the second area 231b may be disposed on the third surface 221 of the second shell structure 220. Such division of areas of the display 230 is merely exemplary, and the display 230 may be divided into multiple areas (e.g., two, four or more) according to its structure or function. Although in Figure 2AIn the illustrated embodiment, the display 230 is divided into a plurality of regions based on a folding region 231c extending parallel to a folding axis (A) corresponding to the y-axis, but the display 230 may be divided into a plurality of regions based on another folding region extending equally to another folding axis (e.g., corresponding to the x-axis) in another embodiment. The above division of the display is merely based on a pair of housing structures 210 and 220 and a hinge structure (e.g., Figure 3 In practice, regardless of the pair of housing structures 210 and 220 and the hinge structure 264, the display 230 can display a full screen. In one embodiment, the first area 231a and the second area 231b may have a symmetrical shape as a whole relative to the folding area 231c. However, unlike the second area 231b, the first area 231a may have a cutout portion (e.g., Figure 3 Therefore, strictly speaking, the first region 231a and the second region 231b may have symmetrical parts and asymmetrical parts.

[0135] Figure 2B is a view showing a folded state of an electronic device according to an embodiment of the present disclosure.

[0136] Reference Figure 2B The hinged cover 265 is disposed between the first housing structure 210 and the second housing structure 220 to cover any underlying components (e.g., Figure 3 In one embodiment, the hinge cover 265 may be hidden or exposed to the outside by a portion of the first housing structure 210 and the second housing structure 220, depending on whether the electronic device 200 is in an unfolded state or a folded state.

[0137] When the electronic device 200 is Figure 2A When the electronic device 200 is in the unfolded state, the hinge cover 265 can be hidden by the first housing structure 210 and the second housing structure 220 and thus not exposed. Figure 2B When the electronic device 200 is in a folded state (e.g., a fully folded state), the hinge cover 265 may be exposed to the outside between the first housing structure 210 and the second housing structure 220. When the electronic device 200 is in an intermediate state where the first housing structure 210 and the second housing structure 220 are folded at a certain angle, the hinge cover 265 may be partially exposed to the outside between the first housing structure 210 and the second housing structure 220. The exposed area in the intermediate state may be smaller than the exposed area in the fully folded state. In one embodiment, the hinge cover 265 may have a curved surface.

[0138] Hereinafter, in each specific state of the electronic device 200 , operations of the first and second housing structures 210 and 220 and various regions of the display 230 will be described.

[0139] In one embodiment, when the electronic device 200 is in the unfolded state (eg, Figure 2A ), the first housing structure 210 and the second housing structure 220 are arranged to form an angle of 180 degrees with each other, so that the first area 231a and the second area 231b of the display 230 face the same direction. In addition, the folding area 231c can form the same plane as the first area 231a and the second area 231b.

[0140] In one embodiment, when the electronic device 200 is in a folded state (eg, Figure 2B ), the first housing structure 210 and the second housing structure 220 are arranged to face each other. Therefore, the first area 231a and the second area 231b of the display 230 can form a very small angle (for example, between 0 degrees and 10 degrees) and face each other. In addition, the folding area 231c can at least partially form a curved surface with a certain curvature.

[0141] In one embodiment, when the electronic device 200 is in an intermediate state, the first housing structure 210 and the second housing structure 220 are arranged to form a certain angle. Therefore, the first area 231a and the second area 231b of the display 230 can form a certain angle, which is greater than the angle in the folded state and less than the angle in the unfolded state. In addition, the folding area 231c can at least partially form a curved surface having a certain curvature, which is less than the curvature in the folded state. In one embodiment, when the electronic device 200 is in an intermediate state or a fully folded state, the electronic device 200 can determine that the electronic device 200 is in an at least partially folded state.

[0142] Figure 3 is an exploded perspective view showing an electronic device according to an embodiment of the present disclosure.

[0143] Reference Figure 3 In one embodiment, the electronic device 200 may include the first housing structure 210, the second housing structure 220, the display 230, the first back cover 240, and the second back cover 250, all of which are described above. The electronic device 200 may also include a bracket assembly 260 and at least one printed circuit board (PCB) 270. The display 230 may also be referred to as a display module, a display assembly, or a display unit.

[0144] The display 230 (or first display) may include a display panel 231 (e.g., a flexible display panel) and at least one board or layer 232 on which the display panel 231 is mounted. In one embodiment, the board 232 may be disposed between the display panel 231 and the support assembly 260. The display panel 231 may be disposed on one surface of the board 232 (e.g., Figure 3 The plate 232 may be formed in a shape corresponding to the display panel 231. For example, a portion of the plate 232 may be formed in a shape corresponding to the cutout portion 233 of the display panel 231.

[0145] The bracket assembly 260 may include a first bracket 261, a second bracket 262, a hinge structure 264 disposed between the first bracket 261 and the second bracket 262, a hinge cover 265 covering the hinge structure 264 (when the hinge structure 264 is viewed from the outside), and at least one wiring member 263 (e.g., a flexible printed circuit board (FPC)) intersecting the first bracket 261 and the second bracket 262.

[0146] In one embodiment, the bracket assembly 260 may be disposed between the board 232 and at least one PCB 270. For example, the first bracket 261 may be disposed between the first area 231a of the display 230 and the first PCB 271, and the second bracket 262 may be disposed between the second area 231b of the display 230 and the second PCB 272.

[0147] In one embodiment, the wiring member 263 and the hinge structure 264 may be at least partially disposed inside the bracket assembly 260. The wiring member 263 may be disposed in a direction (e.g., an x-axis direction) that crosses the first bracket 261 and the second bracket 262. That is, the wiring member 263 may be disposed in a direction perpendicular to the folding axis (e.g., Figure 2A Set in the direction of the y-axis or folding axis (A) in the image.

[0148] As mentioned above, at least one PCB 270 may include a first PCB 271 disposed to correspond to the first bracket 261 and a second PCB 272 disposed to correspond to the second bracket 262. The first PCB 271 and the second PCB 272 may be disposed in a space formed by all of the bracket assembly 260, the first housing structure 210, the second housing structure 220, the first back cover 240, and the second back cover 250. On the first PCB 271 and the second PCB 272, electronic components for realizing various functions of the electronic device 200 may be mounted.

[0149] In one embodiment, while the display 230 is combined with the bracket assembly 260, the first housing structure 210 and the second housing structure 220 can be assembled with each other to be combined with both sides of the bracket assembly 260. As described below, the first housing structure 210 and the second housing structure 220 can be combined with the bracket assembly 260 by sliding on both sides of the bracket assembly 260.

[0150] In one embodiment, the first housing structure 210 may include a first rotation support surface 214, and the second housing structure 220 may have a second rotation support surface 224 corresponding to the first rotation support surface 214. The first rotation support surface 214 and the second rotation support surface 224 may include curved surfaces corresponding to the curved surface included in the hinge cover 265.

[0151] In one embodiment, when the electronic device 200 is in the unfolded state (eg, Figure 2A ), the first rotation support surface 214 and the second rotation support surface 224 cover the hinge cover 265, so that the hinge cover 265 may not be exposed to the rear surface of the electronic device 200, or may be minimally exposed to the rear surface of the electronic device 200. In addition, when the electronic device 200 is in a folded state (for example, Figure 2B ), the first rotation support surface 214 and the second rotation support surface 224 rotate along the curved surface included in the hinge cover 265, so that the hinge cover 265 can be exposed to the rear surface of the electronic device 200 to the greatest extent.

[0152] In one implementation, the sub-display 252 (or second display) may be mounted on the second rear cover 250 and exposed to the outside through the rear surface of the electronic device 200 .

[0153] Figure 4A , Figure 4B , Figure 4C , Figure 4D , Figure 4E and Figure 4F is a perspective view illustrating a use state of an electronic device in a folding operation or an unfolding operation according to various embodiments of the present disclosure.

[0154] According to various embodiments, an electronic device 200 (eg, Figure 1A The electronic device 101 in the embodiment may include a foldable housing 410, a first display 430 (eg, Figure 2A The first display 230 in FIG. 1 and the second display (eg, Figure 2A The secondary display 252 in the display).

[0155] According to various embodiments, the electronic device 200 may include a foldable housing 410 including a hinge structure (eg, Figure 3The first shell structure 210 and the second shell structure 220 are connected by a hinge structure 264).

[0156] According to various embodiments, the first housing structure 210 and the second housing structure 220 may be connected to be foldable to each other. The first housing structure 210 and the second housing structure 220 may be foldable about a folding axis 420 (eg, Figure 2A The first shell structure 210 and the second shell structure 220 may be arranged to face each other in a folded state.

[0157] Reference Figure 4A , the angle formed between the first housing structure 210 and the second housing structure 220 may be about 180 degrees. As such, when the angle between the first housing structure 210 and the second housing structure 220 is greater than a predetermined angle (e.g., about 170 degrees), it may be defined that the electronic device (or the first display 430) is in the unfolded state. When the electronic device 200 is in the unfolded state, the first housing structure 210 and the second housing structure 220 may form a substantially planar structure.

[0158] Reference Figure 4B According to various embodiments, the electronic device 200 may further include a second display 440 (eg, Figure 2A The secondary display 252 in the display).

[0159] Figure 4C The electronic device 200 is shown partially folded in a counterclockwise direction around the folding axis 420. Figure 4D The electronic device 200 is shown to be folded to the maximum extent about the folding axis 420 .

[0160] Reference Figure 4C and Figure 4D , a user of the electronic device 200 can fold the unfolded electronic device 200 about the folding axis 420 or unfold the folded electronic device 200 by applying force to the electronic device 200 .

[0161] While the electronic device 200 is folded or unfolded, the user's finger may touch the first display 430 and / or the second display 440. The touch may be detected by the touch sensor 421 of the first display 430 and / or the touch sensor of the second display 440. The touch may be an unintentional touch by the user, rather than an intentional touch for an actual input action on the screen.

[0162] Reference Figure 4E, while the electronic device 200 is folded or unfolded, the electronic device 200 may receive a user input on the first display 430. For example, the electronic device 200 may receive a user input on some portions 451 and 453 of the first display 430. The user input may be an unintentional touch.

[0163] Reference Figure 4F , while the electronic device 200 is folded or unfolded, the electronic device 200 may receive a user input on the second display 440. For example, the electronic device 200 may receive a user input on a certain portion 461 of the second display 440. The user input may be an unintentional touch.

[0164] Figure 5 is a block diagram illustrating an electronic device according to an embodiment of the present disclosure.

[0165] Reference Figure 5 , the electronic device 500 may include a first display 510, a second display 520, a processor 530, and a memory 540. Some of such components of the electronic device 500 may be omitted or replaced. The electronic device 500 may include Figure 1A The electronic device 500 may include at least some of the configurations and / or functions of the electronic device 101 in FIG. Figure 2A , Figure 2B and Figure 3 The structure shown in FIG. 1 and may include 4A to 4F A foldable structure is described.

[0166] According to various embodiments, the first display 510 may be provided on a first surface (or front surface) in a first direction of a housing of the electronic device 500. The first display 510 may include a first touch sensor 515 that detects a touch input occurring on the first display 510. The first touch sensor 515 may be implemented in one of various schemes, such as an in-cell scheme or an on-cell scheme.

[0167] According to various embodiments, the first display 510 may be folded. Based on the folding area (eg, Figure 2A The first display 510 may be divided into a first area (eg, a folding area 231c in FIG. 2 ), Figure 2A The first region 231a in the embodiment and the second region (eg, Figure 2A The first display 510 may be formed in a second area 231b in the electronic device 500, and may be folded in a direction in which the first area and the second area face each other. Therefore, when the electronic device 500 is folded, the first display 510 may be invisible to the user.

[0168] According to various embodiments, the second display 520 may be disposed on a second surface (or rear surface) of the housing of the electronic device 500 in the second direction. The second display 520 may be disposed on one of the rear covers of the housing (eg, Figure 2A Therefore, the area (or lateral length) of the second display 520 may be half or less of the area (or lateral length) of the first display 510.

[0169] The second display 520 may include a second touch sensor 525 that detects a touch input occurring on the second display 520. The implementation of the second touch sensor 525 may be the same as that of the first touch sensor 515.

[0170] The first touch sensor 515 and / or the second touch sensor 525 may provide a touch event corresponding to the touch input to the processor 530. The touch event may include a press event, a release event, and / or a cancel event. For example, when a user presses a certain area of ​​the first display 510, the first touch sensor 515 may provide the press event together with the coordinates of the pressed area to the processor 530. When the user releases such a touch, the first touch sensor 515 may provide the release event to the processor 530. When the touch is removed without being released, for example, when the user's finger moves away from the touch area without releasing the touch, the first touch sensor 515 may provide the cancel event to the processor 530.

[0171] The processor 530 may provide the received touch event to the application corresponding to the touch event (or the application displayed in the foreground). When a press event or a release event is provided to the application, the processor 530 may perform a corresponding operation. When a cancel event is provided after a press event, the processor 530 may cancel the operation performed according to the press event.

[0172] According to various embodiments, while the electronic device 500 is unfolded, the second display 520 and the second touch sensor 525 may be in an inactive state. Therefore, even if a user's touch occurs on the second display 520, the second touch sensor 525 does not generate a touch event. According to another embodiment, even when the electronic device 500 is unfolded, the second display 520 and the second touch sensor 525 may be in an active state, so the second touch sensor 525 may generate a touch event in response to a user's touch input.

[0173] According to various embodiments, the memory 540 may include volatile memory and non-volatile memory as known in the art and not limited to a particular implementation. The memory 540 may include Figure 1AAt least some of the configuration and / or functions of the memory 130 shown. In addition, the memory 540 may store Figure 1A At least a portion of the procedure 140 shown.

[0174] The memory 540 may be functionally, operationally and / or electrically connected to the processor 530, and may store various instructions executable by the processor 530. These instructions may include various control commands that can be recognized by the processor 120 in combination with arithmetic and logical operations, data transmission, input / output, etc.

[0175] According to various embodiments, the processor 530 is configured to perform operations or data processing related to control and / or communication of components of the electronic device 501, and may include Figure 1A At least some of the configurations and / or functions of the processor 120 shown. The processor 530 may be functionally connected, operatively connected, and / or electrically connected to internal components of the electronic device 500 including the first display 510, the second display 520, and the memory 540.

[0176] The operations and data processing functions that can be implemented by the processor 530 in the electronic device 500 are not limited. However, in the present disclosure, the description will focus on the operation of processing a touch event when a folding gesture or an unfolding gesture occurs and the operation of seamlessly displaying an application screen between the first display 510 and the second display 520. The operations of the processor 530 described below can be performed by loading instructions stored in the memory 540.

[0177] According to various embodiments, the processor 530 may execute an application stored in the memory 540. In a state where the electronic device 500 (or the first display 510) is unfolded, the processor 530 may display an execution screen of the application on the first display 510. In addition, in the unfolded state of the electronic device 500, the second display 520 may be turned off by operating in a power saving mode, or may display only brief information such as time by operating in an always-on display (AOD) mode.

[0178] In addition, when the electronic device 500 is unfolded, the first touch sensor 515 of the first display 510 may provide the processor 530 with a touch event corresponding to the touch input on the first display 510. At this time, the second display 520 and the second touch sensor 525 may be in an inactive state, so the second touch sensor 525 may not detect the touch input.

[0179] According to various embodiments, the electronic device 500 may include no bezel area or only a very narrow bezel area, so that the first display 510 covers substantially the entire first surface of the housing.

[0180] According to various embodiments, in a state where the electronic device 500 (or the first display 510) is folded, the processor 530 may display an execution screen of an application on the second display 520. In the folded state of the electronic device 500, the first area and the second area of ​​the first display 510 face each other and are not recognized by the user. Therefore, the first display 510 may operate in a power saving mode without displaying a screen, and the first touch sensor 515 may also not detect a touch input.

[0181] According to various embodiments, the processor 530 may detect a folding gesture of the electronic device 500 (or the first display 510) in the unfolded state. 4A to 4F As described above, the user may apply force to the housing of the electronic device 500 to fold the first area and the second area of ​​the first display 510 to face each other. When the electronic device 500 is folded, the processor 530 may generate a signal based on the folding area (e.g., Figure 2A The folding area 231c in the first display 510 is formed by a first housing structure (eg, Figure 2A 210) and a second housing structure (eg, Figure 2B The folding gesture is detected by detecting the angle change between the first shell structure and the second shell structure 220 in the unfolded state. For example, when the angle between the first shell structure and the second shell structure is about 180 degrees, the processor 530 recognizes it as an unfolded state. When the angle change occurs in the unfolded state, the processor 530 determines that the folding gesture starts. When the angle decreases below a reference value (e.g., 10 degrees), the processor 530 determines that the folding gesture is completed.

[0182] In addition, if the angle formed by the first shell structure and the second shell structure is close to 0° (for example, 0° or 10°), the electronic device can determine that the device is in the first folded state, and if the angle is close to 180° (for example, 170° or 180°), the electronic device can determine that the device is in the second folded state. Based on the angle, if the device is in the first folded state, the electronic device performs an operation corresponding to the folded state, and if the device is in the second folded state, the electronic device performs an operation corresponding to the unfolded state.

[0183] According to various embodiments, when the folding gesture begins, the processor 530 may request the first touch sensor 515 of the first display 510 to stop sending touch events. This is because, as described above with reference to 4A to 4FAs described above, the touch on the first display 510 during folding is an unintentional touch by the user. According to another embodiment, when the folding gesture begins, the processor 530 may ignore the received touch events without requesting the first touch sensor 515 to stop sending touch events. That is, even if any touch event is received, it may not be provided to the application. In this case, because the second display 520 and the second touch sensor 525 are still inactive, the second touch sensor 525 may not generate and send touch events.

[0184] According to various embodiments, the processor 530 may switch the first display 510 to an inactive state in response to the folding gesture. The time point of turning off the screen of the first display 510 and stopping the touch detection of the first touch sensor 515 is not limited. For example, when the folding gesture is determined to be completed by the angle of the first display 510 being folded being reduced (e.g., 10 degrees or less) as described above, or when a touch lock screen to be described later is displayed on the second display 520, the processor 530 may perform a control operation of turning off the screen of the first display 510 and stopping the touch detection of the first touch sensor 515.

[0185] According to various embodiments, the processor 530 may switch the second display 520 to an activated state in response to the folding gesture. However, even in this case, the processor 530 may keep the second touch sensor 525 in an inactivated state until the touch lock screen is displayed, or even if the second touch sensor 525 is activated together with the second display 520, the processor 530 may not process a touch event occurring at the second touch sensor 525. According to other embodiments, both the second display 520 and the second touch sensor 525 may be activated in the folded state or the unfolded state of the electronic device 500.

[0186] According to various embodiments, the processor 530 may cancel a touch event (e.g., a press event or a release event) that has been provided to the application before the folding gesture begins. For example, the processor 530 may cancel the application execution that is to be implemented in response to the touch event, or cancel the application execution that has been implemented in response to the touch event.

[0187] According to various embodiments, when the folding gesture begins, the processor 530 may provide the application with a cancel event corresponding to the previously provided touch event. For example, even if a press event actually occurs during the folding gesture, it is not the user's intention. Therefore, even if a press event is received from the touch sensor, the processor 530 may provide the cancel event to the application. This prevents the application from being erroneously operated by recognizing the touch for folding as a touch event. Therefore, before the first display 510 is folded, the application may not perform an operation based on the touch event generated by the first touch sensor 515.

[0188] According to various embodiments, the processor 530 may display a touch lock screen on the second display 520 in response to the folding gesture. When the state of the electronic device 500 changes from the fully unfolded state to the at least partially folded state, the processor 530 may display the touch lock screen. The touch lock screen may be determined based on the state information of the running application (e.g., security level and / or whether the size is adjustable). Examples of the touch lock screen will be described below with reference to Fig. 10A and Fig. 10B Give a description.

[0189] According to various embodiments, the touch lock screen may be displayed as an upper layer of the application and may partially overlap the application screen. When the application screen and the touch lock screen partially overlapping the application screen are displayed, the touch input may not be processed as an input to the application.

[0190] According to various embodiments, the touch lock screen may be a partially changed application screen that would have been displayed in the second display. For example, the touch lock screen may be a portion of the application screen, or the application screen may have different resolutions, transparency, etc.

[0191] According to various embodiments, the processor 530 may display the touch lock screen in the foreground to cover the screen of the top application on the z-order, thereby preventing unintentional touch events from being sent to the application.

[0192] According to various embodiments, the processor 530 may process a touch event received from the second touch sensor 525 of the second display 520 after displaying the touch lock screen. In response to displaying the touch lock screen, the processor 520 may activate the second touch sensor 525 or process a touch event received from the activated second touch sensor 525. In this case, the touch event received while the touch lock screen is displayed is executed for the touch lock screen rather than for the application screen displayed as a lower layer of the touch lock screen.

[0193] After displaying the touch lock screen, the processor 530 may release the touch lock screen in response to a touch event received from the second display 520, and provide the touch event to the running application. In this case, the first display 510 and the first touch sensor 515 may have been deactivated.

[0194] According to various embodiments, if at least one feature of the touch event received from the second display satisfies a specified condition, the processor can remove the touch lock screen. In this case, the features and conditions can refer to the distance, speed, position, etc. of the touch event.

[0195] According to another embodiment, the touch lock screen includes an indication, and when the indication is selected, the processor can remove the touch lock screen. In this case, the indication can be displayed as a part of the touch lock screen, or can be displayed as an image separated from the touch lock screen. In addition, the indication can be displayed as partially overlapping the touch lock screen.

[0196] A method of processing a touch event of the first touch sensor 515 and / or the second touch sensor 525 after detecting a folding gesture will be described below with reference to Figure 8 Give a description.

[0197] According to various embodiments, the processor 530 may generate a touch lock screen based on the state information of the application. The state information of the application may include information about a security level assigned to the application and / or information about whether the execution screen of the application is resizable.

[0198] According to various embodiments, the processor 530 may operate in a non-secure mode, a weak security mode, or a strong security mode, depending on the security level assigned to the application. For example, the non-secure mode is a case where a voice call application is running. In this case, even when a folding gesture is detected during a voice call, the processor 530 may not display the touch lock screen, but may display the running screen of the voice call application on the second display 520. In addition, the processor 530 may provide the touch event received from the second touch sensor 525 to the voice call application.

[0199] In the case of the weak security mode (or the first security level), the processor 530 may display a semi-transparent touch lock screen on the upper layer of the application execution screen. Thereafter, when a certain touch input (e.g., swipe) to the touch lock screen displayed on the second display 520 is detected, the processor 530 may remove the touch lock screen and display the screen of the running application on the second display 520. In this case, the screen size of the application may be adjusted corresponding to the resolution of the second display 520.

[0200] In the case of the strong security mode (or the second security level), the processor 530 may display an opaque touch lock screen on the second display 520. In this case, when user authentication (e.g., pattern input, password input, iris recognition, fingerprint recognition, etc.) is completed while the touch lock screen is displayed, the processor 530 may display an application execution screen on the second display 520. According to one embodiment, the processor 530 may display another application (e.g., a home screen or an application running in the background) other than the running application on the second display 520.

[0201] According to various embodiments, if a security level (e.g., strong security mode, second security mode) is specified for an application, the processor may display an interface (e.g., pattern input, password input) for receiving an input for releasing the lock state of the application in the second display. In this case, the interface may be displayed as at least a portion of the touch lock screen, or as an image separated from the touch lock screen.

[0202] According to various embodiments, the second display is smaller than the first display, so the interface displayed in the first display during the expanded state is minimized and then displayed in the second display. In addition, the interface displayed in the first display is displayed in the second display at a lower resolution.

[0203] According to various embodiments, the processor 530 may determine a security level or an operation mode based on properties of an application running in the expanded state.

[0204] For example, when the running application is an application requiring continuous use (e.g., a call application), the processor 530 can operate in a non-secure mode. In addition, the processor 530 can operate in a weak security mode for general applications and in a strong security mode for applications requiring security such as user privacy.

[0205] According to various embodiments, the processor 530 may determine a security level or an operation mode based on the attributes of the folding gesture.

[0206] According to one embodiment, the processor 530 may identify a time difference between the start time and the completion time of the folding gesture. If the identified time difference is less than a given threshold, the processor 530 may operate in a strong security mode. This is because when the user folds the electronic device 500 quickly, it may be interpreted that the user does not want to expose the information displayed on the display for reasons such as privacy.

[0207] According to another embodiment, the processor 530 can determine whether the second display 520 is in the visible direction of the user after folding by the direction of the folding gesture. For example, when the second display 520 is positioned upward (anti-gravity direction), it is determined that the second display 520 is in the visible direction. On the contrary, when the second display 520 is positioned downward (gravity direction), it can be determined that the second display 520 is in the invisible direction. When it is determined that the second display 520 is in the visible direction, the processor 530 can display the touch lock screen of the weak security mode. On the contrary, when it is determined that the second display 520 is in the invisible direction, the processor 530 can operate in the strong security mode or set the second display 520 in the power saving mode.

[0208] According to yet another embodiment, the processor 530 may determine the operating mode based on the style of the folding gesture. For example, the processor 530 may determine the operating mode based on the style of the folding gesture. Figure 2A The acceleration of the second housing structure 220 in FIG. 1 is compared with the acceleration of another housing structure (eg, Figure 2A The acceleration of the first housing structure 210 in the display 520 is compared. If the acceleration of the second housing structure with the second display 520 is greater, the processor 530 can determine that the second display 520 is in the visible direction of the user and displays the touch lock screen of the weak security mode. If the acceleration of the first housing structure without the second display is greater, the processor 530 can determine that the second display 520 is in the invisible direction of the user and operates in the strong security mode or set the second display 520 in the power saving mode.

[0209] According to various embodiments, the electronic device 500 may include a sensor (eg, an acceleration sensor or a gyro sensor) provided on the first housing structure and / or the second housing structure, thereby recognizing the pattern of the folding gesture from the sensor.

[0210] According to various embodiments, the processor 530 may identify whether the application is resizable. For example, based on the attribute information of the application, the processor 530 may identify whether the execution screen of the application is resizable.

[0211] When the application displayed on the first display 510 is a resizable application (e.g., an internet browser), the processor 530 may generate a touch lock screen having at least a translucent portion in response to detecting a folding gesture, and display the touch lock screen on an upper layer of the resized running screen of the application displayed on the second display 520.

[0212] Thereafter, when a certain touch input (e.g., a swipe) is detected for the touch lock screen displayed on the second display 520, the processor 530 may remove the touch lock screen and display the screen of the running application on the second display 520. According to other embodiments, after a given authentication (e.g., pattern input, password input, iris recognition, fingerprint recognition, etc.) is completed for the touch lock screen, the processor 530 may remove the touch lock screen and display the application screen on the second display 520. In this case, the authentication type may be determined according to the security level (e.g., weak security mode, strong security mode, etc.) and / or the user's settings. Thereafter, when the electronic device 500 is unfolded again, the application may be displayed on the first display 510 in its original size. This embodiment will be described below with reference to FIG. Fig.14 Give a description.

[0213] When the application displayed on the first display 510 is a non-resizable application (e.g., a game application), and when a folding gesture is detected, the processor 530 may display a touch lock screen on the second display 520 that includes a menu for selecting restart (i.e., rerun) or resume (i.e., continue running) of the application. Then, if resume is selected from the menu on the touch lock screen, the processor 530 may run the application in the background and display another application (e.g., the home screen or a background running application) on the second display 520. Thereafter, when the electronic device 500 is unfolded again, the application may be displayed in the foreground on the first display 510. This embodiment will be described below with reference to FIG. Figure 5 Give a description.

[0214] According to various embodiments, the touch lock screen may be displayed even after the folding gesture is started but before the folding is completed. For example, when the angle between the first shell structure and the second shell structure reaches a predetermined value (e.g., 150 degrees, 120 degrees, 90 degrees, 60 degrees, 30 degrees) while changing from 180 degrees to 0 degrees, the processor 530 may display the touch lock screen on the second display. Alternatively, the processor 530 may provide a visual effect corresponding to the touch lock screen, and display the touch lock screen when the folding is completed.

[0215] Figure 6 is a block diagram illustrating a display-related configuration of an electronic device according to an embodiment of the present disclosure.

[0216] Reference Figure 6 , the electronic device 600 may include a first display 610 , a second display 620 , a first display driver IC 611 , a second display driver IC 621 , and a processor 630 .

[0217] According to one embodiment, the first display driver IC 611 may include an interface module (not shown), a memory (e.g., a buffer memory) (not shown), an image processing module (not shown), and / or a mapping module (not shown). The first display driver IC 611 may receive image information including image data and / or image control signals corresponding to commands for controlling image data from other components of the electronic device 600 through the interface module. For example, the first display driver IC 611 may receive image information from the processor 630 or from an auxiliary processor (e.g., a graphics processing device) that operates independently of the processor 630. According to one embodiment, the first display driver IC 611 may communicate with the touch circuit or sensor module through the interface module. According to one embodiment, the first display driver IC 611 may store at least part of the received image information in the memory, for example, in units of frames. According to one embodiment, the image processing module may perform at least part of the pre-processing or post-processing (e.g., adjusting the resolution, brightness, or size) of the image data based at least on the characteristics of the image data or the characteristics of the first display 610. According to one embodiment, the mapping module may generate a voltage value or a current value corresponding to the image data pre-processed or post-processed by the image processing module. According to one embodiment, the generation of the voltage value or current value may be performed based at least in part on the properties of the pixels of the first display 610 (e.g., the array of pixels (RGB stripes or pentile structure) or the size of each sub-pixel). At least some pixels of the first display 610 may be driven based at least in part on the voltage value or current value, so that visual information (e.g., text, image, icon) corresponding to the image data may be displayed through the display 610.

[0218] According to an embodiment, the second display driver IC 621 may drive the second display 620 to display an image based on the image information received from the processor 630. According to an embodiment, in addition to driving the second display 620, the second display driver IC 621 may include components that are the same as or similar to those of the first display driver IC 611. For example, the second display driver IC 621 may include an interface module (not shown) that performs operations similar to those of the first display driver IC 611, a memory (e.g., a buffer memory) (not shown), an image processing module (not shown), and / or a mapping module (not shown).

[0219] According to an embodiment, the processor 630 may include a first display port 612 operatively connected to the first display driver IC 611 and a second display port 622 operatively connected to the second display driver IC 621. For example, the processor 630 may send first image information to the first display driver IC 611 through the first display port 612, and may also send second image information to the second display driver IC 621 through the second display port 622.

[0220] According to an embodiment, the first image information and the second image information may be identical to each other. For example, the processor 630 may send image information including the same image data to both the first display driver IC 611 and the second display driver IC 621 .

[0221] According to another embodiment, the image data included in the second image information may include at least a portion of the image data included in the first image information. For example, the processor 630 may receive a user input for selecting a portion of the first image data (e.g., the entire image displayed on the first display 610), and based on the received input, send the second image data as a portion of the first image data (e.g., a portion of the entire image displayed on the first display 610) to the second display driver IC 621.

[0222] According to yet another embodiment, the processor 630 may send the same image data to both the first display driver IC 611 and the second display driver IC 621, and further send coordinate information based on the user input to the second display driver IC 621. For example, the coordinate information may define a specific portion of the first image data selected by the user (i.e., the second image data), and the second display driver IC 621 may drive the second display 620 to display the specific portion of the first image data based on the coordinate information.

[0223] Figure 7 is a block diagram illustrating a software layer of an electronic device according to an embodiment of the present disclosure.

[0224] 7 shows a software structure 700 according to some embodiments, which may depend at least in part on an electronic device (e.g., Figure 5 The electronic device 500 may be changed depending on the platform included in the electronic device 500). Figure 7 Some configurations related to handling touch events on software architecture 700 are shown.

[0225] Reference Figure 7, the application layer may include at least one application 711 stored in the memory and executable by the processor and a system UI 715. The application 711 may include, but is not limited to, an Internet browser, a video application, a game application, etc. The system UI 715 may refer to a specific application that configures various GUI screens such as a notification bar and a quick view to be implemented on the system of the electronic device.

[0226] The framework may provide various functions to the application 711 so that the application 711 may use functions or information provided from one or more resources of the electronic device.

[0227] The framework may include an activity manager 721 for managing the life cycle of the application 711, a window manager 722 for managing one or more GUI resources being displayed, a view system 723 as a set of extensible views for creating a user interface for the application 711, and a battery management system 724 for managing the battery life of the electronic device (e.g., Figure 1A a power manager 724 for providing information about an input path provided by the electronic device, an input manager 725 for providing information about a display of the electronic device (e.g., Figure 5 The display manager 726 for information about the first display 510 and the second display 520 in the ... Figure 1A The sensor manager 727 of the sensor module 176 in the sensor module.

[0228] The hardware abstraction layer (HAL) may refer to an abstraction layer between a plurality of hardware modules and software included in the hardware layer of the electronic device. The hardware abstraction layer may include an input distributor 731, an event center 732, and a surface ejector 733. The input distributor 731 may perform a function of determining to which application 711 the generated event is provided. The event center 732 may provide an interface for standardizing events occurring in the sensor. The surface ejector 733 may perform a function of providing an operating screen to be displayed on a display among operating screens generated by the application 711, and may also request the application 711 to process changes in resolution and density according to the changed display configuration.

[0229] The kernel driver layer may include various drivers for controlling various hardware modules included in the electronic device. The kernel driver layer may include: a touch driver 741 including an interface module for controlling a touch controller 751; and a sensor driver 742 including an interface module for controlling a sensor controller 752 connected to a sensor.

[0230] The hardware layer may include a touch controller 751 and a sensor controller 752. The touch controller 751 may receive a touch signal from a first touch sensor (eg, Figure 55) and / or a second touch sensor of a second display (eg, Figure 5 The electronic device may have a sensor for detecting a fold in a portion of the housing (e.g., the first housing structure 210 and the second housing structure 220), and the sensor controller 752 may provide information obtained from the sensor.

[0231] According to various embodiments, when the first touch sensor of the first display and / or the second touch sensor of the second display detects a touch input, the touch controller 751 may output a touch event corresponding to the touch input. The touch event may be input to the event center 732 through an interface provided by the touch driver 741. The touch event input to the event center 732 may be provided to the application 711 (e.g., a foreground application) determined by the input distributor 731.

[0232] According to various embodiments, when the folding gesture begins, the electronic device may request the first touch sensor of the first display and / or the second touch sensor of the second display to stop sending touch events. In response to the sending stop request, the touch events collected by the event center 732 may not be sent to the application 711.

[0233] According to various embodiments, the electronic device may cancel a touch event (e.g., a press event or a release event) that has been provided to the application 711 before the folding starts. For example, when the folding starts, the electronic device may provide a cancel event corresponding to the previously provided touch event to the application 711. In this case, although the press events are continuously transmitted to the event center, the electronic device may forcibly provide the cancel event to the application 711 because these press events are not caused by the user's intentional touch.

[0234] Figure 8 is a block diagram illustrating a drawing engine of an electronic device according to an embodiment of the present disclosure.

[0235] Reference Figure 8 , the drawing engine 800 may store the memory (e.g., Figure 5 A portion of the memory 540 in FIG. 5 is designated as surfaces 821 , 822 , and 823 for recording the running status of applications 811 and 812 .

[0236] The surface ejector 830 may determine whether to display the execution screen of the application recorded on the surfaces 821 , 822 , and 823 , and may also request the applications 811 and 812 to process the change in resolution and density according to the changed display configuration.

[0237] The first frame buffer 841 may store information related to the first display (eg, Figure 5 The second frame buffer 842 may store a running screen corresponding to the resolution and density of the first display 510 in the image processing unit and generated by each of the applications 811 and 812. Figure 5 The running screen generated by each application corresponds to the resolution and density of the second display 520) in the display.

[0238] In a state where the electronic device is unfolded, the surface ejector 830 may store, in the first frame buffer 841 , execution screens generated by each of the applications 811 and 812 and recorded on the surfaces 821 , 822 , and 823 corresponding to the resolution and density of the first display.

[0239] When the electronic device is folded, the surface ejector 830 may request each of the applications 811 and 812 to process an operating screen corresponding to the resolution and density of the second display, and store the operating screen corresponding to the resolution and density of the second display and recorded on the surfaces 821, 822, and 823 in the second frame buffer 842.

[0240] The electronic device may open or close a path transmitted from the surface ejector 830 to the first frame buffer 841 or the second frame buffer 842 in response to a screen switching event.

[0241] Therefore, in the folded or unfolded state, the screen can be seamlessly provided by switching between the first display and the second display.

[0242] Fig. 9 is a diagram illustrating a method of processing a touch event detected in a folding operation at an electronic device according to an embodiment of the present disclosure.

[0243] Reference Fig. 9 , in electronic devices (e.g. Figure 5 ) or a first display (eg, Figure 5 When the first display 510 in the electronic device is unfolded, the processor can display the running screen of the application on the first display. At this time, a pressing event (A press) on an area of ​​the first display can be detected. According to various embodiments, when the electronic device is in the unfolded state, the second display (for example, Figure 5 The second display 520 in the embodiment and the second touch sensor (eg, Figure 5 The second touch sensor 525 in the touch screen may be in an activated state or in an inactivated state. Hereinafter, an embodiment of switching the inactivated state to the activated state in response to a folding gesture will be described.

[0244] Processor (e.g. Figure 5 The processor 530 in the embodiment may detect the start of the folding gesture. For example, the processor may detect the start of the folding gesture by covering the first housing structure (e.g., Figure 2A a first housing structure 210 in the first display) and a second housing structure (eg, Figure 2B The folding gesture is detected by the angle change between the second shell structure 220 in the shell.

[0245] When a folding gesture is detected, the processor may request the first touch sensor (eg, Figure 5 Therefore, the touch events of the first touch sensor and / or the second touch sensor can be transmitted to the processor only until the processor requests the first touch sensor and / or the second touch sensor to send touch events again. For example, from the touch controller in the hardware layer (e.g., Figure 7 751 in the kernel driver layer) and the touch driver in the kernel driver layer (e.g. Figure 7 741) to the event center (for example, Figure 7 The touch event of 732) may not be transmitted to the application (e.g., Figure 7 711 in the above).

[0246] This is to prevent touches from being mistakenly input during display switching.

[0247] Among the touch events that have occurred, the processor may discard the touch events that have not been transmitted to the application. The processor may provide the application with a cancel event (A cancel) for the touch event (A press) that has been provided to the application before the folding starts. Therefore, the application may not perform the operation corresponding to the previously received touch event (A press), or may cancel the operation that has been performed.

[0248] Touch events (B press, C press) occurring while the folding gesture is being performed may not be transmitted to the processor.

[0249] When the folding gesture is completed, the processor can switch the first display to an inactive state and switch the second display to an active state. The timing of the state switching between the first display and the second display is not limited to the above. In some cases, the first display and the second display can be turned on at the same time for a period of time.

[0250] The processor may generate and display a touch lock screen on the second display in response to the folding gesture. The processor may prevent unintentional touch input from being sent to the application by generating the touch lock screen as an upper layer of the application window in the z order.

[0251] When the touch lock screen is displayed, the processor can activate the second touch sensor and request the first touch sensor and / or the second touch sensor to resume the transmission of the touch event. Regardless of the activated touch sensor, the processor can request both the first touch sensor and the second touch sensor to stop or resume the transmission of the touch event.

[0252] Therefore, a touch event (A release) occurring before the touch lock screen is displayed may not be provided to the application. This is to prevent the touch input from being input by mistake, because the user may maintain the holding state for folding even just after the second display is switched to the activated state.

[0253] The second touch sensor of the second display can provide the processor with touch events that occur after the touch lock screen is generated. For example, from the perspective of the user or the touch sensor, the touch events of B release and C release are operations related to the touch events of B press and C press. Because the touch events of B press and C press occur during folding, the touch events of B press and C press may not be transmitted to the processor. Therefore, even if the touch events of B release and C release are transmitted from the second touch sensor, the processor may ignore the touch events of B release and C release, and may not perform operations corresponding to the touch events of B release and C release. Alternatively, the processor may not provide the touch events of B release and C release to the application.

[0254] According to another embodiment, the processor may transmit all touch events received from the second touch sensor to the application after generating the touch lock screen. Then, among these touch events, the application may regard some touch events (such as B release and C release) received without corresponding press events as errors, so that they may not be reflected in the application state.

[0255] Thereafter, when a new touch event of D press is provided from the second touch sensor, the processor may perform an operation corresponding to the D press. For example, the processor may remove the touch lock screen from the display in response to a touch event (D press and D release) occurring on the second display while the touch lock screen is displayed, and may display the execution screen of the application on the second display. Thereafter, the processor may provide the application with a touch event occurring while the execution screen of the application is displayed.

[0256] and Fig. 9 Differently, when there is no touch event of D press input within a given time (eg, approximately 5 seconds), the processor may terminate displaying the touch lock screen and turn off the second display.

[0257] Fig. 10A , Fig. 10B , Fig. 10C , Fig. 10D , Fig.10E and Fig.10F are screenshots illustrating a touch lock screen displayed on an electronic device according to various embodiments of the present disclosure.

[0258] According to various embodiments, the processor (eg, Figure 5 The processor 530 in the second display 1020 may display a touch lock screen 1070 on the second display 1020 in response to the folding gesture. In this case, the processor may generate the touch lock screen 1070 based on the security level assigned to the application and operate in a non-security mode, a weak security mode, or a strong security mode depending on the security level. Although the touch lock screen determined according to the security mode will be described, this is not to be construed as limiting. For example, Fig. 10A The illustrated touch lock screen 1070 is not necessarily limited to being displayed only in the weak security mode.

[0259] Reference Fig. 10A , showing an example of a touch lock screen 1070 displayed in a weak security mode.

[0260] For example, when the first display (eg, Figure 5 When the first display 510 in the display is unfolded, the processor can execute the Internet application in the foreground and display the running screen of the Internet application on the first display. At this time, the second display 1020 can be turned off in the power saving mode or can be in the always-on display (AOD) mode.

[0261] When the folding gesture is detected, the processor may identify the security level assigned to the Internet application as the first level corresponding to the weak security mode. The security level assigned to the application may be included in the attribute information of the application and may be changed according to the user's setting.

[0262] According to various embodiments, when the security level is set to the first level, the processor may generate a touch lock screen 1070 at least partially including a semi-transparent area. In this case, the touch lock screen is displayed as an upper layer compared to the execution screen 1060 of the application, and the touch lock screen is displayed to partially overlap the execution screen of the application.

[0263] The touch lock screen 1070 may include an icon 1071 indicating the execution screen 1060 of the Internet application being executed in the lower layer of the touch lock screen 1070. The processor may adjust the size of the execution screen 1060 of the Internet application based on the resolution of the second display 1020 in response to the folding gesture.

[0264] Because the first display covers most of the first surface of the housing and the second display 1020 covers a portion (eg, half) of the second surface of the housing, the first display and the second display 1020 may have different resolutions (or aspect ratios).

[0265] The processor may display the generated touch lock screen 1070 on an upper layer of the execution screen 1060 of the Internet application.

[0266] Reference Fig. 10A , because the touch lock screen 1070 includes a semi-transparent area, the execution screen 1060 of the Internet application set in the lower layer can also be recognized by the user.

[0267] Fig. 10B An example of a touch lock screen displayed in strong security mode is shown.

[0268] For example, when the first display is unfolded, the processor may execute a memo application having a security level set to a second level in the foreground and display an execution screen of the memo application on the first display.

[0269] When a folding gesture is detected, the processor may identify the second level assigned to the executed memo application and generate a touch lock screen 1080 containing guidance information for releasing the security state. The guidance information is information for guiding an unlocking method (e.g., pattern input, password input, iris recognition, fingerprint recognition, etc.) in a locked mode.

[0270] Reference Fig. 10B , the guide information may have an image 1081 for inputting an unlock pattern. In this case, the size and / or resolution of the guide information during the expanded state is reduced compared to the size and / or resolution of the guide information displayed in the first display.

[0271] In the strong security mode, in order not to expose information of the running application, the processor may display the touch lock screen 1080 opaquely on the second display 1020 .

[0272] In this case, when user authentication (e.g., pattern input, password input, iris recognition, fingerprint recognition, etc.) is completed while the touch lock screen 1080 is displayed, the processor may display the execution screen of the application on the second display 1020. According to one embodiment, the processor may display another application (e.g., a home screen or an application running in the background) on the second display 1020 instead of the executed application.

[0273] According to various embodiments, the processor may determine the security level or execution mode based on the attributes of the folding gesture. For example, the attributes of the folding gesture may include the time difference between the start time point and the completion time point of the folding gesture, the direction of the second display 1020 determined by the direction of the folding gesture after folding (i.e., whether it is a visible direction for the user), or the housing structure moved during folding (e.g., Figure 2A Acceleration comparison between the first shell structure 210 and the second shell structure 220).

[0274] The application attributes and the folding gesture attributes used to determine the security level or operation mode may be changed through user settings.

[0275] Fig. 10C Another example of a touch lock screen is shown. Fig. 10C The touch lock screen is displayed in weak security mode, but not limited to this

[0276] Reference Fig. 10C , when the electronic device 1000 is folded, the processor may display a touch lock screen composed of a transparent layer on the second display 1020 to overlap the application execution screen 1060. In this case, the touch lock screen may include an object 1075 such as a specific phrase (e.g., touch lock) for indicating a touch lock state. Because the touch lock screen is transparent, the application execution screen 1060 may be seen by the user as it is.

[0277] Thereafter, when an input to the object 1075 of the touch lock screen or a predetermined touch input such as a swipe is received, the touch lock screen can be removed. For example, in addition to a swipe, the predetermined touch input may include any touch input that satisfies a predetermined input strength, input direction, input frequency, input duration, and / or distance.

[0278] While the touch lock screen is displayed, a touch occurring on the application execution screen 1060 may be rejected, and visual or tactile feedback corresponding to the touch may be provided.

[0279] Fig. 10D Yet another example of a touch lock screen is shown.

[0280] Reference Fig. 10D, when the electronic device 1000 is folded, the processor may display a touch lock screen composed of a transparent layer and display an object 1076 such as a specific phrase (e.g., touch lock) for indicating a touch lock state on an outer area 1077 of the application execution screen 1060. Thereafter, when an input to the object 1076 of the touch lock screen or a predetermined touch input such as a swipe is received, the touch lock screen may be removed. While the touch lock screen is displayed, a touch occurring on the application execution screen 1060 may be rejected, and visual or tactile feedback corresponding to the touch may be provided.

[0281] Fig.10E Yet another example of a touch lock screen is shown.

[0282] Reference Fig.10E , the processor may generate a touch lock screen 1090 at least partially including a semi-transparent area, and display the generated touch lock screen 1090 on the second display 1020. The touch lock screen 1090 may include a certain object 1091 for removing the touch lock screen. When a touch input for the object 1091 of the touch lock screen 1090 is received, the touch lock screen 1090 may be removed, and the application execution screen 1060 may be displayed.

[0283] Reference Fig.10F , the processor may turn off the second display without displaying the touch lock screen. For example, when the electronic device 1000 is completely folded, the processor may turn off the second display 1020 and display an object 1095 for turning on the second display 1020. When a touch input for the object 1095 is received, the processor may turn on the second display 1020 and display the application execution screen.

[0284] FIG. 11A to FIG. 11E are screenshots illustrating a screen displayed on each display of an electronic device in a folding operation according to various embodiments of the present disclosure.

[0285] According to various embodiments, a processor (e.g., Figure 5 The processor 530 in the embodiment may determine a method of displaying the application on the second display 1120 based on whether the execution screen of the application is resizable.

[0286] FIG. 11A to FIG. 11C An example of an Internet application being displayed as a resizable application is shown.

[0287] Reference Fig.11A, in the electronic device 1100 , when the first display 1110 is unfolded, the processor may generate an execution screen 1150 of the Internet application corresponding to the resolution and density of the first display 1110 , and display the generated screen 1150 on the first display 1110 .

[0288] Reference Fig. 11B When a folding gesture is detected, the processor may generate a touch lock screen 1170. At the same time, the processor may send a screen switching event to the Internet application so that the Internet application may redraw the application execution screen according to the resolution and density of the second display 1120.

[0289] The touch lock screen 1170 may include an icon 1171 indicating an execution screen 1160 of an application that is being executed on a lower layer of the touch lock screen 1170 .

[0290] According to various embodiments, the processor may generate a touch lock screen 1170 at least partially including a semi-transparent area, and display the touch lock screen 1170 on an upper layer of the resized execution screen 1160 of the Internet application.

[0291] As mentioned above Fig. 10A and Fig. 10B As described, the processor may generate the touch lock screen 1170 based on the security level of the application and / or the attributes of the folding gesture. After displaying the touch lock screen 1170, the processor may perform an operation according to a touch event of the second touch sensor of the second display 1120.

[0292] According to various embodiments, when a specific input (e.g., long press) is received while the touch lock screen 1170 is displayed, the processor may process the received input as an input to the execution screen 1160 displayed at the lower layer of the touch lock screen 1170, thereby performing a corresponding operation. On the contrary, when a touch input of an undetermined type is input, the touch input may not be processed as an input to the application execution screen.

[0293] According to various embodiments, the touch lock screen 1170 may have a partially removed portion. For example, when the touch lock screen 1170 is formed by a translucent screen, at least a portion thereof may be completely transparent. Even when the touch lock screen 1170 is being displayed, the processor may provide a touch event to the application in response to a touch input for a completely transparent portion, and update the application running screen. For example, when an Internet application is running, even if the touch lock screen is displayed, the portion of the touch lock screen corresponding to the web page refresh button, the favorites button, and the URL input window may be removed to receive user input. When the user touches the web page refresh button, the application running screen may be updated by refreshing the web page while maintaining the display of the touch lock screen 1170.

[0294] Reference Fig. 11C , when a predetermined touch input (e.g., swipe) occurs on the touch lock screen 1170, the processor may remove the touch lock screen 1170 displayed on the upper layer, thereby displaying the application execution screen 1160. The application execution screen 1160 may be different from the application execution screen 1150 displayed on the first display 1110. For example, because time passes, the execution state of the application before folding may change after folding, and thus the application execution screen may be updated.

[0295] Reference Fig.11D , when the electronic device 1100 is folded, the processor may display one or more application icons 1180 on the second display 1120. These icons 1180 may be related to applications set by the user, frequently used applications, and / or recently used applications. When receiving an input for one of the application icons 1180, the processor may immediately run the corresponding application and display it on the second display 1120.

[0296] Reference Fig.11E , when the electronic device 1100 is folded, the processor may display icons 1190 corresponding to the plurality of applications 1150 displayed on the multi-screen in the unfolded state. Fig.11E An Internet application 1151, a calendar application 1152, and an album application 1153 displayed on the multi-screen in an unfolded state are shown. After the electronic device is folded, the processor may display icons 1190 corresponding to the above applications on the second display 1120. Then, when an input for one of the icons 1190 is received, the processor may immediately run the corresponding application and display it on the second display 1120. In addition, when a predetermined input (e.g., swipe, password input, etc.) for touching the lock screen is received, the processor may display the application previously displayed on the multi-screen on the second display 1120.

[0297] According to another embodiment, when folded, the processor may display, on the second display, an icon corresponding to at least one application displayed on the first display in the unfolded state and an application running in the background.

[0298] FIG. 12A to FIG. 12D are screenshots illustrating a screen displayed on each display of an electronic device in a folding operation according to various embodiments of the present disclosure.

[0299] FIG. 12A to FIG. 12D An example of a video application is shown where the display does not support changes in resolution (or aspect ratio) but can be resized by the processor.

[0300] Reference Fig. 12A In the electronic device 1200, when the first display 1210 is unfolded, the processor (eg, Figure 5 The processor 530 in the display 1200 may generate a running screen 1250 of the video application to correspond to the resolution and density of the first display 1210 and display the generated screen 1250 on the first display 1210.

[0301] Reference Fig. 12B , the processor may generate and display a touch lock screen 1270 on the second display 1220 in response to the folding gesture. In this case, the touch lock screen 1270 may at least partially include a semi-transparent area and may be displayed on an upper layer of the resized running screen 1260 of the video application.

[0302] Since the video application does not support resolution change, the processor may forcibly change the resolution of the execution screen of the video application according to the resolution (or aspect ratio) of the second display 1220. Therefore, in contrast to the execution screen 1250 of the video application displayed on the first display 1210, the execution screen 1260 of the video application displayed on the second display 1220 may have an aspect ratio that is, for example, horizontally extended.

[0303] Reference Fig. 12C When a predetermined touch input (e.g., swipe) occurs on the touch lock screen 1270, the processor may remove the touch lock screen 1270 displayed on the upper layer, thereby displaying the application execution screen 1261. At this time, the execution screen 1261 of the video application may have an aspect ratio that is further horizontally expanded according to the resolution of the second display 1220.

[0304] In addition, the processor may output a certain button 1265 for converting the resolution of the execution screen 1261 of the video application into the original resolution on the second display 1220 .

[0305] Reference Fig.12DWhen the above button 1265 is selected, the processor may adjust the size of the running screen 1261 of the video application to correspond to a predetermined resolution, that is, a resolution (aspect ratio) of the video application displayed on the first display 1210. Then, the processor may display the resized screen 1262 on the second display 1220.

[0306] Fig.13A , Fig. 13B , Fig. 13C and Fig.13D are screenshots illustrating a screen displayed on each display of an electronic device in a folding operation according to various embodiments of the present disclosure.

[0307] FIG. 13A to FIG. 13D An example of a game application that does not allow the size of the running screen to be adjusted is shown. For example, the game application described below may be an application that does not support changing resolution and / or density during runtime and is configured to be forced to terminate when attempting to change the resolution.

[0308] Reference Fig.13A In the electronic device 1300, when the first display 1310 is unfolded, the processor (eg, Figure 5 The processor 530 in the display 1300 may generate a running screen 1350 of the game application to correspond to the resolution and density of the first display 1310 and display the generated screen 1350 on the first display 1310 including the specific area 1351.

[0309] Reference Fig. 13B , the processor may generate and display a touch lock screen 1380 on the second display 1320 in response to the folding gesture. According to various embodiments, the touch lock screen 1380 may include a button 1381 for selecting an application restart or a compatible mode. As described above, the game application may not support changing the resolution during runtime. Therefore, in order to run the game application on the second display 1320 having a resolution different from the resolution of the first display 1310 while running the game application on the first display 1310, it may be necessary to rerun the game application after termination.

[0310] The processor may generate a thumbnail image 1360 having an area corresponding to the size of the second display 1320 in the execution screen 1350 of the game application displayed on the first display 1310 (eg, Fig.13A Then, the processor may display a thumbnail image 1360 on the second display 1320, and may also display a touch lock screen 1380 on an upper layer of the thumbnail image 1360.

[0311] Reference Fig. 13C, when the user selects the application restart button, the running game application can be terminated and re-run. In this case, the processor can generate an operation screen 1385 of the re-running game application according to the resolution and density of the second display 1320.

[0312] Reference Fig.13D When the user selects the compatible mode button, the processor may not send the screen switching event to the game application, and may maintain the state of running the game application in the background. In this case, the processor may pause the game application.

[0313] The processor may display the main screen 1380 on the second display 1320 at least partially concurrently with the background execution of the game application. According to another embodiment, the processor may display the screen of the application having the highest rank in the z-order on the second display 1320 in addition to the game application.

[0314] Thereafter, when the first display 1310 is expanded, the processor may automatically set the gaming application running in the background back to the top of the z-order and change the paused state to the resumed state, thereby allowing the gaming application to be continuously used on the first display 1310 .

[0315] Fig.14 is a screenshot showing a screen displayed on each display of an electronic device in an expansion operation according to an embodiment of the present disclosure.

[0316] Reference Fig.14 , the electronic device 1400 is shown with an Internet application that is resizable and operates in a weak security mode running.

[0317] When a fold gesture is detected, the processor (e.g., Figure 5 The processor 530 in the second display 1420 may generate a touch lock screen 1470 and display the touch lock screen 1470 on the second display 1420. The touch lock screen 1470 may at least partially include a semi-transparent area and may be displayed on an upper layer of the execution screen 1460 of the Internet application.

[0318] Thereafter, in response to a predetermined touch input on the touch lock screen, the processor may remove the touch lock screen 1470 and display the execution screen 1460 of the Internet application.

[0319] The processor may detect an expansion gesture for the first display 1410 while displaying the touch lock screen 1470 or while displaying the execution screen 1460 of the Internet application with the touch lock screen 1470 removed. The processor may send a screen switching event to the Internet application in response to the expansion gesture, and the Internet application may output the execution screen 1450 resized to correspond to the resolution of the first display 1410.

[0320] When the unfold gesture is completed, the processor may remove the Internet application from the second display 1420 and enter a power saving mode or output an AOD screen.

[0321] Fig.15 is a screenshot showing a screen displayed on each display of an electronic device in an expansion operation according to an embodiment of the present disclosure.

[0322] Reference Fig.15 , shows the electronic device 1500 in a case where a game application that does not allow adjustment of the size of the running screen is running.

[0323] When the electronic device 1500 is folded, the processor (eg, Figure 5 The processor 530 in the example embodiment may display a running screen 1561 of a game application on the second display 1520.

[0324] Thereafter, when an expand gesture is detected, the processor may recognize, based on attribute information of the gaming application, that the gaming application does not support changing resolution and / or density during runtime and is configured to be forcibly terminated when attempting to change resolution.

[0325] In response to the unfolding gesture, the processor may display an execution screen 1562 of the game application corresponding to the resolution and density of the second display 1520 on the first display 1510. For example, the processor may display an execution screen 1562 having the same resolution and density as an execution screen 1561 displayed on the second display 1520 in the folded state on the first display 1510 in the unfolded state. At this time, an area 1564 of the first display 1510 other than the execution screen may be processed as black. Therefore, although the game application does not support resizing, the screen may be seamlessly switched from the second display 1520 to the first display 1510.

[0326] Thereafter, when the user chooses to restart, the processor may terminate the execution of the application, re-execute the application, and display the execution screen 1551 of the re-executed application on the first display 1510. In this case, the game application may generate the execution screen 1551 based on the resolution and density of the first display 1510.

[0327] Fig.16 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.

[0328] Reference Fig.16 , the method 1600 shown can be referred to above Figures 1A to 15 The electronic device described (e.g., Figure 5 The electronic device 500) is executed, and the description of the above technical features will be omitted below.

[0329] In operation 1610, the electronic device may display a first display (eg, Figure 5 The running screen of the application is displayed on the first display 510 in the display. At this time, the second display (for example, Figure 5 The second display 520 in the embodiment and the second touch sensor (eg, Figure 5 The second touch sensor 525) in the embodiment may be in an inactive state.

[0330] In operation 1620, the electronic device may detect the start of the folding gesture. For example, the electronic device may detect the start of the folding gesture through a change in the angle between the first housing structure and the second housing structure of the electronic device.

[0331] When the folding gesture starts, in operation 1630, the electronic device may request the first touch sensor of the first display and / or the second touch sensor of the second display to stop transmitting touch events. In response to the transmission stop request, the event center (e.g., Figure 7 The touch events collected by the event center 732 in the example may not be sent to the application (e.g., Figure 7 The second touch sensor does not generate a touch event because the second touch sensor is still in an inactive state even if a folding gesture is detected. However, regardless of the type of touch sensor, the electronic device can send a transmission stop request for a touch event.

[0332] In operation 1640, the electronic device may identify state information of the running application. According to various embodiments, the application state information may include information related to a security level and / or whether the application is resizable.

[0333] In operation 1650, the electronic device may display a touch lock screen (eg, Fig. 10A Touch lock screen in 1070 or Fig. 10B The electronic device may generate a touch lock screen based on the application state information. For example, the electronic device may display a semi-transparent touch lock screen on the upper layer of the application execution screen. The electronic device may activate the second touch sensor of the second display in response to displaying the touch lock screen.

[0334] In operation 1660, the electronic device may process a touch event received from the second touch sensor of the second display after displaying the touch lock screen. When a predetermined touch input (e.g., swipe) occurs on the touch lock screen, the electronic device may remove the touch lock screen and display the application execution screen on the second display.

[0335] Fig.17 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.

[0336] Reference Fig.17 , a control method 1700 performed by an electronic device is shown. After detecting the folding gesture, the electronic device determines an operation mode depending on a security level of an application, and performs a control method according to the determined operation mode.

[0337] In operation 1710 , the electronic device may detect a folding gesture.

[0338] In operation 1720, the electronic device may identify state information of the application. The application state information may include a security level assigned to the application, and the security level may be determined based on attribute information of the application or a setting of the user. According to another embodiment, the electronic device may determine the operating mode based on the attributes of the folding gesture. For example, the processor may determine the operating mode based on the time difference between the start time and the completion time of the folding gesture, whether the second display after folding is in the visible direction of the user, or the shell structure moved by folding (e.g., Figure 2A The safety level of the operating mode is determined by the acceleration of the first shell structure 210 and the second shell structure 220).

[0339] In operation 1731, the electronic device may determine to operate in a non-secure mode. The non-secure mode may be used for an application (such as a call application) that runs in an unfolded state, does not require security, and requires continuity of operation.

[0340] In operation 1732, the electronic device may resize the execution screen of the executing application (eg, call application) and display the resized screen on the second display.

[0341] In operation 1741 , the electronic device may determine to operate in a weak security mode.

[0342] In operation 1742, the electronic device may generate and display a touch lock screen on the second display. The electronic device may display a semi-transparent touch lock screen on the upper layer of the application execution screen. In this case, the size of the application execution screen may be adjusted according to the resolution and density of the second display. The electronic device may process a touch event received from the second touch sensor of the second display in response to displaying the touch lock screen. Fig. 10A Describes the touch lock screen that is displayed in weak security mode.

[0343] In operation 1743 , the electronic device may detect a predetermined touch input (eg, swipe) on the touch lock screen.

[0344] In operation 1744 , the electronic device may remove the display touch lock screen and display the application execution screen on the second display.

[0345] In operation 1751 , the electronic device may determine to operate in a strong security mode.

[0346] In operation 1752, the electronic device may generate and display a touch lock screen for a strong security mode on the second display. In this case, the touch lock screen may be opaque, and thus the application execution screen may be covered by the opaque touch lock screen. The touch lock screen may contain information for guiding user authentication (e.g., pattern input, password input, iris recognition, fingerprint recognition, etc.).

[0347] In operation 1753, the electronic device may receive a user input for a security pattern on the touch lock screen and determine whether the pattern is correct. When the pattern is correct, in operation 1754, the electronic device may run an application in the background and display another application (e.g., a home screen) on the second display at least partially simultaneously.

[0348] The above has been referred to Fig. 10B Describes the touch lock screen that is displayed in strong security mode.

[0349] In operation 1743 or 1753, if no touch input is received after displaying the touch lock screen, the electronic device may check whether a predetermined time (e.g., 5 seconds) has passed in operation 1761. If the time has passed, the electronic device may switch the second display to a power saving mode in operation 1762.

[0350] Fig.18 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.

[0351] Reference Fig.18, shows a control method 1800 of the electronic device after a folding gesture is detected, depending on whether an application is resizable.

[0352] In operation 1810 , the electronic device may detect a folding gesture.

[0353] In operation 1820, the electronic device may identify state information of the application. In operation 1830, based on the state information, the electronic device may determine whether the execution screen of the application is resizable.

[0354] In operation 1841 , when the application is resizable (eg, an Internet application), the electronic device may generate a touch lock screen and display the touch lock screen on an upper layer of the resized application on the second display.

[0355] In operation 1842 , the electronic device may remove the touch lock screen in response to a predetermined touch input with respect to the touch lock screen, and display the resized application on the second display.

[0356] When it is determined in operation 1830 that the running screen of the application is not resizable, in operation 1850, the electronic device may determine whether the application can continue to operate when resizing. For example, a video application may be resized by the processor even if a change in resolution (or aspect ratio) is not supported. In another example, a game application may not support a change in resolution and / or density during runtime and may be forcibly terminated when an attempt is made to change the resolution.

[0357] In operation 1861, the electronic device may display the touch lock screen on the upper layer of the resized application (e.g., video application). In this case, because the application does not support changing the resolution, the electronic device may forcibly change the resolution of the running screen of the application according to the resolution (or aspect ratio) of the second display.

[0358] In operation 1862, the electronic device may remove the touch lock screen in response to a predetermined touch input for the touch lock screen, and display the resized application on the second display. In this case, the running screen of the video application displayed on the second display may have an aspect ratio such as horizontal expansion, as opposed to the running screen of the video application displayed on the first display. A button for converting the resolution of the running screen of the application to the original resolution may be output on the second display.

[0359] When input for selecting the restart button is received in operation 1863, in operation 1864, the electronic device may restart (re-run) the application and display a running screen of the application on the second display that is resized to correspond to a given resolution, i.e., the resolution (aspect ratio) of the video application displayed on the first display.

[0360] When it is determined in operation 1850 that an application (e.g., a game application that does not support a change in resolution and / or density during runtime) is not operable when resized, the electronic device may generate a touch lock screen corresponding to the application and display it on the second display in operation 1870. At this time, the touch lock screen may include a button for selecting an application restart or a compatible mode.

[0361] When the button for application restart is selected in operation 1881, the electronic device may terminate and restart (re-run) the running application in operation 1882. In this case, the electronic device may generate the running screen of the re-running application according to the resolution and density of the second display.

[0362] In operation 1883 , the electronic device may display the execution screen of the application on the second display.

[0363] When a button of the compatible mode (or continue) is selected in operation 1891, the electronic device runs the application in the background in operation 1892. In this case, the electronic device may suspend the application.

[0364] In operation 1893 , the electronic device may display another application (eg, a home screen) on the second display while displaying the game application in the background.

[0365] Thereafter, when the electronic device is unfolded, the electronic device can automatically set the game application running in the background back to the top of the z-order and change the pause state to the resume state, thereby allowing the game application to continue to be used on the first display.

[0366] In the following, reference will be made to FIG. 19A to FIG. 20C An electronic device having a form factor of a longitudinally (ie, vertically) folded structure is described. Figures 3 to 18 The described features may also be applied to the electronic device described below. Although an inner-folding foldable display structure will be described below, other various form factors such as an outer-folding foldable display structure, a dual display structure, a G-folding structure, an S-folding structure, or a rollable display structure may be implemented in a longitudinal (vertical) folding structure.

[0367] Fig.19A , Fig.19B and Fig.19C is a perspective view illustrating a use state of a vertically foldable electronic device in a folding operation or an unfolding operation according to various embodiments of the present disclosure.

[0368] Reference Fig.19A , showing a first surface of the electronic device 1900 in an unfolded state, Fig.19B The second surface of the electronic device 1900 is shown in the unfolded state.

[0369] Reference Fig.19A and 19B , the electronic device 1900 may include a foldable housing, a first display 1930 and a second display 1940 .

[0370] The foldable housing includes a first housing structure 1910 and a second housing structure 1920 connected by a hinge structure. The first housing structure 1910 and the second housing structure 1920 can be folded with each other around a folding axis. In a folded state, the first housing structure 1910 and the second housing structure 1920 can be arranged to face each other.

[0371] The first display 1930 may be folded and disposed on the first surface (or front surface) of the first housing structure 1910 and the second housing structure 1920. In this embodiment, the first housing structure 1910 and the second housing structure 1920 may be disposed above each other, and the folding axis may extend laterally (in the horizontal direction). When the electronic device 1900 is in the unfolded state, the application may be displayed longitudinally (in the vertical direction).

[0372] One or more sensors 1990 such as a camera and an illumination sensor may be provided at a lower portion of the second housing structure 1920 of the electronic device 1900. The sensor 1990 may be visible from the outside even in a folded state. The length of the first housing structure 1910 in the vertical direction may be smaller than the length of the second housing structure 1920 in the vertical direction. Therefore, when the electronic device 1900 is folded, the sensor 1990 provided at the lower portion of the second housing structure 1920 may be visible from the outside. Alternatively, when the electronic device 1900 may not include the sensor 1990, the first housing structure 1910 and the second housing structure 1920 may have substantially the same length.

[0373] The second display 1940 may be provided on a second surface (or rear surface) of the first housing structure 1910 .

[0374] The user may fold the electronic device 1900 about a folding axis extending laterally by applying force to the electronic device 1900 in the unfolded state.

[0375] Reference Fig.19C When the electronic device 1900 is completely folded, the first display 1930 cannot be seen from the outside. The application screen can be displayed through the second display 1940.

[0376] Fig. 20A , Fig. 20B and Fig. 20Care screenshots illustrating a screen displayed on each display of an electronic device in a folding operation according to various embodiments of the present disclosure.

[0377] Reference Fig. 20A In the electronic device 2000, when the first display 2010 is unfolded, the processor (eg, Figure 1B The processor 120 in the embodiment may generate an execution screen 2050 of the application to correspond to the properties (e.g., size, ratio, resolution, density, etc.) of the first display 2010, and display the generated execution screen 2050 on the first display 2010. In the vertically foldable electronic device 2000, the first display 2010 is long in the vertical direction in the unfolded state, so that the application screen 2050 may have a portrait form.

[0378] According to various embodiments, when a folding gesture is detected, the processor may generate a touch lock screen 2070. The processor may generate a touch lock screen 2070 according to a security level of an application. Fig. 20B , because an Internet application with a weak security level is running, the processor can generate a semi-transparent touch lock screen 2070. At least partially simultaneously, the processor can send a screen switching event to the Internet application, and the Internet application can redraw the application execution screen according to the properties of the second display 2020. Because the length is reduced in the vertical direction during vertical folding, the application execution screen can be redrawn accordingly.

[0379] Reference Fig. 20B , the processor may generate a touch lock screen 2070 at least partially including a semi-transparent area, and display the touch lock screen 2070 on an upper layer of the resized execution screen 2060 of the Internet application.

[0380] Reference Fig. 20C , when a predetermined touch input (eg, swiping) occurs on the touch lock screen 2070 , the processor removes the touch lock screen 2070 displayed on the upper layer and displays the application execution screen 2060 .

[0381] FIG. 20A to FIG. 20C relates to implementation methods for running Internet applications, but FIG. 12A to FIG. 15 Other implementations may also be applied to FIG. 19A to FIG. 19C Vertical folding structure.

[0382] Now, refer to FIG. 21A to FIG. 27 Various embodiments are described in which an electronic device is implemented as an out-folding foldable display structure.

[0383] Fig.21A , Fig.21B and Fig. 21Cis a perspective view illustrating a use state of an outward-folding type electronic device in a folding operation or an unfolding operation according to various embodiments of the present disclosure.

[0384] Reference Fig.21A , the electronic device 2100 may include a first housing structure 2110 and a second housing structure 2120 that are rotatably coupled by a hinge to be folded relative to each other. According to one embodiment, the first housing structure 2110 and the second housing structure 2120 may have the same size so that the back covers of the first housing structure 2110 and the second housing structure 2120 may not be visible from the outside when folded. According to another embodiment, the first housing structure 2110 may be larger than the second housing structure 2120 in the horizontal direction. In this case, a portion of the first housing structure 2110 may be visible from the outside when folded, and the electronic device 2100 may include various sensors, such as a camera provided in the visible portion.

[0385] According to various embodiments, the display 2130 may be provided on the front surfaces of the first housing structure 2110 and the second housing structure 2120. The display 2130 may be divided into a first area 2131 and a second area 2132 based on the folding axis (see Fig. 21C ). The first area 2131 may have the same size as the second area 2132 or a size larger than the second area 2132. The display 2130 may include a touch sensor that detects a touch input on the display 2130.

[0386] Sensors such as a camera and an illumination sensor may be provided on the rear surface of the first housing structure 2110 and / or the second housing structure 2120. In addition, an additional display (not shown) may be provided on the rear surface of the first housing structure 2110 and / or the second housing structure 2120. Contrary to the display 2130 provided on the front surface, the additional display may not be folded.

[0387] Reference Fig.21B , the first shell structure 2110 and the second shell structure 2120 can be folded around the folding axis. At this time, the first shell structure 2110 and the second shell structure 2120 can be folded in a counterclockwise direction (i.e., in a direction in which the rear surfaces of the first shell structure 2110 and the second shell structure 2120 face each other in the folded state), and the first area 2131 and the second area 2132 of the display 2130 are seen from the outside. When the angle between the first shell structure 2110 and the second shell structure 2120 reaches a certain value (e.g., about 10 degrees) by the force applied to the first shell structure and / or the second shell structure by the user, the electronic device 2100 can determine that the unfolded state is switched to the folded state.

[0388] Reference Fig. 21CIn the folded state, the first area 2131 of the display 2130 may be disposed on the front surface of the electronic device 2100, and the second area 2132 of the display 2130 may be disposed on the rear surface of the electronic device 2100. According to an embodiment, because the first housing structure 2110 and the first area 2131 of the display 2130 are respectively larger than the second housing structure 2120 and the second area 2132 of the display 2130, the second area 2132 of the display 2130 may partially cover the rear surface of the electronic device 2100 when the rear cover of the first housing structure 2110 is partially exposed. In the exposed portion, various sensors such as a camera and an illumination sensor may be disposed to be visible from the outside.

[0389] although Fig. 21C The first housing structure 2110 and the first area 2131 of the display 2130 are shown to be respectively larger than the second housing structure 2120 and the second area 2132 of the display 2130, but the first housing structure 2110 and the first area 2131 of the display 2130 may respectively have the same size as the second housing structure 2120 and the second area 2132 of the display 2130. In the latter case, no sensor is provided on the back cover of the second housing structure 2120, and when folded, the back cover of the second housing structure 2120 cannot be seen from the outside.

[0390] Reference Fig.21A , Fig.21B and Fig. 21C , the electronic device 2100 is folded outwardly around a vertically extending folding axis. FIG. 19A to FIG. 19C As shown, the electronic device 1900 can be folded outwardly around a horizontally extending folding axis.

[0391] Fig. 22 is a block diagram illustrating an electronic device according to an embodiment of the present disclosure.

[0392] Reference Fig. 22 , the electronic device 2200 may include a display 2210, a processor 2230, and a memory 2240. Some of such components of the electronic device 2200 may be omitted or replaced. The electronic device 2200 may include Figure 1A and / or Figure 1B The electronic device 2200 may include at least some of the configurations and / or functions of the electronic device 101 in FIG. FIG. 21A to FIG. 21C The outward folded structure is shown.

[0393] According to various embodiments, the display 2210 may be disposed in a housing (eg, Fig.21AWhen the electronic device 2200 is folded, the first area (eg, Fig. 21C The first region 2131 in the example and the second region (eg, Fig. 21C The second area 2132 in the housing may be respectively disposed on the front surface and the rear surface of the electronic device 2200. According to an embodiment, the electronic device 2200 may include an additional display (not shown) on the rear surface of the housing, and the additional display may not be folded.

[0394] According to various embodiments, the display 2220 may include a touch sensor (not shown) that detects a touch input occurring on the display 2220. The touch sensor may provide a touch event corresponding to the touch input to the processor 2230. The touch event may include a press event, a release event, and / or a cancel event.

[0395] According to various embodiments, the processor 2230 is configured to perform operations or data processing related to control and / or communication of components of the electronic device 2200, and may include Figure 1A and / or Figure 1B At least some of the configurations and / or functions of the processor 120 shown. The processor 2230 may be functionally connected, operatively connected, and / or electrically connected to internal components of the electronic device 2200 including the display 2210 and the memory 2240.

[0396] According to various embodiments, when the electronic device 2200 is unfolded, the processor 2230 may display the execution screen of the application on the entire area of ​​the display 2210. In the unfolded state of the electronic device 2200, the touch sensor may provide the processor 2230 with a touch event corresponding to a touch input occurring on the entire area of ​​the display 2210.

[0397] According to various embodiments, the processor 2230 may detect a folding gesture for the electronic device 2200. FIG. 21A to FIG. 21C As described above, the user can apply force to the electronic device 2200 so that the rear surfaces of the first housing structure and the second housing structure face each other, and the first area and the second area of ​​the display 2210 are also visible from the outside. Fig. 21C The form of the electronic device 2200 when folded is described.

[0398] According to various embodiments, when the folding gesture starts, the processor 2230 may request the touch sensor to stop sending touch events. This is because the touch on the display 2210 during folding is an unintentional touch by the user. According to another embodiment, when the folding gesture starts, the processor 2230 may ignore the received touch events without requesting the touch sensor to stop sending touch events. That is, even if any touch event is received, it may not be provided to the application.

[0399] According to various embodiments, the processor 2230 may cancel a touch event (e.g., a press event or a release event) that has been provided to the application before the folding gesture begins. For example, the processor 2230 may cancel the application execution that is to be implemented in response to the touch event, or cancel the application execution that has been implemented in response to the touch event.

[0400] According to various embodiments, when the folding gesture begins, the processor 2230 may provide the application with a cancel event corresponding to the previously provided touch event. For example, even if a press event actually occurs during the folding gesture, it is not the user's intention. Therefore, even if a press event is received from the touch sensor, the processor 2230 may provide the cancel event to the application. This prevents the application from being erroneously operated by recognizing the touch for folding as a touch event. Therefore, before the electronic device 2200 is folded, the application may not perform operations based on the touch event generated by the touch sensor.

[0401] According to various embodiments, the processor 2230 may change the area of ​​the display 2210 to display an application in response to the folding of the electronic device 2200. The processor 2230 may determine that one of the first area and the second area of ​​the display 2210 displays the application in the folded state. For example, in order to identify the area that the user is looking at after folding, the processor 2230 may identify the user's touch input pattern (e.g., a touch with a thumb), identify the area being viewed in the direction by using a sensor (e.g., a gravity sensor), identify the folding direction (e.g., identifying a shell structure with a higher moving speed at the edge), check a predetermined setting, or receive a selection of a specific icon after folding. The processor 2230 may display an application screen on any one of the first area and the second area by using at least one of the above-mentioned methods.

[0402] According to various embodiments, the processor 2230 may generate an application screen based on a property (eg, size, ratio, resolution, density, etc.) of one of the first region and the second region on which a screen is to be displayed.

[0403] According to various embodiments, the processor 2230 may identify whether the execution screen of the application is resizable.

[0404] When the application displayed on the display 2210 in the unfolded state is a resizable application (eg, an Internet browser), and when a folding gesture is detected, the processor 2230 may display an application screen whose size is adjusted based on a property of the first region or the second region.

[0405] When an application displayed on the display 2210 in the expanded state is a non-resizable application (e.g., a game application), and when a folding gesture is detected, the processor 2230 may display a menu for selecting restart (i.e., rerun) or continue (i.e., continue running) of the application.

[0406] According to various embodiments, the processor 2230 may generate a touch lock screen in response to the folding gesture, and display the touch lock screen on the area to be determined as the display application screen after folding. The touch lock screen may be determined based on the state information of the running application (e.g., security level and / or whether the size can be adjusted).

[0407] According to various embodiments, the processor 2230 may display a touch lock screen on the upper layer of the first area or the second area. The processor 2230 may display the touch lock screen in the foreground to cover the screen of the top application on the z order, thereby preventing unintentional touch events from being sent to the application.

[0408] According to various embodiments, the processor 2230 may process a touch event received from the touch sensor of the display 2210 after displaying the touch lock screen. After displaying the touch lock screen, the processor 2230 may release the touch lock screen in response to a touch event received from the display 2210 and provide the touch event to the running application.

[0409] According to various embodiments, the processor 2230 may operate in a non-secure mode, a weak security mode, or a strong security mode, depending on the security level assigned to the application. When folded, the processor 2230 may generate and display a touch lock screen corresponding to the security level of the running application. Alternatively, the processor 2230 may determine the security level or operating mode based on the attributes of the folding gesture.

[0410] The touch lock screen of this embodiment may include the above reference FIG. 10A to FIG. 10F Description of the touch lock screen.

[0411] Fig.23 is a block diagram illustrating a drawing engine of an electronic device according to an embodiment of the present disclosure.

[0412] Reference Fig.23 , the electronic device 2300 may store the memory (eg, Fig. 22A portion of the memory 2240 in FIG. 2 is designated as surfaces 2321 , 2322 , and 2323 for recording the running status of applications 2311 and 2312 .

[0413] The surface ejector 2330 may determine whether to display the execution screen of the application recorded on the surfaces 2321 , 2322 , and 2323 , and may also request the applications 2311 and 2312 to process the change of resolution and density according to the changed display configuration.

[0414] The frame buffer 2340 may store an execution screen corresponding to the properties (eg, size, ratio, resolution, density, etc.) of the display and generated by each of the applications 2311 and 2312 .

[0415] In a state in which the electronic device 2300 is unfolded, the surface ejector 2330 may store, in the frame buffer 2340 , an execution screen corresponding to the attributes of the display, generated by each of the applications 2311 and 2312 and recorded on the surfaces 2321 , 2322 , and 2323 .

[0416] When the electronic device 2300 is folded, the logical display configuration 2350 may update the display configuration based on the properties (size, ratio, resolution, density, etc.) of the first area or the second area to display the screen after folding.

[0417] When the display configuration is changed, the display manager 2360 may send the attributes of the first area or the second area to the application and request the application to generate an execution screen according to the changed attributes.

[0418] The surface ejector 2330 may calculate and output an area of ​​the frame buffer 2340 on which the surface is to be drawn, with reference to information on the first area or the second area on which the screen is to be displayed.

[0419] Each of the applications 2311 and 2312 may generate an execution screen of the application based on the attribute of the first region or the second region received from the display manager 2360 , and record the execution screen on the surfaces 2321 , 2322 , and 2323 .

[0420] Therefore, in the case of folding or unfolding, when the screen displayed on the entire display is switched to the first area or the second area, the screen can be provided seamlessly.

[0421] Fig.24A and Fig. 24B is a block diagram illustrating a drawing engine of an electronic device according to various embodiments of the present disclosure.

[0422] According to various embodiments, a processor (e.g., Fig. 22The processor 2230 in the embodiment may transfer the memory (e.g., Fig. 22 A certain area of ​​the memory 2240 in the display is allocated to the frame buffer 2400 to display the execution screen of the application. The processor can determine the size of the area to be allocated based on the properties of the display and the area information of the running application.

[0423] For example, when the electronic device is in the unfolded state, the execution screen of the application may be displayed on the entire display.

[0424] Reference Fig.24A , the logical display configuration 2450 can specify a surface for recording the running state of the application by using the entire area 2440 of the frame buffer 2400. When the electronic device is in the folded state, the running screen can be displayed in one of the first area and the second area of ​​the display, and no screen can be displayed in the other area.

[0425] Reference Fig. 24B , the logical display configuration 2450 can specify a surface for recording the running state of the application by using a local area 2445 corresponding to the size of the first area or the second area (or its ratio relative to the display) in the entire area of ​​the frame buffer 2400.

[0426] The processor may record the display information in a storage area associated with the display based on the application drawing information and the application setting location (eg, the entire display, the first area, or the second area).

[0427] Fig.25A , Fig.25B , Fig.25C and Fig.25D are screenshots illustrating a screen displayed on a display of an electronic device in an outward-folding operation according to various embodiments of the present disclosure.

[0428] FIG. 25A to FIG. 25D An example of displaying a resizable Internet application on a display is shown.

[0429] Reference Fig.25A In the electronic device 2500, when the display 2510 is unfolded, the processor (eg, Fig. 22 The processor 2230 in the display 2510 may generate an execution screen 2550 of the Internet application corresponding to the properties (eg, size, ratio, resolution, density, etc.) of the display 2510 and display the execution screen 2550 on the entire area of ​​the display 2510.

[0430] The processor may detect the folding of the display 2510 in the unfolded state. In response to detecting the folding, the processor may determine the area of ​​the first area 2511 and the second area 2512 of the display 2510 divided based on the folding axis, in which the running screen of the application is to be displayed. For example, in order to identify the area where the user is looking at after the folding, the processor may identify the user's touch input pattern (e.g., a touch with a thumb), identify the area viewed in the direction by using a sensor (e.g., a gravity sensor), identify the folding direction (e.g., identifying a housing structure with a higher moving speed at the edge), check a predetermined setting, or receive a selection of a specific icon after folding. The processor may display the application screen on any one of the first area 2511 and the second area 2512 by using at least one of the above methods. In the folded state, the area in which the application screen is to be displayed may be changed again according to the user's manipulation (e.g., rotation of the electronic device 2500 or a touch on an icon for changing the display area).

[0431] When the folding gesture is detected, the processor may send a screen switching event to the Internet application, and the Internet application may redraw the application execution screen according to the properties of the first area 2511 determined to display the application screen.

[0432] At least partially simultaneously, the processor may generate touch lock screen 2570 .

[0433] According to various embodiments, when folding starts, the processor may provide a visual effect 2555 indicating the progress of folding until folding is completed. The visual effect 2555 may be the same as the touch lock screen 2570. Alternatively, any other visual effect 2555 such as a certain graphic object or a shadow effect that is distinguished from the screen provided in the unfolded state may be used.

[0434] Reference Fig.25B , when folding begins, the processor can provide visual effects 2555 across the display.

[0435] Reference Fig.25C , when folding is completed, the processor may provide a visual effect 2555 only to the first area 2511 determined to display the application screen.

[0436] According to various embodiments, in the case of 25B or Fig.25C In the illustrated situation where folding is in progress, the processor may not process touch events caused by the user's touch input.

[0437] According to another embodiment, when folding begins, the processor may dynamically change the display range of the visual effect depending on the folding angle. When the electronic device 2500 begins to fold in the unfolded state, the processor may provide the visual effect to the entirety of the first area 2511 and the second area 2512 (for example, Fig.25B ). Then, as folding progresses, that is, as the angle between the first shell structure covering the first area 2511 and the second shell structure covering the second area 2512 decreases about the folding axis, the processor can reduce the display range of the visual effect in the second area 2512. For example, when the angle between the first shell structure and the second shell structure decreases to 90 degrees, the visual effect provided through the first area 2511 and the second area 2512 when folding begins can be displayed only in the entire first area 2511 and half of the second area 2512 (e.g., the half close to the first area 2511).

[0438] Thereafter, when folding is completed, all displayed images may be removed from the second region 2512 , and the touch lock screen 2570 may be displayed on the first region 2511 .

[0439] Reference Fig.25D When folding is completed, the processor may display a touch lock screen 2570 at least partially including a translucent portion on the first area 2511 of the display. The processor may display the touch lock screen 2570 on an upper layer of the resized running screen 2560 of the Internet application. The processor may display an icon 2551 indicating the running application on the touch lock screen 2570. When folding is completed, the processor may close the second area or not display information even in the open state.

[0440] After the touch lock screen 2570 is displayed, the processor may perform an operation according to the touch event for the first area 2511. At this time, the processor may not process the touch event through the touch input occurring in the second area.

[0441] When a predetermined touch input occurs on the touch lock screen 2570 displayed in the first region 2511 , the processor may remove the touch lock screen displayed in an upper layer and display the application execution screen 2560 instead.

[0442] Reference FIG. 25A to FIG. 25D The description is only to show the situation of Internet applications with weak security level. However, as with the previous reference Figures 2A to 18 Like the electronic device with an inner foldable display structure described, referring to FIG. 21A to FIG. 27 The electronic device of the described outer-folding foldable display structure can provide different touch lock screens in a non-security mode, a weak security mode, and a strong security mode.

[0443] Fig.26 is a diagram illustrating a method of processing a touch event detected in a folding operation at an electronic device according to an embodiment of the present disclosure.

[0444] Reference Fig.26 , while the electronic device is unfolded, the processor (e.g., Fig. 22 The processor 2230 in the display may display the running screen of the application on the entire display. At this time, a pressing event (A pressing) for an area of ​​the display may be detected.

[0445] The processor may detect the start of a folding gesture. For example, the processor may detect a folding gesture by a change in angle between a first housing structure covering a first area of ​​the display and a second housing structure covering a second area of ​​the display.

[0446] When a folding gesture is detected, the processor may request the touch sensor of the display to stop sending touch events. Therefore, until the processor requests the touch sensor to send touch events again, the touch events of the touch sensor may be transmitted to the processor. For example, the touch events transmitted from the touch controller in the hardware layer and the touch driver in the kernel driver layer to the event center may not be transmitted to the application.

[0447] Among the touch events that have occurred, the processor may discard the touch events that have not been transmitted to the application. For example, the processor may provide the application with a cancel event (A cancel) for the touch event (A press) that has been provided to the application before the folding starts. Therefore, the application may not perform the operation corresponding to the previously received touch event (A press), or may cancel the operation that has been performed.

[0448] Touch events (B press, C press) occurring while the folding gesture is being performed may not be transmitted to the processor.

[0449] During folding without processing touch events, the processor may provide a visual effect for indicating folding progress (e.g., Fig.25B and Fig.25C Visual effects in 2555).

[0450] When the folding gesture is completed, the processor may terminate displaying the screen in the second area determined not to display the screen when folded, and may not process a touch event occurring in the second area.

[0451] In response to the folding being completed, the processor may display a touch lock screen in the first area of ​​the display determined to display the screen when folded. In response to displaying the touch lock screen, the processor may activate the touch sensor and request the touch sensor to resume transmission of touch events.

[0452] Therefore, a touch event (A Release) occurring before the touch lock screen is displayed may not be provided to the application.

[0453] The touch sensor of the display may provide the processor with touch events that occur after the touch lock screen is generated. For example, from the perspective of the user or the touch sensor, the touch events of B release and C release are operations related to the touch events of B press and C press. Because the touch events of B press and C press occur during folding, the touch events of B press and C press may not be transmitted to the processor. Therefore, even if the touch events of B release and C release are transmitted from the touch sensor, the processor may ignore the touch events of B release and C release, and may not perform operations corresponding to the touch events of B release and C release. Alternatively, the processor may not provide the touch events of B release and C release to the application.

[0454] According to another embodiment, the processor may transmit to the application all touch events received from the touch sensor after the touch lock screen is generated. Then, among such touch events, the application may regard certain touch events (such as B release and C release) received without corresponding press events as errors, so that they may not be reflected in the application state.

[0455] Thereafter, when new touch events of D press and D release are provided from the touch sensor, the processor may perform operations corresponding to the D press and D release. For example, the processor may remove the touch lock screen from the display in response to a touch event (D press and D release) occurring in the first area of ​​the display while the touch lock screen is displayed, and may display the execution screen of the application in the first area of ​​the display. Thereafter, the processor may provide the application with a touch event occurring while the execution screen of the application is displayed.

[0456] and Fig.26 Differently, when a touch event of D press is not input within a given time (eg, approximately 5 seconds), the processor may terminate displaying the touch lock screen and turn off the second display.

[0457] Fig. 27 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.

[0458] The illustrated method 2700 can be referred to above. FIG. 21A to FIG. 26The described electronic device is executed, and the description of the above technical features will be omitted hereinafter.

[0459] Reference Fig. 27 , in operation 2710, the electronic device may display the execution screen of the application on the entire area of ​​the display in the unfolded state.

[0460] In operation 2720, the electronic device may detect the start of a folding gesture. For example, the electronic device may detect the start of a folding gesture through a change in an angle between a first housing structure and a second housing structure of the electronic device.

[0461] When the folding gesture starts, the electronic device may request the touch sensor of the display to stop transmitting touch events in operation 2730. In response to the transmission stop request, the touch events collected by the event center may not be sent to the application.

[0462] In operation 2740, the electronic device may identify state information of the running application. According to various embodiments, the application state information may include information related to a security level and / or whether the application is resizable.

[0463] In operation 2750, the electronic device may display the application execution screen in the first area of ​​the display. The electronic device may determine the area where the application execution screen will be displayed in the folded state as the first area, and redraw the application execution screen based on the properties (e.g., size, ratio, resolution, etc.) of the first area.

[0464] The electronic device may generate a touch lock screen based on the state information of the application. For example, the electronic device may display a semi-transparent touch lock screen on the upper layer of the application running screen. In addition, the electronic device may terminate the display of the screen in the second area of ​​the display and may not process the touch event occurring in the second area.

[0465] In operation 2760, after displaying the touch lock screen, the electronic device may process a touch event for the first area received from the touch sensor of the display. When a predetermined touch input (e.g., swipe) occurs on the touch lock screen, the electronic device may remove the touch lock screen and instead display the application execution screen in the first area of ​​the display.

[0466] Fig.28 is a perspective view showing an electronic device in which a part of a housing structure is rotatable 360 ​​degrees according to an embodiment of the present disclosure.

[0467] Reference Fig.28, the electronic device 2800 may include a first housing structure 2810 , a second housing structure 2820 , and a display 2830 . The display 2830 may be disposed on the front surfaces of the first housing structure 2810 and the second housing structure 2820 .

[0468] Each of the first housing structure 2810 and the second housing structure 2820 may be rotatable 360 ​​degrees. For example, when the second housing structure 2820 rotates clockwise, similar to the above-mentioned inner-folding foldable display structure, the first area and the second area of ​​the display 2830 are folded in a direction facing each other. In addition, when the second housing structure 2820 rotates counterclockwise, similar to the above-mentioned outer-folding foldable display structure, the first area and the second area of ​​the display 2830 are folded in a direction in which the first area and the second area of ​​the display 2830 are seen from the outside.

[0469] When the second housing structure 2820 is rotated clockwise as in the inner-folding foldable display structure, the electronic device 2800 can be used as described above with reference to FIG. Figures 2A to 18 For example, when the electronic device 2800 is folded, the processor of the electronic device 2800 can display the running screen of the application on the second display provided on the rear surface of the first housing structure 2810.

[0470] In addition, when the second housing structure 2820 is rotated counterclockwise as in the external foldable display structure, the electronic device 2800 can be similar to the above referenced structure. FIG. 21A to FIG. 27 For example, when the electronic device 2800 is folded, the processor of the electronic device 2800 may display the application execution screen on the first area or the second area of ​​the display 2830.

[0471] Hereinafter, an electronic device having a dual display structure in which two displays physically separated from each other are provided on the front surface of a housing will be referred to as FIG. 29A to FIG. 30 Although the following description will focus on an electronic device having a dual display structure and folded in an inner-folding structure, the same description can also be applied to an electronic device folded in an outer-folding structure.

[0472] Fig.29A and Fig.29B is a perspective view illustrating an electronic device having a plurality of displays on one surface of a housing according to various embodiments of the present disclosure.

[0473] The electronic device 2900 may include a first case structure 2910 and a second case structure 2920 which are rotatably coupled to each other through a hinge structure to be foldable.

[0474] Reference Fig.29A, the first display 2930 may be provided on the front surface of the first housing structure 2910, and the second display 2940 may be provided on the front surface of the second housing structure 2920. The first display 2930 and the second display 2940 are physically separated and may be connected to the processor of the electronic device 2900 through independent ports and interfaces. The first display 2930 may include a first touch sensor (not shown) for detecting a touch input on the first display 2930, and the second display 2940 may include a second touch sensor (not shown) for detecting a touch input on the second display 2940.

[0475] Reference Fig.29B , the third display 2950 may be provided on the rear surface of the first housing structure 2910. The third display 2950 may include a third touch sensor (not shown) for detecting a touch input on the third display 2950.

[0476] The electronic device 2900 may be folded based on the folding axis. For example, the second housing structure 2920 may be rotated clockwise to be folded in a direction in which the first display 2930 and the second display 2940 face each other.

[0477] Fig.30 is a block diagram illustrating an electronic device according to an embodiment of the present disclosure.

[0478] Reference Fig.30 , the electronic device 3000 may include a first display 3010, a second display 3020, a third display 3030, a processor 3040, and a memory 3050. Some of such components of the electronic device 3000 may be omitted or replaced. The electronic device 3000 may include Figure 1A and / or Figure 1B The electronic device 3000 may include at least some of the configurations and / or functions of the electronic device 101 in FIG. Fig.29A and Fig.29B The dual-display structure shown.

[0479] According to various embodiments, the first display 3010 may be disposed in the first housing structure (eg, Fig.29A and Fig.29B On the front surface of the first housing structure 2910 in the embodiment, the second display 3020 may be disposed on the second housing structure (eg, Fig.29A and Fig.29BThe electronic device 3000 is provided with a first display 3010 and a second display 3020 on the front surface of the second housing structure 2920 in the electronic device 3000. Therefore, when the electronic device 3000 is in the unfolded state, the first display 3010 and the second display 3020 may face the same direction. The third display 3030 may be provided on the rear surface of the first housing structure. According to one embodiment, the electronic device 3000 may not include the third display 3030. According to one embodiment, the second display 3020 may be separated from the second housing structure. To this end, the second housing structure may include a structure allowing the second display 3020 to be detachable, and may also include one or more pins for electrical connection when attached.

[0480] According to various embodiments, when the electronic device 3000 is unfolded, the processor 3040 may display the execution screen of the application on the first display 3010 and / or the second display 3020. At this time, when multiple applications are executed, the processor 3040 may display the screen of the first application on the first display 3010, and may also display the screen of the second application on the second display 3020. When only one application is executed, the processor 3040 may divide the execution screen of the application and display the divided screens on the first display 3010 and the second display 3020, respectively, or may display the execution screen of the application on one of the first display 3010 and the second display 3020.

[0481] When the electronic device 3000 is in the unfolded state, the third display 3030 may be turned off.

[0482] According to various embodiments, when the folding gesture starts, the processor 3040 may request the touch sensor to stop sending touch events. According to various embodiments, the processor 3040 may cancel the touch events (e.g., press events or release events) that have been provided to the application before the folding gesture starts. According to various embodiments, when the folding starts, the processor 3040 may provide the application with a cancel event corresponding to the previously provided touch event.

[0483] According to various embodiments, when the electronic device 3000 is folded, the processor 3040 may turn off the first display 3010 and the second display 3020 and display the application execution screen on the third display 3030. The processor 3040 may redraw the application based on the properties of the third display 3030 (e.g., size, ratio, resolution, density, etc.).

[0484] According to various embodiments, the processor 3040 may display a touch lock screen on the third display 3030 in response to the folding gesture. After displaying the touch lock screen, the processor 3040 may process a touch event received from the third touch sensor of the third display 3030. The processor 3040 may release the touch lock screen in response to a touch event received from the third display 3030 after displaying the touch lock screen, and provide the touch event to the running application.

[0485] According to various embodiments, the processor 3040 may generate a touch lock screen based on the state information of the application. The application state information may include information about a security level assigned to the application and / or information about whether the application execution screen is resizable.

[0486] In addition, the electronic device 3000 may also include the above reference Figures 2A to 18 In this case, the first area of ​​the first display in the inner foldable display structure (eg, Figure 4E 451 in the first region) and the second region (eg, Figure 4E The second area 452 in the figure may correspond to the first display 3010 and the second display 3020 in the dual display structure, respectively.

[0487] Fig.31A and Fig.31B 2 is a view illustrating a G-shaped foldable electronic device according to various embodiments of the present disclosure.

[0488] According to various embodiments, the electronic device 3100 may include a first case structure 3111 , a second case structure 3112 , and a third case structure 3113 divided based on two folding axes A and B.

[0489] Reference Fig.31A , the display 3110 may be disposed on the front surfaces of the first housing structure 3111, the second housing structure 3112, and the third housing structure 3113. The display 3110 has a foldable display structure that can be folded around two folding axes. That is, the display 3110 may be divided into a first area disposed on the first housing structure 3111, a second area disposed on the second housing structure 3112, and a third area disposed on the third housing structure 3113.

[0490] Reference Fig.31B , the first housing structure 3111 can be folded inwardly toward the second housing structure 3112, and then the third housing structure 3113 can be folded inwardly. Therefore, in the folded state, the first area of ​​the display 3110 can face the second area, and the third area can face the rear surface of the first housing structure 3111.

[0491] According to various embodiments, when folding starts, the electronic device 3100 may not process a touch event occurring on the display 3110. When folding is completed, the electronic device 3100 may turn off the display 3110.

[0492] Fig.32A , Fig.32B and Fig.32C 2 is a view illustrating an S-shaped foldable electronic device according to various embodiments of the present disclosure.

[0493] According to various embodiments, the electronic device 3200 may include a first case structure, a second case structure, and a third case structure divided based on two folding axes.

[0494] Reference Fig.32A , the first display 3210 may be disposed on the front surfaces of the first shell structure and the second shell structure.

[0495] Reference Fig.32B , the second display 3220 may be disposed on the rear surface of the third housing structure. The first display 3210 may be a foldable display, and the second display 3220 may not be foldable.

[0496] Since the first display 3210 covers the two housing structures, the first display 3210 may have a size larger than that of the second display 3220 .

[0497] Reference Fig.32C , when the electronic device 3200 is folded, the first area and the second area of ​​the first display 3210 divided by one folding axis may face each other, and the second display 3220 may be exposed to the outside.

[0498] According to various embodiments, in the unfolded state, the electronic device 3200 may display an application screen on the first display 3210. At this time, the second display 3220 may be closed. In the folded state, the electronic device 3200 may display an application screen on the second display 3220 and close the first display 3210.

[0499] When folding starts, the processor may not process a touch event occurring on the first display 3210. In response to the folding of the electronic device 3200, the processor may adjust the size of the application screen based on the properties (e.g., size, ratio, resolution, density, etc.) of the second display 3220, and display the resized application screen on the second display 3220. In addition, in response to the folding gesture, the processor may generate a touch lock screen and display the touch lock screen in the area where the application screen is to be displayed after folding. The touch lock screen may be determined based on the status information of the running application (e.g., security level and / or whether the application is resizable).

[0500] Fig.33A and Fig.33B is a view illustrating an electronic device having a rollable display according to various embodiments of the present disclosure.

[0501] Reference Fig.33A , the electronic device 3300 may have a completely rollable form without any folding axis. The display 3310 may be disposed on the front surface of the electronic device 3300. The display 3310 may be a rollable display. When the electronic device 3300 is fully unfolded, the running screen of the application may be displayed on the entire display 3310.

[0502] Reference Fig.33B , the electronic device 3300 may be rolled. When the electronic device 3300 is rolled at a predetermined angle or greater, the electronic device 3300 may determine an area where an application is to be displayed in response to the rolling. For example, the electronic device 3300 may display an application execution screen 3350 in a central area of ​​the display 3310. In the rolled state, the electronic device 3300 may adjust the size of the application screen based on the properties of the determined area (e.g., size, ratio, resolution, density, etc.) to display the application.

[0503] According to various embodiments, when the curling starts, the electronic device 3300 may not process the touch event. When the curling is completed, the electronic device 300 may display the touch lock screen and process the touch event occurring in the corresponding area after the touch lock screen is displayed. In this case, the screen may not be displayed on the area other than the display area, and the touch event occurring in the corresponding area may not be processed.

[0504] Fig.34 is a flowchart illustrating a control method of an electronic device according to an embodiment of the present disclosure.

[0505] The illustrated method 3400 may be referred to above. Figures 1A to 33B The electronic device described (e.g., Figure 1BThe electronic device 101 is executed, and the description of the above technical features will be omitted below.

[0506] Reference Fig.34 In operation 3410, the electronic device may display an application execution screen on at least one display in the unfolded state. According to various embodiments, the electronic device may be configured with various form factors (e.g., an inner-folding foldable display structure, an outer-folding foldable display structure, a dual display structure, a G-type folding structure, an S-type folding structure, or a rollable display structure). The display area for displaying the application execution screen in the unfolded state has been previously described with respect to each form factor structure.

[0507] In operation 3420, the electronic device may detect a folding gesture. The folding gesture may refer to an action in which a user folds a portion of the electronic device based on a folding axis by applying force to the electronic device in an unfolded state. When the folding gesture starts, the electronic device may request each display to stop sending touch events or ignore received touch events. The electronic device may cancel touch events that have been provided to the application before the folding gesture starts.

[0508] In operation 3430, in response to a folding gesture, the electronic device may determine an area (or a portion) of at least one display to display an application running screen. For example, when the electronic device has an inner-folding foldable display structure, both a foldable first display disposed on one housing surface and a non-foldable second display disposed on another housing surface may be used to display the application screen. When the electronic device has an outer-folding foldable display structure, the application screen may be displayed on any one of the first and second areas separated based on the folding axis of the foldable display. In the case where the user cannot see most of the display among the various form factors described above (for example, in an inner-folding foldable display structure or in a dual display structure without a rear display), when the electronic device is folded, the application is no longer displayed and can operate in the background.

[0509] In operation 3440, the electronic device may generate and display a touch lock screen on the determined area (or portion). FIG. 10A to FIG. 10F A touch lock screen according to various embodiments is described.

[0510] In operation 3450, the electronic device may process a touch event received from a touch sensor of a display on which an application execution screen is displayed after the touch lock screen is displayed. The electronic device may release the touch lock screen in response to a touch event received from the display after the touch lock screen is displayed, and provide the touch event to the running application.

[0511] While the present disclosure has been particularly shown and described with reference to various embodiments thereof, it will be understood by those skilled in the art that various changes in form and details may be made therein without departing from the spirit and scope of the present disclosure as defined by the appended claims and their equivalents.

Claims

1. A mobile communication device, include: a first touch display forming at least a portion of a first surface of the mobile communication device; a second touch display forming at least a portion of a second surface of the mobile communication device; as well as At least one processor configured to: While the state of the mobile communication device is in the unfolded state, displaying a first screen corresponding to an application running in the unfolded state via the first touch display, and When the state of the mobile communication device is changed to the at least partially folded state, displaying a second screen corresponding to the application and an image visually at least partially overlapping the second screen via the second touch display; Wherein, a touch input input on the second touch display while the second screen and the image are displayed via the second touch display is not processed as an input on the application.

2. The mobile communication device according to claim 1, in, The at least one processor is further configured to: When at least one feature corresponding to the touch input satisfies a specified condition, stopping display of the image from the second touch display; as well as When the display of the image is stopped, the application is controlled based on another touch input detected on the second screen through the second touch display.

3. The mobile communication device according to claim 1, wherein the image includes instructions, and in, The at least one processor is further configured to stop display of the second screen from the second touch display when indicating that it is selected by the touch input.

4. The mobile communication device according to claim 1, in, The image includes instructions, and Wherein, the at least one processor is further configured to: When the indication is selected by the touch input, the display of the second screen is stopped from the second touch display, and A third screen corresponding to an application running in the at least partially folded state is displayed in the second touch display.

5. The mobile communication device according to claim 4, in, The at least one processor is further configured to: Terminate the application, and Run the app again before displaying the third screen.

6. The mobile communication device according to claim 1, in, The at least one processor is further configured to display an indication corresponding to the application in the second touch display as at least a portion of the image or as an image separate from the image.

7. The mobile communication device according to claim 6, in, The at least one processor is further configured to display an indication at least partially overlapping the image.

8. The mobile communication device according to claim 1, in, The at least one processor is further configured to display an interface for receiving an input for releasing a lock state of the application in the second touch display as an image that is a part of the image or separate from the image.

9. The mobile communication device according to claim 1, in, A first size of the first touch display is greater than a second size of the second touch display, and The at least one processor is further configured to minimize at least one indication included in the first screen as at least a portion of displaying the second screen.

10. The mobile communication device according to claim 1, in, A first resolution of the first touch display is greater than a second resolution of the second touch display, and Wherein the at least one processor is further configured to reduce a resolution of at least one indication included in the first screen as at least a portion of displaying the second screen.

11. The mobile communication device of claim 1 , further comprising a housing comprising a first housing portion and a second housing portion; in, The first touch display includes a flexible touch display mounted to the first housing portion and the second housing portion.

12. The mobile communication device according to claim 1, in, The at least one processor is further configured to change and display at least a portion of the second screen as the image.

13. A mobile communication device, include: a touch display visually exposed through the first surface of the mobile communication device, the touch display comprising a display area corresponding to a portion of the mobile communication device; as well as At least one processor configured to: When the mobile communication device is in the unfolded state, a first screen corresponding to an application running in the unfolded state is displayed via the touch display. When the state of the mobile communication device is changed to the at least partially folded state, displaying a second screen corresponding to the application and an image visually at least partially overlapping the second screen via the touch display, Wherein, a touch input input on the touch display while the second screen and the image are displayed via the touch display is not processed as an input on the application.

14. An electronic device, include: case; A first display is located on a first surface of the housing in a first direction and includes a first touch sensor; a second display located on a second surface in a second direction of the housing and including a second touch sensor, the first display being foldable, and when the first display is folded, a first area and a second area of ​​the first display separated based on the folding area face each other; at least one processor located within the housing and operatively connected to the first display and the second display; as well as a memory located within the housing and operatively connected to the at least one processor, The memory is configured to store instructions that, when executed by the at least one processor, perform the following operations: While the first display is in the unfolded state, displaying the running screen of the application on the first display, detecting a fold gesture with respect to the first display, displaying a touch lock screen in the second display in response to detecting the fold gesture, and A touch event received from a second touch sensor of a second display after displaying a touch lock screen is processed.

15. The electronic device according to claim 14, in, When the instructions are executed by the at least one processor, the following operations are also performed: touch events received from at least a first touch sensor of the first display and a second touch sensor of the second display between the time when the folding gesture is detected and the time when the touch lock screen is displayed are not provided to the application.

16. The electronic device according to claim 14, in, When the instructions are executed by the at least one processor, the following operations are also performed: when a folding gesture is detected, a cancel event is provided to the application corresponding to at least some touch events received from at least the first touch sensor of the first display and the second touch sensor of the second display and provided to the application before the folding gesture.

17. The electronic device according to claim 14, in, When the instructions are executed by the at least one processor, an operation of generating a touch lock screen based on at least a portion of the state information of the application is also performed; and The application status information includes a security level specified for the application.

18. The electronic device according to claim 17, in, When the instructions are executed by the at least one processor, the following operations are also performed: When the security level is configured as the first level, generating a touch lock screen in such a manner that at least a portion of the touch lock screen is a semi-transparent area, and displaying the generated touch lock screen as an upper layer of the application execution screen; as well as When the security level is configured as the second level, a touch lock screen including guide information for releasing the security state is displayed in the second display, and an application execution screen is displayed in the second display based on at least a part of a user input for releasing the security state.

19. The electronic device according to claim 17, in, The application's state information includes information about whether the screen on which the application is running is resizable, and When the at least one processor executes the instruction, the following operations are performed: When the execution screen of the application is determined to be resizable based on at least a portion of the state information of the application, generating a touch lock screen in such a manner that at least the portion of the touch lock screen is a semi-transparent area, and Display the resulting touch lock screen as an overlay on top of your app's resized run screen.

20. The electronic device according to claim 17, in, When the state information of the application indicates that the running screen of the application cannot be resized, the running of the application is restarted.

Images