Electronic device and method for controlling screen thereof

By integrating sensors and processors on the flexible display of the electronic device, sensing display size changes and displaying an optional item list, users can switch screens or perform multi-screen display by expanding or reducing the size of the visible part of the display, solving the problem that users in the prior art need to inconveniently switch screens, and achieving higher user convenience.

CN114449100BActive Publication Date: 2025-04-15SAMSUNG ELECTRONICS CO LTD
View PDF 2 Cites 0 Cited by

Patent Information

Application Number
CN202110534855.2
Authority / Receiving Office
CN · China
Patent Type
Patents(China)
Current Assignee / Owner
Priority Date
2020-11-05
Filing Date
2021-05-17
Publication Date
2025-04-15
Estimated Expiration
2041-05-17

AI Technical Summary

Technical Problem

When using multiple applications in existing electronic devices, users need to switch screens through inconvenient steps, and partial expansion and reduction operations of flexible displays are not common, making them difficult to use as gestures for screen switching and multi-screen display.

Method used

By integrating sensors and processors on a flexible display, sensing the size change of the display and displaying an optional item list in a partial area of ​​the display, the user switches the screen or performs a multi-screen display by expanding or reducing the size of the visible portion of the display.

Benefits of technology

The operation of expanding or reducing the display area is realized, and screen switching and multi-screen display are easily performed, thereby improving user convenience and satisfaction with electronic devices.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure CN114449100B_ABST
    Figure CN114449100B_ABST
Patent Text Reader

Abstract

An electronic device and a method for controlling a screen thereof. The method includes: displaying a first screen on a display; sensing a change in the size of a visible portion of the display by at least one sensor; displaying a list including at least one selectable item in at least a partial area of ​​the display during the change in the size of the visible portion of the display; determining whether the change in the size of the visible portion of the display is completed; in response to the completion of the change in the size of the visible portion of the display, displaying a first screen corresponding to the display having the changed size; and in response to returning the size of the visible portion of the display to the original size when the change in the size of the visible portion of the display is not completed, displaying a second screen corresponding to an item selected while the size of the visible portion of the display is changed among the items included in the list on the display having the original size.
Need to check novelty before this filing date? Find Prior Art

Description

Technical Field

[0001] Certain embodiments relate to an electronic device capable of expanding the size of a visible portion of a display area and a method for controlling a screen thereof. Background Art

[0002] An electronic device (e.g., a mobile terminal, a smart phone, or a wearable terminal) may include a flexible display. For example, the electronic device may include a flexible display that is bendable or foldable or rollable. As another example, the flexible display may be displayed on the electronic device so that the size of the visible portion of its display area can be expanded. For example, at least a portion of the area of ​​the flexible display may be positioned inside the housing (e.g., rolled up and disposed inside the electronic device) and may be exposed to the outside (the visible portion of the flexible display) by the user, thereby expanding the size of the visible portion of the display area. This expansion of the visible portion of the display area can provide a new user interface environment.

[0003] Meanwhile, the electronic device may provide various functions (eg, an imaging function, a music playback function, a navigation function, a short-range wireless communication (eg, Bluetooth, Wi-Fi, or Near Field Communication (NFC)) function, a fingerprint recognition function, and an electronic payment function).

[0004] The above information is presented as background information only to assist with an understanding of the present disclosure. No determination has been made, and no assertion is made, as to whether any of the above might be applicable as prior art with respect to the present disclosure. Summary of the invention

[0005] According to some embodiments, the electronic device may include, for example: a flexible display; at least one sensor, the at least one sensor being configured to sense a change in the size of a visible portion of the flexible display; at least one processor, the at least one processor being operatively connected to the flexible display and the at least one sensor; and a memory, the memory being operatively connected to the at least one processor, wherein the memory is configured to store instructions which, when executed, cause the at least one processor to: display a first screen on the flexible display; sense a change in the size of the flexible display through the at least one sensor; display a list including at least one selectable item in at least a portion of the flexible display while the size of the flexible display is changing; determine whether the change in the size of the flexible display is completed; in response to the change in the size of the flexible display being completed, display the first screen corresponding to the flexible display having the changed size; and in response to returning the size of the visible portion of the flexible display to the original size without completing the change in the size of the flexible display, displaying a second screen corresponding to an item selected from among the items included in the list while the size of the flexible display is changing on the flexible display having the original size.

[0006] According to certain embodiments, a method for controlling a screen of an electronic device capable of expanding a display area may include, for example: displaying a first screen on a display; sensing a change in the size of the display through at least one sensor; displaying a list including at least one optional item in at least a portion of the display while the size of the display is changing; determining whether the change in the size of the display is completed; in response to the change in the size of the display being completed, displaying the first screen corresponding to the display having the changed size; and in response to returning the size of the display to its original size without completing the change in the size of the display, displaying a second screen corresponding to an item included in the list that was selected while the size of the display was changing on the display having the original size. BRIEF DESCRIPTION OF THE DRAWINGS

[0007] The above and other aspects, features and advantages of certain embodiments of the present disclosure will be more apparent from the following description taken in conjunction with the accompanying drawings, in which:

[0008] Figure 1 illustrates a block diagram of an electronic device in a network environment according to some embodiments;

[0009] Figure 2A A slidable electronic device according to some embodiments is illustrated;

[0010] Figure 2BA slidable electronic device according to some embodiments is illustrated;

[0011] Figure 2C A slidable electronic device according to some embodiments is illustrated;

[0012] Figure 3 illustrates a block diagram of an electronic device according to an embodiment;

[0013] Figure 4 illustrates a flow chart illustrating a method for controlling a screen of an electronic device according to an embodiment;

[0014] Figure 5A illustrates an example of a screen for controlling an electronic device according to an embodiment;

[0015] Figure 5B illustrates an example of a screen for controlling an electronic device according to an embodiment;

[0016] Figure 5C illustrates an example of a screen for controlling an electronic device according to an embodiment;

[0017] Figure 6 illustrates an example of a screen for controlling an electronic device according to an embodiment;

[0018] Figure 7 illustrates a flow chart illustrating a method for controlling a screen of an electronic device according to another embodiment;

[0019] Figure 8 illustrates a flow chart illustrating a method for controlling a screen of an electronic device according to another embodiment;

[0020] Fig.9A illustrates an example of an object included in a control application according to an embodiment;

[0021] Fig. 9B illustrates another example of an object included in a control application according to an embodiment;

[0022] Fig.10 A method for controlling a screen of an electronic device by using a sliding interaction according to another embodiment is illustrated; and

[0023] Fig.11 A method for performing a multi-screen of an electronic device by using a slide interaction according to another embodiment is illustrated. DETAILED DESCRIPTION

[0024] The disclosure presents an embodiment in which a user of an electronic device with a flexible display can change the screen by partially expanding the size of a visible portion of the flexible display, completely reducing the size to a minimum, or partially reducing the size, and then completely expanding the size to a maximum.

[0025] The user of the electronic device may execute multiple applications. Even if multiple applications are executed, only the screen from one application is displayed on the display of the electronic device. The user of the electronic device may have to use another application by switching the screen. This may be inconvenient.

[0026] However, users of electronic devices can use multiple applications through a multi-view display, which also requires the user to take multiple inconvenient steps.

[0027] At the same time, it is noted that in an electronic device with a flexible display, the user does not often only partially expand the visible portion of the display or reduce the visible portion of the display. Therefore, a pattern of partially expanding and then fully reducing, or partially reducing and then fully expanding can be used as a gesture for switching screens. However, it is noted that fully expanding or fully reducing may be common. Therefore, in some embodiments, when the flexible display is fully expanded or fully reduced, the same screen appears.

[0028] Certain embodiments may provide an electronic device capable of expanding its display area and a method of controlling its screen, wherein screen control may be easily performed using an operation of expanding or reducing the display area (eg, a sliding operation).

[0029] In some embodiments, the user can expand / reduce the size of the visible portion of the display following a gesture used to switch screens.

[0030] Discussed below Figures 1 to 11 The certain embodiments used to describe the principles of the disclosure in this patent document are only for illustration and should not be interpreted in any way as limiting the scope of the disclosure. Those skilled in the art will understand that the principles of the disclosure can be implemented in any suitably arranged system or device.

[0031] Figure 1 An electronic device 101 according to some embodiments of the present disclosure is described. The electronic device 101 includes a display module 160, which may include an expandable display. When a user uses multiple applications at the same time, when the visible portion of the display is expanded, the electronic device 101 can display a screen of another application from the multiple applications.

[0032] Electronic Devices

[0033] Figure 11 is a block diagram illustrating an electronic device 101 in a network environment 100 according to various embodiments. Figure 1 , the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with at least one of the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the above components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the above-described components (eg, sensor module 176, camera module 180, or antenna module 197) may be implemented as a single integrated component (eg, display module 160).

[0034] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to one embodiment, as at least part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operationally independent or combined with the main processor 121. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be dedicated to a specific function. The auxiliary processor 123 may be implemented separately from the main processor 121, or as part of the main processor 121.

[0035] The term "processor" shall be used in this document to refer to both the singular and plural contexts.

[0036] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., a camera module 180 or a communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated by machine learning. For example, such learning may be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or a deep Q network or a combination of two or more thereof, but is not limited thereto. Additionally or alternatively, the artificial intelligence model may include a software structure in addition to a hardware structure.

[0037] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.

[0038] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .

[0039] The input module 150 may receive commands or data to be used by other components (e.g., the processor 120) of the electronic device 101 from outside (e.g., a user) of the electronic device 101. The input module 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).

[0040] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records. The receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as part of the speaker.

[0041] The display module 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display device 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch. The display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch. Figure 2A , Figure 2B , Figure 2C Flexible displays are described in more detail in .

[0042] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.

[0043] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.

[0044] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0045] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0046] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.

[0047] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.

[0048] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0049] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0050] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.

[0051] The wireless communication module 192 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip).

[0052] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to an embodiment, another component (e.g., a radio frequency integrated circuit (RFIC)) other than the radiating element may be additionally formed as part of the antenna module 197.

[0053] According to various embodiments, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a specified high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the specified high frequency band.

[0054] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.

[0055] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices receiving the request may execute at least part of the function or service requested, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request in the case of further processing the result or in the case of not further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars or health care) based on 5G communication technology or IoT-related technologies.

[0056] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.

[0057] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the nouns in the singular form corresponding to the term may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., the second element)”, “combined to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” when the terms “operably” or “communicatively” are used or when the terms “operably” or “communicatively” are not used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.

[0058] As used in connection with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, according to an embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).

[0059] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in a storage medium and data being temporarily stored in a storage medium.

[0060] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., Play Store TM ) The computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).

[0061] According to various embodiments, each component (e.g., module or program) in the above-mentioned components may include a single entity or multiple entities, and some entities in the multiple entities may be separately arranged in different components. According to various embodiments, one or more components in the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each component in the multiple components in the same or similar manner as the corresponding one component in the multiple components before integration. According to various embodiments, the operations performed by a module, program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more operations in the operations may be run or omitted in different orders, or one or more other operations may be added.

[0062] The display module 160 may include a flexible display. The flexible display provides a larger display area for a better user experience while maintaining the portability of the electronic device 100. The electronic device 100 is advantageously small to allow the user to easily carry them on their person. However, this also imposes size restrictions on the display module 160. The flexible display allows the user to enjoy a larger display when using the device, while allowing the size to be reduced by folding or deforming when the user is carrying the electronic device 100.

[0063] Figure 2A , Figure 2B and Figure 2C A slidable electronic device with a flexible display is described.

[0064] Electronic device with flexible display

[0065] Figure 2A illustrates an electronic device according to some embodiments, Figure 2B illustrates an electronic device according to some embodiments, Figure 2C An electronic device according to some embodiments is illustrated.

[0066] refer to FIG. 2A to FIG. 2CAccording to some embodiments, the electronic devices (e.g., the electronic device 101) 201, 203, and 205 may include flexible displays 261, 263, and 265, respectively. According to an embodiment, the flexible displays 261, 263, and 265 may be arranged at the electronic devices 201, 203, and 205, respectively, so as to be unfoldable in at least one direction (e.g., a lateral direction and / or a longitudinal direction), thereby increasing the size of the visible portion of the flexible display. In a flexible display, "visible portion of the flexible display" should be understood to mean a portion of the flexible display that can be viewed by a user. A portion should include some portion or all.

[0067] According to the embodiment, Figure 2A As shown, in the electronic device (hereinafter, referred to as the "first electronic device") 201, the first flexible display 261 can be expanded or reduced in the lateral direction (e.g., the X-axis direction), thereby increasing the width of the visible portion of the flexible display. For example, the first area 261-1 as a part of the first flexible display 261 can always be visually exposed to the outside (visible from the outside). The second area 261-2 as another part of the first flexible display 261 can be positioned in the housing 210 in a first state (a sliding-in state in which the second area 261-2 is pulled into the housing 210), and can become visually exposed to the outside in a second state (e.g., a sliding-out state or a rolled-up state in which the second area 261-2 is pulled out of the housing 210).

[0068] In the slide-in state, the visible portion of the flexible display is 261-1. In the slide-out state, the visible portion of the flexible display is a continuous area of ​​261-1 and 261-2. As can be seen, the visible portion of the flexible display is expanded when turning from the slide-in state to the slide-out state.

[0069] According to some embodiments, the first flexible display 261 can slide in or out manually, semi-automatically, or automatically. Figure 2A As shown, the first electronic device 201 may include a first flexible display 261, a first roller 21, a second roller 22, a tensioning belt 23, and a support 24, which allow the first flexible display 261 to slide in or out manually. The first roller 21 and the second roller 22 may be arranged relative to each other and rotatable. The tensioning belt 23 may be connected to one end of the support 24 at one end thereof and to the other end of the support 24 at the other end thereof to provide tension to pull the two ends of the support 24, thereby providing a force to maintain the uniformity of the support 24. At the same time, the support 24 is arranged to contact the second area 261-2 of the first flexible display 261, and may uniformly support the second area 261-2 when the second area 261-2 is visually exposed to the outside.

[0070] According to another example, the first electronic device 201 may further include an elastic body (not shown) that allows the first flexible display 261 to slide in or out in a semi-automatic manner. According to another example, in order to allow the first flexible display 261 to slide in or out in an automatic manner, the first electronic device 201 may further include a gear (not shown) and a motor (not shown) that are configured to rotate at least one of the first roller 21 or the second roller 22. Figure 2A This is just one example, so the first electronic device 201 can make the first flexible display 261 slide in or out in a manual, semi-automatic, or automatic manner by using various known structures.

[0071] According to another embodiment, Figure 2B As shown, in the electronic device (hereinafter, referred to as the "second electronic device") 203, a portion of the housing 230 may be expanded or reduced in the lateral direction (X-axis direction). For example, the housing 230 may include a first body 230-1 and a second body 230-2, and the first body 230-1 may be connected to the second body 230-2 so that the first body 230-1 can be pulled into the second body 230-2 (can be reduced) or can be pulled out of the second body 230-2 (can be expanded). The first area 263-1 of the second flexible display 263 may be positioned on the first surface (e.g., the front surface) of the first body 230-1 and may always be visually exposed to the outside. The second area 263-2 may be positioned in the second body 230-2 in the first state, and therefore may not be visually exposed to the outside, and in the second state, may be visually exposed to the outside through the first surface (e.g., the front surface) of the second body 230-2. The second electronic device 203 is similar to the first electronic device 201 except that a portion of the housing 230 (eg, the first body 230 - 1 ) is unfolded or reduced in order to unfold or reduce the second flexible display 263 , and thus a detailed description thereof will be omitted.

[0072] In the first state, the visible portion of the flexible display is 263-1. In the second state, the visible portion of the flexible display is a continuous area of ​​263-1 and 263-2. As can be seen, the visible portion of the flexible display is unfolded when turning from the slide-in state to the slide-out state.

[0073] According to another embodiment, Figure 2CAs shown, in the electronic device (hereinafter, referred to as the "third electronic device") 205, the third flexible display 265 may be expanded or reduced in the longitudinal direction (e.g., the Y-axis direction). Similar to the first electronic device 201 and the second electronic device 203, in the third electronic device 205, the first area 265-1 of the third flexible display 265 may always be visually exposed to the outside, and the second area 265-2 of the third flexible display 265 may not be visually exposed to the outside in the first state, but may be visually exposed to the outside in the second state. The third electronic device 205 is similar to the first electronic device 201 and the second electronic device 203, except that the third flexible display 265 is expanded or reduced in the longitudinal direction, so its detailed description will be omitted.

[0074] According to some embodiments, the electronic devices 201, 203, and 205 may perform screen control based on an interaction of changing the state of the flexible displays 261, 263, and 265 (e.g., changing the size of the flexible displays (e.g., expanding or reducing the flexible displays)). For example, the electronic devices 201, 203, and 205 may perform screen switching by an interaction of changing (e.g., expanding or reducing) the size of the flexible displays 261, 263, and 265 while displaying the first screen and then returning the size of the flexible displays to the original state, and may perform multi-screen by an interaction of inputting a specified event (e.g., holding for a predetermined time or longer or a specified gesture input) while changing the size of the flexible displays 261, 263, and 265. Reference will be made later Figures 3 to 11 Give a detailed description thereof.

[0075] In the first state, the visible portion of the flexible display is 265-1. In the second state, the visible portion of the flexible display is a continuous area of ​​265-1 and 265-2. As can be seen, the visible portion of the flexible display is unfolded when turning from the slide-in state to the slide-out state.

[0076] In an electronic device with a non-flexible display or a display that is not unfolded, the output of the executed application is referred to as a screen that typically uses the entire or substantially the entire displayable area of ​​the flexible display. However, when the user is using two applications simultaneously, the user can switch screens. Additionally, some screens, such as paid applications, can output multiple screens, showing only one of them at a time. The user usually has to swipe sideways. This is inconvenient.

[0077] In certain embodiments of the present disclosure, the size of the visible portion of the display is expanded / reduced along with the gesture of switching screens.

[0078] Figure 3The block diagram of the electronic device according to the embodiment is illustrated. The sensor 376 can sense whether the visible portion of the flexible display 360 is increasing or decreasing and provide a signal to the processor 320. Based on the signal received by the processor 320 from the sensor, the processor 320 can determine which screen of a plurality of applications is being executed for display.

[0079] refer to Figure 3 According to an embodiment of the present invention, the electronic device 301 (eg, Figure 1 The electronic device 101 or FIG. 2A to FIG. 2C The first electronic device 201, the second electronic device 203, and the third electronic device 205 in the embodiment may include a processor 320 (eg, Figure 1 processor 120 in the processor 120), memory 330 (e.g., Figure 1 Memory 130 in), flexible display 360 (e.g., Figure 1 The display module 160 or FIG. 2A to FIG. 2C The first flexible display 261, the second flexible display 263 and the third flexible display 265) and the sensor module 376 (for example, Figure 1 Sensor module 176 in.

[0080] The processor 320 may control the screen based on at least one interaction that changes the state of the flexible display 360 (e.g., changes the size of the flexible display 360 (e.g., expands or reduces the flexible display 360)). For example, the processor 320 may switch the screen or perform multi-screen based on the interaction. Figures 4 to 11 Give a detailed description thereof.

[0081] According to some embodiments, the memory 330 may be operatively connected to the processor 320. The memory 330 may store instructions that, when executed, cause the processor 320 to perform a plurality of operations including controlling a screen based on at least one interaction of changing a state of the flexible display 360 (e.g., changing a size of the flexible display 360 (e.g., unfolding or reducing the flexible display 360)). According to an embodiment, the memory 330 may store historical information (execution time or execution frequency) of executed applications. According to an embodiment, the memory 330 may store historical information (execution time, execution frequency) of applications executed within a predetermined time period (e.g., seven days).

[0082] According to some embodiments, the flexible display 360 may be curved, foldable, or rollable. According to an embodiment, the flexible display 360 may be configured so that the display area can be unfolded. For example, at least a portion of the area of ​​the flexible display 360 may be positioned in the housing so as not to be visually exposed to the outside, and may be pulled out of the housing to unfold the display area.

[0083] According to some embodiments, the sensor module 376 may sense a state change of the flexible display 360 (e.g., sliding in (or curling) or sliding out (or rolling out)) and may transfer the sensing result to the processor 320. According to an embodiment, the sensor module 376 may sense the state change by using at least one of a plurality of Hall ICs, a touch sensor (e.g., TSP), a magnetic sensor, a proximity sensor, an optical sensor, a time-of-flight (ToF) sensor, a motion sensor, or a rotational position sensor. For example, the electronic device 301 may have a plurality of Hall ICs arranged at regular intervals on a path on which the flexible display 360 slides, and may identify sliding in or sliding out based on the order of signals received from the corresponding Hall ICs. In another example, the electronic device 301 may have a touch sensor arranged on a path on which the flexible display 360 slides, and may identify sliding in or sliding out based on a touch signal sensed according to a sliding operation. In another example, the electronic device 301 may have at least one magnetic sensor arranged on a path on which the flexible display 360 slides, and may identify sliding in or sliding out based on a change in the strength of a magnetic signal depending on a sliding operation. In another example, the electronic device 301 may cause a portion of the flexible display 360 to emit light in a specific pattern (or brightness pattern), and an optical sensor (or illuminance sensor) may be used to identify the corresponding pattern, thereby identifying sliding in or out. In another example, the electronic device 301 may have a ToF sensor, which includes a light emitter and a light receiver disposed in a portion of the flexible display 360, and may identify the distance by the time it takes for the infrared light emitted from the light emitter to be reflected and returned to the light emitter, and may identify sliding in or out based on a change in the distance (e.g., increase or decrease). In another example, the electronic device 301 may have a motion sensor mounted to the first roller 21 or the second roller 22, and may identify the sliding direction (e.g., sliding in or out) based on the rotation direction and / or rotation amount of the first roller 21 or the second roller 22 sensed by the motion sensor. In another example, the electronic device 301 may sense the rotation direction and / or rotation amount of the first roller 21 or the second roller 22 through a rotation position sensor, and may identify sliding in or out based on the sensed rotation direction and / or rotation amount.

[0084] Figure 4 A flowchart illustrating a method for controlling a screen of an electronic device according to an embodiment is illustrated.

[0085] refer to Figure 4 In operation 401, an electronic device according to an embodiment (eg, Figure 1 The electronic device 101, FIG. 2A to FIG. 2C The first electronic device 201, the second electronic device 203 and the third electronic device 205 or Figure 3 A processor (eg, Figure 1 The processor 120 or Figure 3 The processor 320 in the embodiment may be configured to be operable on a flexible display (eg, Figure 1 The display module 160, FIG. 2A to FIG. 2C The first flexible display 261, the second flexible display 263 and the third flexible display 265 or Figure 3 The first picture is displayed on the flexible display 360 in the figure. In this article, the flexible display may be in a state where it has a minimum size (hereinafter, referred to as a "reduced state") (see Figure 5A , Figure 5C and Figure 6 ), or may be in a state in which it has a maximum size (hereinafter, referred to as an "expanded state") (see Figure 5B ).

[0086] According to some embodiments, in operation 403, the processor may sense a change in the size of the flexible display. For example, by at least one sensor (e.g., Figure 1 Sensor module 176 or Figure 3 The processor can sense that the flexible display is unfolded in the horizontal direction in the reduced state (see Figure 5A and Figure 6 ), or it may be sensed that the flexible display is reduced in the lateral direction in the unfolded state (see Figure 5B According to an embodiment, the processor may sense, through at least one sensor, that the flexible display is unfolded in the longitudinal direction in the reduced state (for example, see Figure 5C ), or it may be sensed that the flexible display is reduced in the longitudinal direction in the unfolded state. Sensing a change in the size of the flexible display may mean sensing a change in the size of a visible portion of the flexible display. For example, the change in the size of the flexible display may mean a change in the size of the visible portion of the flexible display. In another example, sensing a change in the size of the flexible display may mean sensing a change in the size of a visible portion of the flexible display that is visually exposed through the front surface of the electronic device.

[0087] According to some embodiments, in operation 405, the processor may display a list including at least one selectable item. For example, while the size of the flexible display is changing, the processor may display the list including at least one selectable item in at least a portion of the flexible display. In some embodiments, the list may be displayed sequentially, while in other embodiments, the list may be displayed simultaneously in a selectable menu format. For example, the processor may display the list while its size is changing (e.g., see FIG. 5A to FIG. 5C ) of the flexible display, or the list may be displayed in an increased display area (e.g., see Figure 6 ). The at least one selectable item included in the list may include an item corresponding to a most recently executed application or an object included in the first screen (currently executed application).

[0088] According to an embodiment, the list may include items whose number (e.g., 6) is specified based on priority (e.g., most recently used or used frequency). The processor may display one of the items included in the list as a representative item (e.g., the item may be displayed at a maximum size, the item may be displayed at a center, and / or the item may be highlighted). The processor may scroll the list to change the representative item in response to a change in the size of the flexible display. According to an embodiment, when a change in the size of the flexible display is sensed, the processor may display one item based on priority, and may sequentially change the displayed items in response to the change in the size of the flexible display.

[0089] According to some embodiments, the processor may determine whether the change in size of the flexible display is complete in operation 407. For example, through at least one sensor, the processor may determine whether the flexible display has been fully unfolded from the reduced state, or may determine whether the flexible display has been fully reduced from the unfolded state.

[0090] As a result of the determination in operation 407, when the change in the size of the flexible display is completed, the processor may display the first screen on the flexible display having the changed size (e.g., in an expanded state or a reduced state) in operation 409. In contrast, as a result of the determination in operation 407, when the change in the size of the flexible display is not completed, the processor may determine whether the flexible display returns to the original state in operation 411.

[0091] As a result of the determination in operation 411, when the flexible display does not return to the original state, the processor may return to operation 405. The processor may display the list until the change in the size of the flexible display is completed or the flexible display returns to the original state. For example, the processor may scroll the list in response to the change in the size of the flexible display to change the representative item. As a result of the determination in operation 411, when the flexible display returns to the original state, the processor may display a second screen corresponding to the item selected from the list on the flexible display in the original state (e.g., the reduced state or the expanded state) in operation 413.

[0092] According to an embodiment, the processor may determine that the representative item displayed at the time point when the direction of the size change of the flexible display (display area of ​​the flexible display) (or the direction in which the flexible display slides) changes is the selected item. For example, the processor may determine that the representative item finally displayed when changing from sliding out to sliding in is the selected item. Similarly, the processor may determine that the representative item finally displayed when changing from sliding in to sliding out is the selected item. When the direction of the size change of the flexible display changes, the processor may not scroll the list in response to the change in the size of the flexible display.

[0093] According to another embodiment, the processor may determine the selected item based on a change in the sliding speed of the flexible display. For example, when a sliding operation (e.g., sliding in or sliding out) is performed within a specified first speed, the processor may scroll the list according to the sliding operation, and when sensing that the sliding speed changes to a second speed, it may be determined that the representative item displayed when the change in the sliding speed (e.g., increase) is sensed is the selected item.

[0094] Furthermore, according to another embodiment, the processor may determine that an item to which a user input (eg, a touch) is received among items included in the list is a selected item.

[0095] Figure 5A An example of a screen of a control electronic device according to an embodiment is illustrated. A user can select a screen of another application to display by increasing the size of the visible portion of the flexible display to one of a plurality of reference points, and then reducing the size of the visible portion of the flexible display to a minimum size (or within a 10% deviation of the minimum size, now collectively referred to as "minimum"). For example, depending on whether the user expands the size of the visible portion of the display to references 502, 503, 504, and then reduces it to the minimum size, the electronic device will display a screen from application B, C, or D on the flexible display. If the user expands the size of the visible portion of the display to a maximum size (or within a 10% deviation of the maximum size, now collectively referred to as "maximum"), the electronic device will revert to the screen of application A.

[0096] refer to Figure 5A , as in the drawing corresponding to reference numeral 511, an electronic device according to an embodiment (eg, Figure 1 The electronic device 101, FIG. 2A to FIG. 2C The first electronic device 201, the second electronic device 203 and the third electronic device 205 or Figure 3 The electronic device 301 in the embodiment may be in a first state (a normal state in which the flexible display has a minimum size) in which the flexible display (eg, Figure 1 The display module 160, FIG. 2A to FIG. 2C The first flexible display 261, the second flexible display 263 and the third flexible display 265 or Figure 3 The first screen is displayed on the flexible display 360 in the embodiment. The first screen may be an execution screen of application "A".

[0097] According to an embodiment, the electronic device may sense the expansion (e.g., sliding out) of the flexible display. When the expansion of the flexible display is sensed, the electronic device may display a list including at least one item (e.g., a thumbnail). For example, as in the figure corresponding to reference numeral 513, when the flexible display is expanded beyond the first reference limit 501, the electronic device may display a list of cascade images including previously executed applications on the expanded flexible display based on priority (e.g., most recently executed or executed frequency). As in the figure corresponding to reference numeral 513, the electronic device may display an image corresponding to the most recently executed (or most frequently executed) application "B" (hereinafter referred to as a "representative image") at the maximum size.

[0098] In the state as in the drawing corresponding to reference numeral 513, when the flexible display slides in and returns to the first state, the electronic device may display the execution screen of application "B" on the flexible display in the first state as in the drawing corresponding to reference numeral 514. Therefore, the user of the electronic device can easily switch the execution screen of application "A" to the execution screen of application "B" through the slide-in and slide-out operations. In contrast, in the state as in the drawing corresponding to reference numeral 513, when the flexible display is unfolded beyond the second reference limit 502, the electronic device may scroll the list as in the drawing corresponding to reference numeral 515. For example, the electronic device may display an image corresponding to application "C" having the next priority as a representative image.

[0099] In the state as in the drawing corresponding to reference numeral 515, when the flexible display returns to the first state, the electronic device may display the execution screen of application "C" on the flexible display in the first state as in the drawing corresponding to reference numeral 516. Therefore, the user of the electronic device can easily switch the execution screen of application "A" to the execution screen of application "C" through slide-out and slide-in operations. In contrast, in the state as in the drawing corresponding to reference numeral 515, when the flexible display is unfolded beyond the third reference limit 503, the electronic device may scroll the list as in the drawing corresponding to reference numeral 517. For example, the electronic device may display an image corresponding to application "D" having the next priority as a representative image.

[0100] In the state as in the figure corresponding to reference numeral 517, when the flexible display slides in and returns to the first state, the electronic device may display the execution screen of application "D" on the flexible display in the first state as in the figure corresponding to reference numeral 518. Therefore, the user of the electronic device can easily switch the execution screen of application "A" to the execution screen of application "D" through the slide-out and slide-in operations. In contrast, in the state as in the figure corresponding to reference numeral 517, when the flexible display is fully unfolded beyond the fourth reference limit 504, as in the figure corresponding to reference numeral 519, the electronic device may determine that the screen is not switched unintentionally and may display the execution screen of application "A" on the fully unfolded flexible display.

[0101] According to an embodiment, the number of items included in the list may have a specified value (e.g., 6). The items included in the list may be determined based on a priority. The number of reference limits may be set based on the number of items included in the list. For example, if the list includes six items, the number of reference limits may be set to 7 (=6 (number of items) + 1). The first reference limit may have a specified value (e.g., 0.5 cm). The last reference limit (e.g., the seventh reference limit) may have a value (e.g., 6.5 cm) obtained by subtracting a specified value (e.g., 0.5 cm) from the maximum deployable length of the flexible display (e.g., 7 cm). The remaining reference limits between the first reference limit and the last reference limit may be set to have an interval (e.g., 1 cm) obtained by dividing the distance between the first reference limit and the last reference limit (6 cm = 6.5 cm - 0.5 cm) by the number of items (e.g., 6). For example, the first reference limit may be set to 0.5 cm, the second reference limit may be set to 1.5 cm, the third reference limit may be set to 2.5 cm, the fourth reference limit may be set to 3.5 cm, the fifth reference limit may be set to 4.5 cm, the sixth reference limit may be set to 5.5 cm, and the seventh reference limit may be set to 6.5 cm. If the list includes only items whose number is less than the specified number (e.g., Figure 5A As shown, if there are three items (images corresponding to applications "B, C, and D"), the electronic device may display the image of application "D" from the time when the third reference limit (2.5 cm) is exceeded until the seventh reference limit is exceeded. According to an embodiment, the electronic device may display the image of application "B" when the fourth reference limit is exceeded, may display the image of application "C" when the fifth reference limit is exceeded, and may display the image of application "D" when the sixth reference limit is exceeded. In some embodiments, the images of the applications may be thumbnails.

[0102] In some embodiments, when the size is reduced from the reference size to the minimum within a predetermined time period (e.g., 2 seconds) from the stop of the increase, the electronic device displays a new screen. In some embodiments, an increase followed by a temporary partial reduction or stop (e.g., an increase of less than 10% for a period of less than 2 seconds) and then followed by another increase is regarded as an increase, and the reduction or stop is ignored.

[0103] According to an embodiment, the number of reference limits or the intervals between the reference limits may be changed based on the number of items included in the list. For example, if the number of items included in the list is 3, the interval between the first reference limit and the last reference limit may be set to 2 cm (= 6 cm / 3). The first reference limit may be set to 0.5 cm, the second reference limit may be set to 2.5 cm, the third reference limit may be set to 4.5 cm, and the fourth reference limit may be set to 6.5 cm.

[0104] Figure 5B An example of a screen for controlling an electronic device according to an embodiment is illustrated. Figure 5B In the embodiment of the present invention, the user can select a screen for display by reducing the size of the visible portion of the flexible display to a specific reference size and then expanding it back to the maximum size. For example, depending on whether the user reduces the size of the visible portion of the display to reference 502, 503, 504 and then expands it to the maximum size, the electronic device will display a screen from application B, C, or D on the flexible display. If the user reduces the size of the visible portion of the display to the minimum size, the electronic device will revert to the screen of application A.

[0105] refer to Figure 5B , as in the drawing corresponding to reference numeral 531, an electronic device according to an embodiment (eg, Figure 1 The electronic device 101, FIG. 2A to FIG. 2C The first electronic device 201, the second electronic device 203 and the third electronic device 205 or Figure 3 The electronic device 301 in the embodiment may be in a flexible display (eg, Figure 1 The display module 160, FIG. 2A to FIG. 2C The first flexible display 261, the second flexible display 263 and the third flexible display 265 or Figure 3 The first screen is displayed on the flexible display 360 in the embodiment. The first screen may be an execution screen of application "A".

[0106] According to an embodiment, the electronic device may sense the reduction (e.g., sliding in) of the flexible display. As illustrated in the drawings corresponding to reference numerals 533, 535, and 537, the electronic device may scroll a list including at least one item (e.g., a thumbnail image) in response to the reduction of the flexible display.

[0107] In the state as in the drawings corresponding to reference numerals 533, 535, or 537, when the flexible display slides out and returns to the second state, the electronic device may display an execution screen of application "B", an execution screen of application "C," or an execution screen of application "D" on the flexible display in the second state, as in the drawings corresponding to reference numerals 534, 536, or 538.

[0108] In a state as in the drawing corresponding to reference numeral 537, when the reduction of the flexible display is completed, as in the drawing corresponding to reference numeral 539, the electronic device may determine that there is no intention to switch the screen and may display the execution screen of application 'A' on the fully reduced flexible display.

[0109] In addition to the sliding operation being used to switch applications in the second state (expanded state) of the flexible display, Figure 5B Similar to Figure 5A , so its detailed description will be omitted.

[0110] Figure 5C An example of a screen for controlling an electronic device according to an embodiment is illustrated.

[0111] refer to Figure 5C , in an electronic device according to an embodiment (eg, Figure 1 The electronic device 101, FIG. 2A to FIG. 2C The first electronic device 201, the second electronic device 203 and the third electronic device 205 or Figure 3 In the electronic device 301), the flexible display can be unfolded or reduced in the longitudinal direction.

[0112] According to some embodiments, Figure 5CThe electronic device in the figure can perform screen switching through the interaction of the flexible display being unfolded in the longitudinal direction and then returning to the original state. For example, as in the figure corresponding to reference numeral 551, the electronic device can display the first screen. In the state of displaying the first screen, the electronic device can scroll the list in response to the longitudinal unfolding of the flexible display as illustrated in the figure corresponding to reference numerals 553, 555, or 557. When the flexible display returns to the original state from the state as in the figure corresponding to reference numerals 553, 555, or 557, the electronic device can perform screen switching to the second screen (execution of application "B", execution of application "C", or execution of application "D") as in the figure corresponding to reference numerals 554, 556, or 558. In contrast, when the flexible display has been fully unfolded in the longitudinal direction without returning to the original state, the electronic device can display the first screen on the unfolded flexible display as in the figure corresponding to reference numeral 559. In addition to the flexible display sliding out (being unfolded) or sliding in (being reduced) in the longitudinal direction, Figure 5C The electronic device in Figure 5A The electronic device in the embodiment of the present invention is not disclosed, and therefore its detailed description will be omitted.

[0113] Figure 5C An example of performing application switching by a sliding operation in which the flexible display slides out (is expanded) and then slides in (is reduced) in the longitudinal direction is illustrated. Figure 5B ,exist Figure 5C In the electronic device of the present invention, application switching can be performed by a sliding operation in which the flexible display slides in and then slides out in a longitudinal direction in a state in which the flexible display is fully unfolded.

[0114] Figure 6 An example of controlling a screen of an electronic device according to an embodiment is illustrated. In some embodiments, during the expansion of the size of the visible portion of the display, the previously displayed screen may continue to be displayed in the original area, and an indicator of a different screen may be displayed in the expanded area.

[0115] refer to Figure 6 , according to the electronic device of the embodiment (for example, Figure 1 The electronic device 101, FIG. 2A to FIG. 2C The first electronic device 201, the second electronic device 203 and the third electronic device 205 or Figure 3 The electronic device 301 in the embodiment may be, as in the figure corresponding to reference numeral 611, in a flexible display (eg, Figure 1 The display module 160, FIG. 2A to FIG. 2C The first flexible display 261, the second flexible display 263 and the third flexible display 265 or Figure 3 The first screen is displayed on the flexible display 360 in the embodiment. The first screen may be the execution of application "A".

[0116] According to an embodiment, the electronic device may sense the expansion (e.g., sliding out) of the flexible display. As in the drawings corresponding to reference numerals 613, 615, and 617, the electronic device may scroll a list including at least one item (e.g., thumbnail image) in response to the expansion of the flexible display. The electronic device may scroll the list in a non-expanded area 601 (e.g., FIG. 2A to FIG. 2C The display of the first screen is maintained in the first area 261-1 of the first flexible display 261, the first area 263-1 of the second flexible display 263, and the first area 265-1 of the third flexible display 265, and the list can be displayed in the expanded area 602 of the flexible display (for example, FIG. 2A to FIG. 2C In the second area 261-2 of the first flexible display 261, the second area 263-2 of the second flexible display 263, and the second area 265-2 of the third flexible display 265).

[0117] When the flexible display slides down in a state as in the drawings corresponding to reference numerals 613, 615, or 617 and returns to the first state, the electronic device may display an execution screen of application "B", an execution screen of application "C," or an execution screen of application "D" on the flexible display in the first state as in the drawings corresponding to reference numerals 614, 616, or 618.

[0118] When the unfolding of the flexible display is completed in the state as in the drawing corresponding to reference numeral 617, the electronic device may determine that the screen is not switched unintentionally as in the drawing corresponding to reference numeral 619 and may display the execution screen of application 'A' on the fully unfolded flexible display.

[0119] Except that the list is displayed in the expanded area 602 of the flexible display instead of the entire area, Figure 6 Similar to Figure 5A , so its detailed description will be omitted. Figure 6 The list is displayed in the expanded area 602. Figure 5C The embodiments in .

[0120] Figure 7 A flowchart illustrating a method for controlling a screen of an electronic device according to another embodiment is illustrated.

[0121] refer to Figure 7 , according to the electronic device of the embodiment (for example, Figure 1 The electronic device 101, FIG. 2A to FIG. 2CThe first electronic device 201, the second electronic device 203, the third electronic device 205 or Figure 3 A processor (eg, Figure 1 The processor 120 or Figure 3 The processor 320 in the embodiment may be configured to display the image on the flexible display (eg, Figure 1 The display module 160, FIG. 2A to FIG. 2C The first flexible display 261, the second flexible display 263, the third flexible display 265 or Figure 3 The first screen is displayed on the flexible display 360 in the embodiment, and the change in the size of the flexible display can be sensed in operation 703. Operations 701 and 703 are similar to Figure 4 Operations 401 and 403 in FIG. 4 are described herein, and thus their detailed description will be omitted.

[0122] According to some embodiments, the processor may store reference information in operation 705. The reference information may be, for example, information about a position touched by a user when the flexible display is expanded (slid out) or reduced (slid in).

[0123] According to some embodiments, the processor may display a list including at least one selectable item in operation 707, and may determine whether the size of the flexible display has been completely changed in operation 709. Operations 707 and 709 are similar to those in Figure 4 Operations 405 and 407 in FIG. 4 are described herein, and thus their detailed description will be omitted.

[0124] As a result of the determination in operation 709 , when the size change is completed, the processor may display the first screen on the flexible display having the changed size (eg, in an expanded state or a reduced state) in operation 711 .

[0125] In contrast, as a result of the determination in operation 709, when the size change is not completed, the processor may determine whether the size of the flexible display returns to the original state (e.g., the reduced state or the unfolded state) in operation 713. As a result of the determination in operation 713, when the size of the flexible display does not return to the original state, the processor may return to operation 707. In contrast, as a result of the determination in operation 713, when the size of the flexible display returns to the original state, the processor may determine whether the reference information has changed in operation 715.

[0126] As a result of the determination in operation 715, when the reference information (e.g., information about the position touched by the user) has changed, the processor may determine in operation 717 that the screen is not switched unintentionally and may display the first screen on the flexible display in the original state. In contrast, as a result of the determination in operation 715, when the reference information has not changed, the processor may display the second screen corresponding to the item selected from the list on the flexible display in the original state in operation 719. Operation 719 is similar to Figure 4 Operation 413 in , so its detailed description will be omitted.

[0127] Figure 8 A flowchart illustrating a method for controlling a screen of an electronic device according to another embodiment is illustrated.

[0128] refer to Figure 8 , operations 801, 803, and 805 according to the embodiment are similar to Figure 4 Operations 401, 403 and 405 in FIG. 4 are described herein, and thus their detailed description will be omitted.

[0129] According to some embodiments, in operation 807, the processor may determine whether a specific item is selected. For example, the processor may determine whether a touch input is sensed in the entire area or a designated area of ​​the flexible display while the size of the flexible display is changed. According to an embodiment, the processor may determine whether one of the items included in the list is touched.

[0130] As a result of the determination in operation 807, when the specific item is selected, the processor may determine whether the change in the size of the flexible display is completed in operation 809. As a result of the determination in operation 809, when the size change is completed, the processor may display a second screen corresponding to the specific item on the flexible display having a changed size (e.g., in an expanded state or a reduced state) in operation 811.

[0131] In contrast, as a result of the determination in operation 809, when the size change is not completed, the processor may determine whether the size of the flexible display returns to the original state in operation 813. As a result of the determination in operation 813, when the size of the flexible display does not return to the original state, the processor may return to operation 805. In contrast, as a result of the determination in operation 813, when the size of the flexible display returns to the original state, the processor may display a second screen corresponding to the specific item on the flexible display in the original state in operation 815.

[0132] As a result of the determination in operation 807, when the specific item is not selected, the processor may determine in operation 817 whether the change in the size of the flexible display is completed. As a result of the determination in operation 817, when the size change is completed, the processor may display the first screen on the flexible display having the changed size (e.g., in an expanded state or a reduced state) in operation 819. In contrast, as a result of the determination in operation 817, when the size change is not completed, the processor may determine in operation 821 whether the size of the flexible display returns to the original state. As a result of the determination in operation 821, when the size of the flexible display does not return to the original state, the processor may return to operation 805. In contrast, as a result of the determination in operation 821, when the size of the flexible display returns to the original state, the processor may return to operation 801 and may maintain the display of the first screen.

[0133] Fig.9A An example of an object included in a control application according to an embodiment is illustrated.

[0134] refer to Fig.9A , according to the electronic device of the embodiment (for example, Figure 1 The electronic device 101, FIG. 2A to FIG. 2C The first electronic device 201, the second electronic device 203, the third electronic device 205 or Figure 3 The electronic device 301 in the example may perform switching (scrolling) of objects included in an application through a sliding interaction without switching between applications. For example, the electronic device may select a payment card from a list of payment cards included in a payment application through a sliding interaction and may execute the selected payment card. Fig.9A As illustrated in the drawing with reference numeral 911 in FIG. 8 , the electronic device may display a screen of a payment application including thumbnail images 901 , 902 , and 903 of a plurality of selectable payment cards.

[0135] According to an embodiment, as corresponding to Fig.9AAs illustrated in the drawings with reference numerals 913 and 915 in the figure, the electronic device may scroll the thumbnail images 901, 902, and 903 of the payment card as the flexible display is unfolded in the horizontal direction. When a specified input (e.g., a touch to the first thumbnail image 901) is sensed in a state as in the drawing corresponding to reference numeral 911, the electronic device may display a payment screen using the first payment card. In addition, in a state where the second thumbnail image 902 or the third thumbnail image 903 is displayed as a representative image as illustrated in the drawing corresponding to reference numeral 913 or the drawing corresponding to reference numeral 915, when the flexible display is reduced to the original state, the electronic device may display a payment screen using the second payment card or the third payment card. Therefore, the electronic device according to the embodiment can easily perform switching between multiple cards included in the payment application through sliding interaction.

[0136] Fig.9A 913 and 915 illustrate that even when the flexible display is unfolded in the horizontal direction, the size of the payment application screen displaying the thumbnail image is maintained. However, the payment application screen may be enlarged in response to the unfolding of the flexible display.

[0137] Fig. 9B Another example of an object included in a control application according to an embodiment is illustrated.

[0138] refer to Fig. 9B According to an embodiment, the electronic device can select a tab from a list of multiple tabs included in a web browser application through a sliding interaction and can execute the selected tab. Fig. 9B As illustrated in the figure corresponding to reference numeral 931, the electronic device may display an execution screen of a web browser application. At this time, the web browser application may include a plurality of tabs.

[0139] According to an embodiment, when the unfolding of the flexible display is sensed, the electronic device may display a list screen including thumbnail images 941, 942, and 943 corresponding to a plurality of tabs, such as Fig.9A As illustrated in the accompanying drawings corresponding to figure mark 933.

[0140] According to an embodiment, as illustrated in a drawing corresponding to reference numeral 935 and a drawing corresponding to reference numeral 937 , the electronic device may scroll thumbnail images in response to unfolding of the flexible display.

[0141] According to an embodiment, when the flexible display is reduced to the original state in a state as in the drawing corresponding to reference numeral 935 or the drawing corresponding to reference numeral 937, the electronic device may display a tab screen corresponding to the second thumbnail image 942 or the third thumbnail image 943. Therefore, the electronic device according to the embodiment may easily perform switching between a plurality of tabs included in a web browser application through a slide interaction.

[0142] Fig.10 A method for controlling a screen of an electronic device by using a slide interaction according to another embodiment is illustrated.

[0143] refer to Fig.10 , according to the electronic device of the embodiment (for example, Figure 1 The electronic device 101, FIG. 2A to FIG. 2C The first electronic device 201, the second electronic device 203 and the third electronic device 205 or Figure 3 The electronic device 301 in the embodiment may be in a flexible display (eg, in a first state (a reduced state in which the flexible display has a minimum size)). Figure 1 The display module 160, FIG. 2A to FIG. 2C The first flexible display 261, the second flexible display 263 and the third flexible display 265 or Figure 3 The first screen is displayed on the flexible display 360 in the display). The first screen may be an execution screen of a specific application (e.g., application "A"). According to an embodiment, the processor may determine whether the first screen includes selectable objects. As illustrated in the drawing corresponding to reference numeral 1011, when the first screen includes objects a1, a2, and a3, the electronic device may display a switching icon 1001 for switching between objects a1, a2, and a3 in an area of ​​the first screen. When the first screen does not include any selectable objects, the switching icon 1001 may not be displayed on the first screen. For example, the selectable objects a1, a2, and / or a3 may include corresponding credit cards in a payment application (e.g., see Fig.9A ) or a corresponding open tab (or window) in an Internet browser (see, for example, Fig. 9B ).

[0144] According to an embodiment, when the switching icon 1001 is selected (e.g., touched) or when the expansion (e.g., sliding out) of the flexible display is sensed while the switching icon 1001 is selected (while the touch is maintained), the electronic device may scroll the list including the objects a1, a2, and a3 in response to the expansion of the flexible display, as illustrated in the drawings corresponding to reference numerals 1013, 1015, and 1017. The electronic device may scroll the list in a non-expanded area (e.g., FIG. 2A to FIG. 2CThe display of the first screen is maintained in the first area 261-1 of the first flexible display 261, the first area 263-1 of the second flexible display 263, and the first area 265-1 of the third flexible display 265, and the list can be displayed in the expanded area of ​​the flexible display (for example, FIG. 2A to FIG. 2C In the second area 261-2 of the first flexible display 261, the second area 263-2 of the second flexible display 263, and the second area 265-2 of the third flexible display 265).

[0145] In a state as in the drawings corresponding to reference numerals 1013, 1015, or 1017, when the flexible display slides into and returns to the first state, the electronic device may display a screen corresponding to the first object a1, a screen corresponding to the second object a2, or a screen corresponding to the third object a3 on the flexible display in the first state, as illustrated in the drawings corresponding to reference numerals 1014, 1016, or 1018.

[0146] When the unfolding of the flexible display is completed in the state as in the drawing corresponding to reference numeral 1017, as illustrated in the drawing corresponding to reference numeral 1019, the electronic device may determine that the screen is not switched unintentionally and may display the screen of application "A" on the fully unfolded flexible display.

[0147] In a state as in the drawing corresponding to reference numeral 1011, when the expansion (eg, sliding out) of the flexible display is sensed without selecting the switching icon 1001, the electronic device may Figure 6 Switching between applications that have been recently executed or frequently used can be performed as described. Fig.10 The toggle icon 1001 in the application FIG. 5A to FIG. 5C Examples in Figure 7 Examples and Figure 8 The embodiments in .

[0148] Fig.11 A method for performing a multi-screen of an electronic device by using a slide interaction according to another embodiment is illustrated.

[0149] refer to Fig.11 , according to the electronic device of the embodiment (for example, Figure 1 The electronic device 101, FIG. 2A to FIG. 2C The first electronic device 201, the second electronic device 203 and the third electronic device 205 or Figure 3 The electronic device 301 in the embodiment may be in a flexible display (eg, in a first state (a reduced state in which the flexible display has a minimum size) as illustrated in the drawing corresponding to reference numeral 1111. Figure 1The display module 160, FIG. 2A to FIG. 2C The first flexible display 261, the second flexible display 263 and the third flexible display 265 or Figure 3 The first screen is displayed on the flexible display 360 in the display. The first screen may be an execution screen of a specific application (eg, application "A").

[0150] According to an embodiment, when the expansion (e.g., sliding out) of the flexible display is sensed, the electronic device may display a list including at least one item as illustrated in the drawings corresponding to reference numerals 1113, 1115, and 1117, and may scroll the list in response to the expansion of the flexible display. The electronic device may display the list in a non-expanded area (e.g., FIG. 2A to FIG. 2C The display of the first screen is maintained in the first area 261-1 of the first flexible display 261, the first area 263-1 of the second flexible display 263, and the first area 265-1 of the third flexible display 265, and the list can be displayed in the expanded area of ​​the flexible display (for example, FIG. 2A to FIG. 2C In the second area 261-2 of the first flexible display 261, the second area 263-2 of the second flexible display 263, and the second area 265-2 of the third flexible display 265).

[0151] In the state as in the drawings corresponding to reference numerals 1113, 1115, or 1117, when the flexible display slides in and returns to the first state, the electronic device may display an execution screen of application "B", an execution screen of application "C," or an execution screen of application "D" on the flexible display in the first state as illustrated in the drawings corresponding to reference numerals 1114, 1116, or 1118. In the state as in the drawings corresponding to reference numerals 1117, when the unfolding of the flexible display is completed, the electronic device may determine that the screen is not switched unintentionally as illustrated in the drawings corresponding to reference numerals 1119 and may unfold and display the screen of application "A" so that the screen corresponds to the fully unfolded flexible display.

[0152] In the state as in the drawings corresponding to reference numerals 1113, 1115, or 1117, when a specified event (e.g., holding (or free stop) for a specified time (e.g., 1 second) without sliding in or out, long touch, pressure touch, gesture input, and / or touching an icon for multi-screen execution) is sensed, the electronic device may display the first screen and the application execution screen corresponding to the representative image through the multi-screen as illustrated in the drawings corresponding to reference numerals 1131, 1133, or 1135. For example, the electronic device may display the first screen (the execution screen of application A) in the first area, and may display the second screen (the execution screen of application B, the execution screen of application C, or the execution screen of application D) in the second area.

[0153] According to an embodiment, in a state as in the drawings corresponding to reference numerals 1131, 1133, or 1135, when the flexible display returns to the original state, the electronic device may display the first screen on the flexible display in the original state as illustrated in the drawings corresponding to reference numerals 1137. In contrast, in a state as in the drawings corresponding to reference numerals 1131, 1133, or 1135, when the change in the size of the flexible display is completed (when the flexible display has been fully unfolded), the electronic device may unfold and display a multi-screen corresponding to the flexible display whose size change has been completed as illustrated in the drawings corresponding to reference numerals 1139.

[0154] According to an embodiment, in a state as in the drawing corresponding to reference numeral 1139, when the size of the flexible display is reduced to a size in a state of reference numeral 1111, the processor may end the multi-screen and may not display the second screen (the execution screen of application B, the execution screen of application C, or the execution screen of application D) displayed in the second area in the first area.

[0155] According to an embodiment, in a state as in the drawing corresponding to reference numeral 1139, when the size of the flexible display is reduced to a size in a state of reference numeral 1111, the processor may split the screen of the first area, and may reduce the first screen and the second screen displayed in the second area (the execution screen of application B, the execution screen of application C, or the execution screen of application D) and display the reduced first screen and the second screen in the first area that has been split into screens.

[0156] Corresponds to Fig.11The drawings with reference numerals 1131, 1133, 1135, and 1139 in the figure illustrate that the first screen and the second screen have unequal sizes. However, according to an embodiment, the electronic device may adjust and display the first screen and the second screen in equal sizes when performing multi-screen. In addition, the multi-screen is performed using a sliding interaction. Fig.11 The embodiments in may be combined with at least one of the other embodiments described above.

[0157] In the above, some embodiments have been described by taking a slidable electronic device as an example. However, some embodiments may be applied to a rollable electronic device. For example, when the unrolling of a flexible display in a rolled-up state is sensed, the rollable electronic device may display a list screen including at least one item while the flexible display is rolled up, and when the unrolling of the flexible display is completed, the rollable electronic device may display a screen corresponding to the item selected while the flexible display is rolled up. Alternatively, when the curling of a flexible display in an unrolled state is sensed, the rollable electronic device may display a list screen while the flexible display is rolled up, and when the flexible display is rolled up again without being completely rolled up, the rollable electronic device may display a screen corresponding to the item selected while the flexible display is rolled up on the rolled-up display.

[0158] According to some embodiments, an electronic device includes: a flexible display; at least one sensor, the at least one sensor being configured to sense a change in the size of a visible portion of the flexible display; at least one processor, the at least one processor being operatively connected to the flexible display and the at least one sensor; and a memory, the memory being operatively connected to the at least one processor, wherein the memory stores instructions, which, when executed, cause the at least one processor to perform a plurality of operations, the plurality of operations including: displaying a first picture on the flexible display; sensing a change in the size of a visible portion of the flexible display through the at least one sensor; and The invention relates to a method of controlling the size of the visible portion of the flexible display to be changed, wherein the first screen corresponds to the visible portion of the flexible display having the changed size, the second screen corresponds to the item selected while the size of the visible portion of the flexible display is changed, the second screen corresponding to the item included in the list being selected while the size of the visible portion of the flexible display is changed, the second screen corresponding to the item ...

[0159] According to some embodiments, displaying the second screen corresponding to the selected item on the flexible display having the original size includes determining the selected item based on a time point at which a direction of the size change of the flexible display changes while the size of the flexible display changes.

[0160] According to some embodiments, the at least one selectable item includes at least one object included in a screen of at least one previously executed application or a screen of a currently executed application.

[0161] According to some embodiments, the list comprises a number of items, wherein the number is based on a priority.

[0162] According to some embodiments, the list includes items displayed as representative items, and the representative items change in response to a change in the size of the viewable portion of the flexible display.

[0163] According to some embodiments, displaying the second screen corresponding to the selected item on the flexible display having the original size includes: determining the representative item as the selected item; or determining an item selected by the user from among the items included in the list as the selected item.

[0164] According to some embodiments, the multiple operations also include: storing reference information in response to sensing a change in the size of the visible portion of the flexible display; determining whether the reference information has changed when the flexible display returns to the original size; displaying the second screen on the flexible display having the original size when the reference information has not changed; and displaying the first screen on the flexible display having the original size when the reference information has changed.

[0165] According to some embodiments, the multiple operations also include: determining whether the first screen includes at least one optional object; and when the first screen includes at least one optional object, displaying a specified icon in an area of ​​the first screen, and wherein displaying the list including the at least one optional item also includes: when a change in the size of the visible portion of the flexible display is sensed when the designated icon is selected, displaying at least one optional object included in the first screen as the list; and when a change in the size of the visible portion of the flexible display is sensed when the designated icon is not selected, displaying the at least one previously executed application as the list.

[0166] According to some embodiments, the multiple operations also include: sensing a change in the size of the visible portion of the flexible display; and when a specified event is sensed before the change in the size of the visible portion of the flexible display is completed, displaying the first screen and the second screen using multiple screens.

[0167] According to some embodiments, using the multiple screens to display the first screen and the second screen includes: maintaining the display of the first screen and displaying the second screen in the expanded area of ​​the flexible display; or equally dividing the flexible display with the changed size and displaying the first screen and the second screen on the divided flexible display.

[0168] According to certain embodiments, a method for controlling a screen of an electronic device capable of expanding a display area, the method comprising: displaying a first screen on a display; sensing a change in the size of a visible portion of the display by at least one sensor; displaying a list including at least one selectable item in at least a portion of the display during the change in the size of the visible portion of the display; determining whether the change in the size of the visible portion of the display is completed; in response to completion of the change in the size of the visible portion of the display, displaying the first screen corresponding to the display having the changed size; and in response to returning the size of the visible portion of the display to its original size without completing the change in the size of the visible portion of the display, displaying a second screen corresponding to an item among the items included in the list that was selected while the size of the visible portion of the display was changed on the display having the original size.

[0169] According to some embodiments, displaying the second screen corresponding to the selected item on the display having the original size includes determining the selected item based on a time point at which a direction of the size change of the display changes while the size of the display changes.

[0170] According to some embodiments, the at least one selectable item includes at least one object included in a screen of at least one previously executed application or a screen of a currently executed application.

[0171] According to some embodiments, the list comprises a number of items, wherein the number is based on a priority.

[0172] According to some embodiments, the list includes items displayed as representative items, and the representative items change in response to a change in the size of a visible portion of the display.

[0173] According to some embodiments, displaying the second screen corresponding to the selected item on the display having the original size includes: determining the representative item as the selected item; or determining the item selected by the user from among the items included in the list as the selected item.

[0174] According to certain embodiments, the method further includes: storing reference information in response to sensing a change in the size of a visible portion of the display; determining whether the reference information has changed when the display returns to the original size; displaying the second picture on the display having the original size when the reference information has not changed; and displaying the first picture on the display having the original size when the reference information has changed.

[0175] According to some embodiments, the method also includes: determining whether the first screen includes at least one optional object; and when the first screen includes at least one optional object, displaying a specified icon in an area of ​​the first screen, wherein displaying the list including the at least one optional item includes: when a change in the size of the visible portion of the display is sensed in a state where the designated icon is selected, displaying the at least one optional object included in the first screen as the list; and when a change in the size of the visible portion of the display is sensed in a state where the designated icon is not selected, displaying the at least one previously executed application as the list.

[0176] According to some embodiments, the method further includes: sensing a change in the size of a visible portion of the display; and displaying the first screen and the second screen using a multi-screen when a specified event is sensed before the change in the size of the visible portion of the display is completed.

[0177] According to some embodiments, using the multiple screens to display the first screen and the second screen includes: maintaining the display of the first screen and displaying the second screen in the expanded area of ​​the display; or equally splitting the display with the changed size and displaying the first screen and the second screen on the split displays.

[0178] According to some embodiments, the electronic device can easily control the screen (switch screens or perform multiple screens) by expanding or reducing (e.g., sliding out or sliding in) the display area, thereby improving the convenience of the user. In addition, some embodiments can provide screen control (e.g., user interaction) optimized for electronic devices whose display areas can be expanded (e.g., slidable electronic devices), thereby improving the user's satisfaction with the electronic device.

Claims

1. An electronic device, comprising: Flexible displays; at least one sensor configured to sense a change in a size of a viewable portion of the flexible display; at least one processor operatively connected to the flexible display and the at least one sensor; as well as a memory operatively connected to the at least one processor, The memory stores instructions, which, when executed, cause the at least one processor to perform multiple operations, including: Displaying a first screen corresponding to the first application on the flexible display; sensing, by the at least one sensor, a change in the size of a visible portion of the flexible display; During the change of the size of the visible portion of the flexible display, displaying a list including at least one selectable item in at least a portion of the flexible display, wherein the at least one selectable item corresponds to at least one application including the second application; determining whether the change in size of the visible portion of the flexible display has been completed to a maximum size; In response to determining that the change in the size of the visible portion of the flexible display has been completed to the maximum size, displaying the first screen corresponding to the first application and to the visible portion of the flexible display on the visible portion having the maximum size; and In response to the size of the visible portion of the flexible display returning to an original size before the change in the size of the visible portion of the flexible display is completed to the maximum size, a second screen corresponding to the second application is displayed on the visible portion of the original size.

2. The electronic device of claim 1 , wherein displaying the second screen corresponding to the selected item on the flexible display having the original size comprises determining the selected item based on a time point at which a direction of the size change of the flexible display changes while the size of the flexible display is changed. 3 . The electronic device of claim 1 , wherein the at least one selectable item comprises at least one object included in a screen of at least one previously executed application or a screen of a currently executed application. The electronic device of claim 1 , wherein the list includes a number of items, wherein the number is based on a priority regarding usage of the items. 5 . The electronic device of claim 1 , wherein the list includes items displayed as representative items, and the representative items change in response to a change in a size of a visible portion of the flexible display.

6. The electronic device according to claim 5, wherein displaying the second screen corresponding to the selected item on the flexible display having the original size comprises: Determining the representative project as the selected project; or An item selected by a user among the items included in the list is determined to be the selected item.

7. The electronic device according to claim 1, wherein the plurality of operations further comprises: storing reference information in response to sensing a change in the size of a visible portion of the flexible display, the reference information comprising information about a location on the flexible display touched by a user when changing the size of the visible portion of the flexible display; When the flexible display returns to the original size, determining whether the reference information has changed; When the reference information has not changed, displaying the second picture on the flexible display having the original size; as well as When the reference information has changed, the first screen is displayed on the flexible display having the original size.

8. The electronic device according to claim 3, wherein the plurality of operations further comprises: determining whether the first picture includes at least one selectable object; as well as When the first screen includes at least one selectable object, displaying a designated icon in an area of ​​the first screen, and Wherein displaying the list including the at least one selectable item further comprises: When a change in the size of the visible portion of the flexible display is sensed in a state in which the designated icon is selected, displaying at least one selectable object included in the first screen as the list; as well as When a change in the size of the visible portion of the flexible display is sensed in a state in which the designated icon is not selected, the at least one previously executed application is displayed as the list.

9. The electronic device according to claim 1, wherein the plurality of operations further comprises: sensing a change in a size of a viewable portion of the flexible display; as well as The first screen and the second screen are displayed using a multi-screen when a specified event is sensed before the change in the size of the visible portion of the flexible display is completed, the specified event including holding or free staying for a specified time without sliding in or out, a long touch, a pressure touch, a gesture input, and / or a touch on an icon for multi-screen execution.

10. The electronic device according to claim 9, wherein using the multiple screens to display the first screen and the second screen comprises: Maintaining the display of the first screen and displaying the second screen in the unfolded area of ​​the flexible display; or The flexible display having the changed size is equally divided and the first screen and the second screen are displayed on the divided flexible display.

11. A method for controlling a screen of an electronic device, wherein the electronic device is capable of expanding a display area, the method comprising: Displaying a first screen corresponding to the first application on the display; sensing, by at least one sensor, a change in the size of a viewable portion of the display; During the change in size of the visible portion of the display, displaying a list including at least one selectable item in at least a portion of the display, wherein the at least one selectable item corresponds to at least one application including the second application; determining whether the change in size of the visible portion of the display has been completed to a maximum size; In response to determining that the change in size of the visible portion of the display has been completed to the maximum size, displaying the first screen corresponding to the first application and corresponding to the visible portion of the display on the visible portion having the maximum size; and In response to the size of the visible portion of the display returning to an original size before the change in the size of the visible portion of the display is completed to the maximum size, a second screen corresponding to the second application is displayed on the visible portion of the original size.

12. The method of claim 11, wherein displaying the second screen corresponding to the selected item on the display having the original size comprises determining the selected item based on a time point at which a direction of the size change of the display changes while the size of the display changes. 13 . The method according to claim 11 , wherein the at least one selectable item comprises at least one object included in a screen of at least one previously executed application or a screen of a currently executed application. The method of claim 11 , wherein the list includes a number of items, wherein the number is based on a priority regarding usage of the items.

15. The method of claim 11, wherein the list includes items displayed as representative items, and the representative items change in response to a change in the size of a visible portion of the display.

16. The method according to claim 15, wherein displaying the second screen corresponding to the selected item on the display having the original size comprises: Determining the representative project as the selected project; or An item selected by a user among the items included in the list is determined to be the selected item.

17. The method according to claim 11, further comprising: storing reference information in response to sensing a change in the size of a viewable portion of the display, the reference information comprising information regarding a location on the display touched by a user when changing the size of the viewable portion of the display; when the display returns to the original size, determining whether the reference information has changed; When the reference information has not changed, displaying the second picture on the display having the original size; as well as When the reference information has changed, the first picture is displayed on the display having the original size.

18. The method according to claim 13, further comprising: determining whether the first picture includes at least one selectable object; as well as When the first screen includes at least one selectable object, displaying a designated icon in an area of ​​the first screen; Wherein displaying the list including the at least one selectable item comprises: When a change in the size of the visible portion of the display is sensed in a state where the designated icon is selected, displaying at least one selectable object included in the first screen as the list; as well as When a change in the size of the visible portion of the display is sensed in a state in which the designated icon is not selected, the at least one previously executed application is displayed as the list.

19. The method according to claim 11, further comprising: sensing a change in size of a viewable portion of the display; as well as The first screen and the second screen are displayed using a multi-screen when a specified event is sensed before the change in the size of the visible portion of the display is completed, the specified event including holding or free staying for a specified time without sliding in or out, a long touch, a pressure touch, a gesture input and / or a touch on an icon for multi-screen execution.

20. The method according to claim 19, wherein using the multi-screen to display the first screen and the second screen comprises: Maintaining the display of the first picture and displaying the second picture in the expanded area of ​​the display; or The display having the changed size is equally divided and the first screen and the second screen are displayed on the divided displays.

Citation Information

Patent Citations

  • Foldable electronic device including hidden display and information display method thereof

    CN107924216A

  • Flexible display device and control method and device thereof

    CN108735100A