Electronic device including flexible display, method of operating same, and storage medium
By implementing the processor configuration and operation method on a flexible display, the problem that flexible electronic devices in the prior art are difficult to manage multiple windows during folding and unfolding, and flexible window management in different states is realized, and user experience and device availability are improved.
Patent Information
- Application Number
- CN202380069414.7
- Authority / Receiving Office
- CN · China
- Patent Type
- Applications(China)
- Current Assignee / Owner
- Priority Date
- 2022-09-28
- Filing Date
- 2023-08-09
- Publication Date
- 2025-05-09
AI Technical Summary
It is difficult for existing flexible electronic devices to effectively manage the display and interaction of multiple windows during folding and deploying, affecting user experience and device availability.
By implementing the processor configuration and operation method on the flexible display, the first window of the application is displayed in the expanded state and the second window is displayed based on the input; in the partially collapsed state, the first window and the second window are displayed in the first and second display areas divided by folding, respectively.
It realizes flexible management of display and interaction of multiple windows in different states of flexible displays, improving user experience and device availability.
Smart Images

Figure CN119968838A_ABST
Abstract
Description
Technical Field
[0001] Embodiments of the present disclosure relate to an electronic device including a flexible display, a method of operating the same, and a storage medium. Background Art
[0002] Due to the development of electronic technology, various types of flexible electronic devices are being developed. Such flexible electronic devices can provide a larger display while ensuring portability. For example, the flexible electronic device can provide a foldable (or bendable) or rollable display that can be deformed by applying force by a user.
[0003] In an electronic device including a foldable flexible display, a screen can be displayed on displays (or display areas) of various sizes. For example, when the electronic device is placed upright and folded in half, the user can view the screen (e.g., a content screen) in a hands-free state. Therefore, when various user interfaces reflecting the user's intention for the action of bending the electronic device with a flexible display can be provided, the usability of the electronic device can be improved. Summary of the invention
[0004] According to an embodiment, the electronic device 101 includes a flexible display 160, 260 or 560 and at least one processor 120 or 520. The at least one processor is configured to: display a first window of an application through the display when the display is unfolded; display the second window on an area of the first window based on an input for displaying the second window; and separately display the first window and the second window in a first display area and a second display area divided by folding, respectively, when the display is at least partially folded.
[0005] According to an embodiment, a method for operating an electronic device including a flexible display includes: displaying a first window of an application in a state where the display is unfolded; displaying the second window on an area of the first window based on an input for displaying the second window; and separately displaying the first window and the second window in a first display area and a second display area divided by folding, respectively, in a state where the display is at least partially folded.
[0006] According to an embodiment, a non-volatile storage medium storing instructions is configured to enable the electronic device to perform at least one operation when executed by at least one processor 120 or 520 of the electronic device 101. The at least one operation includes: displaying a first window of an application in a state where the flexible display of the electronic device is unfolded; displaying the second window on an area of the first window based on an input for displaying the second window; and separately displaying the first window and the second window in a first display area and a second display area divided by folding, respectively, in a state where the flexible display is at least partially folded. BRIEF DESCRIPTION OF THE DRAWINGS
[0007] Figure 1 is a block diagram illustrating electronic devices in a network environment according to an embodiment.
[0008] Figure 2 2 is a diagram showing an unfolded state and a folded state of an electronic device of a first shape according to an embodiment.
[0009] Figure 3a is a diagram illustrating a folded state of the electronic device of a second shape in a portrait mode according to an embodiment.
[0010] Figure 3b is a diagram illustrating a folded state of the electronic device of a second shape in a landscape mode according to an embodiment.
[0011] Figure 4 are perspective views illustrating various folding states of the electronic device according to the embodiment.
[0012] Figure 5 is a block diagram showing an internal structure of an electronic device according to an embodiment.
[0013] Figure 6 is a diagram illustrating a method of operating a plurality of windows in an unfolded state and a partially folded state of an electronic device according to an embodiment.
[0014] Figure 7 is a flowchart illustrating the operation of the electronic device according to the embodiment.
[0015] Figure 8 is a flowchart illustrating an operation of operating multiple windows in response to a folding event according to an embodiment.
[0016] Fig. 9 is a diagram illustrating a plurality of layers according to an embodiment.
[0017] Fig.10 is a diagram illustrating multiple interactions according to an embodiment.
[0018] Fig.112 is a diagram illustrating a case where inputs to regions divided by folding are independent of each other in a case where a plurality of windows are displayed according to an embodiment.
[0019] Fig.12 is a diagram illustrating a case where inputs to regions divided by folding are independent of each other in a case where the divided regions are displayed according to an embodiment.
[0020] Fig.13 is a flowchart illustrating an operation of an electronic device when there are different interactive inputs on one screen according to an embodiment.
[0021] Fig.14 is a diagram illustrating exemplary screens in which an execution screen of a first application is independently displayed in each region divided by folding according to an embodiment.
[0022] Fig.15 is a diagram illustrating exemplary screens in which an execution screen of a second application is independently displayed in each region divided by folding according to an embodiment.
[0023] Fig.16 is a diagram illustrating exemplary screens in which an execution screen of a second application is independently displayed in each region divided by folding according to an embodiment.
[0024] Fig.17 is a diagram illustrating exemplary screens in which an execution screen of an application is independently displayed in each area divided by folding in a landscape mode of an electronic device of a second shape according to an embodiment.
[0025] Fig.18 is a diagram illustrating exemplary screens in which an execution screen of an application is independently displayed in each area divided by folding in a portrait mode of an electronic device of a first shape according to an embodiment.
[0026] Fig.19 is a diagram illustrating exemplary screens in which an execution screen of an application is independently displayed in each area divided by folding in a landscape mode of an electronic device of a first shape according to an embodiment.
[0027] Regarding the description of the drawings, the same or similar reference numerals may be used for the same or similar components. DETAILED DESCRIPTION
[0028] Figure 1 1 is a block diagram showing an electronic device 101 in a network environment 100 according to an embodiment. Figure 1, the electronic device 101 in the network environment 100 may communicate with the electronic device 102 via the first network 198 (e.g., a short-range wireless communication network), or communicate with the electronic device 104 or the server 108 via the second network 199 (e.g., a long-range wireless communication network). According to an embodiment, the electronic device 101 may communicate with the electronic device 104 via the server 108. According to an embodiment, the electronic device 101 may include a processor 120, a memory 130, an input module 150, a sound output module 155, a display module 160, an audio module 170, a sensor module 176, an interface 177, a connection terminal 178, a haptic module 179, a camera module 180, a power management module 188, a battery 189, a communication module 190, a user identification module (SIM) 196, or an antenna module 197. In some embodiments, at least one of the components (e.g., the connection terminal 178) may be omitted from the electronic device 101, or one or more other components may be added to the electronic device 101. In some embodiments, some of the components (eg, sensor module 176, camera module 180, or antenna module 197) may be implemented as a single component (eg, display module 160).
[0029] The processor 120 may run, for example, software (e.g., program 140) to control at least one other component (e.g., hardware component or software component) of the electronic device 101 connected to the processor 120, and may perform various data processing or calculations. According to an embodiment, as at least part of the data processing or calculation, the processor 120 may store a command or data received from another component (e.g., sensor module 176 or communication module 190) in the volatile memory 132, process the command or data stored in the volatile memory 132, and store the resultant data in the non-volatile memory 134. According to an embodiment, the processor 120 may include a main processor 121 (e.g., a central processing unit (CPU) or an application processor (AP)) and an auxiliary processor 123 (e.g., a graphics processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP)) that is operationally independent of or combined with the main processor 121. For example, when the electronic device 101 includes a main processor 121 and an auxiliary processor 123, the auxiliary processor 123 may be adapted to consume less power than the main processor 121, or adapted to be specifically used for a specified function. The auxiliary processor 123 may be implemented as a separate part from the main processor 121, or as part of the main processor 121.
[0030] When the main processor 121 is in an inactive (e.g., sleep) state, the auxiliary processor 123 (rather than the main processor 121) may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190), or when the main processor 121 is in an active state (e.g., running an application), the auxiliary processor 123 may control at least some of the functions or states related to at least one component among the components of the electronic device 101 (e.g., the display module 160, the sensor module 176, or the communication module 190) together with the main processor 121. According to an embodiment, the auxiliary processor 123 (e.g., an image signal processor or a communication processor) may be implemented as part of another component (e.g., a camera module 180 or a communication module 190) that is functionally related to the auxiliary processor 123. According to an embodiment, the auxiliary processor 123 (e.g., a neural processing unit) may include a hardware structure dedicated to artificial intelligence model processing. The artificial intelligence model may be generated by machine learning. For example, such learning may be performed by the electronic device 101 where the artificial intelligence is executed or via a separate server (e.g., server 108). The learning algorithm may include, but is not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, for example. The artificial intelligence model may include multiple artificial neural network layers. The artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q network, or a combination of two or more thereof, but is not limited thereto. Additionally or alternatively, the artificial intelligence model may include a software structure in addition to a hardware structure.
[0031] The memory 130 may store various data used by at least one component of the electronic device 101 (e.g., the processor 120 or the sensor module 176). The various data may include, for example, software (e.g., the program 140) and input data or output data for commands related thereto. The memory 130 may include a volatile memory 132 or a nonvolatile memory 134.
[0032] The program 140 may be stored as software in the memory 130 , and may include, for example, an operating system (OS) 142 , middleware 144 , or applications 146 .
[0033] The input device 150 may receive commands or data from outside the electronic device 101 (e.g., a user) to be used by other components of the electronic device 101 (e.g., the processor 120). The input device 150 may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus).
[0034] The sound output module 155 can output sound signals to the outside of the electronic device 101. The sound output module 155 may include, for example, a speaker or a receiver. The speaker can be used for general purposes such as playing multimedia or playing records, and the receiver can be used to receive incoming calls. Depending on the embodiment, the receiver can be implemented as a separate part from the speaker, or as a part of the speaker.
[0035] The display module 160 may visually provide information to the outside of the electronic device 101 (e.g., a user). The display module 160 may include, for example, a display, a holographic device, or a projector, and a control circuit for controlling a corresponding one of the display, the holographic device, and the projector. According to an embodiment, the display module 160 may include a touch sensor adapted to detect a touch or a pressure sensor adapted to measure the strength of a force caused by a touch.
[0036] The audio module 170 may convert sound into an electrical signal, or vice versa. According to an embodiment, the audio module 170 may obtain sound via the input module 150, or output sound via the sound output module 155 or an earphone of an external electronic device (e.g., electronic device 102) directly (e.g., wired) or wirelessly connected to the electronic device 101.
[0037] The sensor module 176 may detect an operating state (e.g., power or temperature) of the electronic device 101 or an environmental state (e.g., a state of a user) outside the electronic device 101, and then generate an electrical signal or data value corresponding to the detected state. According to an embodiment, the sensor module 176 may include, for example, a gesture sensor, a gyro sensor, an atmospheric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an infrared (IR) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illumination sensor.
[0038] The interface 177 may support one or more specific protocols to be used to connect the electronic device 101 directly (e.g., wired) or wirelessly to an external electronic device (e.g., the electronic device 102). According to an embodiment, the interface 177 may include, for example, a high-definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.
[0039] The connection end 178 may include a connector, wherein the electronic device 101 can be physically connected to an external electronic device (e.g., the electronic device 102) via the connector. According to an embodiment, the connection end 178 may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0040] The haptic module 179 may convert the electrical signal into mechanical stimulation (eg, vibration or motion) or electrical stimulation that can be recognized by the user via his sense of touch or kinesthetic sense. According to an embodiment, the haptic module 179 may include, for example, a motor, a piezoelectric element, or an electrical stimulator.
[0041] The camera module 180 may capture still images or moving images. According to an embodiment, the camera module 180 may include one or more lenses, an image sensor, an image signal processor, or a flash.
[0042] The power management module 188 may manage power supply to the electronic device 101. According to an embodiment, the power management module 188 may be implemented as, for example, at least a part of a power management integrated circuit (PMIC).
[0043] The battery 189 may power at least one component of the electronic device 101. According to an embodiment, the battery 189 may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0044] The communication module 190 may support establishing a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device 101 and an external electronic device (e.g., electronic device 102, electronic device 104, or server 108), and perform communication via the established communication channel. The communication module 190 may include one or more communication processors capable of operating independently from the processor 120 (e.g., an application processor (AP)) and supporting direct (e.g., wired) communication or wireless communication. According to an embodiment, the communication module 190 may include a wireless communication module 192 (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module 194 (e.g., a local area network (LAN) communication module or a power line communication (PLC) module). A corresponding one of these communication modules can communicate with an external electronic device via a first network 198 (e.g., a short-range communication network such as Bluetooth, Wireless Fidelity (Wi-Fi) Direct, or Infrared Data Association (IrDA)) or a second network 199 (e.g., a long-range communication network such as a traditional cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a wide area network (WAN))). These various types of communication modules can be implemented as a single component (e.g., a single chip), or these various types of communication modules can be implemented as multiple components separated from each other (e.g., multiple chips). The wireless communication module 192 can identify and authenticate the electronic device 101 in a communication network (such as the first network 198 or the second network 199) using user information (e.g., an International Mobile Subscriber Identity (IMSI)) stored in the user identification module 196.
[0045] The wireless communication module 192 can support 5G networks after 4G networks and next-generation communication technologies (e.g., new radio (NR) access technology). NR access technology can support enhanced mobile broadband (eMBB), massive machine type communication (mMTC), or ultra-reliable low-latency communication (URLLC). The wireless communication module 192 can support high-frequency bands (e.g., millimeter wave bands) to achieve, for example, high data transmission rates. The wireless communication module 192 can support various technologies for ensuring performance on high-frequency bands, such as, for example, beamforming, massive multiple-input multiple-output (massive MIMO), full-dimensional MIMO (FD-MIMO), array antennas, analog beamforming, or massive antennas. The wireless communication module 192 can support various requirements specified in the electronic device 101, an external electronic device (e.g., electronic device 104), or a network system (e.g., a second network 199). According to an embodiment, the wireless communication module 192 may support a peak data rate for implementing eMBB (e.g., 20 Gbps or greater), loss coverage for implementing mMTC (e.g., 164 dB or less), or U-plane delay for implementing URLLC (e.g., 0.5 ms or less for each of the downlink (DL) and uplink (UL), or 1 ms or less round trip).
[0046] The antenna module 197 may transmit or receive a signal or power to or from the outside of the electronic device 101 (e.g., an external electronic device). According to an embodiment, the antenna module 197 may include an antenna including a radiating element formed of a conductive material or a conductive pattern formed in or on a substrate (e.g., a printed circuit board (PCB)). According to an embodiment, the antenna module 197 may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication scheme used in a communication network (such as the first network 198 or the second network 199) may be selected from the plurality of antennas by, for example, the communication module 190 (e.g., the wireless communication module 192). A signal or power may then be transmitted or received between the communication module 190 and the external electronic device via the selected at least one antenna. According to some embodiments, additional components other than the radiating element (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module 197.
[0047] According to various embodiments, the antenna module 197 may form a millimeter wave antenna module. According to an embodiment, the millimeter wave antenna module may include a printed circuit board, a radio frequency integrated circuit (RFIC), and a plurality of antennas (e.g., array antennas), wherein the RFIC is disposed on a first surface (e.g., bottom surface) of the printed circuit board, or adjacent to the first surface and capable of supporting a specified high frequency band (e.g., millimeter wave band), and the plurality of antennas are disposed on a second surface (e.g., top surface or side surface) of the printed circuit board, or adjacent to the second surface and capable of transmitting or receiving signals of the specified high frequency band.
[0048] At least some of the above components may be connected to each other via an inter-peripheral communication scheme (e.g., a bus, a general purpose input output (GPIO), a serial peripheral interface (SPI), or a mobile industry processor interface (MIPI)) and communicatively transmit signals (e.g., commands or data) therebetween.
[0049] According to an embodiment, a command or data may be sent or received between the electronic device 101 and the external electronic device 104 via the server 108 connected to the second network 199. Each of the electronic device 102 or the electronic device 104 may be a device of the same type as the electronic device 101, or a device of a different type from the electronic device 101. According to an embodiment, all or some operations to be executed in the electronic device 101 may be executed in one or more of the external electronic device 102, the external electronic device 104, or the server 108. For example, if the electronic device 101 should automatically execute a function or service or should execute a function or service in response to a request from a user or another device, the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service instead of executing the function or service, or the electronic device 101 may request the one or more external electronic devices to execute at least part of the function or service in addition to executing the function or service. The one or more external electronic devices receiving the request may execute at least part of the function or service requested, or execute another function or another service related to the request, and transmit the result of the execution to the electronic device 101. The electronic device 101 may provide the result as at least a partial reply to the request in the case of further processing the result or in the case of not further processing the result. To this end, cloud computing technology, distributed computing technology, mobile edge computing (MEC) technology or client-server computing technology, for example, may be used. The electronic device 101 may use, for example, distributed computing or mobile edge computing to provide ultra-low latency services. In another embodiment, the external electronic device 104 may include an Internet of Things (IoT) device. The server 108 may be an intelligent server using machine learning and / or neural networks. According to an embodiment, the external electronic device 104 or the server 108 may be included in the second network 199. The electronic device 101 may be applied to intelligent services (e.g., smart homes, smart cities, smart cars or health care) based on 5G communication technology or IoT-related technologies.
[0050] Figure 2 2 is a diagram showing an unfolded state and a folded state of an electronic device of a first shape according to an embodiment.
[0051] refer to Figure 2In an embodiment, the electronic device 101 may include a foldable housing and a flexible or foldable display 260 disposed in a space formed by the foldable housing. The foldable housing may have a shape that is substantially symmetrical with respect to a folding axis (e.g., axis A). According to an embodiment, a surface provided with the first display 260 may be defined as a first surface 210a of the electronic device 101, and a surface opposite to the first surface 210a may be defined as a second surface 220a. Here, the surface provided with the first display 260 may be defined as a first surface 210a or a front surface of the electronic device 101, and a surface opposite to the front surface may be defined as a second surface 220a or a rear surface of the electronic device 101.
[0052] refer to Figure 2 , the electronic device 101 may have a first shape in which the longitudinal length on the front surface thereof is greater than the horizontal length. For example, the electronic device 101 of the first shape may be referred to as a folding electronic device, and a state in which the bottom surface of the body faces downward relative to the folding axis (e.g., axis A) in the electronic device 101 of the first shape may be referred to as a longitudinal mode. In addition, a state in which one of the two side surfaces of the body faces downward relative to the folding axis (e.g., axis A) in the electronic device of the first shape may be referred to as a transverse mode.
[0053] like Figure 2 As shown in (a), the first display 260 may be formed to occupy the entire first surface 210a of the electronic device 101, and as shown in FIG. Figure 2 As shown in (b), the second display 261 may be formed to occupy at least a portion of the second surface 220a. In this case, the first display 260 may be pivoted by a separate hinge module, and the second display 261 may be fixed to the housing. For example, the hinge structure may be configured to fold or unfold inwardly or outwardly. For example, a free stop hinge may keep the electronic device 101 in a folded state at various angles.
[0054] For example, the second display 261 may be provided on one of a pair of housings, the pair of housings being provided on both sides of the folding axis (e.g., axis A). According to an embodiment, the first display 260 may refer to a flexible display in which at least a portion of the area is deformable into a flat surface or a curved surface. The first display 260 may include a first area (or first display area) 260a provided on one side of the folding axis (e.g., axis A) and a second area (or second display area) 260b provided on the other side of the folding axis (e.g., axis A).
[0055] For example, when the electronic device 101 is in an unfolded state (eg, a flat state), a surface of the first region 260a and a surface of the second region 260b may form an angle of 180 degrees with each other and face the same direction (eg, a front direction of the electronic device 101).
[0056] like Figure 2 As shown in (c), when the electronic device 101 is in a folded state, the surface of the first area 260a of the first display 260 and the surface of the second area 260b may form a narrow angle (e.g., between 0 degrees and 10 degrees) with each other and face each other. According to an embodiment, when the electronic device 101 is in a folded state, the second display 261 may be disposed on one of a pair of shells, and the pair of shells are disposed on both sides of a folding axis (e.g., axis A). However, this is exemplary, and the second display 261 may form a large part of the rear surface 220a depending on its structure or function. For example, the electronic device 101 may include a second display 261 that is at least partially visually exposed through a back cover. Therefore, it will be noted that the size and shape of the first display 260 and the second display 261 are not limited thereto. In addition, Figure 2 The area division of the first display 260 shown in (a) is exemplary, and the first display 260 may be divided into a plurality of areas (eg, four or more areas or two areas) according to its structure or function.
[0057] Figure 3a is a diagram showing a folded state of an electronic device of a second shape in a portrait mode according to an embodiment, and Figure 3b is a diagram illustrating a folded state of the electronic device of a second shape in a landscape mode according to an embodiment.
[0058] For example, the electronic device 101 of the second shape may be referred to as a flip electronic device, and Figure 3a As shown in , the state in which the electronic device 101 of the second shape is placed upright while being folded inwardly (such as in a compact form) relative to the folding axis (e.g., axis A-A') can be referred to as a portrait mode. In addition, the state in which the electronic device 101 of the second shape is folded inwardly relative to the folding axis (e.g., axis A-A') can be referred to as a landscape mode.
[0059] like Figure 3a As shown in , when a user folds the electronic device 101 in the forward direction 330, the electronic device 101 may be in a partially unfolded state relative to a folding axis (eg, axis AA'). This folding method may be referred to as an inward folding method.
[0060] The electronic device 101 may be in a state where the first housing structure 320 is in contact with a contact surface (e.g., a floor or a table) and the second housing structure 310 is placed upright on the contact surface. In this way, the electronic device 101 including a flexible display may be folded or bent relative to one axis. According to an embodiment, when the electronic device 101 is in a partially folded state in a portrait mode, the first display 260 may be divided into a first display area 260a and a second display area 260b above and below each other relative to the folding axis. In the portrait mode, the first display area 260a corresponding to the upper portion viewed by the user relative to the folding axis may be referred to as the upper area of the first display 260 (or the internal display), and the second display area 260b corresponding to the lower portion may be referred to as the lower area of the first display 260 (or the internal display). At least one of the first display area 260a or the second display area 260b may include a front camera.
[0061] like Figure 3b As shown in , the electronic device 101 can be in a partially unfolded state relative to a folding axis (eg, axis AA′) by force and bending motion applied by the user's hands.
[0062] According to an embodiment, when the electronic device 101 is in a partially folded state in the landscape mode, the first display 260 may be divided into a first display area 260a and a second display area 260b to the left and right relative to the folding axis. In the landscape mode, the first display area 260a corresponding to the left side viewed by the user relative to the folding axis may be referred to as the left side area of the first display 260 (or the internal display), and the second display area 260b corresponding to the right side may be referred to as the right side area of the first display 260 (or the internal display).
[0063] According to an embodiment, when at least a portion of the first display 260 is folded, Figure 2 The electronic device 101 shown in FIG. 1 can be in various folding states according to the installation state (or posture), such as Figure 4 as shown in . Figure 4 are perspective views illustrating various folding states of the electronic device according to the embodiment.
[0064] like Figure 4 As shown in FIG. 4 , the electronic device 101 may be in various partially folded states 400a, 400b, and 400c. The electronic device 101 may be in a state where it is placed upright while being folded inwardly (such as in a compact form). According to an embodiment, when the electronic device 101 is in a state such as Figure 4In the installation state or posture shown in 400a to 400c of the embodiment, both the first display area and the second display area of the first display divided by folding may be in an activated state enabling user input. According to an embodiment, the interactive input through the first display area and the interactive input through the second display area may be independent of each other. For example, when the first display area is controlled based on the interactive input in a specified direction, the second display area may be controlled based on the interactive input in the specified direction or in a different direction.
[0065] In addition, according to an embodiment, when the electronic device 101 is in the first housing structure (eg, Figure 3a 320) and a second housing structure (eg, Figure 3a When an angle is formed between the display and the side surface of the body, and thus the side surface of the body supports the contact surface, the electronic device 101 can be in a state 400c in which it is placed upright. This folding method can be called an outward folding method. Even when the electronic device 101 is folded outward, an interactive input to one area (or one surface) of the display and an interactive input to another area (or another surface) of the display can be independent of each other.
[0066] According to an embodiment, when the first display 260 of the electronic device 101 is in an expanded state, a second window partially overlapping the first window may be displayed through the first display 260. According to an embodiment, in a case where the second window is displayed on the first window, the electronic device 101 may display the first window and the second window in the first display area and the second display area divided by folding, respectively, in response to a folding event. The execution screen of the application may be displayed on the first window, and content associated with the execution screen of the application may be displayed on the second window.
[0067] For example, different windows may be respectively set in the first display area and the second display area, and various user interfaces related to the running applications may be implemented on the windows.
[0068] According to an embodiment, when the first display 260 of the electronic device 101 is in an unfolded state, the first area and the second area enabling independent interactive input may be displayed through the first display 260. For example, the first window may include the first area and the second area. According to an embodiment, when the first area and the second area are displayed, the electronic device 101 may separately display the first area and the second area in the first display area and the second display area divided by folding, respectively, in response to a folding event.
[0069] As described above, when various user interfaces reflecting the user's intention for the action of bending the electronic device 101 with a flexible display can be provided, the usability of the electronic device 101 can be improved.
[0070] According to an embodiment, the at least partially folded state of the display may be referred to as a flex mode, and the electronic device 101 may be maintained in the folded state at various angles. Although the electronic device may be folded in half relative to the center of the electronic device, the folding ratio may be achieved differently based on the axis.
[0071] The axis may be preset or arbitrary. A preset axis may mean that only a specific area of the flexible display of the electronic device 101 (e.g., a partial area including the axis) is bendable. On the other hand, an arbitrary axis may mean that the entire area of the display of the electronic device 101 is bendable. Although Figures 2 to 4 The electronic device 101 is shown to be folded in half with respect to an axis passing through the center of the electronic device 101 , but those skilled in the art will readily appreciate that the position of the axis is not limited.
[0072] In addition, the “front surface” or “rear surface” of the electronic device 101 may be referred to in the following detailed description, and regardless of the first housing structure (eg, Figure 3a 320) and a second housing structure (eg, Figure 3a 310) in the relative position (for example, the expanded state or the folded state), set Figure 2 The surface of the first display 260 is defined as the “front surface of the electronic device 101”, and the surface on which the second display 261 is provided, facing the direction opposite to the surface on which the first display 260 is provided, is defined as the “rear surface of the electronic device 101”. According to an embodiment, the “display” may refer to a flexible display. For example, Figure 2 , Figure 3a or Figure 3b The first display 260 may refer to a flexible display.
[0073] In the following detailed description, the same reference numerals or no reference numerals are assigned to components in the drawings that can be easily understood from the aforementioned embodiments, and a detailed description of the components can be avoided. The electronic device 101 according to an embodiment of the present disclosure can be implemented by selectively combining components of different embodiments, and components of an embodiment can be replaced by components of another embodiment. For example, it will be noted that the present disclosure is not limited to specific drawings or embodiments.
[0074] Figure 5 is a block diagram 500 showing an internal structure of an electronic device according to an embodiment.
[0075] refer to Figure 5 According to the electronic device 101 (eg, Figure 1 The electronic device 101 may include a processor 520 (eg, Figure 1 processor 120 in the embodiment of the present invention), memory 530 (e.g., Figure 1 130 in the memory), display 560 (e.g., Figure 1 display module 160 in the example), sensor 576 (e.g., Figure 1 sensor module 176 in) and / or communication module 590 (e.g., Figure 1 The communication module 190 in FIG. Figure 5 All components shown in FIG. 1 are not essential for the electronic device 101, and the electronic device 101 may be used in a variety of ways. Figure 5 The components shown may be implemented with more or fewer components.
[0076] The display 560 may refer to a flexible display. According to an embodiment, the display 560 may include a first display 260 and a second display 261, such as Figures 2 to 3b As shown in FIG. 1 , the following description is by way of example only. Figure 3a Given the case where the display 560 is folded in the forward direction 330 , it will be understood that the display 560 corresponds to the first display 260 .
[0077] For example, when the display 560 is at least partially folded, the display 560 may be divided into a first display area and a second display area. According to an embodiment, the partially folded state of the display 560 (e.g., the flexure mode) may mean a state in which at least a portion of the display 560 is visually exposed to the outside.
[0078] For example, when the display 560 is at least partially folded relative to the common boundary line, the entire screen of the display 560 may include a first display area and a second display area. The first display area may be controlled based on an interactive input in a specified direction, and the second display area may be controlled based on an interactive input in a specified direction or in different directions. For example, since the first display area and the second display area are controlled based on independent interactive inputs, simultaneous input and simultaneous control may be possible. Interactive inputs such as navigation or scrolling according to the application being run may be applied to each area divided by folding, and in addition to 4-way navigation and vertical or horizontal scrolling inputs, various user inputs such as text input are also included.
[0079] The sensor 576 may include a sensor (e.g., a digital Hall sensor or a 6-axis sensor) for determining the operating state (e.g., unfolded state, folded state, and / or intermediate state) and the folding angle of the electronic device 101. In addition, the sensor 576 may also include a strain sensor that outputs a strain value for indirectly measuring the folding angle of the electronic device 101.
[0080] The processor 520 may detect a physical state and / or a change in physical state of the electronic device 101 based on data received from the sensor 576. The processor 520 may detect a change (e.g., a folding event or an unfolding event) in an operating state (e.g., an unfolded state, a folded state, and / or an intermediate state of a partially folded state). For example, when the first housing structure (e.g., Figure 3a 320) and a second housing structure (eg, Figure 3a When the angle between the electronic device 101 and the electronic device 101 is within the specified angle range, it can be determined that the electronic device 101 is in a partially unfolded (or partially folded) state.
[0081] The processor 520 may execute at least one application and visually output content corresponding to the application through the display 560. The processor 520 may execute the application in response to a request from a user to execute the application. For example, the processor 520 may output an execution screen of the application through at least a portion (e.g., the entire screen) of the display 560 in response to executing the application in the expanded state of the display 560. The execution screen of the application as an output result of the currently running application may include a data object generated when the application is being executed, for example, at least one of video data, audio data, or display information. In addition, the execution screen of the application on the display 560 may be referred to as content, and may also be referred to as data or screen data related to the running application.
[0082] According to an embodiment, when the display 560 is in the expanded state, the screen interface for supporting the multi-window environment can be configured in a method in which two or more windows are overlapped and displayed on one screen and a method in which one screen is separated and displayed as two or more areas. Figure 6 . Figure 6 is a diagram illustrating a method of operating a plurality of windows in an unfolded state and a partially folded state of an electronic device according to an embodiment.
[0083] For example, in Figure 6 In the method in which two or more windows 610 and 620 are displayed overlappingly as shown in (a), the plurality of windows 610 and 620 may be arranged in a hierarchical structure on a layout 660 in an expanded state of the display 560. One of the two or more windows 610 and 620 may be in an active state in which interactive input is enabled. For example, input may be enabled on the topmost window 620, and when a window 610 covered by the topmost window 620 is selected, the topmost window 620 may be in an inactive state in which interactive input is disabled, and the selected window 610 may be in an active state in which interactive input is enabled.
[0084] For example, in Figure 6In the case of a method in which one screen is displayed divided into two or more areas 610a and 610b as shown in (b), one window 610 may be provided on a single layout 660 in an expanded state of the display 560. Although reference is made by way of example Figure 6 (b) describes a case where a single window 610 is configured to include regions 610a and 610b that enable different interactive inputs, but for ease of description, this is merely an example, and the first region 610a and the second region 610b may also be referred to as a first window and a second window, respectively. One of the two or more regions 610a and 610b may be in an activated state that enables interactive input. Therefore, the two regions may be selectively controlled rather than simultaneously.
[0085] When the screen interface is implemented so that when a folding event of the display 560 occurs, independent interactive input can be performed in each of the areas divided by folding instead of simply optimizing the layout in the areas, the divided screen can be effectively controlled. According to an embodiment, since one screen is divided into two areas by a folding event that bends the flexible display, intuitive screen control is possible for each area, thereby improving usability.
[0086] According to an embodiment, in Figure 6 In the case of the method in which two or more windows 610 and 620 are displayed overlappingly as shown in (a), the processor 520 may display the first window 610 of the application through the display 560 in the expanded state of the display 560. The first window 610 may correspond to the execution screen of the application. In response to an input for displaying the second window 620 in the case of displaying the first window 610, the processor 520 may display the second window 620 on at least a portion of the first window 610.
[0087] For example, the first window 610 is a window displayed on the entire area of the display 560, and may be referred to as a main window. The main window may include data generated during the execution of an application (or task), and may refer to an image output on the display 560 by an application executed in a foreground environment. The second window 620 is a subwindow displayed as a window smaller than the area of the display 560, and when a function (or item) provided by the application during the execution of the application is selected, the second window 620 may be displayed as overlapping a portion of the main window. Since the first window 610 corresponds to the execution screen of the application, the user may manipulate a specific item displayed on the execution screen or perform manipulation to navigate the execution screen. Therefore, the first window 610 may be controlled based on an interactive input in a specified direction. In addition, the second window 620 displayed as overlapping the first window 610 may be controlled based on an interactive input in a specified direction or in different directions.
[0088] According to an embodiment, when the second window 620 is displayed on the first window 610, the processor 520 may use the sensor 576 to detect a folding event of the display 560. For example, when different interactive inputs are enabled on the first window 610 and the second window 620, the processor 520 may separately display the first window 610 and the second window 620 in the first display area 660a and the second display area 660b of the display 56 divided by folding in response to the folding event, as shown in FIG. Figure 6 As shown in (c).
[0089] According to an embodiment, in Figure 6 In the case where one screen is displayed to be divided into two or more regions 610a and 610b as shown in (b), the processor 520 may detect a folding event of the display 560. For example, when different interactive inputs are enabled on the first region 610a and the second region 610b, the processor 520 may separately display the first region 610a and the second region 610b in the first display region 660a and the second display region 660b of the display 560 divided by folding in response to the folding event, as shown in FIG. Figure 6 The first area 610a and the second area 610b may be included in the first window 610, for example, and the first area 610a may be controlled based on an interactive input in a specified direction, and the second area 610b may be controlled based on an interactive input in a different direction.
[0090] As described above, an interactive input such as navigation or scrolling according to a running application may be independently performed in each display area divided by folding.
[0091] According to an embodiment, the electronic device 101 may include a flexible display 160, 260 or 560 and at least one processor 120 or 520. According to an embodiment, the at least one processor may be configured to display a first window of an application through the display when the display is unfolded. According to an embodiment, the at least one processor may be configured to display the second window in an area of the first window based on an input for displaying the second window. According to an embodiment, the at least one processor may be configured to separately display the first window and the second window in a first display area and a second display area divided by folding, respectively, when the display is at least partially folded.
[0092] According to an embodiment, the first window may be controlled based on an interactive input in a designated direction, and the second window may be controlled based on an interactive input in the designated direction or in a different direction.
[0093] According to an embodiment, when the display is unfolded, one of the first window and the second window may be in an activated state enabling interactive input, and when the display is at least partially folded, each of the first window and the second window may be in an activated state enabling interactive input.
[0094] According to an embodiment, the at least one processor may be configured to detect a folding event of the display, and in response to detecting the folding event, separately display the first window and the second window in a first display area and a second display area of the display, respectively.
[0095] According to an embodiment, the first window may correspond to an execution screen of an application, and the second window may include content associated with the execution screen of the application.
[0096] According to an embodiment, the at least one processor may be configured to: detect a folding event of the display, in response to detecting the folding event, identify whether the first window and the second window enable different interactive inputs, and in response to identifying that the first window and the second window enable different interactive inputs, separately display the first window and the second window in the first display area and the second display area, respectively.
[0097] According to an embodiment, the at least one processor may be configured to: detect a folding event of the display, and in response to detecting the folding event, identify whether a first window of an application displayed on the display when the display is unfolded includes two areas in which different interactive inputs are enabled, and in response to identifying that the first window includes two areas in which different interactive inputs are enabled, divide the entire area of the display into a first display area and a second display area according to the folding.
[0098] According to an embodiment, the at least one processor may be configured to: detect a folding event of the display, and in response to detecting the folding event, identify whether the first window of an application displayed in a state where the display is unfolded includes a first area and a second area enabling different interactive inputs, and in response to identifying that the first window includes the first area and the second area enabling different interactive inputs, when the display is at least partially folded, separately display the first area and the second area in the first display area and the second display area divided by folding, respectively.
[0099] According to an embodiment, when a first window of an application includes a first region and a second region enabling different interactive inputs, the first region may be controlled based on interactive input in a specified direction, and the second region may be controlled based on interactive input in different directions.
[0100] According to an embodiment, the at least one processor may be configured to: when a first area of a first window is controlled based on an interactive input in a specified direction, and a second area of the first window is controlled based on an interactive input in a direction different from the specified direction, when the display is in an at least partially folded state, the first area controlled based on the interactive input in the specified direction and the second area controlled based on the interactive input in a direction different from the specified direction are separately displayed in the first display area and the second area divided by folding, respectively.
[0101] Figure 7 is a flowchart showing the operation of the electronic device according to the embodiment. Figure 7 , the method of operating an electronic device having a flexible display may include operations 705 to 715. Figure 7 Each operation of the operation method may be performed by an electronic device (eg, Figures 1 to 5 1) or at least one processor of the electronic device (e.g., Figure 1 The processor 120 or Figure 5 In an embodiment, at least one of operations 705 to 715 may be omitted, the order of some operations may be changed, or other operations may be added.
[0102] At operation 705, the electronic device 101 may display a first window of the application in a state in which the flexible display of the electronic device 101 is unfolded. The first window of the application may correspond to an execution screen of the application.
[0103] In operation 710, the electronic device 101 may display the second window on the area of the first window based on the input for displaying the second window. For example, the electronic device 101 may receive a selection of one of the items included in the execution screen. For example, the electronic device 101 may detect a selection of an item (e.g., a specific area, icon, text, or number) on the first window. The selection may include a hover or touch event of a touch input (e.g., a finger or a stylus). The electronic device 101 may display a second window providing content (or detailed information) associated with the execution screen based on the selection.
[0104] According to an embodiment, the first window may be controlled based on an interactive input in a designated direction, and the second window may be controlled based on an interactive input in the designated direction or in a different direction.
[0105] According to an embodiment, in a state in which the display is unfolded, one of the first window and the second window may be in an activated state in which an interactive input is enabled.
[0106] At operation 715, in a state where the flexible display is at least partially folded, the electronic device 101 may separately display the first window and the second window in the first display area and the second display area divided by the folding, respectively. For example, the first window and the second window may be respectively arranged in the first display area and the second display area.
[0107] According to an embodiment, the electronic device 101 may detect a folding event of the display, and in response to detecting the folding event, separately display the first window and the second window in the first display area and the second display area, respectively.
[0108] According to an embodiment, the first window may correspond to an execution screen of an application, and the second window may include content associated with the execution screen of the application.
[0109] According to an embodiment, in a state where the display is at least partially folded, each of the first window and the second window may be in an activated state in which interactive input is enabled. According to an embodiment, the first window displayed in the first display area may be controlled based on interactive input in a specified direction, and the second window displayed in the second display area may be controlled based on interactive input in a specified direction or in different directions.
[0110] According to an embodiment, the electronic device 101 may detect a folding event of the display. In response to detecting the folding event, the electronic device 101 may identify whether different interactive inputs are enabled for the first window and the second window.
[0111] According to an embodiment, in response to recognizing that the first window and the second window enable different interactive inputs, the electronic device 101 may separately display the first window and the second window in the first display area and the second display area, respectively.
[0112] According to an embodiment, the electronic device 101 may detect a folding event of the display, and in response to detecting the folding event, identify whether the first window of the application displayed in the state where the display is unfolded includes a first area and a second area in which different interactive inputs are enabled. In response to identifying that the first window includes the first area and the second area in which different interactive inputs are enabled, the electronic device 101 may separately display the first area and the second area in the first display area and the second display area divided by the folding, respectively, in a state where the display is at least partially folded.
[0113] According to an embodiment, when a first window of an application includes a first region and a second region enabling different interactive inputs, the first region may be controlled based on interactive input in a specified direction, and the second region may be controlled based on interactive input in different directions.
[0114] Figure 8is a flowchart illustrating an operation of operating multiple windows in response to a folding event according to an embodiment. Figure 8 , the operating method of the electronic device having a flexible display may include operations 805 to 835. Figure 8 Each operation of the operation method may be performed by an electronic device (eg, Figures 1 to 5 1) or at least one processor of the electronic device (e.g., Figure 1 The processor 120 or Figure 5 In an embodiment, at least one of operations 805 to 835 may be omitted, the order of some operations may be changed, or other operations may be added. To help understand Figure 8 For a description, see Figures 9 to 12 . Fig. 9 is a diagram showing a plurality of layers according to an embodiment, Fig.10 is a diagram illustrating a plurality of interactions according to an embodiment, Fig.11 is a diagram illustrating a case where inputs to regions divided by folding are independent of each other in a case where a plurality of windows are displayed according to an embodiment, and Fig.12 is a diagram illustrating a case where inputs to regions divided by folding are independent of each other in a case where the divided regions are displayed according to an embodiment.
[0115] According to an embodiment, Figure 8 The operations include operations for operating a plurality of windows when a folding event is detected to occur in the electronic device 101 .
[0116] In operation 805, the electronic device 101 may identify whether it is multi-layered. For example, the electronic device 101 may identify whether it is multi-layered when a folding event is detected. In response to identifying a plurality of layers, in operation 810, the electronic device 101 may identify whether the number of layers is 2. Conversely, when a plurality of layers are not identified in operation 805, the electronic device 101 may perform operation 815.
[0117] For example, in response to Fig. 9 (a) is used to display the input 930 of the second window 920 on the first window 910, as shown in FIG. Fig. 9 As shown in (b), the electronic device 101 may display the second window 920 as overlapping at least a portion of the first window 910. In this case, when the first window 910 and the second window 920 have a layered structure in which they are stacked, the electronic device 101 may recognize them as a plurality of layers. In the case of a multi-layer structure, input may be enabled on one of the first window 910 and the second window 920. Therefore, when Fig. 9 When a user input 940 occurs on the first window 910 as shown in (b), the electronic device 101 may Fig. 9(a) shows that the display of the second window 920 is removed.
[0118] When the number of layers is 2 at operation 810, the electronic device 101 may identify a plurality of interactions at operation 815. In response to identifying the plurality of interactions, at operation 820, the electronic device 101 may identify whether the number of interactions is 2. Conversely, when the plurality of interactions are not identified, the electronic device 101 may terminate the operation of operating the plurality of windows in response to the folding event.
[0119] When the number of interactions is 2 at operation 820, the electronic device 101 may prepare multiple windows at operation 825. For example, the electronic device 101 may detect whether a folding event for operating multiple windows occurs. Fig.10 As shown in (a), when a screen (e.g., an application execution screen) includes a first area 1010 and a second area 1020, the first area 1010 may be controlled based on an interactive input 1040 in a specified direction, and the second area 1020 may be controlled based on an interactive input 1030 in a different direction. Fig.10 As shown in (b), the size of the second area 1020 may be changed based on interaction inputs 1030 in different directions.
[0120] Already referenced Figure 8 It is described that, for example, since the flexible display is divided into two areas by being folded in half, the number of layers is 2, and the number of interactions is 2. However, when the electronic device 101 has a different appearance, the number of areas divided by folding may be two or more. For example, an appearance in which one portion of the flexible display is folded inward and the other portion is folded outward may be referred to as a Z-shaped folding structure, and in this case, the electronic device 101 may have an appearance including both inward folding and outward folding. Therefore, since the number of divided areas may be plural according to the Z-shaped folding structure, a window based on multiple layers and multiple interactions may be set in each divided area.
[0121] At operation 830, the electronic device 101 may identify whether the folding angle is greater than a specified angle (e.g., 30 degrees). When the folding event is not detected or the folding angle is less than the specified angle, the operation of detecting the folding event may be performed continuously or periodically. Optionally, when the folding angle is less than the specified angle, the operation of operating multiple windows in response to the folding event may be terminated.
[0122] When the folding angle is greater than a specified angle (eg, 30 degrees) at operation 830 , the electronic device 101 may perform multi-window switching at operation 835 .
[0123] For example, in the case of a method in which two or more windows are overlapped and displayed on one screen, the electronic device 101 may respond to the following Fig.11(a) is used to display the input 1130 of the second window 1120 on the first window 1110, as shown in FIG. Fig.11 (b) shows that the second window 1120 is displayed overlapping at least a portion of the first window 1110 .
[0124] In response to the folding event, the electronic device 101 may set the first window 1110 in the first display area 1160a divided by folding, and set the second window 1120 in the second display area 1160b, as shown in FIG. Fig.11 Thus, the first display area 1160a may be controlled based on the interaction input 1140 in a specified direction, and the second display area 1160b may be controlled based on the interaction input 1150 in a different direction.
[0125] For example, in Fig.12 In the case of the method in which one screen is displayed as divided into two or more regions as shown in (a), when one screen is displayed as divided into a first region 1210 and a second region 1220, the first region 1210 may be controlled based on an interactive input 1230 in a specified direction. Fig.12 As shown in (b), the second area 1220 may be controlled based on an interaction input 1240 in a direction different from the designated direction.
[0126] In response to the folding event, the electronic device 101 may set the first area 1210 in the first display area 1260a divided by folding, and set the second area 1220 in the second display area 1260b, as shown in FIG. Fig.12 Thus, the first display area 1260a may be controlled based on the interaction input 1230 in a specified direction, and the second display area 1260b may be controlled based on the interaction input 1240 in a different direction.
[0127] Fig.13 is a flowchart illustrating an operation of an electronic device when the electronic device is folded if there are different interaction inputs on one screen according to an embodiment. Fig.13 Each operation may be performed by an electronic device (e.g., Figures 1 to 5 1) or at least one processor of the electronic device (e.g., Figure 1 The processor 120 or Figure 5 In an embodiment, at least one of operations 1305 to 1325 may be omitted, the order of some operations may be changed, or other operations may be added. To help understand Fig.13 , will refer to Fig.14 . Fig.14is a diagram illustrating exemplary screens in which an execution screen of a first application is independently displayed in each region divided by folding according to an embodiment.
[0128] At operation 1305, the electronic device 101 may display the execution screen of the application. For example, when the display is in the expanded state, the execution screen of the application may be displayed to occupy the entire screen of the display, such as Fig.14 According to an embodiment, the first area of the execution screen of the application can be controlled based on the interactive input in the first direction. Fig.14 As shown in (b), the second area of the application may be controlled based on the interactive input in the second direction.
[0129] In operation 1310, the electronic device 101 may identify whether a folding event occurs. When the occurrence of the folding event is not detected, the execution screen of the application may remain displayed.
[0130] On the other hand, upon detecting the occurrence of the folding event, the electronic device 101 may determine whether a list view and a horizontal scroll view are recognized on the execution screen at operation 1315. Fig.14 (a), the list view may correspond to a first area of an execution screen of an application controlled based on an interactive input in a first direction. Fig.14 (b), the horizontal scroll view may correspond to a second area of the execution screen of the application controlled based on the interactive input in the second direction. Fig.14 (a) and Fig.14 As shown in (b), the execution screen of the application may include areas that enable different interactive inputs.
[0131] In operation 1320, the electronic device 101 may create an additional view in response to the execution screen including the list view and the horizontal scroll view. In operation 1325, the electronic device 101 may set the list view in the first view and set the horizontal scroll view in the second view. For example, the list view and the horizontal scroll view may be provided by separate layers (e.g., the first view and the second view). The first view and the second view may refer to areas divided by folding in a multi-window environment. For example, referring to Fig.14 (c), the first view may correspond to the first display area, and the second view may correspond to the second display area. Views (e.g., a list view and a horizontal scroll view) may be provided in an overlapping manner in the first display area and the second display area. Fig.14 As shown in (c), different interactive inputs can be applied independently in views (e.g., list view and horizontal scroll view) respectively set in the areas divided by folding (e.g., upper area and lower area). Therefore, different interactive inputs can be received simultaneously through the areas divided by folding.
[0132] Fig.15 is a diagram illustrating a screen example in which each area divided by folding independently displays an execution screen of a second application according to an embodiment.
[0133] refer to Fig.15 (a), when executing the second application (e.g., a map application), the user can navigate in four directions on the area (or the first window) displaying the map or manipulate the map display area in any direction. When the user selects an item related to the second application (e.g., a specific location), an area (or a second window) including content (or detailed information) related to the map application can be displayed in the map display area, such as Fig.15 As shown in (b).
[0134] In response to detecting the occurrence of the folding event, the electronic device 101 may separately display the first window and the second window in the areas divided by the folding, respectively. Fig.15 As shown in (c), different interactive inputs can therefore be enabled in each region.
[0135] Fig.16 is a diagram illustrating a screen example in which an execution screen of a second application is independently displayed in each region divided by folding according to an embodiment.
[0136] When Fig.16 As shown in (a), when the user selects an item (e.g., a specific location) related to the second application (e.g., a map application) while the execution screen of the second application is displayed, an area (or a second window) including content (or location information) related to the map application may be displayed, as shown in FIG. Fig.16 (b). According to the user's selection, the second window may be displayed to overlap all or at least a portion of the first window. In response to detecting the occurrence of the folding event, the electronic device 101 may separately display the first window and the second window in the areas divided by the folding, such as Fig.16 For example, when the upper region can be controlled based on an interaction input in a specified direction (eg, four directions), the lower region can be controlled based on an interaction input in the same direction as the specified direction or in a different direction.
[0137] Fig.17 is a diagram illustrating a screen example in which an execution screen of an application is independently displayed in each area divided by folding in a landscape mode of an electronic device of a second shape according to an embodiment.
[0138] Fig.17 It shows that Figure 3aIn the landscape mode, when the display is in the unfolded state, the first window (or upper area) 1710 and the second window (or lower area) 1720 of the electronic device 101 may be displayed. Fig.17 When the electronic device 101 detects a folded state in which the electronic device 101 is folded inwardly by a user's bending motion from both sides, the first window 1710 may be set in a first display area 1760a divided relative to the folding axis, and the second window 1720 may be set in a second display area 1760b, as shown in FIG. Fig.17 Since the first window 1710 and the second window 1720 enable different interactive inputs, when the first display area 1760a is controlled based on an interactive input in a specified direction, the second display area 1760b may also be controlled based on an interactive input in a different direction.
[0139] Fig.18 is a diagram illustrating a screen example in which an execution screen of an application is independently displayed in each area divided by folding in a portrait mode of an electronic device of a first shape according to an embodiment.
[0140] Fig.18 It shows that Figure 2 The first shape of the electronic device 101 is shown in the portrait mode. Fig.18 As shown in FIG. 1 , the electronic device 101 may have a first shape on its front surface where the height is longer than the width. In the portrait mode, when the display is in the unfolded state, the first window 1810 and the second window 1820 of the electronic device 101 may be displayed, as shown in FIG. Fig.18 Although the first window 1810 and the second window 1820 enable different interactive inputs, only one window may be in an active state in which the interactive input is enabled.
[0141] When the electronic device 101 detects a folded state in which the electronic device 101 is folded inwardly by a user's bending motion from both sides, the first window 1810 may be set in the first display area 1860a divided relative to the folding axis, and the second window 1820 may be set in the second display area 1860b, as shown in FIG. Fig.18 Since the first window 1810 and the second window 1820 enable different interactive inputs, when the first display area 1860a is controlled based on an interactive input in a specified direction, the second display area 1860b may also be controlled based on an interactive input in a different direction.
[0142] Fig.19is a diagram illustrating a screen example in which an execution screen of an application is independently displayed in each area divided by folding in a landscape mode of an electronic device of a first shape according to an embodiment.
[0143] Fig.19 It shows that Figure 2 The first-shaped electronic device 101 is in a landscape mode as shown in FIG. A state in which one of the two side surfaces of the main body of the first-shaped electronic device 101 faces downward relative to the folding axis may be referred to as a landscape mode. In the landscape mode, when the display is in an unfolded state, a first window 1910 and a second window 1920 of the electronic device 101 may be displayed, such as Fig.19 Although the first window 1910 and the second window 1920 enable different interactive inputs, in the expanded state, only one window may be in an active state in which the interactive input is enabled.
[0144] When the electronic device 101 detects a folded state in which the electronic device 101 is folded inwardly by a bending motion of a user, the first window 1910 may be set in a first display area 1960a divided relative to the folding axis, and the second window 1920 may be set in a second display area 1960b, as shown in FIG. Fig.19 Since the first window 1910 and the second window 1920 enable different interactive inputs, when the first display area 1960a is controlled based on an interactive input in a specified direction, the second display area 1960b may also be controlled based on an interactive input in a different direction.
[0145] According to an embodiment, an execution screen of an application is divided into two areas according to a folding event that bends a flexible display, thereby enabling intuitive screen control through independent interaction inputs to each divided area and thus improving usability.
[0146] The electronic device according to various embodiments may be one of various types of electronic devices. The electronic device may include, for example, a portable communication device (e.g., a smart phone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a household appliance. According to an embodiment of the present disclosure, the electronic device is not limited to those electronic devices described above.
[0147] It should be understood that the various embodiments of the present disclosure and the terms used therein are not intended to limit the technical features set forth herein to specific embodiments, but include various changes, equivalent forms or alternative forms for corresponding embodiments. For the description of the accompanying drawings, similar reference numerals may be used to refer to similar or related elements. It will be understood that the noun corresponding to the item in the singular form may include one or more things unless the relevant context clearly indicates otherwise. As used herein, each of the phrases such as "A or B", "at least one of A and B", "at least one of A or B", "A, B or C", "at least one of A, B and C" and "at least one of A, B or C" may include any one or all possible combinations of the items listed together with the corresponding one of the multiple phrases. As used herein, terms such as "1st" and "2nd" or "first" and "second" may be used to simply distinguish the corresponding component from another component, and do not limit the component in other aspects (e.g., importance or order). It will be understood that if an element (e.g., a first element) is referred to as being “combined with another element (e.g., the second element)”, “combined to another element (e.g., the second element)”, “connected with another element (e.g., the second element)”, or “connected to another element (e.g., the second element)” when the terms “operably” or “communicatively” are used or when the terms “operably” or “communicatively” are not used, it means that the element may be directly (e.g., wired) connected to the other element, wirelessly connected to the other element, or connected to the other element via a third element.
[0148] As used in connection with various embodiments of the present disclosure, the term "module" may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with other terms (e.g., "logic," "logic block," "portion," or "circuit"). A module may be a single integrated component adapted to perform one or more functions or a minimum unit or portion of the single integrated component. For example, depending on the embodiment, a module may be implemented in the form of an application specific integrated circuit (ASIC).
[0149] The various embodiments described herein may be implemented as software (e.g., program 140) including one or more instructions stored in a storage medium (e.g., internal memory 136 or external memory 138) that can be read by a machine (e.g., electronic device 101). For example, under the control of a processor, a processor (e.g., processor 120) of the machine (e.g., electronic device 101) may call at least one of the one or more instructions stored in the storage medium and execute the at least one instruction with or without the use of one or more other components. This enables the machine to operate to perform at least one function according to the at least one instruction called. The one or more instructions may include code generated by a compiler or code that can be run by an interpreter. A machine-readable storage medium may be provided in the form of a non-transitory storage medium. Among them, the term "non-transitory" only means that the storage medium is a tangible device and does not include a signal (e.g., an electromagnetic wave), but the term does not distinguish between data being semi-permanently stored in a storage medium and data being temporarily stored in a storage medium.
[0150] According to an embodiment, the method according to various embodiments of the present disclosure may be included and provided in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be released in the form of a machine-readable storage medium (e.g., a compact disk read-only memory (CD-ROM)), or may be downloaded via an application store (e.g., PlayStore). TM ) The computer program product may be published (e.g., downloaded or uploaded) online, or the computer program product may be distributed (e.g., downloaded or uploaded) directly between two user devices (e.g., smart phones). If published online, at least part of the computer program product may be temporarily generated, or at least part of the computer program product may be at least temporarily stored in a machine-readable storage medium (such as a memory of a manufacturer's server, an application store's server, or a forwarding server).
[0151] According to various embodiments, each component (e.g., module or program) of the above-mentioned components may include a single entity or multiple entities, and some of the multiple entities may be separately arranged in different components. According to various embodiments, one or more of the above-mentioned components may be omitted, or one or more other components may be added. Alternatively or additionally, multiple components (e.g., modules or programs) may be integrated into a single component. In this case, according to various embodiments, the integrated component may still perform the one or more functions of each of the multiple components in the same or similar manner as the corresponding one of the multiple components performing one or more functions before integration. According to various embodiments, the operations performed by a module, a program or another component may be performed sequentially, in parallel, repeatedly or in a heuristic manner, or one or more of the operations may be run or omitted in a different order, or one or more other operations may be added.
[0152] According to an embodiment, the non-volatile storage medium may store instructions configured to enable the electronic device 101 to perform at least one operation when executed by at least one processor 120 or 520 of the electronic device. The at least one operation may include: displaying a first window of an application in a state where the flexible display of the electronic device is unfolded; displaying the second window on an area of the first window based on an input for displaying the second window; and separately displaying the first window and the second window in a first display area and a second display area divided by folding, respectively, in a state where the flexible display is at least partially folded.
Claims
1. An electronic device (101), comprising: Flexible displays (160, 260, 560); as well as at least one processor (120, 520), Wherein, the at least one processor is configured to: When the display is unfolded, a first window of an application is displayed on the display. based on an input for displaying a second window, displaying the second window on an area of the first window, and In a state in which the display is at least partially folded, the first window and the second window are separately displayed in a first display area and a second display area divided by the folding, respectively.
2. The electronic device according to claim 1, wherein: The first window is controlled based on an interactive input in a specified direction, and the second window is controlled based on an interactive input in the specified direction or in a different direction.
3. The electronic device according to claim 1 or 2, wherein: When the display is expanded, one of the first window and the second window is in an activated state to enable interactive input, and Wherein, when the display is at least partially folded, each of the first window and the second window is in the activation state enabling interactive input.
4. The electronic device according to any one of claims 1 to 3, wherein: The at least one processor is configured to: detecting a folding event of the display, and In response to detecting the folding event, the first window and the second window are separately displayed in the first display area and the second display area of the display, respectively.
5. The electronic device according to any one of claims 1 to 4, wherein: The first window corresponds to an execution screen of the application, and the second window includes content associated with the execution screen of the application.
6. The electronic device according to any one of claims 1 to 5, wherein: The at least one processor is configured to: detecting a folding event of the display, In response to detecting the folding event, identifying whether the first window and the second window enable different interactive inputs, and In response to recognizing that the first window and the second window enable different interactive inputs, the first window and the second window are separately displayed in the first display area and the second display area, respectively.
7. The electronic device according to any one of claims 1 to 6, wherein: The at least one processor is configured to: detecting a folding event of the display, In response to detecting the folding event, identifying whether the first window of the application displayed in the state where the display is unfolded includes two areas enabling different interactive inputs, and In response to identifying that the first window includes the two regions enabling different interactive inputs, the entire area of the display is divided into the first display region and the second display region according to the folding.
8. The electronic device according to any one of claims 1 to 7, wherein: The at least one processor is configured to: detecting a folding event of the display, In response to detecting the folding event, identifying whether the first window of the application displayed in the state where the display is unfolded includes a first area and a second area enabling different interactive inputs, and In response to recognizing that the first window includes the first area and the second area enabling different interactive inputs, the first area and the second area are separately displayed in the first display area and the second display area divided by folding, respectively, when the display is at least partially folded.
9. The electronic device according to any one of claims 1 to 8, wherein: When the first window of the application includes a first area and a second area enabling different interactive inputs, the first area is controlled based on an interactive input in a specified direction, and the second area is controlled based on interactive inputs in different directions.
10. The electronic device according to any one of claims 1 to 9, wherein: The at least one processor is configured to, when in an expanded state of the display, a first area of the first window is controlled based on an interactive input in a specified direction, and a second area of the first window is controlled based on an interactive input in a direction different from the specified direction, separately display the first area controlled based on an interactive input in the specified direction and the second area controlled based on an interactive input in a direction different from the specified direction in the first display area and the second display area divided by folding, respectively.
11. A method of operating an electronic device including a flexible display, the method comprising: Displaying a first window of an application in a state where the display is expanded; Based on an input for displaying a second window, displaying the second window on an area of the first window; as well as In a state in which the display is at least partially folded, the first window and the second window are separately displayed in a first display area and a second display area divided by the folding, respectively.
12. The method according to claim 11, wherein: The first window is controlled based on an interactive input in a specified direction, and the second window is controlled based on an interactive input in the specified direction or in a different direction.
13. The method according to claim 11 or 12, wherein: When the display is unfolded, one of the first window and the second window is in an activated state to enable interactive input. wherein, in a state where the display is at least partially folded, each of the first window and the second window is in the activation state enabling interactive input, wherein the first window corresponds to an execution screen of the application, and The second window includes content associated with the execution screen of the application.
14. The method according to any one of claims 11 to 13, comprising: detecting a folding event of the display, and In response to detecting the folding event, identifying whether the first window and the second window enable different interactive inputs, and In response to recognizing that the first window and the second window enable different interactive inputs, the first window and the second window are separately displayed in the first display area and the second display area, respectively.
15. A non-volatile storage medium storing instructions, the instructions being configured to, when executed by at least one processor (120, 520) of the electronic device (101), enable the electronic device to perform at least one operation, in, The at least one operation comprises: When the flexible display of the electronic device is unfolded, displaying a first window of the application; Based on an input for displaying a second window, displaying the second window on an area of the first window; and In a state in which the flexible display is at least partially folded, the first window and the second window are separately displayed in a first display area and a second display area divided by the folding, respectively.