Electronic device and method for displaying screen on basis of rotation of housing

WO2025048136A1PCT designated stage expired Publication Date: 2025-03-06SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/007396
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-09-27
Filing Date
2024-05-30
Publication Date
2025-03-06

Smart Images

  • Figure KR2024007396_06032025_PF_FP_ABST
    Figure KR2024007396_06032025_PF_FP_ABST
Patent Text Reader

Abstract

A processor of an electronic device, according to an embodiment, displays, in an unfolded state of a first housing, a second housing, and a third housing, a first screen executing one application on a first display area, a second display area, and a third display area of a flexible display. The processor displays, on the basis of the occurrence of a notification event while the one application is executed, the notification event on at least one display area among the first display area, the second display area, and the third display area. The processor identifies that, while the notification event is displayed on the at least one display area, the first housing and the third housing are changed from the unfolded state to a semi-folded state by a certain angle. The processor displays, on the basis of the change to the semi-folded state, the notification event on the first display area or the third display area.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device and method for displaying a screen based on rotation of a housing

[0001] The present disclosure relates to an electronic device and method for displaying a screen based on rotation of a housing.

[0002] The shape and / or size of electronic devices are diversifying. To enhance mobility, electronic devices with reduced size and / or volume are being designed. Electronic devices may include a display for visualizing information. As the number of functions supported by electronic devices increases, the size of the display may increase to visualize more information to the user and / or to support the execution of the functions. For example, electronic devices may be designed to be reduced in size and / or volume while maintaining or increasing the size of the display.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0004] According to an embodiment, an electronic device may include a multi-foldable housing including a first housing, a second housing rotatably coupled to the first housing, and a third housing rotatably coupled to the second housing, a flexible display including a first display area supported by the first housing, a second display area supported by the second housing, and a third display area supported by the third housing, a first sensor for sensing a first angle between the first housing and the second housing, a second sensor for sensing a second angle between the second housing and the third housing, a memory for storing instructions, and a processor for accessing the memory to execute the instructions. The instructions, when executed by the processor, may cause the processor to display a first screen executing an application on the first display area, the second display area, and the third display area of ​​the flexible display in unfolded states of the first housing, the second housing, and the third housing. The instructions, when executed by the processor, may cause the processor to display a notification event on at least one of the first display area, the second display area, and the third display area based on occurrence of a notification event while the one application is running. The instructions, when executed by the processor, may cause the processor to identify that at least one of the first housing and the third housing changes from the unfolded state to a semi-folded state by a predetermined angle with respect to the second housing while the notification event is displayed on the at least one display area.The above instructions, when executed by the processor, may cause the processor to display the notification event in the first display area or the third display area based on the processor changing to the semi-folding state.

[0005] In one embodiment, a method of an electronic device may include an operation of displaying a first screen executing an application on a first display area of ​​a flexible display supported by a first housing, a second display area of ​​the flexible display supported by a second housing, and a third display area of ​​the flexible display supported by a third housing, in unfolded states of a first housing, a second housing, and a third housing of the electronic device. The method may include an operation of displaying a notification event on at least one display area among the first display area, the second display area, and the third display area based on occurrence of a notification event while the one application is executing. The method may include an operation of identifying that at least one of the first housing and the third housing changes from an unfolded state to a semi-folded state by a predetermined angle with respect to the second housing while the notification event is displayed on the at least one display area. The method may include an action of displaying the notification event in the first display area or the third display area based on the change to the semi-folding state.

[0006] In one embodiment, an electronic device may include a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a flexible display disposed on a first surface of the first housing, a second surface of the second housing, and a third surface of the third housing, a cover display disposed on a fourth surface of the first housing opposite the first surface, a plurality of sensors, a memory for storing instructions, and a processor for accessing the memory to execute the instructions. The processor may be configured to display, on the flexible display in an unfolded state identified by the plurality of sensors, a first screen having a size of an entire display area of ​​the flexible display. The processor may be configured to display, on the cover display, a second screen related to the first screen, together with the first screen displayed on the flexible display, based on the first surface and the second surface being folded for a specified period of time while displaying the first screen in the unfolded state.

[0007] In one embodiment, a method of an electronic device may include an operation of displaying, in an unfolded state of the electronic device, a first screen having a size of an entire display area of ​​a flexible display disposed on a first surface of a first housing of the electronic device, a second surface of a second housing rotatably coupled with the first housing, and a third surface of a third housing rotatably coupled with the second housing. The method may include an operation of displaying, on a cover display disposed on a fourth surface of the first housing, opposite the first surface, a second screen related to the first screen, together with the first screen displayed on the flexible display, based on the first surface and the second surface being folded for a specified period of time while displaying the first screen in the unfolded state.

[0008] FIG. 1 illustrates one embodiment of a deformable electronic device.

[0009] FIG. 2 illustrates an example block diagram of an electronic device according to one embodiment.

[0010] Figures 3a, 3b and 3c illustrate one embodiment of a deformable electronic device.

[0011] FIG. 4 illustrates a flow diagram of an electronic device according to one embodiment.

[0012] FIG. 5 illustrates an exemplary flowchart for explaining the operation of an electronic device according to one embodiment, based on a program.

[0013] Figures 6a and 6b illustrate an example of the operation of an electronic device for obtaining information related to the angle between housings.

[0014] Figures 7a and 7b illustrate exemplary states of an electronic device that are switched based on rotation between housings.

[0015] Figure 8 illustrates exemplary states of an electronic device that are switched based on rotation between housings.

[0016] Figures 9a and 9b illustrate exemplary states of an electronic device that are switched based on rotation between housings.

[0017] Figure 10 illustrates exemplary states of an electronic device that are switched based on rotation between housings.

[0018] Figure 11 illustrates exemplary states of an electronic device that are switched based on rotation between housings.

[0019] Figure 12 illustrates one embodiment of a deformable electronic device.

[0020] FIG. 13 is a block diagram of an electronic device within a network environment according to various embodiments.

[0021] Hereinafter, various embodiments of this document are described with reference to the attached drawings.

[0022] FIG. 1 illustrates an embodiment of a deformable electronic device (101). In terms of being owned by a user, the electronic device (101) may be referred to as a terminal (or user terminal), user equipment (UE), or the like. The terminal may include, for example, a personal computer (PC) such as a laptop or desktop. The terminal may include, for example, a smartphone, a smartpad, and / or a tablet PC. The terminal may include a smart accessory such as a smartwatch and / or a head-mounted device (HMD).

[0023] Referring to FIG. 1, according to one embodiment, an electronic device (101) may include a deformable multi-foldable housing. Based on the deformability, the multi-foldable housing may be divided into a plurality of parts (or combinations and / or portions). For example, the multi-foldable housing of the electronic device (101) of FIG. 1 may include a first housing (111), a second housing (112), and a first hinge assembly (121) for rotatably coupling the first housing (111) and the second housing (112). By the first hinge assembly (121), the relative position, posture (or position), angle, shape, and / or distance of the first housing (111) and the second housing (112), which are rigid bodies, may be changed by an external force.

[0024] Referring to FIG. 1, the multi-foldable housing of the electronic device (101) may include a second housing (112), a third housing (113), and a second hinge assembly (122) for rotatably coupling the second housing (112) and the third housing (113). By the second hinge assembly (122), the relative position, posture, angle, shape, and / or distance of the second housing (112) and the third housing (113) may be changed by an external force. Based on the first hinge assembly (121) and the second hinge assembly (122), the electronic device (101) may have a structure that can be folded more than once. However, the multi-foldable housing is not limited to three housings, and may also include four, five, or more housings. In one embodiment, the housings, such as the first housing (111), the second housing (112), and the third housing (113), may be referred to as a housing assembly (or housing combination, housing part, and / or housing assembly), a sub-housing, a flat housing, and / or a rigid housing. In one embodiment, the hinge assembly, including the first hinge assembly (121) and the second hinge assembly (122), may be referred to as a hinge housing, a joint housing, and / or a flexible housing.

[0025] Referring to FIG. 1, the first folding axis (131) may be a rotation axis of the first housing (111) and the second housing (112) connected through the first hinge assembly (121), and may be located within the first hinge assembly (121). As the first housing (111) and / or the second housing (112) rotate around the first folding axis (131), the first angle (141) between the first housing (111), the first hinge assembly (121), and the second housing (112) may change. The second folding axis (132) may be a rotation axis of the second housing (112) and the third housing (113) connected through the second hinge assembly (122), and may be located within the second hinge assembly (122). As the second housing (112) and / or the third housing (113) rotate about the second folding axis (132), the second angle (142) between the second housing (112), the second hinge assembly (122), and the third housing (113) can be changed. In terms of including a plurality of deformable folding axes, such as the first folding axis (131) and the second folding axis (132), the electronic device (101) can be referred to as a multi-foldable electronic device. The first angle (141) and the second angle (142) can be changed independently of each other.

[0026] Referring to FIG. 1, according to one embodiment, an electronic device (101) may include a flexible display (150) disposed on one surface (e.g., a front surface of the electronic device (101)) of a first housing (111), a second housing (112), and a third housing (113). For example, the flexible display (150) may extend from the first housing (111) across the second housing (112) to the third housing (113). The flexible display (150) may form at least a portion of the front surfaces of the first housing (111), the second housing (112), and the third housing (113). For example, the flexible display (150) may be arranged from the first housing (111) across the first hinge assembly (121), the second housing (112), and the second hinge assembly (122) to the third housing (113). Hereinafter, the first angle (141) may correspond to an angle between one side of the first housing (111) where the flexible display (150) is arranged and one side of the second housing (112), which may be folded by the first folding axis (131) of the first hinge assembly (121). Hereinafter, the second angle (142) may correspond to an angle between one side of the second housing (112) where the flexible display (150) is arranged and one side of the third housing (113), which may be folded by the second folding axis (132) of the second hinge assembly (122). In one embodiment, the flexible display (150) may be referred to as a display, a deformable display, and / or a deformable panel. An exemplary hardware configuration of an electronic device (101) for controlling the flexible display (150) is described with reference to FIG. 2.

[0027] Referring to FIG. 1, the posture and / or shape of the electronic device (101) and / or the flexible display (150) can be distinguished by the first angle (141) and / or the second angle (142). The state of the electronic device (101) distinguished by the first angle (141) and / or the second angle (142) is described with reference to FIGS. 3A to 3C. According to one embodiment, the electronic device (101) can display one or more screens displayed on the flexible display (150) based on the rotation of the first folding axis (131) and / or the second folding axis (132). The operation performed by the electronic device (101) based on the rotation of the first folding axis (131) and / or the second folding axis (132) is described with reference to FIGS. 4 to 12.

[0028] Referring to FIG. 1, the front of the electronic device (101) as viewed from the z-axis (e.g., as viewed from the +z direction) and the side appearance of the electronic device (101) as viewed from the y-axis (e.g., as viewed from the -y direction) are illustrated. In a state (191) where the first angle (141) and the second angle (142) are substantially straight angles (approximately 180º), the electronic device (101) can display a screen using the entire display area (active region, active area, displaying region and / or displaying area) of the flexible display (150). For example, in the state (191), a screen (e.g., a window and / or an activity) provided from a software application (hereinafter, “application”) can be displayed on the entire display area of ​​the flexible display (150).

[0029] Referring to FIG. 1, the electronic device (101) can detect or identify a change in state, shape, mode, and / or posture of the electronic device (101) based on a physical rotation of the first folding axis (131) and / or the second folding axis (132). For example, within state (191), the electronic device (101) can identify a rotation of the first housing (111) with respect to the second housing (112). In one embodiment, within state (192) switched based on the rotation from state (191), the electronic device (101) can display a second screen related to the first screen that was displayed within the state (191). For example, after a specified period of time (e.g., a period of about 1.5 seconds) from the timing of switching to the state (192), the electronic device (101) may display the second screen on a portion (171) of the flexible display (150) disposed on the first housing (111), which is distinguished by the first folding axis (131) rotated within the state (192). For example, if the electronic device (101) is switched to another state (e.g., state (191)) distinct from the state (192) within the specified period of time from the timing of switching to the state (192), the electronic device (101) may not display the second screen.

[0030] For example, within the state (191), the electronic device (101) can identify the rotation of the third housing (113) with respect to the second housing (112). In one embodiment, within the state (193) switched based on the rotation from the state (191), the electronic device (101) can display a second screen related to the first screen displayed within the state (191). For example, after a specified period of time from the timing of switching from the state (193), the electronic device (101) can display the second screen on a portion (173) of the flexible display (150) disposed on the third housing (113), which is distinguished by the second folding axis (132) rotated within the state (193). For example, if the electronic device (101) switches to another state (e.g., state (191)) distinct from the state (193) within the specified period of time from the timing, the electronic device (101) may not display the second screen. Although not shown in FIG. 1, the rotation of the first housing (111) relative to the second housing (112) and / or the rotation of the third housing (113) relative to the second housing (112) may be such that the first angle (141) and / or the second angle (142) exceeds 180º. In other words, an out-folding operation may also be performed.

[0031] In one embodiment, within state (192) and / or state (193), the second screen displayed together with the first screen may be related to the content of the first screen. For example, within state (191) displaying a first screen including a visual object for user interaction (e.g., button (170)), the electronic device (101) may display a second screen related to the visual object after switching to at least one of states (192, 193). Within states (192, 193) providing flat portions defined by a first folding axis (131) and / or a second folding axis (132), the electronic device (101) may simultaneously display a second screen related to the first screen, together with the first screen displayed in the state (191) prior to states (192, 193), on each of the flat portions. By simultaneously displaying the first screen and the second screen, the electronic device (101) can provide a user experience based on multi-tasking. When switching from one of the states (192, 193) that provide both the first screen and the second screen to the state (191), the electronic device (101) can stop displaying the second screen that was additionally displayed within the states (192, 193) and display the first screen on the entire display area of ​​the flexible display (150).

[0032] Hereinafter, with reference to FIG. 2, an example of a hardware configuration included in an electronic device (101) to perform the operation described with reference to FIG. 1 is described.

[0033] FIG. 2 illustrates an example of a block diagram of an electronic device (101), according to one embodiment. The electronic device (101) of FIG. 1 may include hardware of the electronic device (101) described with reference to FIG. 2 . Referring to FIG. 2 , the electronic device (101) according to one embodiment may include at least one of a processor (210), a memory (220), a flexible display (150), and a sensor (230). The processor (210), the memory (220), the flexible display (150), and the sensor (230) may be electrically and / or operably coupled with each other by an electronic component, such as a communication bus (202). The embodiment is not limited thereto, and the electronic device (101) may further include a cover display (152).

[0034] In one embodiment, the operative coupling of the hardware components of the electronic device (101) may mean that a direct connection or an indirect connection is established, either wired or wireless, between the hardware components such that a second hardware component is controlled by a first hardware component among the hardware components. Although illustrated based on different blocks, the embodiment is not limited thereto, and a portion of the hardware of FIG. 2 (e.g., at least a portion of the processor (210) and the memory (220)) may be included in a single integrated circuit such as a system on a chip (SoC). The hardware components of the electronic device (101), which are divided into blocks, may be located in or included in at least one of the first housing (111), the second housing (112), or the third housing (113) described with reference to FIG. 1. The type and / or number of hardware components included in the electronic device (101) is not limited to that illustrated in FIG. 2. For example, the electronic device (101) may include only some of the hardware components illustrated based on the blocks of FIG. 2.

[0035] According to one embodiment, the processor (210) of the electronic device (101) may include hardware and / or circuitry for processing data based on one or more instructions. The hardware and / or circuitry for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). The number of processors (210) may be one or more. For example, the processor (210) may have a multi-core processor structure such as a dual core, a quad core, a hexa core, or an octa core.

[0036] According to one embodiment, the memory (220) of the electronic device (101) may include a hardware component for storing data and / or instructions input to or output from the processor (210). The memory (220) may include, for example, a volatile memory such as a random-access memory (RAM) and / or a non-volatile memory such as a read-only memory (ROM). The volatile memory may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, a solid state drive (SSD), and an embedded multi-media card (eMMC).

[0037] According to one embodiment, the flexible display (150) of the electronic device (101) can output visualized information to a user (e.g., screens of FIGS. 1, 7A, 7B, 8, 9A, 9B, 10 to 13). For example, the flexible display (150) can be controlled by a controller, such as a graphic processing unit (GPU) and / or a processor (210), to output visualized information to the user. For example, the flexible display (150) can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs). For example, the flexible display (150) can include electronic paper. The flexible display (150) may have an at least partially curved shape and / or a deformable shape, as described above with reference to FIG. 1. Hereinafter, the active area and / or displaying area of ​​the flexible display (150) may correspond to at least a portion of the flexible display (150) that includes one or more enabled or activated pixels.

[0038] According to one embodiment, the flexible display (150) of the electronic device (101) may include a sensor (e.g., a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger) on the flexible display (150). For example, based on the TSP, the electronic device (101) may detect an external object that is in contact with the flexible display (150) or floating on the flexible display (150). In response to detecting the external object, the electronic device (101) may execute a function associated with a specific visual object corresponding to a location of the external object on the flexible display (150) among visual objects displayed within the flexible display (150).

[0039] According to one embodiment, the cover display (152) of the electronic device (101) may be disposed on a side opposite to one side of the housing of the electronic device (101) on which the flexible display (150) is disposed. The side on which the cover display (152) is disposed may be referred to as the front side (or front surface) of the electronic device (101), and the other side on which the flexible display (150) is disposed may be referred to as the rear side (or rear surface) (or back surface) of the electronic device (101). The embodiment is not limited thereto, and one side of the electronic device (101) on which the flexible display (150) is disposed may be referred to as the front side, and the other side of the electronic device (101) on which the cover display (152) is disposed may be referred to as the rear side. The cover display (152), similar to the flexible display (150), may include a circuit for visualizing information. The electronic device (101) may include a touch sensor (e.g., an electrostatic touch sensor or a resistive touch sensor) for identifying an external object (e.g., a body part such as a user's finger) adjacent to or in contact with the cover display (152). In the description of the cover display (152), descriptions that overlap with the description of the flexible display (150) may be omitted.

[0040] According to one embodiment, the sensor (230) of the electronic device (101) may generate electrical information from non-electronic information related to the electronic device (101), which may be processed by the processor (210) and / or stored in the memory (220). For example, the sensor (230) may include a global positioning system (GPS) sensor for detecting a geographic location of the electronic device (101). Additionally or alternatively to the GPS method, the sensor (230) may generate information indicating the geographic location of the electronic device (101) based on a global navigation satellite system (GNSS), such as, for example, Galileo or Beidou (compass). The information may be stored in the memory (220), processed by the processor (210), and / or transmitted to another electronic device distinct from the electronic device (101) via the communication circuitry (240). The sensor (230) is not limited to those described above, and may include an image sensor, a light sensor, a proximity sensor, a grip sensor, a fingerprint sensor, and / or a ToF sensor for detecting electromagnetic waves including light.

[0041] In one embodiment, the processor (210) of the electronic device (101) can use the sensor (230) to identify the pose, shape, and / or orientation of the electronic device (101). The sensor (230) can include a Hall sensor, a 6-degree of freedom (6-DoF) sensor, and / or an inertial measurement unit (IMU) for identifying the pose, shape, and / or orientation of the electronic device (101). The Hall sensor can include a magnet and a magnetic field sensor that measures a change in a magnetic field formed by the magnet. The magnet and the magnetic field sensor can be disposed in different parts (or portions) of the housing of the electronic device (101). Based on the change in the magnetic field measured by the magnetic field sensor, the Hall sensor can output sensor data indicating a distance between the portions.

[0042] For example, in one embodiment where the electronic device (101) includes a deformable housing, the processor (210) of the electronic device (101) can use the magnets and the magnetic field sensors disposed in different parts of the housing (e.g., the first housing (111), the second housing (112), and / or the third housing (113) of FIG. 1) to identify a shape of the housing or a parameter associated with the shape (e.g., the first angle (141) and / or the second angle (142) of FIG. 1). For example, the Hall sensor can output sensor data indicative of the distance and / or the shape of the housing.

[0043] In one embodiment, the IMU may include an acceleration sensor, a gyro sensor, a geomagnetic sensor, or any combination thereof. The acceleration sensor may output an electrical signal representing gravitational acceleration and / or acceleration along each of a plurality of axes (e.g., x-axis, y-axis, and z-axis) that are perpendicular to each other. The gyro sensor may output an electrical signal representing an angular velocity (e.g., an angular velocity based on roll, pitch, and / or yaw) along each of the plurality of axes. The geomagnetic sensor may output an electrical signal representing a magnitude of a magnetic field formed in the electronic device (101) along each of the plurality of axes (e.g., x-axis, y-axis, and / or z-axis). The processor (210) may repeatedly acquire data representing acceleration, angular velocity, and / or magnitude of a magnetic field from the IMU based on a specified period (e.g., 1 millisecond). Using a Hall sensor and / or an IMU, the processor (210) can identify parameters related to the shape of the electronic device (101) (e.g., the first angle (141) and / or the second angle (142) of FIG. 1). Based on the parameters, the processor (210) can identify the current shape of the electronic device (101) among designated shapes for distinguishing the shape of the electronic device (101) (e.g., the unfolded state, the folded state, and / or the sub-folded state described with reference to FIGS. 3A to 3C). For example, the processor (210) of the electronic device (101) can identify the first angle (141) between the first housing (111) and the second housing (112) of FIG. 1 and / or the second angle (142) between the second housing (112) and the third housing (113) of FIG. 1 using the sensor (230).

[0044] Although not shown, according to one embodiment, the electronic device (101) may include output means for outputting information in a form other than a visualized form. For example, the electronic device (101) may include a motor (or haptic actuator) for providing haptic feedback based on vibration. For example, the electronic device (101) may include one or more speakers (e.g., the first speaker (161), the second speaker (162), the third speaker (163), and the fourth speaker (164) of FIGS. 3A to 3C) for outputting audio signals.

[0045] According to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by the processor (210) may be stored in the memory (220) of the electronic device (101). For example, a set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or a software application (hereinafter, “application”). For example, the electronic device (101) and / or the processor (210) may perform at least one of the operations of FIG. 4 and / or FIG. 5 when a set of a plurality of instructions distributed in the form of an operating system, firmware, a driver, and / or an application is executed. Hereinafter, the fact that an application is installed in an electronic device (101) may mean that one or more instructions provided in the form of an application are stored in the memory (220) of the electronic device (101), and that the one or more applications are stored in a format executable by the processor (210) of the electronic device (101) (e.g., a file having an extension specified by the operating system of the electronic device (101)).

[0046] Referring to FIG. 2, programs stored in the memory (220) are illustrated as different blocks. The programs stored in the memory (220) may be classified into software applications (250) (or application software), frameworks (260), and / or sensor drivers (270) based on targets. The sensor drivers (270) may include programs (e.g., firmware) that are executed to drive one or more sensors (e.g., sensors (230)) included in the electronic device (101). The frameworks (260) may include programs (e.g., operating systems including system software and / or kernels), libraries, and / or APIs (application programming interfaces) for supporting control of the electronic device (101) based on the software applications (250). The software applications (250) may be installed in the electronic device (101) to execute one or more functions designed to target users of the electronic device (101).

[0047] Referring to FIG. 2, software applications (250) installed in the electronic device (101) are exemplarily illustrated. For example, a messenger application (251) for exchanging text messages (or media content such as images, videos, and sounds) between users, such as SMS, may be installed in the electronic device (101). For example, a gallery application (252) for browsing one or more media contents (e.g., images such as photos and / or videos) stored in the memory (220) of the electronic device (101) may be installed in the electronic device (101). For example, a calling application (253) for call connection (e.g., voice over internet protocol (VoIP), voice over long term evolution (VoLTE), voice over new radio (VoNR), and / or voice over fifth generation (Vo5G)) may be installed in the electronic device (101). The embodiment is not limited thereto, and the electronic device (101) may support installation and / or execution of other software applications different from the software applications (250) illustrated in FIG. 2, using a store application for downloading, installing, and / or updating applications.

[0048] In one embodiment, the processor (210) of the electronic device (101) may acquire a screen to be displayed on a display (e.g., flexible display (150) and / or cover display (152)) based on the execution of at least one of the software applications (250). For example, the electronic device (101) may determine at least a portion of the display on which the screen is to be displayed based on a state of the electronic device (101) identified by the sensor (230). The state of the electronic device (101) identified by the sensor (230) may be distinguished by the shape, state, and / or posture of a deformable housing (e.g., the multi-foldable housing of FIG. 1). For example, an electronic device (101) including both a flexible display (150) and a cover display (152) can determine at least one display on which the screen is to be displayed among the flexible display (150) and / or the cover display (152), based on a state of the electronic device (101) identified by a sensor (230). An electronic device (101) including a flexible display (150) can determine at least a portion on which the screen is to be displayed, based on a state of the electronic device (101) identified by a sensor (230).

[0049] In one embodiment, the processor (210) of the electronic device (101) can execute multiple software applications (250) substantially simultaneously based on multitasking (or multi-window). The multiple software applications (250) executed substantially simultaneously by the processor (210) can occupy different portions of the flexible display (150) and / or the cover display (152). For example, the processor (210) can display screens provided from the multiple software applications (250) executed by the processor (210) on each of the portions of the flexible display (150).

[0050] In one embodiment, the processor (210) of the electronic device (101) may identify a motion that temporarily bends the flexible display (150). The motion may include a motion that bends the flexible display (150) for a specified period of time. For example, the motion may cause an angle (e.g., the first angle (141) and / or the second angle (142) of FIG. 1) between housings of the electronic device (101) (e.g., the first housing (111), the second housing (112), and / or the third housing (113) of FIG. 1) to increase or decrease from a specified angle of about 180° to another angle exceeding a threshold angle. The motion may include a first gesture that rotates at least one of the housings such that a difference between the angle between the housings and the specified angle changes to exceed the threshold angle. The motion may include, after the first gesture, a second gesture of rotating at least one of the housings such that the angle between the housings changes to the specified angle. The first gesture and the second gesture may be performed with a time difference exceeding a specified time difference (e.g., about 1.5 seconds and / or about 3 seconds). However, the present disclosure is not limited to a specific time difference, and other time differences may also be used.

[0051] In one embodiment, if the difference between the angle between the housings and the designated angle (e.g., 180º) exceeds a threshold angle for a period of time exceeding a designated period of time, the processor (210) may display a second screen related to the first screen that was displayed on the flexible display (150) prior to identifying the first gesture. For example, the processor (210) may display the second screen on the flexible display (150) and / or the cover display (152) while maintaining the display of the first screen on the flexible display (150). Maintaining the first screen on the flexible display (150) may include displaying the first screen in a smaller size.

[0052] In one embodiment, the second screen displayed together with the first screen based on multitasking may correspond to a software application selected (or specified) by a user of the electronic device (101). For example, the electronic device (101) may receive a user input from the user for mapping at least one software application to various conditions. Based on the user input, the electronic device (101) may identify a software application to provide the second screen. The embodiment is not limited thereto, and the second screen may be a software application matched (or paired, or linked) with the first screen. For example, the matching between the first screen and the second screen may be based on instructions of a software application corresponding to the first screen. The instructions may be predefined. For example, the matching between the first screen and the second screen may be registered by a user input (e.g., a user input based on a visual object such as an application tray).

[0053] In one embodiment, after a specified period of time from the time at which the first gesture is identified, the processor (210) may display the second screen by overlapping it on at least a portion of the first screen displayed on the flexible display (150). For example, the electronic device (101) may provide a UI (user interface) such that the second screen floats (or hovers) on the first screen. The operation of the processor (210) to display the first screen and the entire second screen on the flexible display (150) is described with reference to FIGS. 7A to 9B and / or FIG. 11. For example, the processor (210) may display the first screen on the flexible display (150) and the second screen on the cover display (152). The operation of an electronic device (101) that displays a first screen on a flexible display (150) and a second screen on a cover display (152) is described with reference to FIG. 10.

[0054] In one embodiment, the electronic device (101) that displays a first screen and a second screen on a flexible display (150) that is bent beyond a period of time specified by the first gesture may, in response to identifying the second gesture, stop displaying the second screen and display the first screen on the flexible display (150). Since the display of the second screen is stopped in response to the second gesture, the processor (210) may provide a user experience of temporarily displaying the second screen related to the first screen. Based on the user experience, the electronic device (101) may provide a user experience based on multitasking (or multi-window) based on the user's motion of temporarily bending the flexible display (150).

[0055] Hereinafter, with reference to FIGS. 3a, 3b, 3c, 4 and / or 5, the appearance of the electronic device (101) changed by the motion and / or the operation of the electronic device (101) for identifying the motion are described.

[0056] Figures 3a, 3b, and 3c illustrate one embodiment of a transformable electronic device (101). The electronic device (101) of Figures 1 and / or 2 may include the electronic device (101) of Figures 3a to 3c.

[0057] Referring to FIGS. 3A to 3C , according to one embodiment, an electronic device (101) may include a first speaker (161) and / or a third speaker (163) disposed in a first housing (111). The electronic device (101) may include a second speaker (162) and / or a fourth speaker (164) disposed in a third housing (113). The third speaker (163) may be disposed at a second edge of the first housing (111) opposite a first edge of the first housing (111) where the first speaker (161) is disposed. The fourth speaker (164) may be disposed at a second edge of the third housing (113) opposite a first edge of the third housing (113) where the second speaker (162) is disposed. Although the second speaker (162) disposed on one side of the third housing (113) where the flexible display (150) is disposed and the first speaker (161), the third speaker (163) and the fourth speaker (164) disposed on the side connected to the front of the electronic device (101) are exemplarily illustrated, the positions of the speakers (e.g., the first speaker (161) to the fourth speaker (164)) included in the electronic device (101) are not limited to the positions illustrated in FIGS. 3A to 3C.

[0058] Referring to FIGS. 3A to 3C , different configurations of an electronic device (101) supporting deformability based on multiple folding axes (e.g., a first folding axis (131) and / or a second folding axis (132)) are illustrated. Referring to FIG. 3A , a first electronic device (101-1) is illustrated including a flexible display (150) that is visually completely covered by first housings (111) to third housings (113) folded along the first folding axis (131) and the second folding axis (132). Referring to FIG. 3A , different states (301, 302, 303) of the first electronic device (101-1) are illustrated, distinguished by a first angle (141) and a second angle (142). The state (301) of the first electronic device (101-1) in which the first angle (141) and the second angle (142) are substantially straight angles (e.g., about 180º) may be referred to as a fully unfolded state, an opened state, a fully-opened state, an unfolded state, a flat state, an outspread state, and / or a planar state. Although FIGS. 3A to 3C illustrate only two folding axes, the present disclosure is not limited thereto.

[0059] Referring to FIGS. 3A to 3C, within a state (301), a flexible display (150) disposed from the first housing (111) across the second housing (112) to the third housing (113) may have a substantially flat shape. Within the state (301), a single plane may be formed on the front surface of the electronic device (101) on which the flexible display (150) is disposed. Within the state (301), the directions of the front surfaces of the first housing (111), the second housing (112), and the third housing (113) may be parallel to and / or coincide with each other. The state (191) of FIG. 1 may correspond to or be included in the state (301) of FIG. 3A and / or the unfolded state.

[0060] Referring to FIG. 3A, a state (302) of the first electronic device (101-1) is illustrated in which the first angle (141) is substantially parallel and the second angle (142) is less than parallel. The state of the first electronic device (101-1) in which the first angle (141) and / or the second angle (142) are less than parallel, including the state (302), may be referred to as a semi-fold (or semi-folding) state, an in-fold state, a sub-unfolded state (or sub-folded state), an intermediate state, and / or a concave state. Although only the second hinge assembly (122) among the first hinge assembly (121) and the second hinge assembly (122) is shown as being folded, the embodiment is not limited thereto, and the sub-fold state may include a state in which both the first angle (141) and the second angle (142) are less than a parallel angle and exceed 0°. Within the sub-fold state, a plurality of planes may be formed by the flexible display (150) folded by at least one hinge assembly. Referring to state (302), the flexible display (150) bent by the second hinge assembly (122) may include two flat portions separated by the second hinge assembly (122). For example, the flat portions of the flexible display (150) separated by the second hinge assembly (122) may face different, non-parallel directions. States (192, 193) of FIG. 1 may correspond to or be included in state (302) and / or subfold state of FIG. 3a.

[0061] The sub-fold state of the first electronic device (101-1) is not limited to the state (302) of FIG. 3A in which the first angle (141) and / or the second angle (142) are folded to less than a flat angle. Referring to FIG. 3B, a state (302) of the first electronic device (101-1) included in the sub-fold state is illustrated. Within the state (302) of FIG. 3B, the first angle (141) and / or the second angle (142) of the first electronic device (101-1) may be bent to an angle exceeding a flat angle. The state (302) may be referred to as an out-fold state, a sub-fold state, an intermediate state, and / or a convex state of the first electronic device (101-1). Referring to FIG. 3B, an exemplary state (302) in which the first angle (141) is bent to exceed a flat angle is illustrated. From state (302), as the first angle (141) and the second angle (142) are folded substantially 360°, the first electronic device (101-1) can switch to state (303) of FIGS. 3A to 3B. From state (302) of FIG. 3B, as the first angle (141) and the second angle (142) are unfolded substantially 180°, the first electronic device (101-1) can switch to state (301) of FIGS. 3A to 3B.

[0062] Referring to FIG. 3A, a state (303) of the first electronic device (101-1) in which the first angle (141) and the second angle (142) are substantially all 0° may be referred to as a fully folded state, a folded state, a closed state, and / or a fully-closed state. Within the state (303), the flexible display (150) may be visually completely covered by the first housing (111) to the third housing (113). For example, within the folded state, the size of the flexible display (150) of the first electronic device (101-1) exposed to the outside may be substantially 0. Referring to FIG. 3a, an exemplary state (303) is illustrated in which the front and rear surfaces of the third housing (113) on which a portion of the flexible display (150) is disposed are each covered by the first housing (111) and the second housing (112), but the embodiment is not limited thereto.

[0063] A first electronic device (101-1) including a flexible display (150) that is visually completely obscured within a folded state may include a cover display (152) disposed on a rear surface opposite to a front surface on which the flexible display (150) is disposed. Referring to FIG. 3A, according to one embodiment, the first electronic device (101-1) may include a cover display (152) disposed on a second surface (e.g., a rear surface of the first housing (111)) of the first housing (111) opposite to a first surface (e.g., a front surface of the first housing (111)) of the first housing (111) on which a portion of the flexible display (150) is disposed. The embodiment is not limited thereto, and the cover display (152) may be disposed on the rear surface of the second housing (112) opposite to the front surface of the second housing (112) where a portion of the flexible display (150) is disposed. However, it is also conceivable that the cover display (152) is disposed on the rear surface of the first housing (111) and the rear surface of the second housing (112).

[0064] Referring to FIG. 3a, a first electronic device (101-1) including a flexible display (150) configured to be folded at an angle less than a parallel angle along a first folding axis (131) and a second folding axis (132) may be referred to as a G-shaped foldable electronic device. Referring to FIG. 3c, different forms of a second electronic device (101-2) including a flexible display (150) configured to be folded at an angle greater than a parallel angle along at least one of the first folding axis (131) and the second folding axis (132) are illustrated. The second electronic device (101-2) may be referred to as an S-shaped foldable electronic device.

[0065] Referring to FIG. 3c, different states (301, 302, 303) of the second electronic device (101-2) are illustrated, distinguished by a first angle (141) and a second angle (142). Within the state (301) corresponding to the unfolded state, a flat plane can be formed by the flexible display (150).

[0066] Referring to FIG. 3C, a state (302) of the second electronic device (101-2) is illustrated in which the first angle (141) exceeds a flat angle and the second angle (142) is folded to be less than a flat angle. The state of the second electronic device (101-2) in which the first angle (141) and / or the second angle (142) are changed to an angle different from a flat angle may be referred to as a semi-fold (or semi-folding) state, an out-fold state, an intermediate state, a sub-fold state, and / or a convex state. Although only the first angle (141) among the first angle (141) and the second angle (142) is illustrated as exceeding a flat angle, the embodiment is not limited thereto. Within the convex state including state (302), a plurality of planes formed by the flexible display (150) folded by the first hinge assembly (121) can face different directions.

[0067] Referring to FIG. 3C, a state (303) of the second electronic device (101-2) in which the first angle (141) is substantially 360° and the second angle (142) is substantially 0° may be referred to as a fully folded state, a folded state, and / or a closed state. Within the state (303), among the portions of the flexible display (150) disposed in each of the first housing (111) to the third housing (113), only the portion of the flexible display (150) disposed on the first housing (111) may be exposed to the outside.

[0068] According to one embodiment, the electronic device (101) can identify a state of the electronic device (101) (e.g., one of an unfolded state, a folded state, an in-fold state, and / or an out-fold state) indicated by the first angle (141) and the second angle (142) based on a sensor (e.g., sensor (230) of FIG. 2). Based on the switching between the states described with reference to FIGS. 3A to 3C, the electronic device (101) can display one or more screens based on multitasking on the flexible display (150) and / or the cover display (152).

[0069] For example, the electronic device (101) may display a second screen related to the first screen displayed on the flexible display (150) within the state (301) on the flexible display (150) and / or the cover display (152) after a specified period of time from the timing at which the third housing (113) is switched to the state (302) in which the third housing (113) is bent relative to the second housing (112) from the state (301) of FIG. 3A. For example, within the state (302) of displaying the second screen, the electronic device (101) may display the first screen on at least a portion of the flexible display (150). In one embodiment, the position at which the electronic device (101) displays the second screen may be related to the shape of the flexible display (150) that is bent (or folded) within the state (302).

[0070] Hereinafter, with reference to FIG. 4, an exemplary operation of an electronic device (101) displaying a second screen related to the first screen is described.

[0071] FIG. 4 illustrates a flowchart of an electronic device according to one embodiment. The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations described with reference to FIG. 4.

[0072] Referring to FIG. 4, in operation (410), according to one embodiment, a processor of an electronic device may display a first screen on a flexible display (e.g., the flexible display (150) of FIGS. 1 and 2) based on an unfolded state. For example, in an unfolded state checked by a plurality of sensors of the electronic device (e.g., the sensor (230) of FIG. 2), the processor may display a first screen having a size of the entire display area of ​​the flexible display on the flexible display. In one embodiment, where the electronic device includes a first housing (111), a second housing (112), and a third housing (113) of FIG. 1, the plurality of sensors may include a first sensor for detecting rotation of the first housing (111) with respect to the second housing (112), and a second sensor for detecting rotation of the third housing (113) with respect to the second housing (112). The first sensor and / or the second sensor may include an IMU sensor, a 6-axis sensor, and / or a Hall sensor, as described above with reference to FIG. 2. The unfolded state of the operation (410) may include the state (191) of FIG. 1, the state (301) of FIG. 3a, and / or the state (301) of FIG. 3c.

[0073] Referring to FIG. 4, within operation (420), a processor of an electronic device according to one embodiment may identify or determine an angle between housings (e.g., the first housing (111), the second housing (112), and / or the third housing (113) of FIG. 1) in which portions of a flexible display are positioned. The angles of operation (420) may include the first angle (141) and / or the second angle (142) of FIG. 1 and FIGS. 3A-3C. The processor may identify the angle of operation (420) based on sensor data acquired from at least one of a plurality of sensors. While the operation of the processor to directly identify the angle based on the sensor data has been described, the embodiment is not limited thereto, and the processor may acquire sensor data dependent on the angle, and / or may compute or measure a numeric value.

[0074] Referring to FIG. 4, in operation (430), according to one embodiment, the processor of the electronic device may determine whether the angle of operation (420) is included in a second angle range different from the first angle range for the unfolded state. The first angle range may be set to include a flat angle including 180º to distinguish the unfolded state from other states. The second angle range may be related to the sub-folded state. An example of the first angle range and / or the second angle range of operation (430) is described with reference to FIG. 6A and / or FIG. 6B. If the angle of operation (420) is included in the second angle range (430-Yes), the processor may perform operation (440). If the angle of the action (420) is within the first angle range and / or is not within the second angle range (430-No), the processor may track or monitor the angle between the housings based on the action (420).

[0075] Referring to FIG. 4, in operation (440), according to one embodiment, the processor of the electronic device may display the first screen of operation (410) and a second screen related to the first screen based on whether an angle included in a second angle range is maintained for a specified period of time. For example, if the angle identified based on operation (420) is maintained for a specified period of time within the second angle range, the processor may perform operation (440) to display the second screen. Since the angle of operation (420) is included in the second angle range associated with the sub-fold state, the flexible display of the electronic device may have an at least partially curved (or folded) shape while the processor performs operation (440). The processor may display the first screen and the second screen on each of the flat portions of the flexible display separated by a portion of the curved flexible display. Embodiments are not limited thereto, and the processor may display a first screen on a flexible display and a second screen on a cover display (e.g., the cover display (152) of FIG. 2 and / or FIG. 3A). Furthermore, the second screen may be displayed as if floating on the first screen.

[0076] According to one embodiment, the processor's display of the first screen and the second screen based on operation (440) may additionally or alternatively be performed depending on whether a grip on the electronic device is detected based on a grip sensor. For example, a processor that detects a grip on the electronic device may perform operation (440). If a grip on the electronic device is not detected, the processor may not perform operation (440) or may refrain from performing operation (440). For example, if the angle between the housings is changed by an unintended event such as a drop, a processor that identifies an angle within the second angle range based on operation (430) may use the grip sensor to confirm that a grip is not detected. If a grip is not detected, the processor may refrain from performing operation (440) or may stop performing operation (440) even though it has identified an angle within the second angle range.

[0077] The position of the second screen displayed based on the operation (440) may be related to the shape of the flexible display folded by the angle of the operation (420). While displaying the first screen in the unfolded state, the processor of the electronic device that has identified the second housing and the third housing that have been folded for more than a specified period of time may display the second screen related to the first screen on a portion of the flexible display disposed on the third housing, and may display the first screen on another portion of the flexible display disposed on the first housing and the second housing. While displaying the first screen in the unfolded state, the processor of the electronic device that has identified the first housing and the second housing that have been folded for more than a specified period of time may display the second screen on a portion of the flexible display disposed on the first housing, and may display the first screen on another portion of the flexible display disposed on the second housing and the third housing.

[0078] In one embodiment, after displaying the first screen and the second screen based on the operation (440), the processor may determine whether the state of the electronic device is restored to the unfolded state. Based on the second housing and the third housing being folded for a specified period of time, while displaying the first screen and the second screen, the processor may determine, detect, confirm, or identify whether the second housing and the third housing change to a posture associated with the unfolded state.

[0079] For example, in response to housings of the electronic device changing to a posture associated with an unfolded state within a state in which a second screen is displayed based on an action (440), the processor may display the first screen in the entire display area of ​​the flexible display and at least temporarily cease displaying the second screen.

[0080] In one embodiment, the second screen displayed within operation (440) may be related to the first screen. For example, while displaying the first screen including a visual object related to a notification message, the processor may display the second screen related to the notification message on the portion of the flexible display disposed on the third housing based on the second and third housings being folded over a specified period of time. The second screen may be related to buttons and / or links displayed for switching to other screens within the first screen, such as the visual object (170) of FIG. 1 . When multiple second screens are linked with the first screen, the processor may simultaneously display the multiple second screens based on a layout based on a multi-window. The embodiment is not limited thereto, and the processor may selectively display any one of the multiple second screens using a priority assigned to each of the multiple second screens. Alternatively, the processor may successively display the multiple second screens.

[0081] In one embodiment, the second screen displayed in operation (440) may be a screen set by the user of the electronic device to be paired with the first screen. For example, prior to pairing the first screen and the second screen, the processor of the electronic device may provide an application tray (or application list) together with the first screen. The processor may execute a software application specified by a user input related to the application tray to display the second screen. The processor may receive a user input indicating whether to maintain the pairing of the first screen and the second screen. After receiving the user input, the processor may display the first screen and the second screen specified by the user input based on operation (440) of FIG. 4. While displaying the second screen based on operation (440), the processor may display a visual object for disassociating (unlinking) the first screen and the second screen.

[0082] FIG. 5 illustrates an exemplary flowchart for explaining the operation of an electronic device according to an embodiment, based on a program. The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operation described with reference to FIG. 5. For example, the electronic device (101) and / or the processor (210) of FIG. 2 may perform the operation described with reference to FIG. 5. Referring to FIG. 5, the operation of the electronic device (101) is explained, which is divided based on a process (e.g., a thread and / or an instance), which is a unit of work executed by the processor of the electronic device. For example, a software application (510), a framework (260), and a sensor driver (270), which are depicted as different blocks, may correspond to each of the processes executed by the processor. Based on multitasking (or multithreading), the processor of the electronic device may execute instructions of each of the processes of FIG. 5 substantially simultaneously.

[0083] Referring to FIG. 5, in operation (520), according to one embodiment, a processor of an electronic device may display a first screen provided from a software application (510). The processor may perform operation (520) of FIG. 5 similarly to operation (410) of FIG. 4. Based on operation (520), the processor may display the first screen on a flexible display of the electronic device (e.g., the flexible display (150) of FIG. 1 and / or FIG. 2). Operation (520) may be performed in an unfolded state. The software application (510) of FIG. 5 may be included in the software applications (250) of FIG. 2.

[0084] Referring to FIG. 5, in operation (530), according to one embodiment, the processor of the electronic device may obtain attitude information indicating the attitude of the electronic device by controlling the sensor driver (270) based on the execution of the framework (260). For example, the attitude information may include sensor data of a sensor of the electronic device (e.g., sensor (230) of FIG. 2) including an IMU, a 6-axis sensor, and / or a Hall sensor. Based on the attitude information, the processor may identify a current state and / or current shape of the electronic device among designated states (e.g., an unfolded state, a sub-folded state, and / or a folded state). For example, the designated states may be distinguished by an angle between housings (e.g., the first angle (141) and / or the second angle (142) of FIGS. 1 and 3A to 3C), as described above with reference to FIGS. 3A to 3C. The current state can also be predicted to be defined by a combination of multiple angles (e.g., a first angle (141) and a second angle (142)).

[0085] In one embodiment, the processor may acquire the posture information based on the operation (520) while displaying the first screen of the operation (520) on the flexible display (e.g., the flexible display (150) of FIGS. 1 , 2 , and 3A to 3C) based on the execution of the software application (510). For example, if the angles between the housings (e.g., the first angle (141) of FIGS. 1 , 3A to 3C and / or the second angle (142) of FIGS. 1 , 3A to 3C) are maintained for a specified period of time within an angular range distinct from the unfolded state, the processor may perform the operation (540).

[0086] Referring to FIG. 5 , in operation (540), a processor of an electronic device according to an embodiment may identify or detect the occurrence of a folding event based on posture information. The processor, having identified the occurrence of the folding event, may notify the software application (510) of the occurrence of the folding event based on the execution of the framework (260). The folding event of operation (540) may be identified by an input indicating the display of a second screen related to a first screen displayed on the flexible display based on the rotation of the housings. For example, the processor may identify the input when the angle between the housings changes from a specified angle in an unfolded state to a different angle and then remains within the different angle for a specified period of time. The input may be identified based on whether a first gesture is received that rotates the housings so that a difference between the angle between the housings identified by the detail information and the specified angle changes by exceeding a threshold angle, and whether the angle between the housings changed by the first gesture is maintained for exceeding a specified period of time.

[0087] In one embodiment, the processor notifying the software application (510) of a folding event may include executing a subroutine (e.g., an event listener) indicated by instructions included in the software application (510). For example, the processor may execute the subroutine based on an identifier (or a designated constant) corresponding to the folding event. The subroutine executed by the processor may be executed by a process corresponding to the software application (510), such as operation (550) of FIG. 5 . The subroutine may be pre-registered with the framework (260) based on an application programming interface (API) provided by the framework (260) to process the shuttle event and / or other events identified by the framework (260). A system process (e.g., an event dispatcher and / or an event handler) included in the framework (260) may cause a processor of the electronic device to execute the sub-routine of the software application (510) based on the identification of a folding event.

[0088] Referring to operation (550) of FIG. 5, the processor of the electronic device can determine a second screen to be displayed based on a folding event based on the execution of the software application (510). Operation (550) can be performed based on the execution of a subroutine (or one or more instructions included in the subroutine) corresponding to the folding event. The processor that determines the second screen based on operation (550) can execute an API provided by the framework (260) for requesting display of the second screen (e.g., operation (560) of FIG. 5). For example, the processor can call or invoke an API for requesting display of the second screen to the framework (260) within operation (560). Based on the execution of the API, the processor can initiate an operation for displaying the second screen together with the first screen displayed based on the software application (510).

[0089] Referring to FIG. 5, in operation (570), a processor of an electronic device according to one embodiment may display a second screen on a flexible display and / or a cover display (e.g., the cover display (152) of FIGS. 1-2 and / or 3A) together with a first screen. For example, in one embodiment including only a flexible display, the processor may display the first screen and the second screen on each of the flat portions of the flexible display. For example, in one embodiment including both a flexible display and a cover display, the processor may maintain displaying the first screen on the flexible display and display the second screen on the cover display.

[0090] While the operation of a processor requesting the display of a single secondary screen is exemplarily described, the embodiment is not limited thereto. An embodiment in which the processor displays multiple secondary screens in response to a folding event is described with reference to FIG. 11. These multiple secondary screens may be displayed as floating on the primary screen or on multiple corresponding cover displays.

[0091] Hereinafter, with reference to FIG. 6a and / or FIG. 6b, the posture, angle, and / or shape of the electronic device that causes the occurrence of the folding event of FIG. 5 are exemplarily described.

[0092] FIGS. 6A and 6B illustrate an example of an operation of an electronic device (101) for obtaining information related to an angle between housings. The electronic device (101) of FIGS. 1 and / or 2 may include the electronic device (101) of FIG. 6A and / or the first electronic device (101-1) of FIG. 6B. The operation of the electronic device (101) described with reference to FIGS. 6A and / or 6B may be related to operations (420, 430, 440) of FIG. 4 and / or operations (520, 530) of FIG. 5.

[0093] Referring to FIG. 6A, an exemplary appearance of an electronic device (101) in an unfolded state as viewed from the y-axis (or as viewed from the -y-axis) is illustrated. The electronic device (101) can identify a first angle (141) between a first housing (111) and a second housing (112) using one or more sensors (e.g., sensor (230) of FIG. 2). The electronic device (101) can identify a second angle (142) between a second housing (112) and a third housing (113) using one or more sensors. As long as both the first angle (141) and the second angle (142) maintain a designated angle (approximately 180°) corresponding to the unfolded state, the state of the electronic device (101) can remain in the unfolded state.

[0094] In one embodiment, within the unfolded state, the electronic device (101) can monitor changes in the state and / or shape of the electronic device (101) based on the first angle (141) and / or the second angle (142). For example, a user of the electronic device (101) can rotate the first housing (111) relative to the second housing (112), and / or rotate the third housing (113) relative to the second housing (112). When the user rotates the first housing (111) relative to the second housing (112), the electronic device (101) can identify the change in the first angle (141) using a sensor. Referring to FIG. 6A, an angular range (611) can be formed based on a designated angle corresponding to the unfolded state. For example, the angular range (611) can be formed in a range of about ± 30 º (e.g., 150 º to 210 º) based on 180 º. The angular range (611) can correspond to the first angular range of the operation (430) of FIG. 4. However, the range of about ± 30 º is only an example, and other ranges (e.g., ± 20 º, ± 25 º, ± 35 º, ± 40 º, etc.) can be similarly utilized.

[0095] In one embodiment, by using a sensor to identify the rotation of the first housing (111) relative to the second housing (112), the electronic device (101) can identify that the first angle (141) has changed beyond the angle range (611). The electronic device (101) that identifies that the first angle (141) has changed beyond the angle range (611) can determine that it has switched from the unfolded state to another state.

[0096] Within the unfolded state, as the first housing (111) rotates relative to the second housing (112), the first angle (141) may fall within any one of angle ranges (612, 613) that are different from the angle range (611). For example, the angle range (612) may be formed between 90° and 150°. For example, the angle range (613) may be formed between 210° and 270°. When the first angle (141) falls within any one of the angle ranges (612, 613) for a period of time exceeding a specified period, the processor may identify the occurrence of the folding event of FIG. 5. An electronic device (101) that identifies the occurrence of a folding event based on a change in the first angle (141) can display a designated second screen, together with the first screen displayed on the flexible display (150), on a portion of the flexible display (150) disposed on the first housing (111). For example, within a sub-fold state switched based on a change in the first angle (141), the electronic device (101) can display the second screen as an overlay on the first screen displayed on the flexible display (150).

[0097] Similar to the operation described above based on the first angle (141), the electronic device (101) can identify a change in the second angle (142). For example, when the user rotates the third housing (113) with respect to the second housing (112), the electronic device (101) can identify a change in the second angle (142) using a sensor. Referring to FIG. 6A, the angular range compared to the second angle (142) may include at least one of an angular range (621) formed based on a designated angle corresponding to an unfolded state, and angular ranges (622, 623) different from the angular range (621). For example, the angular range (621) may be formed in a range between about 150º and 210º. The angular range (622) may be formed in a range between about 90º and 150º. The angular range (623) can be formed in a range between about 210º and 270º. The electronic device (101) can identify the occurrence of the folding event of FIG. 5 when, within the unfolded state, the second angle (142) corresponding to substantially 180º changes from 180º to any one of the angular ranges (622, 623) for a period exceeding a designated period.

[0098] Referring to FIG. 6B, an exemplary appearance of the first electronic device (101-1) in an unfolded state as viewed from the y-axis (or as viewed from the -y-axis) is illustrated. The first electronic device (101-1), including the flexible display (150) and the cover display (152), can determine or identify a first angle (141) and / or a second angle (142) using one or more sensors. The state of the first electronic device (101-1) can be maintained in the unfolded state while each of the first angle (141) and the second angle (142) is included in angle ranges (631, 641) associated with the unfolded state. For example, the angle range (631) for comparing with the first angle (141) and determining the unfolded state can be formed in a range between about 150° and 180°. The embodiment is not limited thereto, and the angular range (631) may be formed in a range between about 135º and 180º. For example, the angular range (641) for determining the unfolded state may also be formed in a range between about 150º and 180º, or may be formed in a range between about 135º and 180º. These values ​​are merely exemplary and do not limit the present disclosure in any way.

[0099] In one embodiment, within the unfolded state, the first electronic device (101-1) can determine or identify a state in which the first electronic device (101-1) switches from the unfolded state to another state based on whether the first angle (141) and / or the second angle (142) change to an angle within a different angular range (e.g., angular ranges (632, 642)) than the angular ranges (631, 641). For example, as the first housing (111) rotates relative to the second housing (112), the first angle (141) may change to an angular range (632). The angular range (632) may be between about 45º and 135º. The embodiment is not limited thereto, and the angular range (632) may be between about 30º and 135º.

[0100] In one embodiment, when the first angle (141) switches from the angle range (631) to the angle range (632) and then remains within the angle range (632) for a specified period of time, the first electronic device (101-1) may identify or confirm the occurrence of the folding event of FIG. 5. For example, the first electronic device (101-1) that identifies the folding event based on the first angle (141) may display a second screen related to the first screen displayed on the flexible display (150) on a portion of the flexible display (150) disposed on the first housing (111). For example, the first electronic device (101-1) including the cover display (152) may display the second screen on the cover display (152) together with the first screen displayed on the flexible display (150).

[0101] For example, the first electronic device (101-1) can identify or confirm the second angle (142) changed by the rotation of the third housing (113) with respect to the second housing (112). For example, as the third housing (113) rotates with respect to the second housing (112), the second angle (142) can change to an angular range (642). The angular range (642) can be formed between about 45° and 135°, or between about 30° and 135°. When the second angle (142) changes from the angular range (641) to the angular range (642) and then remains within the angular range (642) for a specified period of time, the first electronic device (101-1) can identify or confirm the occurrence of the folding event of FIG. 5. The first electronic device (101-1), which has identified a folding event based on the second angle (142), can display a second screen related to the first screen displayed on the flexible display (150) on a part of the flexible display (150) disposed on the third housing (113).

[0102] In one embodiment, the first electronic device (101-1) that identifies a folding event based on a second angle (142) between a first housing (111) in which the cover display (152) is arranged and a second housing (112) and a third housing (113) that are different from each other may display the first screen and the second screen together on the flexible display (150). The embodiment is not limited thereto, and the first electronic device (101-1) may display the first screen on the flexible display (150) and the second screen on the cover display (152).

[0103] Hereinafter, the shuttle gesture (or shuttle control gesture or folding gesture) may include a gesture and / or motion of changing a first angle (141) and / or a second angle (142) having a specified angle (approximately 180º) and / or an angular range (e.g., angular ranges (611, 621, 631, 641)) corresponding to an unfolded state to another angular range (e.g., angular ranges (612, 613, 622, 623, 632, 642)) and then maintaining the first angle (141) and / or the second angle (142) within the specified angular range for a period exceeding a specified period (e.g., 1.5 to 3 seconds). In one embodiment, the electronic device (101) may, in response to the shuttle gesture, display a second screen related to a first screen displayed on the flexible display (150) on the flexible display (150) and / or the cover display (152). An electronic device (101) displaying a second screen based on a shuttle gesture may stop displaying the second screen and display the first screen on the entire display area of ​​the flexible display (150) when switching from a sub-fold state to an unfolded state based on the shuttle gesture. In this case, displaying the second screen may only be temporarily stopped.

[0104] Hereinafter, with reference to FIG. 7a and / or FIG. 7b, an exemplary operation of an electronic device (101) that identifies a shuttle gesture that causes rotation of a first folding axis (131) and / or a second folding axis (132) is described.

[0105] Figures 7a and 7b illustrate states (701, 702, 703, 704) of an electronic device (101) that are switched based on rotation between housings. The electronic device (101) of Figures 1 and 2 and / or the processor (210) of Figure 2 can perform the operations of the electronic device (101) described with reference to Figures 7a and / or 7b. The operations of the electronic device (101) described with reference to Figures 7a and / or 7b can be related to at least one of the operations of Figure 4.

[0106] Referring to FIGS. 7A and / or 7B , different states (701, 702, 703, 704) of the electronic device (101) distinguished by the rotation of the multi-foldable housing are illustrated. Within the state (701) corresponding to the unfolded state, the electronic device (101) can display a first screen (712) provided from a software application (e.g., a game application) on the entire display area (or the entire active area) of the flexible display (150). Within the state (701), the electronic device (101) can detect or identify the rotation of the multi-foldable housing (e.g., rotation based on the first folding axis (131) and / or the second folding axis (132).

[0107] For example, while identifying the second housing (112) and the third housing (113) that maintain a position associated with an unfolded state, the electronic device (101) that identifies the first housing (111) and the second housing (112) that are folded for more than a specified period of time may switch from state (701) to state (702). For example, the electronic device (101) that identifies the first housing (111) folded with respect to the second housing (112) based on a shuttle gesture may switch from state (701) to state (702). Within state (702), the electronic device (101) may display a second screen (720) associated with the first screen (712) on a portion (or display area) of the flexible display (150) disposed on the first housing (111). Within the state (702), the electronic device (101) can maintain displaying the first screen (712) on another portion (or display area) of the flexible display (150) disposed on the second housing (112) and the third housing (113).

[0108] Referring to an exemplary state (702) of FIG. 7A, the electronic device (101) can display the second screen (720) as an overlay on the first screen (712) that occupies the entire display area of ​​the flexible display (150). In a state (702) switched from the state (701) of displaying the first screen (712) including the visual object (710) related to the notification message, the electronic device (101) can display the second screen (720) related to the visual object (710) on the flexible display (150). For example, when the electronic device (101) detects the first housing (111) folded with respect to the second housing (112) for a specified period of time based on a shuttle gesture, the electronic device (101) can execute a software application corresponding to the visual object (710). The electronic device (101) can display a second screen (720) provided from the executed software application on a portion of a flexible display (150) placed on a first housing (111) folded by a shuttle event.

[0109] In one embodiment, the state (702) of displaying the first screen (712) and the second screen (720) may be maintained based on whether the state of the electronic device (101) changes to an unfolded state. For example, when the first angle (141) between the second housing (112) and the first housing (111) changes to an angular range corresponding to the unfolded state (e.g., angular range (611) of FIG. 6A) or substantially changes to 180°, the electronic device (101) may switch from the state (702) to the state (701). The electronic device (101) that switches from the state (702) to the state (701) may stop displaying the second screen (720) on the flexible display (150) and display the first screen (712) on the entire display area of ​​the flexible display (150).

[0110] For example, while identifying the first housing (111) and the second housing (112) that maintain a posture associated with an unfolded state, the electronic device (101) that identifies the second housing (112) and the third housing (113) that are folded for a specified period of time may switch from state (701) to state (703). For example, based on a shuttle gesture, if the second angle (142) between the third housing (113) and the second housing (112) is within a specified angular range (e.g., angular ranges (622, 623) of FIG. 6A) for a specified period of time, the electronic device (101) may switch from state (701) to state (703). Within the state (703), the electronic device (101) can display a third screen (730) related to the first screen (712) on a portion (or display area) of the flexible display (150) disposed on the third housing (113). Within the state (703) switched from the state (701) displaying the first screen (712) including the visual object (710), the third screen (730) displayed by the electronic device (101) can be provided from a software application corresponding to the visual object (710), similar to the second screen (720).

[0111] In one embodiment, the state (703) of displaying the first screen (712) and the third screen (730) may be maintained until the position or posture of the third housing (113) and the second housing (112), which are rotated based on the shuttle gesture, change to the posture of the unfolded state. For example, when the second angle (142) between the third housing (113) and the second housing (112) changes to an angular range corresponding to the unfolded state (e.g., an angular range (621) of FIG. 6A) or substantially changes to 180°, the electronic device (101) may switch from the state (703) to the state (701). An electronic device (101) that switches from state (703) to state (701) can exclusively display the first screen (712) among the third screen (730) or the first screen (712) on the flexible display (150). A change substantially by 180º can also include values ​​of, for example, ± 2º.

[0112] Referring to FIG. 7A, states (702, 703) are illustrated in which a second screen (720) and / or a third screen (730) are displayed overlappingly on the first screen (712) that occupies the entire display area of ​​the flexible display (150). Within states (702, 703), at least a portion of the first screen (712) may be covered or occluded by the second screen (720) and / or the third screen (730). The embodiment is not limited thereto. For example, the electronic device (101) may display the first screen (712) having a reduced or shrunk size based on a size of another portion that is different from the portion of the flexible display (150) on which the second screen (720) and / or the third screen (730) are displayed.

[0113] Referring to FIG. 7B, different states (702, 703) are illustrated that the electronic device (101) switches to when it identifies the first housing (111) as folded for a specified period of time relative to the second housing (112). The first housing (111) may be rotated relative to the second housing (112) based on a shuttle gesture. As described above with reference to FIG. 7A, the electronic device (101) may switch to a state (702) in which the second screen (720) is superimposed on the first screen (712) in response to the shuttle gesture relative to the first housing (111). The embodiment is not limited thereto, and based on the first housing (111) and the second housing (112) being folded over a specified period of time, the electronic device (101) can display a second screen (720) on a part of the flexible display (150) disposed on the first housing (111), as in state (704), and can display a first screen (712) having a reduced size based on the size of the other part of the flexible display (150).

[0114] Referring to an exemplary state (704) of FIG. 7B, the electronic device (101) can display a first screen (712) that is reduced based on the size of the portion of the flexible display (150) disposed on the second housing (112) and the third housing (113). The ratio between the width and the height (e.g., aspect ratio) of the first screen (712) displayed within the state (704) can correspond to the ratio between the width and the height of the first screen (712) displayed within the state (701) prior to the state (704) (e.g., the ratio between the width and the height of the entire display area of ​​the flexible display (150). Within the state (704), the electronic device (101) can display one or more letter boxes (e.g., letter boxes (741, 742)) together with the first screen (712). The above one or more letter boxes may be referred to as margins or padding. In the state (704), to prevent or minimize the first screen (712) from being covered by the second screen (720), the electronic device (101) may reduce the first screen (712).

[0115] When the first screen (712) is restored to the unfolded state in a reduced state (704), the electronic device (101) can at least temporarily stop displaying the second screen (720) and display the first screen (712) with the reduced size on the entire display area of ​​the flexible display (150). For example, the size of the first screen (712) can be expanded from a size smaller than a portion of the flexible display (150) disposed on the second housing (112) and the third housing (113) to a size of the entire display area of ​​the flexible display (150).

[0116] As described above, according to one embodiment, the electronic device (101) may display a second screen (e.g., the second screen (720) of FIGS. 7A and 7B and / or the third screen (730) of FIG. 7A) related to information (e.g., a visual object (710)) included in a first screen (712) displayed on the flexible display (150) based on a shuttle gesture of bending (or folding) the flexible display (150) for a specified period of time. For example, while displaying a first screen (712) related to a game application, the electronic device (101) may display a second screen related to a notification message (e.g., a visual object (710)) included in the first screen (712) based on the shuttle gesture. The second screen may be displayed on a portion of the flexible display (150) that is separated by a folding axis (e.g., a first folding axis (131) and / or a second folding axis (132)) of the flexible display (150) folded by a shuttle gesture based on multitasking. For example, the second screen may be displayed together with the first screen (712).

[0117] In one embodiment, the electronic device (101) can display the second screen together with the first screen (712) to prevent the user experience based on the first screen (712) from being interrupted. While preventing the user experience based on the first screen (712) from being interrupted, the electronic device (101) can support a user's instant action based on the second screen. For example, the electronic device (101) can identify or receive a user action related to a visual object (710) (e.g., a user's reply to a text message guided through the visual object (710)) through the second screen based on a messenger application. The electronic device (101) that has performed a function based on the action (e.g., sending a text message) can stop displaying the second screen based on a user motion that unfolds the flexible display (150) (e.g., switching to an unfolded state). In the above-described case, the user of the electronic device (101) can continue to view the first screen (712) while replying to a text message based on the second screen. For example, based on a shuttle gesture, the electronic device (101) can improve or enhance the user experience based on multitasking.

[0118] Hereinafter, with reference to FIG. 8, an exemplary operation of an electronic device (101) related to deformation of a multi-foldable housing based on a shuttle gesture is described.

[0119] FIG. 8 illustrates exemplary states (801, 802, 803) of an electronic device (101) that are switched based on rotation between housings (e.g., a first housing (111), a second housing (112), and / or a third housing (113)). The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations of the electronic device (101) described with reference to FIG. 8. The operations of the electronic device (101) described with reference to FIG. 8 may be related to at least one of the operations of FIG. 4.

[0120] Referring to FIG. 8, different states (801, 802, 803) of the electronic device (101) distinguished by a shuttle gesture are illustrated. In the state (801) corresponding to the unfolded state before the shuttle gesture is performed, the electronic device (101) can display a first screen on the entire display area of ​​the flexible display (150). The embodiment is not limited thereto, and in the state (801), the electronic device (101) can display multiple screens based on multitasking and / or multi-window. The multiple screens can be displayed on the flexible display (150) based on a picture-by-picture (PBP) layout and / or a picture-in-picture (PIP) layout.

[0121] According to one embodiment, the electronic device (101) can identify or detect a shuttle gesture performed based on the first folding axis (131) and / or the second folding axis (132) using a sensor (e.g., sensor (230) of FIG. 2). The shuttle gesture can be performed by a hand holding the electronic device (101) (e.g., right hand (813) and / or left hand (814)). The electronic device (101) that identifies the shuttle gesture based on the first folding axis (131) can display a plurality of screens based on a multi-window on each of the flat portions of the flexible display (150) separated by the first folding axis (131). For example, within state (801), an electronic device (101) that has identified a shuttle gesture associated with a first folding axis (131) may switch to state (802). An electronic device (101) that has identified a shuttle gesture based on a second folding axis (132) may display multiple screens provided from multiple software applications running based on multitasking on each of the flat portions of the flexible display (150) separated by the second folding axis (132).

[0122] Within state (802) of FIG. 8, the electronic device (101) can display a plurality of screens on each of the flat portions of the flexible display (150) separated by the first folding axis (131). Within state (802), the flat portions of the flexible display (150) can include a portion of the flexible display (150) disposed on the first housing (111) adjacent to the first folding axis (131) and other portions of the flexible display (150) disposed on the second housing (112) and the third housing (113). Within state (802), the electronic device (101) can display the first screen that was displayed in state (801) prior to state (802) on the flat first portion of the flexible display (150) disposed on the second housing (112) and the third housing (113). Within state (802), the electronic device (101) can display a second screen (820) related to the first screen on a flat second portion of the flexible display (150) disposed on the first housing (111). While the present disclosure illustrates the second screen (820) being displayed on a portion of the flexible display (150) positioned on the first housing (111) (as in state (802)), the present disclosure is not limited thereto, and the second screen (820) can also be displayed on a portion of the flexible display (150) positioned on the third housing (113) within this state.

[0123] Referring to FIG. 8, a second screen (820) displayed on a display (e.g., a flexible display (150)) of an electronic device (101) may correspond to a setting screen for adjusting setting values ​​of the electronic device (101). Based on the second screen (820), the electronic device (101) may receive or identify a user input for adjusting a state of the flexible display (150) and / or the electronic device (101). Within the second screen (820), the electronic device (101) may display visual objects (e.g., icons, buttons, images, videos, texts, or any combination thereof) corresponding to different states of the electronic device (101). For example, based on the execution of a software application for viewing a video, within a state (801) of displaying a first screen for playing the video, the electronic device (101) may, in response to a shuttle gesture, display a second screen (820) for controlling and / or adjusting states of the electronic device (101) together with the first screen.

[0124] In one embodiment, the position, orientation, and / or size of the first screen displayed before the shuttle gesture and the second screen to be displayed together with the first screen after the shuttle gesture within the flexible display (150) may vary depending on the distance by which each of the first housing (111) to the third housing (113) of the electronic device (101) is moved or rotated by the shuttle gesture. For example, the electronic device (101) may identify or calculate the degree by which each of the first housing (111), the second housing (112), and / or the third housing (113) is moved or rotated (e.g., the movement distance and / or the rotation angle).

[0125] Referring to FIG. 8, a state (803) of an electronic device (101) that identifies a shuttle gesture based on a second folding axis (132) is exemplarily illustrated. An electronic device (101) that displays a first screen in a state (801) corresponding to an unfolded state can identify a shuttle gesture based on a second folding axis (132). The electronic device (101) that identifies the shuttle gesture can select or determine a location of a second screen relative to the first screen from among flat portions of a flexible display (150) that are identified by the second folding axis (132) based on displacement of each portion of the electronic device (101) that is identified by the second folding axis (132). The displacement may include at least one of the distances, degrees and / or angles of the moved parts of the electronic device (101) based on the shuttle gesture.

[0126] For example, by comparing a first distance that the third housing (113) moves by a shuttle gesture based on the second folding axis (132) and a second distance that the combination of the first housing (111) and the second housing (112) moves by the shuttle gesture, the electronic device (101) can determine the position of the second screen. If the first distance is greater than the second distance, the electronic device (101) can display the second screen on a portion of the flexible display (150) disposed on the third housing (113). As in state (803) of FIG. 8, when the second distance is greater than the first distance (e.g., when the combination of the first housing (111) and the second housing (112) is moved by the user's hand (814) to a greater extent than the third housing (113), the electronic device (101) can display a second screen (830) on a portion of the flexible display (150) positioned on the first housing (111) and the second housing (112). Although the present disclosure illustrates that the second screen (830) is displayed on a portion of the flexible display (150) positioned on the first housing (111) and the second housing (112) (as in state (803)), the present disclosure is not limited thereto, and the second screen (830) can also be displayed on a portion of the flexible display (150) positioned on the second housing (112) and the third housing (113) within this state.

[0127] In at least one of the states (802, 803) switched based on the shuttle gesture, the electronic device (101) may stop displaying the second screen based on whether the electronic device (101) is restored to the unfolded state. For example, in state (802), if the first angle (141) increases to about 180°, the electronic device (101) may stop displaying the second screen (820). For example, in state (803), if the second angle (142) increases to about 180°, the electronic device (101) may remove the second screen (830) from the flexible display (150).

[0128] As described above, according to one embodiment, the electronic device (101) can compare the distances that each part of the electronic device (101) has moved by the shuttle gesture to determine the positions at which each of the plurality of screens is to be displayed. Based on the determination of the positions, the electronic device (101) can measure the distances that each part has moved based on at least one of an IMU sensor, a Hall sensor, and / or a 6-axis sensor. Depending on the measured distance, the electronic device (101) can adjust the size and / or position of the second screen (830) that is additionally displayed based on the shuttle gesture, as in state (803).

[0129] FIGS. 9A and 9B illustrate states (901, 902, 903, 904, 905, 906) of an electronic device (101) that are switched based on rotation between housings (e.g., a first housing (111), a second housing (112), and / or a third housing (113)). The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations of the electronic device (101) described with reference to FIGS. 9A and 9B. The operations of the electronic device (101) described with reference to FIGS. 9A and 9B may be related to at least one of the operations of FIG. 4.

[0130] Referring to FIG. 9A, different states (901, 902, 903) of an electronic device (101) executing a software application for playing and / or streaming a video are illustrated. In state (901) corresponding to the unfolded state, the electronic device (101) can display a first screen provided from the software application on the entire display area of ​​the flexible display (150). In state (901), the electronic device (101) can receive a shuttle gesture. For example, the electronic device (101) that receives a shuttle gesture for the first folding axis (131) can switch from state (901) to state (902).

[0131] Referring to FIG. 9A, in a state (902) in which a folded first housing (111) is identified based on a shuttle gesture, the electronic device (101) can display a second screen related to the first screen on a portion of a flexible display (150) disposed on the first housing (111). For example, a boundary line between the first screen and the second screen can be formed on the first folding axis (131) in the state (902). For example, the second screen can be a screen designated by a software application that provides the first screen. For example, the electronic device (101) can display a second screen including a list of multiple videos in order to change a video to be displayed on the first screen. In the state (902), the electronic device (101) can identify or receive a user input for changing and / or replacing a video to be displayed on the first screen through the second screen. Similarly, the second screen may also include a list of jump marks to allow the user to jump within the video displayed via the first screen.

[0132] Referring to FIG. 9A, in a state (902) in which a user input for changing a video displayed on the first screen through the second screen is identified, the electronic device (101) can change the video displayed on the first screen to a video corresponding to the user input. After the state (902), the user can unfold the electronic device (101) using the hands (813, 814). For example, when switching to a state (903) corresponding to an unfolded state after the state (902), the electronic device (101) can remove the second screen additionally displayed in the state (902) from the flexible display (150). In the state (903), the electronic device (101) can display the first screen without the second screen.

[0133] As described above with reference to FIG. 9A, the electronic device (101) may display or provide a second screen designated by a software application providing the first screen in response to a shuttle gesture. While one embodiment in which the second screen is provided by a software application executing the first screen is described, the embodiment is not limited thereto.

[0134] For example, the electronic device (101) can acquire the second screen by executing another software application specified by the software application executing the first screen. For example, while the first software application executing the drawing function based on a touch input (e.g., a touch input performed on the flexible display (150) and / or the cover display (152) of FIG. 2) is executing, the electronic device (101) can display the first screen provided by the first software application on the entire display area of ​​the flexible display (150).

[0135] In response to a shuttle gesture identified while displaying the first screen based on an unfolded state, the electronic device (101) may execute a second software application (e.g., a gallery application (252) of FIG. 2) designated by the first software application. Along with the first screen, the electronic device (101) may display a second screen (e.g., a list of videos and / or images stored in the electronic device (101)) provided from the second software application on different portions of the flexible display (150) folded by the shuttle gesture. While simultaneously displaying the first screen and the second screen, the electronic device (101) may receive a user input for inserting an image and / or video displayed on the second screen into media content (e.g., a picture) displayed on the first screen. In response to the user input, the electronic device (101) may add the media content selected on the second screen into the media content displayed on the first screen.

[0136] For example, while displaying a first screen including a web page in an unfolded state, the electronic device (101) may identify or receive a user input for selecting a hyperlink included in the web page. The user input may include a gesture of clicking and / or touching the hyperlink. If a shuttle gesture is performed together with the user input, the electronic device (101) may display, together with the first screen, a second screen including another web page corresponding to a uniform resource location (URL) based on the hyperlink. The electronic device (101) may display the first screen and the second screen on each of the flat portions of the flexible display (150) folded by the shuttle gesture, similarly to what was described above with reference to FIG. 9A.

[0137] An embodiment of displaying a first screen displayed on a flexible display (150) and / or a second screen designated by a software application providing the first screen is described, but the embodiment is not limited thereto. For example, an electronic device (101) that has identified a shuttle gesture may display a screen designated by an operating system and / or a system process. The designated screen may include a second screen (820) for changing setting values, as described above with reference to FIG. 8. The designated screen may include a notification center that includes one or more notification messages accumulated in the electronic device (101), such as push notifications. The designated screen may include recent apps that include a list of screens that have been displayed by the electronic device (101).

[0138] Referring to FIG. 9B, an embodiment of an electronic device (101) that displays a list of screens displayed by the electronic device (101) based on a shuttle gesture is illustrated. Within a state (904) corresponding to an unfolded state, the electronic device (101) can display a screen A provided by a specific software application. Within the unfolded state displaying screen A, when a user bends the flexible display (150) around the first folding axis (131) using hands (813, 814), the electronic device (101) can identify the shuttle gesture. Based on the shuttle gesture, the electronic device (101) can switch from state (904) to state (905).

[0139] Within state (905) of FIG. 9B, the electronic device (101) may display a second screen (950) including a list of screens that were displayed on the display of the electronic device (101) (e.g., the flexible display (150) and / or the cover display (152) of FIG. 2) on a portion of the flexible display (150) disposed on the first housing (111). For example, the second screen (950) may be referred to as recent apps. Within state (905), the electronic device (101) may display icons (e.g., icons (951)) representing each of the screens and thumbnails (e.g., thumbnails (952)) corresponding to each of the screens along the vertical direction of the flexible display (150). The combination of icons (951) and thumbnails (952) displayed within the second screen (950) may correspond to a single screen and / or a single software application displayed by the electronic device (101).

[0140] Within the state (905) of FIG. 9B, the electronic device (101) may identify or receive a user input for selecting one screen included in the list of the second screen (950). In response to the user input, the electronic device (101) may replace or change the screen A displayed on a different portion of the flexible display (150) from the portion where the second screen (950) is displayed, with a screen corresponding to the user input. Referring to FIG. 9B, within the state (906) corresponding to the unfolded state after the state (905), the electronic device (101) may display the screen B corresponding to the user input on the entire display area of ​​the flexible display (150). Referring to FIG. 9B, the electronic device (101) may change the screen displayed on the flexible display (150) based on a shuttle gesture.

[0141] Hereinafter, with reference to FIG. 10, the operation of an electronic device (101) including both a flexible display (150) and a cover display (e.g., a cover display (152) of FIG. 2) is described.

[0142] FIG. 10 illustrates exemplary states (1001, 1002) of an electronic device (e.g., a first electronic device (101-1)) that are switched based on rotation between housings (e.g., a first housing (111), a second housing (112), and / or a third housing (113)). The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 may perform the operations of the first electronic device (101-1) described with reference to FIG. 10. The first electronic device (101-1) of FIG. 10 may correspond to the first electronic device (101-1) of FIG. 3A. The operations of the first electronic device (101-1) described with reference to FIG. 10 may be related to at least one of the operations of FIG. 4.

[0143] Referring to FIG. 10, different states (1001, 1002) of a first electronic device (101-1) including a flexible display (150) and a cover display (152) are illustrated. Although the first electronic device (101-1) including the cover display (152) disposed on the first housing (111) is illustrated as an example, the position of the cover display (152) is not limited to the embodiment of FIG. 10. In an unfolded state (e.g., state (1001)) identified by a plurality of sensors (e.g., sensor (230) of FIG. 2), the first electronic device (101-1) can display an A screen having a size of the entire display area of ​​the flexible display (150) on the flexible display (150).

[0144] In one embodiment, a first electronic device (101-1) including a flexible display (150) and a cover display (152) may selectively activate at least one of the flexible display (150) and the cover display (152) in each of an unfolded state, a sub-folded state, or a folded state. For example, in a state (1001) corresponding to an unfolded state, the first electronic device (101-1) may activate the flexible display (150) and deactivate the cover display (152). The first electronic device (101-1) activating the display may mean providing a voltage higher than a specified voltage for driving pixels included in the display to the display. The first electronic device (101-1) deactivating the display may mean providing a voltage lower than the specified voltage to the display. For example, within state (1001), the first electronic device (101-1) can activate the flexible display (150) and deactivate the cover display (152).

[0145] Within state (1001), in response to a shuttle gesture associated with the first housing (111) in which the cover display (152) is arranged, the first electronic device (101-1) can switch to state (1002). For example, a user can rotate the first housing (111) with respect to the second housing (112) using a hand (1020). For example, in response to a shuttle gesture of folding the flexible display (150) based on the first folding axis (131), the first electronic device (101-1) can switch to state (1002). The first angle (141) between the first housing (111) and the second housing (112) by the shuttle gesture can be included within the angular range (632) of FIG. 6B. The first electronic device (101-1), which has identified the first housing (111) and the second housing (112) that have been folded for a specified period of time based on the above shuttle gesture, can activate the cover display (152) and display the B screen related to the A screen displayed on the flexible display (150) on the cover display (152). Within the state (1002), the electronic device (101) can display the B screen on the cover display (152) together with the A screen displayed on the flexible display (150). Within the state (1002), the electronic device (101) can activate both the flexible display (150) and the cover display (152).

[0146] In a state (1002) in which both the flexible display (150) and the cover display (152) are activated, the first electronic device (101-1) can detect whether the postures of the first housing (111) and the second housing (112) change to a posture associated with an unfolded state. If the postures of the first housing (111) and the second housing (112) change to a posture associated with an unfolded state, the first electronic device (101-1) can at least temporarily stop displaying the B screen on the cover display (152). For example, the first electronic device (101-1) can deactivate the cover display (152). In the above example, the first electronic device (101-1) can activate the flexible display (150) to continue displaying the A screen.

[0147] In one embodiment, the B screen displayed on the cover display (152) in the state (1002) of FIG. 10 may include content related to the A screen. For example, as described above with reference to FIG. 7A and / or FIG. 7B , the first electronic device (101-1) may display the B screen corresponding to the notification message included in the A screen on the cover display (152). For example, the first electronic device (101-1) may display a text message received by the first electronic device (101-1) through the B screen, and may receive a user's response message to the text message.

[0148] For example, as described above with reference to FIG. 8, the first electronic device (101-1) may display, on the cover display (152), a screen A and / or a screen B for adjusting setting values ​​related to the first electronic device (101-1). For example, the first electronic device (101-1) may receive, through the screen B, a user input for adjusting the brightness of the flexible display (150) on which the screen A is displayed and / or the volume of an audio signal output from the first electronic device (101-1).

[0149] For example, as described above with reference to FIG. 9A, the first electronic device (101-1) may display a B screen designated by a software application providing an A screen on the cover display (152). For example, the first electronic device (101-1) may display a prompt corresponding to a presentation provided through the A screen through the B screen. For example, the first electronic device (101-1) may exclusively provide information to a user viewing the cover display (152) (e.g., a user of the first electronic device (101-1)) through the B screen.

[0150] For example, as described above with reference to FIG. 9B, the first electronic device (101-1) may display, on the cover display (152), a B screen including a list of one or more screens displayed through the display of the first electronic device (101-1) (e.g., the flexible display (150) and / or the cover display (152)) and / or one or more software applications executed by the first electronic device (101-2).

[0151] In one embodiment, the first electronic device (101-1), which activates both the flexible display (150) and the cover display (152) based on the state (1002), can switch to another state different from the state (1002). For example, if the first angle (141) between the first housing (111) and the second housing (112) is increased back to 180° by the hand (1020), the first electronic device (101-1) can switch to the state (1001). In the above example, the first electronic device (101-1) can deactivate the cover display (152) to stop displaying the B screen on the cover display (152).

[0152] As described above, according to one embodiment, the first electronic device (101-1) can activate or deactivate at least one of the flexible display (150) or the cover display (152) based on the shuttle gesture. In response to the shuttle gesture, the first electronic device (101-1) can display different screens on each of the flexible display (150) and the cover display (152).

[0153] As described above with reference to FIGS. 1 to 10 , the electronic device can display various screens related to the first screen displayed in the unfolded state based on a shuttle gesture. In one embodiment, the electronic device can selectively display various screens related to the first screen, or simultaneously, based on priorities and / or multi-windows. Hereinafter, an exemplary operation of the electronic device that simultaneously displays various screens related to the first screen is described with reference to FIG. 11 .

[0154] FIG. 11 illustrates, by way of example, states (1101, 1102, 1103) of an electronic device (101) that are switched based on rotation between housings (e.g., a first housing (111), a second housing (112), and / or a third housing (113)). The electronic device (101) of FIGS. 1 and 2 and / or the processor (210) of FIG. 2 can perform the operations of the electronic device (101) described with reference to FIG. 11. The operations of the electronic device (101) described with reference to FIG. 11 can be related to at least one of the operations of FIG. 4.

[0155] Referring to FIG. 11, different states (1101, 1102, 1103) of the electronic device (101) are illustrated, distinguished by a first angle (141) and / or a second angle (142). The electronic device (101) can identify the state (e.g., unfolded state, sub-folded state, and / or folded state) of the electronic device (101) distinguished by the first angle (141) and / or the second angle (142) using a plurality of sensors (e.g., sensor (230) of FIG. 2). Using the plurality of sensors, the electronic device (101) can identify or detect a shuttle gesture that causes a change in at least one of the first angle (141) or the second angle (142).

[0156] Within a state (1101) corresponding to the unfolded state, the electronic device (101) can display screen A on the entire display area of ​​the flexible display (150). Based on the shuttle gesture identified within the unfolded state displaying screen A, the electronic device (101) can identify one or more screens related to screen A. When multiple screens are determined to be related to screen A, the electronic device (101) can determine or select at least one screen to be displayed together with screen A on the display of the electronic device (101) (e.g., the flexible display (150) and / or the cover display (152) of FIG. 2) based on the priorities of Table 1.

[0157] Description of priority screen 1A A screen provided by a software application corresponding to a notification message (or notification event) included in screen 2A A screen provided by a software application mapped (or paired) with screen 3 A screen provided by a software application that provided screen 4 A screen set by the operating system and / or system process (or registered or set in advance by the user) 5 A screen provided by a software application that was recently executed by the electronic device (101)

[0158] Referring to Table 1, in response to an identified shuttle gesture while displaying Screen A including a visual object (e.g., visual object (710) of FIGS. 7A and / or 7B) containing a notification message, the electronic device (101) may preferentially display a screen provided by a software application corresponding to the notification message. For example, in a case where a specific screen matches Screen A, the electronic device (101) may preferentially display another screen corresponding to the notification message. If no notification message is displayed and no screen matches Screen A, the electronic device (101) may display a screen set by the operating system (e.g., second screen (820) of FIG. 8) based on the priorities of Table 1. The priorities defined in Table 1 are merely examples and other orders may be expected.

[0159] The embodiment is not limited thereto, and in response to identifying or confirming a plurality of screens associated with screen A, the electronic device (101) may simultaneously display the plurality of screens on the flexible display (150). Referring to FIG. 11, based on a shuttle gesture identified in a state (1101) corresponding to an unfolded state, the electronic device (101) may switch to a state (1102). In the state (1102), the electronic device (101) may display a plurality of screens associated with screen A (e.g., screen B (1121) and / or screen C (1122)) on a portion of the flexible display (150) disposed on the first housing (111) that is folded by the shuttle gesture. For example, screen B (1121) may be associated with a notification message included in screen A. For example, screen C (1122) may be associated with a hyperlink included in screen A. The examples are not limited thereto.

[0160] Within the exemplary state (1102) of FIG. 11, the electronic device (101) can display the B screen (1121) and the C screen (1122) based on the PBP layout within a portion of the flexible display (150) disposed on the first housing (111). Within the state (1102), the electronic device (101) can display the B screen (1121) and the C screen (1122) together with the A screen that was being displayed within the state (1101) prior to the state (1102). Within the state (1102), the A screen, the B screen (1121), and the C screen (1122) can occupy different portions of the flexible display (150). Although one embodiment is illustrated in which the B screen (1121) and the C screen (1122) at least partially cover the A screen, the embodiment is not limited thereto. For example, the electronic device (101) can reduce the size of the A screen based on the size of a portion of the flexible display (150) disposed on the second housing (112) and the third housing (113), as in the state (704) of FIG. 7b.

[0161] Although the operation of the electronic device (101) that identifies a shuttle gesture performed on either the first folding axis (131) or the second folding axis (132) has been described, the embodiment is not limited thereto. For example, a user may use both hands (813, 814) to fold both the first folding axis (131) and the second folding axis (132) at a specified angle and for a specified period of time. In a state (1103) in which both the first folding axis (131) and the second folding axis (132) are folded by the shuttle gesture, the electronic device (101) can display screens (e.g., B screen (1121) and C screen (1103)) related to the A screen displayed in the unfolded state (e.g., state (1101)) on each of the first housing (111) and the third housing (113) adjacent to each of the two hands (813, 814).

[0162] For example, within state (1102), the electronic device (101) that additionally identifies a shuttle gesture for the second folding axis (132) may switch to state (1103) to move either the B screen (1121) or the C screen (1122) displayed through a portion of the flexible display (150) disposed on the first housing (111) to another portion of the flexible display (150) disposed on the third housing (113). Although an exemplary state (1103) is shown in which the C screen (1122) is moved to another portion of the flexible display (150) disposed on the third housing (113), the embodiment is not limited thereto. For example, when a user performs a shuttle gesture for the second folding axis (132) in a state (1102) in which the user selects the B screen (1121) using the hand (814), the electronic device (101) can change the position of the C screen (1122) among the B screen (1121) or the C screen (1122).

[0163] For example, in a state (1101) corresponding to an unfolded state, when both the first folding axis (131) and the second folding axis (132) are rotated by a shuttle gesture, the electronic device (101) can switch to a state (1103) and additionally display a B screen (1121) and a C screen (1122) related to the A screen displayed in the state (1101). The electronic device (101) can maintain displaying the A screen on a part of the flexible display (150) disposed on the second housing (112), and can display the B screen (1121) and the C screen (1122) on each of the parts of the flexible display (150) disposed on each of the first housing (111) and the third housing (113). Within state (1103), the electronic device (101) can identify or receive user inputs for controlling screen B (1121) and screen C (1122) using each of the two hands (813, 814).

[0164] In each of the states (1102, 1103) switched from the unfolded state (e.g., state (1101)) based on the shuttle gesture, the electronic device (101) can identify a gesture for switching back to the unfolded state. For example, in the state (1102), the electronic device (101) that identifies a first angle (141) increasing toward a horizontal angle can switch to the state (1101), stop displaying the B screen (1121) and the C screen (1122), and display the A screen on the entire display area of ​​the flexible display (150). For example, in state (1103), the electronic device (101) that has confirmed the shape of the flexible display (150) being spread out flat by the user's two hands (813, 814) can switch to state (1101) and remove the B screen (1121) and the C screen (1122) that cover different parts of the A screen from the flexible display (150).

[0165] With reference to FIGS. 1 to 11, one embodiment of an electronic device (101) including a multi-foldable housing foldable by two folding axes has been described, but the embodiment is not limited thereto. Below, one embodiment of an electronic device based on a multi-foldable housing including more than two folding axes is described.

[0166] Fig. 12 illustrates an embodiment of a transformable (multi-foldable) electronic device. The third electronic device (101-3) of Fig. 12 may be an example of the electronic device (101) of Fig. 1 and / or Fig. 2. The operation of the third electronic device (101-3) described with reference to Fig. 12 may be performed by the electronic device (101) of Fig. 2 and / or the processor (210).

[0167] Referring to FIG. 12, according to one embodiment, the housing of the third electronic device (101-3) may be divided into five housings (a first housing (1211), a second housing (1212), a third housing (1213), a fourth housing (1214), and / or a fifth housing (1215)). The housing of the third electronic device (101-3) may include a first hinge assembly (1221) for rotatably coupling the first housing (1211) and the second housing (1212), a second hinge assembly (1222) for rotatably coupling the second housing (1212) and the third housing (1213), a third hinge assembly (1223) for rotatably coupling the third housing (1213) and the fourth housing (1214), or a fourth hinge assembly (1224) for rotatably coupling the fourth housing (1214) and the fifth housing (1215). The number of five housings is merely exemplary, and other numbers of housings, such as four, six, or eight housings, may also be envisaged.

[0168] Referring to FIG. 12, within the first hinge assembly (1221), a first folding axis (1231) of the first housing (1211) and the second housing (1212) may be positioned. Within the second hinge assembly (1222), a second folding axis (1232) between the second housing (1212) and the third housing (1213) may be positioned. Within the third hinge assembly (1223), a third folding axis (1233) of the third housing (1213) and the fourth housing (1214) may be positioned. Within the fourth hinge assembly (1224), a fourth folding axis (1234) between the fourth housing (1214) and the fifth housing (1215) may be positioned.

[0169] According to one embodiment of FIG. 12, the third electronic device (101-3) can identify rotation about the first folding axis (1231) to the fourth folding axis (1234) using a plurality of sensors (e.g., sensor (230) of FIG. 2). For example, the third electronic device (101-3) can identify a first angle (1241) between the first housing (1211) and the second housing (1212), a second angle (1242) between the second housing (1212) and the third housing (1213), a third angle (1243) between the third housing (1213) and the fourth housing (1214), and a fourth angle (1244) between the fourth housing (1214) and the fifth housing (1215). The third electronic device (101-3) can identify the state of the third electronic device (101-3) distinguished based on the first angle (1241) to the fourth angle (1244) using sensor data of a plurality of sensors. The state of the third electronic device (101-3) distinguished by the first angle (1241) to the fourth angle (1244) can include the unfolded state, the sub-folded state, and / or the folded state described with reference to FIGS. 3A to 3C.

[0170] According to one embodiment, the third electronic device (101-3) can identify a shuttle gesture based on any one of the first folding axis (1231) to the fourth folding axis (1234). In response to the shuttle gesture identified in the unfolded state (e.g., state (1201)), the third electronic device (101-3) can display a B screen related to the A screen displayed in the unfolded state. The third electronic device (101-3) can display the A screen and the B screen on each of the flat portions of the flexible display (150) separated by the folding axis related to the shuttle gesture.

[0171] For example, within a state (1201) of displaying screen A on the entire display area of ​​the flexible display (150), a third electronic device (101-3) that identifies a shuttle gesture based on a first folding axis (1231) may switch to a state (1202). For example, a third electronic device (101-3) that identifies a first angle (1241) included in a period specified in an angular range (612) of FIG. 6A by a shuttle gesture may switch to a state (1202). Within the state (1202), the third electronic device (101-3) may display screen B on a portion of the flexible display (150) disposed on a first housing (1211) that is separated by the first folding axis (1231). The third electronic device (101-3) can maintain displaying the A screen, along with the B screen displayed on a portion of the flexible display (150) disposed on the first housing (1211). For example, the A screen can occupy a portion of the flexible display (150) disposed on the second housing (1212) to the fifth housing (1215) within the state (1202).

[0172] In a state (1201) that displays a screen A provided from a first software application based on an unfolded state, the third electronic device (101-3) can switch to a state (1203) in response to a shuttle gesture based on a second folding axis (1232). In the state (1203), the third electronic device (101-3) can display a screen B on a portion of a flexible display (150) disposed on a first housing (1211) and a second housing (1212), which are separated by the second folding axis (1232). The screen B displayed in the state (1203) can be displayed based on the execution of a second software application designated by the first software application.

[0173] In an exemplary state (1203) of FIG. 12, the third electronic device (101-3) may display screen A on a part of the flexible display (150) on which screen B is displayed and on a different part (e.g., a part of the flexible display (150) disposed on the third housing (1213) to the fifth housing (1215). The screen A displayed on the different part may correspond to a part of the screen A displayed on the different part in the state (1201). The embodiment is not limited thereto, and the third electronic device (101-3) may display a reduced screen A based on the size of the different part. Together with the screen A, the third electronic device (101-3) may display a letter box (e.g., letter boxes (741, 742) of FIG. 7b).

[0174] Referring to FIG. 12, in a state (1201) corresponding to an unfolded state, the third electronic device (101-3) can identify a shuttle gesture based on a third folding axis (1233). The third electronic device (101-3) displaying screen A can determine or select a portion of the flexible display (150) corresponding to screen B related to screen A based on the distances that each portion of the multi-foldable housing moves by the shuttle gesture. For example, the third electronic device (101-3) can determine the position of the screen B based on the displacement of two portions of the multi-foldable housing (e.g., a combination of the first housing (1211) to the third housing (1213) and a combination of the fourth housing (1214) and the fifth housing (1215)) separated by the third folding axis (1233). Referring to FIG. 12, when the distance moved by the combination of the first housing (1211) to the third housing (1213) is greater than the distance moved by the combination of the fourth housing (1214) and the fifth housing (1215), the third electronic device (101-3) switches to a state (1204) and can display the B screen on a portion of the flexible display (150) disposed on the first housing (1211) to the third housing (1213). In the state (1204) of displaying the B screen, the third electronic device (101-3) can display the A screen on another portion of the flexible display (150).

[0175] As shown in FIG. 12, in one embodiment including four folding axes, the third electronic device (101-3) may be able to identify a shuttle gesture performed on at least one of the folding axes and may not respond to a shuttle gesture performed on another folding axes. For example, the third electronic device (101-3) may not respond to a shuttle gesture performed on the second folding axis (1232) and the third folding axis (1233) associated with the third housing (1213) positioned in the middle among the five serially connected housings. Within the above example, the third electronic device (101-3) may display a B screen related to an A screen displayed within the unfolded state in response to a shuttle gesture for other folding axes (e.g., the first folding axis (1231) and / or the fourth folding axis (1234)) that are different from the second folding axis (1232) and the third folding axis (1233).

[0176] In at least one of the switched states (1202, 1203, 1204) based on the shuttle gesture, if the third electronic device (101-3) switches back to the unfolded state, it may stop displaying the B screen and display the A screen again on the entire display area of ​​the flexible display (150). For example, the B screen may be displayed within a time period in which the flexible display (150) is partially folded by the shuttle gesture, and may disappear from the flexible display (150) after the time period.

[0177] As described above, according to one embodiment, the electronic device can display different screens on each of the flat portions of the flexible display (e.g., the flexible display (150) of FIG. 2) folded by the shuttle gesture, within a sub-fold state switched by the shuttle gesture from the unfolded state. The electronic device including another display (e.g., the cover display (152) of FIG. 2) together with the flexible display can, within the sub-fold state, activate the other display to display another screen related to a specific screen displayed on the flexible display. By simultaneously displaying multiple screens using one or more displays, the electronic device can support multitasking based on the shuttle gesture.

[0178] FIG. 13 is a block diagram of an electronic device (1301) within a network environment (1300) according to various embodiments. Referring to FIG. 13 , in the network environment (1300), the electronic device (1301) may communicate with the electronic device (1302) via a first network (1398) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1304) or the server (1308) via a second network (1399) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1301) may communicate with the electronic device (1304) via the server (1308). According to one embodiment, the electronic device (1301) may include a processor (1320), a memory (1330), an input module (1350), an audio output module (1355), a display module (1360), an audio module (1370), a sensor module (1376), an interface (1377), a connection terminal (1378), a haptic module (1379), a camera module (1380), a power management module (1388), a battery (1389), a communication module (1390), a subscriber identification module (1396), or an antenna module (1397). In some embodiments, the electronic device (1301) may omit at least one of these components (e.g., the connection terminal (1378)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1376), camera module (1380), or antenna module (1397)) may be integrated into a single component (e.g., display module (1360)).

[0179] The processor (1320) may, for example, execute software (e.g., a program (1340)) to control at least one other component (e.g., a hardware or software component) of the electronic device (1301) connected to the processor (1320) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1320) may store commands or data received from other components (e.g., a sensor module (1376) or a communication module (1390)) in a volatile memory (1332), process the commands or data stored in the volatile memory (1332), and store result data in a non-volatile memory (1334). According to one embodiment, the processor (1320) may include a main processor (1321) (e.g., a central processing unit or an application processor) or an auxiliary processor (1323) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1321). For example, when the electronic device (1301) includes the main processor (1321) and the auxiliary processor (1323), the auxiliary processor (1323) may be configured to use less power than the main processor (1321) or to be specialized for a given function. The auxiliary processor (1323) may be implemented separately from the main processor (1321) or as a part thereof.

[0180] The auxiliary processor (1323) may control at least a portion of functions or states associated with at least one component (e.g., the display module (1360), the sensor module (1376), or the communication module (1390)) of the electronic device (1301), for example, on behalf of the main processor (1321) while the main processor (1321) is in an inactive (e.g., sleep) state, or together with the main processor (1321) while the main processor (1321) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1323) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1380) or a communication module (1390)). In one embodiment, the auxiliary processor (1323) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1301) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1308)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0181] The memory (1330) can store various data used by at least one component (e.g., the processor (1320) or the sensor module (1376)) of the electronic device (1301). The data can include, for example, software (e.g., the program (1340)) and input data or output data for commands related thereto. The memory (1330) can include volatile memory (1332) or non-volatile memory (1334).

[0182] The program (1340) may be stored as software in memory (1330) and may include, for example, an operating system (1342), middleware (1344), or an application (1346).

[0183] The input module (1350) can receive commands or data to be used in a component of the electronic device (1301) (e.g., a processor (1320)) from an external source (e.g., a user) of the electronic device (1301). The input module (1350) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0184] The audio output module (1355) can output audio signals to the outside of the electronic device (1301). The audio output module (1355) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0185] The display module (1360) can visually provide information to an external party (e.g., a user) of the electronic device (1301). The display module (1360) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (1360) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0186] The audio module (1370) can convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module (1370) can acquire sound through the input module (1350), output sound through the sound output module (1355), or an external electronic device (e.g., electronic device (1302)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1301).

[0187] The sensor module (1376) can detect the operating status (e.g., power or temperature) of the electronic device (1301) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1376) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0188] The interface (1377) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1301) with an external electronic device (e.g., the electronic device (1302)). In one embodiment, the interface (1377) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0189] The connection terminal (1378) may include a connector through which the electronic device (1301) may be physically connected to an external electronic device (e.g., the electronic device (1302)). In one embodiment, the connection terminal (1378) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0190] The haptic module (1379) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1379) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0191] The camera module (1380) can capture still images and videos. In one embodiment, the camera module (1380) may include one or more lenses, image sensors, image signal processors, or flashes.

[0192] The power management module (1388) can manage the power supplied to the electronic device (1301). According to one embodiment, the power management module (1388) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0193] A battery (1389) may power at least one component of the electronic device (1301). In one embodiment, the battery (1389) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0194] The communication module (1390) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1301) and an external electronic device (e.g., electronic device (1302), electronic device (1304), or server (1308)), and the performance of communication through the established communication channel. The communication module (1390) may operate independently from the processor (1320) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1390) may include a wireless communication module (1392) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1394) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1304) via a first network (1398) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1399) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1392) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1396) to verify or authenticate the electronic device (1301) within a communication network such as the first network (1398) or the second network (1399).

[0195] The wireless communication module (1392) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency communications (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1392) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1392) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1392) may support various requirements specified in the electronic device (1301), an external electronic device (e.g., the electronic device (1304)), or a network system (e.g., the second network (1399)). According to one embodiment, the wireless communication module (1392) may support a peak data rate (e.g., 20 Gbps or more) for eMBB implementation, a loss coverage (e.g., 164 dB or less) for mMTC implementation, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC implementation.

[0196] The antenna module (1397) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1397) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1397) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1398) or the second network (1399), may be selected from the plurality of antennas by, for example, the communication module (1390). A signal or power may be transmitted or received between the communication module (1390) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1397).

[0197] According to various embodiments, the antenna module (1397) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0198] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0199] According to one embodiment, commands or data may be transmitted or received between the electronic device (1301) and an external electronic device (1304) via a server (1308) connected to a second network (1399). Each of the external electronic devices (1302 or 1504) may be the same or a different type of device as the electronic device (1301). According to one embodiment, all or part of the operations executed in the electronic device (1301) may be executed in one or more of the external electronic devices (1302, 1504, or 1508). For example, when the electronic device (1301) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1301) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1301). The electronic device (1301) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1301) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (1304) may include an Internet of Things (IoT) device. The server (1308) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1304) or server (1308) may be included within the second network (1399). The electronic device (1301) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0200] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0201] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0202] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0203] Various embodiments of the present document may be implemented as software (e.g., a program (1340)) including one or more instructions stored in a storage medium (e.g., an internal memory (1336) or an external memory (1338)) readable by a machine (e.g., an electronic device (1301)). For example, a processor (e.g., a processor (1320)) of the machine (e.g., an electronic device (1301)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0204] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0205] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separately arranged in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to integration. According to various embodiments, the operations performed by a module, a program, or another component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added. The electronic device 1301 of FIG. 13 may be an example of the electronic device described with reference to FIGS. 1 to 12.

[0206] In one embodiment, a method may be required to control a screen displayed on a display based on the folding of a multi-foldable housing. According to one embodiment of the present invention, an electronic device (e.g., the electronic device (101) of FIGS. 1 to 12 and / or the electronic device (1301) of FIG. 13) as described above comprises a multi-foldable housing including a first housing (e.g., the first housing (111) of FIGS. 3A to 3C), a second housing (e.g., the second housing (112) of FIGS. 3A to 3C) rotatably coupled to the first housing, a third housing (e.g., the third housing (113) of FIGS. 3A to 3C) rotatably coupled to the second housing, a flexible display (e.g., the flexible display (150) of FIGS. 1, 2, and 3A to 3C) including a first display area supported by the first housing, a second display area supported by the second housing, and a third display area supported by the third housing), the first housing and the The flexible display may include a first sensor (e.g., sensor (230) of FIG. 2) for sensing a first angle between the second housing and the third housing, a second sensor (e.g., sensor (230) of FIG. 2) for sensing a second angle between the second housing and the third housing, a memory (e.g., memory (220) of FIG. 2) for storing instructions, and a processor (e.g., processor (210) of FIG. 2) for accessing the memory and executing the instructions. The processor may be configured to display a first screen executing one application on the first display area, the second display area, and the third display area of ​​the flexible display in unfolded states of the first housing, the second housing, and the third housing.The processor may be configured to display a notification event on at least one of the first display area, the second display area, and the third display area based on occurrence of a notification event while the one application is running. The processor may be configured to identify, while the notification event is displayed on the at least one display area, that the first housing and the third housing are changed from the unfolded state to a semi-folded state by a predetermined angle with respect to the second housing. The processor may be configured to display the notification event on the first display area or the third display area based on the change to the semi-folded state.

[0207] For example, the processor may be configured to display a visual object corresponding to the notification event as an overlay on the first screen based on the occurrence of the notification event.

[0208] For example, the processor may be configured to display a second screen corresponding to the notification event in the first display area based on identifying the first housing and the second housing that have been folded for more than the specified period of time based on the first sensor, while identifying the second housing and the third housing that maintain a position associated with the unfolded state based on the second sensor, and display the first screen in the second display area and the third display area.

[0209] For example, the processor may be configured to display the second screen in the third display area and display the first screen in the second display area and the first display area based on identifying the second housing and the third housing that have been folded for more than the specified period of time based on the second sensor, while identifying the first housing and the second housing that maintain a posture associated with the unfolded state based on the first sensor.

[0210] For example, the processor may be configured to detect whether the second housing and the third housing change to a posture associated with the unfolded state while displaying the first screen and the second screen based on the second housing and the third housing being folded for a period of time exceeding the specified period of time. The processor may be configured to, in response to the second housing and the third housing changing to the posture associated with the unfolded state, display the first screen in the first display area, the second display area, and the third display area of ​​the flexible display, and at least temporarily cease displaying the second screen associated with the notification event.

[0211] For example, the processor may be configured to detect whether the first housing and the second housing change to a posture associated with the unfolded state while displaying the first screen and the second screen based on the first housing and the second housing being folded for a period of time exceeding the specified period of time. The processor may be configured to, in response to the first housing and the second housing changing to the posture associated with the unfolded state, display the first screen in the first display area, the second display area, and the third display area of ​​the flexible display, and at least temporarily stop displaying the second screen corresponding to the notification event.

[0212] For example, the processor may be configured to display the first screen including a visual object related to the notification event within the unfolded state. The processor may be configured to display the second screen related to the notification event in the third display area based on the second housing and the third housing being folded beyond the specified period of time.

[0213] For example, the processor may be configured to display the first screen, having a reduced size based on the sizes of the first display area and the second display area, based on the second housing and the third housing being folded beyond the specified period of time.

[0214] According to one embodiment of the present invention, a method of an electronic device as described above may include an operation of displaying a first screen executing an application on a first display area of ​​a flexible display supported by the first housing, a second display area of ​​the flexible display supported by the second housing, and a third display area of ​​the flexible display supported by the third housing, in unfolded states of the first housing, the second housing, and the third housing of the electronic device. The method may include an operation of displaying a notification event on at least one display area among the first display area, the second display area, and the third display area, based on occurrence of a notification event while the one application is executing. The method may include an operation of identifying, while the notification event is displayed on the at least one display area, that the first housing and the third housing are changed from the unfolded state to a semi-folded state by a predetermined angle with respect to the second housing. The method may include an action of displaying the notification event in the first display area or the third display area based on the change to the semi-folding state.

[0215] For example, the identifying action may include identifying the first housing and the second housing that maintain a posture associated with the unfolded state based on a first sensor for detecting rotation of the first housing relative to the second housing, while identifying the second housing and the third housing that are folded for more than the specified period of time based on a second sensor for detecting rotation of the third housing relative to the second housing.

[0216] For example, the identifying action may include identifying, based on the first sensor, the first housing and the second housing that have been folded for more than the specified period of time, while identifying, based on the second sensor, the second housing and the third housing that maintain a posture associated with the unfolded state.

[0217] For example, the operation of displaying the notification event on the first display area or the third display area may include an operation of detecting whether the second housing and the third housing change to a posture associated with the unfolded state. The operation of displaying the notification event on the display area or the third display area may include an operation of displaying the first screen on the first display area, the second display area, and the third display area of ​​the flexible display in response to the second housing and the third housing changing to a posture associated with the unfolded state, and at least temporarily stopping displaying the second screen associated with the notification event.

[0218] For example, the operation of displaying the notification event on the first display area or the third display area may include an operation of detecting whether the first housing and the second housing change to a posture associated with the unfolded state. The operation of displaying the notification event on the first display area or the third display area may include an operation of displaying the first screen on the first display area, the second display area, and the third display area of ​​the flexible display in response to the first housing and the second housing changing to a posture associated with the unfolded state, and at least temporarily stopping displaying the second screen associated with the notification event.

[0219] For example, the operation of displaying the first screen in the first display area, the second display area, and the third display area may include the operation of displaying the first screen including a visual object related to the notification event. The operation of displaying the notification event in the first display area or the third display area may include the operation of displaying the second screen related to the notification event in the third display area.

[0220] For example, the action of displaying the notification event in the first display area or the third display area may include an action of displaying the first screen, which has a reduced size based on the size of a portion of the flexible display including the second display area.

[0221] According to one embodiment of the present invention, an electronic device (e.g., the electronic device (101) of FIGS. 1 to 12 and / or the electronic device (1301) of FIG. 13) as described above comprises a first housing (e.g., the first housing (111) of FIGS. 3A to 3C), a second housing (e.g., the second housing (112) of FIGS. 3A to 3C) rotatably coupled to the first housing, a third housing (e.g., the third housing (113) of FIGS. 3A to 3C) rotatably coupled to the second housing, a flexible display (e.g., the flexible display (150) of FIGS. 1, 2, 3A to 3C) disposed on a first surface of the first housing, a second surface of the second housing, and a third surface of the third housing), a plurality of sensors (e.g., the sensor (230) of FIG. 2), a memory for storing commands (e.g., the sensor (230) of FIG. 2) The flexible display may include a memory (220) and a processor (e.g., processor (210) of FIG. 2) for accessing the memory and executing the instructions. The processor may be configured to display a first screen having a size of the entire display area of ​​the flexible display on the flexible display within an unfolded state identified by the plurality of sensors. The processor may be configured to display a second screen related to the first screen on a portion of the flexible display disposed on the third surface based on the second surface and the third surface folded for a specified period of time while displaying the first screen within the unfolded state, and to display the first screen on another portion of the flexible display disposed on the first surface and the second surface.The processor may be configured to display the second screen on a portion of the flexible display disposed on the first surface, based on the first surface and the second surface being folded for a specified period of time while displaying the first screen in the unfolded state, and to display the first screen on another portion of the flexible display disposed on the second surface and the third surface.

[0222] For example, the plurality of sensors may include a first sensor for detecting rotation of the first housing relative to the second housing. The plurality of sensors may include a second sensor for detecting rotation of the third housing relative to the second housing.

[0223] For example, the processor may be configured to display the second screen on the portion of the flexible display disposed on the first surface, and display the first screen on the other portion of the flexible display disposed on the second surface and the third surface, based on identifying the first housing and the second housing that are folded for more than the specified period of time based on the first sensor, while identifying the second housing and the third housing that maintain a position associated with the unfolded state based on the second sensor.

[0224] For example, the processor may be configured to display the second screen on the portion of the flexible display disposed on the third surface based on identifying the second housing and the third housing that have been folded for more than the specified period of time based on the second sensor, while identifying the first housing and the second housing that maintain a posture associated with the unfolded state based on the first sensor, and to display the first screen on the other portion of the flexible display disposed on the second surface and the third surface.

[0225] For example, the processor may be configured to detect whether the second side and the third side change into a posture associated with the unfolded state while displaying the first screen and the second screen based on the second side and the third side being folded for a period of time exceeding the specified period. The processor may be configured to, in response to the second side and the third side changing into the posture associated with the unfolded state, display the first screen on the entire display area of ​​the flexible display and at least temporarily cease displaying the second screen.

[0226] For example, the processor may be configured to detect, while displaying the first screen and the second screen based on the first face and the second face being folded for a period exceeding the specified period, whether the first face and the second face change to a posture associated with the unfolded state. The processor may be configured to, in response to the first face and the second face changing to the posture associated with the unfolded state, display the first screen on the entire display area of ​​the flexible display and at least temporarily stop displaying the second screen.

[0227] For example, the processor may be configured to display the first screen including a visual object related to the notification message within the unfolded state. The processor may be configured to display the second screen related to the notification message on the portion of the flexible display disposed on the third surface based on the second surface and the third surface being folded for a period exceeding the specified period.

[0228] For example, the processor may be configured to display the first screen, having a reduced size based on the size of the other portion, on the other portion of the flexible display disposed on the first and second surfaces, based on the second and third surfaces folded beyond the specified period of time.

[0229] According to one embodiment of the present invention, a method of an electronic device as described above may include an operation of displaying a first screen having a size of an entire display area of ​​a flexible display, on a flexible display disposed on a first surface of a first housing of the electronic device, a second surface of a second housing rotatably coupled with the first housing, and a third surface of a third housing rotatably coupled with the second housing, in an unfolded state of the electronic device. The method may include an operation of displaying a second screen related to the first screen on a portion of the flexible display disposed on the third surface based on the second surface and the third surface being folded for a specified period of time while displaying the first screen in the unfolded state, and displaying the first screen on another portion of the flexible display disposed on the first surface and the second surface. The method may include an operation of displaying the second screen on a portion of the flexible display disposed on the first surface based on the first surface and the second surface folded for a specified period of time while displaying the first screen in the unfolded state, and displaying the first screen on another portion of the flexible display disposed on the second surface and the third surface.

[0230] For example, the operation of displaying the second screen on the part of the flexible display disposed on the third surface may include an operation of identifying the first housing and the second housing that maintain a posture associated with the unfolded state based on a first sensor for detecting rotation of the first housing with respect to the second housing, while identifying the second housing and the third housing that are folded for more than the specified period of time based on a second sensor for detecting rotation of the third housing with respect to the second housing.

[0231] For example, the operation of displaying the second screen on the portion of the flexible display disposed on the first surface may include an operation of identifying the first housing and the second housing that have been folded for more than the specified period of time, based on the first sensor, while identifying the second housing and the third housing that maintain a posture associated with the unfolded state, based on the second sensor.

[0232] For example, the operation of displaying the second screen on the part of the flexible display disposed on the third surface may include an operation of detecting whether the second surface and the third surface have changed into a posture associated with the unfolded state. The method may include an operation of displaying the first screen on the entire display area of ​​the flexible display and at least temporarily stopping displaying the second screen in response to the second surface and the third surface having changed into a posture associated with the unfolded state.

[0233] For example, the operation of displaying the second screen on the portion of the flexible display disposed on the first surface may include an operation of detecting whether the first surface and the second surface have changed into a posture associated with the unfolded state. The method may include an operation of displaying the first screen on the entire display area of ​​the flexible display and at least temporarily stopping displaying the second screen in response to the first surface and the second surface having changed into a posture associated with the unfolded state.

[0234] For example, the operation of displaying the first screen on the entire display area may include an operation of displaying the first screen including a visual object related to the notification message. The operation of displaying the second screen on the portion of the flexible display disposed on the third surface may include an operation of displaying the second screen related to the notification message on the portion of the flexible display disposed on the third surface.

[0235] For example, the operation of displaying the second screen on the part of the flexible display disposed on the third surface may include the operation of displaying the first screen on the other part of the flexible display disposed on the first surface and the second surface, having a reduced size based on the size of the other part.

[0236] According to one embodiment of the present invention, an electronic device (e.g., an electronic device (101) of FIGS. 1 to 12 and / or an electronic device (1301) of FIG. 13) as described above comprises a first housing (e.g., a first housing (111) of FIGS. 3A to 3C), a second housing (e.g., a second housing (112) of FIGS. 3A to 3C) rotatably coupled to the first housing, a third housing (e.g., a third housing (113) of FIGS. 3A to 3C) rotatably coupled to the second housing, a flexible display (e.g., a flexible display (150) of FIGS. 1, 2, 3A to 3C) disposed on a first surface of the first housing, a second surface of the second housing, and a third surface of the third housing, a cover display (e.g., a cover display (150) of FIGS. 1, 2, 3A to 3C) disposed on a fourth surface of the first housing opposite to the first surface. The flexible display may include a cover display (152) of FIG. 3A), a plurality of sensors (e.g., a sensor (230) of FIG. 2), a memory for storing commands (e.g., a memory (220) of FIG. 2), and a processor (e.g., a processor (210) of FIG. 2) for accessing the memory and executing the commands. The processor may be configured to display a first screen having a size of the entire display area of ​​the flexible display on the flexible display within an unfolded state identified by the plurality of sensors. The processor may be configured to display a second screen related to the first screen on the cover display together with the first screen displayed on the flexible display based on the first side and the second side being folded for a specified period of time while displaying the first screen within the unfolded state.

[0237] For example, the plurality of sensors may include a first sensor for detecting rotation of the first housing relative to the second housing. The plurality of sensors may include a second sensor for detecting rotation of the third housing relative to the second housing.

[0238] For example, the processor may be configured to display the second screen on the cover display based on identifying the first housing and the second housing that have been folded for more than the specified period of time based on the first sensor, while identifying the second housing and the third housing that maintain a position associated with the unfolded state based on the second sensor.

[0239] For example, the processor may be configured to detect, while displaying the first screen and the second screen, whether the first side and the second side change to a posture associated with the unfolded state. The processor may be configured to, in response to the first side and the second side changing to the posture associated with the unfolded state, at least temporarily stop displaying the second screen on the cover display.

[0240] For example, the processor may be configured to, within the unfolded state, activate the flexible display among the flexible display or the cover display to display the first screen. The processor may be configured to activate the cover display to display the second screen based on the first side and the second side being folded for a specified period of time.

[0241] According to one embodiment of the present invention, a method of an electronic device as described above may include an operation of displaying, in an unfolded state of the electronic device, a first screen having a size of an entire display area of ​​a flexible display disposed on a first surface of a first housing of the electronic device, a second surface of a second housing rotatably coupled with the first housing, and a third surface of a third housing rotatably coupled with the second housing. The method may include an operation of displaying, on a cover display disposed on a fourth surface of the first housing opposite the first surface, a second screen related to the first screen, together with the first screen displayed on the flexible display, based on the first surface and the second surface being folded for a specified period of time while displaying the first screen in the unfolded state.

[0242] For example, the act of displaying the second screen may include an act of displaying the second screen on the cover display based on identifying the first housing and the second housing that are folded for more than the specified period of time based on a second sensor for detecting rotation of the first housing with respect to the second housing, while identifying the second housing and the third housing that maintain a posture associated with the unfolded state based on a first sensor for detecting rotation of the third housing with respect to the second housing.

[0243] For example, the operation of displaying the second screen may include an operation of detecting whether the first side and the second side change to a posture associated with an unfolded state while displaying the first screen and the second screen. The method may include an operation of at least temporarily stopping displaying the second screen on the cover display in response to the first side and the second side changing to the posture associated with the unfolded state.

[0244] For example, the operation of displaying the first screen may include an operation of activating the flexible display among the flexible display or the cover display within the unfolded state to display the first screen. The operation of displaying the second screen may include an operation of activating the cover display to display the second screen based on the first side and the second side being folded for a period exceeding the specified period.

[0245] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0246] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0247] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.

[0248] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above teachings. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0249] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In an electronic device (101; 1301), 1st housing (111, 1211); A second housing (112, 1212) rotatably coupled to the first housing (111, 1211); A multi-foldable housing including a third housing (113, 1213) rotatably coupled to the second housing (112, 1212); A flexible display (150) including a first display area supported by the first housing (111, 1211), a second display area supported by the second housing (112, 1212), and a third display area supported by the third housing (113, 1213); A first sensor (230) that senses a first angle (141, 1241) between the first housing (111, 1211) and the second housing (112, 1212); A second sensor (230) that senses a second angle (142, 1242) between the second housing (112, 1212) and the third housing (113, 1213); Memory for storing commands (220, 1330); and It includes a processor (210, 1320) for accessing the memory (220, 1330) and executing the instructions, and the instructions, when executed by the processor (210, 1320), cause the processor (210, 1320) to: In the unfolded state of the first housing (111, 1211), the second housing (112, 1212) and the third housing (113, 1213), a first screen (712) executing one application is displayed on the first display area, the second display area and the third display area of ​​the flexible display (150); Based on the occurrence of a notification event while the one application is running, displaying the notification event in at least one display area among the first display area, the second display area and the third display area; While the above notification event is displayed on the at least one display area, identifying that at least one of the first housing (111, 1211) and the third housing (113, 1213) changes from the unfolded state to a semi-folded state by a predetermined angle based on the second housing (112, 1212); and Based on the change to the semi-folding state, causing the notification event to be displayed in the first display area or the third display area. Electronic devices (101, 1301).

2. In claim 1, the processor (210, 1320) Based on the occurrence of the above notification event, a visual object (710) corresponding to the above notification event is configured to be displayed as an overlay on the first screen (712). Electronic devices (101, 1301).

3. In claim 1 or claim 2, the instructions cause the processor (210, 1320) to: While identifying the second housing (112, 1212) and the third housing (113, 1213) that maintain a position related to the unfolded state based on the second sensor (230), based on identifying the first housing (111, 1211) and the second housing (112, 1212) that are folded for more than the specified period based on the first sensor (230), further causing the second screen (720, 820, 830, 950) corresponding to the notification event to be displayed on the first display area, and the first screen (712) to be displayed on the second display area and the third display area. Electronic devices (101, 1301).

4. In claim 1 or claim 2, the instructions cause the processor (210, 1320) to: While identifying the first housing (111, 1211) and the second housing (112, 1212) that maintain a posture related to the unfolded state based on the first sensor (230), further causing the second screen (720, 820, 830, 950) to be displayed on the third display area, and the first screen (712) to be displayed on the second display area and the first display area, based on identifying the second housing (112, 1212) and the third housing (113, 1213) that have been folded for more than the specified period based on the second sensor (230). Electronic devices (101, 1301).

5. In any one of claims 1 to 4, the instructions cause the processor (210, 1320) to: While displaying the first screen (712) and the second screen (720, 820, 830, 950) based on the second housing (112, 1212) and the third housing (113, 1213) being folded beyond the above-mentioned specified period, detecting whether the second housing (112, 1212) and the third housing (113, 1213) change to a posture related to the unfolded state; In response to the second housing (112, 1212) and the third housing (113, 1213) being changed to the posture related to the unfolded state, further causing the first screen to be displayed in the first display area, the second display area and the third display area of ​​the flexible display (150), and at least temporarily ceasing to display the second screen (720, 820, 830, 950) related to the notification event. Electronic devices (101, 1301).

6. In any one of claims 1 to 4, the instructions cause the processor (210, 1320) to: While displaying the first screen (712) and the second screen (720, 820, 830, 950) based on the first housing (111, 1211) and the second housing (112, 1212) being folded beyond the specified period, detecting whether the first housing (111, 1211) and the second housing (112, 1212) change to a posture related to the unfolded state; In response to the first housing (111, 1211) and the second housing (112, 1212) being changed to the posture related to the unfolded state, the first screen (712) is displayed in the first display area, the second display area and the third display area of ​​the flexible display (150), and further causes at least temporary cessation of displaying the second screen (720, 820, 830, 950) corresponding to the notification event. Electronic devices (101, 1301).

7. In any one of claims 1 to 6, the instructions cause the processor (210, 1320) to: Within the unfolded state, display the first screen (712) including a visual object (710) related to the notification event; Further causing the second screen (720, 820, 830, 950) related to the notification event to be displayed in the third display area based on the second housing (112, 1212) and the third housing (113, 1213) folded beyond the above-mentioned specified period. Electronic devices (101, 1301).

8. In any one of claims 1 to 6, the instructions cause the processor (210, 1320) to: Based on the second housing (112, 1212) and the third housing (113, 1213) folded beyond the above-mentioned specified period, further causing the first screen (712) to be displayed, having a reduced size based on the size of the first display area and the second display area, in the first display area and the second display area. Electronic devices (101, 1301).

9. In the method of electronic device (101, 1301), An operation of displaying a first screen (712) executing one application on a first display area of ​​a flexible display (150) supported by the first housing (111, 1211), a second display area of ​​the flexible display supported by the second housing (112, 1212), and a third display area of ​​the flexible display supported by the third housing (113, 1213) within an unfolded state of the first housing (111, 1211), the second housing (112, 1212), and the third housing (113, 1213) of the electronic device (101, 1301); An action of displaying a notification event on at least one of the first display area, the second display area and the third display area based on the occurrence of a notification event while the one application is running; An operation for identifying that at least one of the first housing (111, 1211) and the third housing (113, 1213) changes from the unfolded state to a semi-folded state by a predetermined angle based on the second housing (112, 1212) while the above notification event is displayed on the at least one display area; and Based on the change to the semi-folding state, including an action of displaying the notification event in the first display area or the third display area, method.

10. In claim 9, the identifying action comprises: An operation of identifying the first housing (111, 1211) and the second housing (112, 1212) that maintain a posture related to the unfolded state based on a first sensor (230) for detecting rotation of the first housing (111, 1211) with respect to the second housing (112, 1212), while identifying the second housing (112, 1212) and the third housing (113, 1213) that are folded for more than the specified period of time based on a second sensor (230) for detecting rotation of the third housing (113, 1213) with respect to the second housing (112, 1212), method.

11. In claim 9, the identifying action comprises: An operation of identifying the second housing (112, 1212) and the third housing (113, 1213) that maintain a posture related to the unfolded state based on a second sensor (230) for detecting rotation of the first housing (111, 1211) with respect to the second housing (112, 1212), while identifying the first housing (111, 1211) and the second housing (112, 1212) that are folded for more than a specified period of time based on a first sensor (230) for detecting rotation of the first housing (111, 1211) with respect to the second housing (112, 1212), method.

12. In any one of claims 9 to 11, the operation of displaying the notification event in the third display area comprises: An operation of detecting whether the second housing (112, 1212) and the third housing (113, 1213) change to a posture related to the unfolded state; In response to the second housing (112, 1212) and the third housing (113, 1213) being changed to a posture related to the unfolded state, an operation of displaying the first screen (712) in the first display area, the second display area and the third display area of ​​the flexible display (150) and at least temporarily stopping displaying the second screen (720, 820, 830, 950) related to the notification event. method.

13. In any one of claims 9 to 11, the operation of displaying the notification event in the first display area comprises: An operation for detecting whether the first housing (111, 1211) and the second housing (112, 1212) change to a posture related to the unfolded state; In response to the first housing (111, 1211) and the second housing (112, 1212) being changed to a posture related to the unfolded state, an operation of displaying the first screen (712) in the first display area, the second display area and the third display area of ​​the flexible display (150) and at least temporarily stopping displaying the second screen (720, 820, 830, 950) related to the notification event. method.

14. In any one of claims 9 to 13, the operation of displaying the first screen (712) in the first display area, the second display area, and the third display area is: Including an action of displaying the first screen (712) including a visual object (710) related to the above notification event, The action of displaying the above notification event in the first display area or the third display area is: Including an action of displaying a second screen (720, 820, 830, 950) related to the notification event in the first display area or the third display area. method.

15. In any one of claims 9 to 14, the operation of displaying the notification event in the first display area or the third display area comprises: An operation of displaying the first screen (712) having a reduced size based on the size of a portion of the flexible display including the second display area, method.

Citation Information

Patent Citations

  • Mobile terminal and control method thereof

    KR1020160055646A

  • Display apparatus

    KR1020160108705A

  • Annealing apparatus and method using induced heating coil

    KR102529074B1

  • Performance test device and performance test method of precision reducer

    KR102580129B1

  • Dynamic screen modes on a bendable computing device

    US20210097901A1