Electronic device and method for storing image corresponding to screen on basis of touch input
The electronic device addresses the challenge of capturing and storing screen images across multiple display regions by using a multi-foldable housing with flexible displays and sensors to detect touch inputs, enabling efficient image capture and storage.
Patent Information
- Application Number
- PCT/KR2024/012145
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-11-10
- Filing Date
- 2024-08-14
- Publication Date
- 2025-04-10
AI Technical Summary
Existing electronic devices struggle to efficiently store images corresponding to the screen based on touch input, especially in devices with flexible displays that can be folded or rotated, as they lack effective methods to capture and store screen images across multiple display regions.
The electronic device employs a multi-foldable housing with flexible displays on multiple housings, equipped with sensors to detect angles and touch inputs. When a touch input is detected on the boundary area between display regions, the device captures and stores an image corresponding to at least part of the screen, allowing for flexible screen capture across multiple display areas.
This solution enables efficient image capture and storage across multiple display regions of a flexible electronic device, enhancing user interaction and functionality, especially in devices with complex folding mechanisms.
Smart Images

Figure KR2024012145_10042025_PF_FP_ABST
Abstract
Description
Electronic device and method for storing an image corresponding to a screen based on a touch input
[0001] The present disclosure relates to an electronic device and method for storing an image corresponding to a screen based on a touch input.
[0002] The shape and / or size of electronic devices are diversifying. To enhance mobility, electronic devices with reduced size and / or volume are being designed. Electronic devices may include a display for visualizing information. As the number of functions supported by electronic devices increases, the size of the display may increase to visualize more information to the user and / or to support the execution of the functions. For example, electronic devices may be designed to be reduced in size and / or volume while maintaining or increasing the size of the display.
[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.
[0004] According to an embodiment, an electronic device may include a flexible display including a first housing, a second housing rotatably coupled to the first housing, a third housing rotatably coupled to the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing, a first sensor for detecting an angle between the first housing and the second housing, a second sensor for detecting an angle between the second housing and the third housing, a memory including one or more storage media for storing instructions, and at least one processor including a processing circuit. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to detect a touch input based on an external object contacting a boundary area between two of the first display area, the second display area, and the third display area while displaying a screen on the flexible display. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to store an image corresponding to at least a portion of the screen in response to the touch input based on the external object moving along a direction in which the boundary area extends.
[0005] In one embodiment, a method of an electronic device is provided, including a flexible display comprising a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing. The method may include an operation of detecting a touch input based on an external object contacting a boundary area between two display areas among the first display area, the second display area, and the third display area while a screen is displayed on the flexible display. The method may include an operation of storing an image corresponding to at least a portion of the screen in response to the touch input based on the external object moving along a direction in which the boundary area extends.
[0006] In one embodiment, an electronic device may include a flexible display including a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing, a first sensor for detecting an angle between the first housing and the second housing, a second sensor for detecting an angle between the second housing and the third housing, a memory including one or more storage media and for storing instructions, and at least one processor including a processing circuit. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to detect a touch input based on an external object contacting the flexible display while displaying a screen on the flexible display. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to store an image corresponding to at least one display area including the path, among the first display area, the second display area, and the third display area, based on a path along which the external object contacted according to a specified form moves on the flexible display.
[0007] In one embodiment, a method of an electronic device is provided, including a flexible display comprising a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing. The method may include an operation of displaying a first screen on a portion of the first display area divided by an edge of the third housing that is different from a portion covered by the third housing, while an edge of the third housing is in contact with the first display area, and displaying a second screen on a cover display disposed on a second surface of the third housing opposite to a first surface on which the third display area is disposed. The method may include an operation of detecting a touch input based on an external object contacting a portion of the first display area that the edge is in contact with. The method may include an operation of storing an image including at least one of the first screen or the second screen in response to the touch input based on the external object moving along the direction of the edge.
[0008] In one embodiment, an electronic device may include a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a flexible display including a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing, a cover display disposed on a second surface of the third housing opposite a first surface of the third housing disposed on the third display area, a first sensor for detecting an angle between the first housing and the second housing, a second sensor for detecting an angle between the second housing and the third housing, a memory including one or more storage media for storing instructions, and at least one processor including the processing circuit. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to display a first screen on a portion of the first display area defined by an edge of the third housing, the portion being different from the portion occluded by the third housing, while the edge of the third housing is in contact with the first display area, and to display a second screen on the cover display. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to detect a touch input based on an external object contacting a portion of the first display area that the edge contacted. The instructions, when individually and / or collectively executed by the at least one processor, may cause the electronic device to store an image including at least one of the first screen or the second screen in response to the touch input based on the external object moving along the direction of the edge.
[0009] In one embodiment, a method of an electronic device is provided, including a flexible display comprising a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing. The method may include an operation of displaying a first screen on a portion of the first display area divided by an edge of the third housing that is different from a portion covered by the third housing, while an edge of the third housing is in contact with the first display area, and displaying a second screen on a cover display disposed on a second surface of the third housing opposite to a first surface on which the third display area is disposed. The method may include an operation of detecting a touch input based on an external object contacting a portion of the first display area that the edge is in contact with. The method may include an operation of storing an image including at least one of the first screen or the second screen in response to the touch input based on the external object moving along the direction of the edge.
[0010] Figures 1a and 1b illustrate one embodiment of a deformable electronic device.
[0011] FIGS. 2A and 2B illustrate an example block diagram of an electronic device according to one embodiment.
[0012] FIG. 3 illustrates a flow diagram of an electronic device according to one embodiment.
[0013] FIG. 4 illustrates the operation of an electronic device for receiving a designated touch input to capture a screen displayed on a display.
[0014] FIG. 5 illustrates an example of the operation of an electronic device for obtaining information related to the angle between housings.
[0015] FIGS. 6A, 6B, and 6C illustrate exemplary operations of an electronic device for storing an image associated with a screen displayed on one or more displays based on a designated touch input.
[0016] FIG. 7 illustrates a flow diagram of an electronic device according to one embodiment.
[0017] FIGS. 8A, 8B, 8C, 8D, 8E, 8F, and 8G illustrate exemplary states of an electronic device receiving a specified touch input.
[0018] FIG. 9 illustrates a flow diagram of an electronic device according to one embodiment.
[0019] FIG. 10 illustrates the operation of an electronic device based on touch input on an area of a display formed on a folding axis.
[0020] Figures 11a and 11b illustrate the operation of an electronic device based on touch input on an area of a display formed on a folding axis.
[0021] FIGS. 12A and 12B illustrate exemplary operations of an electronic device that stores an image corresponding to at least one of the screens displayed on a plurality of displays.
[0022] FIG. 13 illustrates a flow diagram of an electronic device according to one embodiment.
[0023] FIGS. 14a, 14b, 14c, and 14d illustrate exemplary states of an electronic device receiving a designated touch input for capturing a screen.
[0024] FIG. 15 illustrates a flow diagram of an electronic device according to one embodiment.
[0025] FIG. 16 is a block diagram of an electronic device within a network environment according to various embodiments.
[0026] Hereinafter, various embodiments of this document are described with reference to the attached drawings.
[0027] Figures 1A and 1B illustrate an embodiment of a deformable electronic device (101). In terms of being owned by a user, the electronic device (101) may be referred to as a terminal (or user terminal). The terminal may include, for example, a personal computer (PC) such as a laptop or desktop. The terminal may include, for example, a smartphone, a smartpad, and / or a tablet PC. The terminal may include a smart accessory such as a smartwatch and / or a head-mounted device (HMD).
[0028] Referring to FIGS. 1A and / or 1B , an electronic device (101) according to one embodiment may include a deformable multi-foldable housing. Based on the deformability, the multi-foldable housing may be divided into a plurality of parts (or combinations and / or portions). For example, the multi-foldable housing of the electronic device (101) of FIGS. 1A and / or 1B may include a first housing (111), a second housing (112), and a first hinge assembly (121) for rotatably coupling the first housing (111) and the second housing (112). By the first hinge assembly (121), the relative position, posture (or position), angle, shape, and / or distance of the first housing (111) and the second housing (112), which are rigid bodies, may be changed by an external force.
[0029] Referring to FIG. 1A and / or FIG. 1B, the multi-foldable housing of the electronic device (101) may include a second housing (112), a third housing (113), and a second hinge assembly (122) for rotatably coupling the second housing (112) and the third housing (113). By the second hinge assembly (122), the relative position, posture, angle, shape, and / or distance of the second housing (112) and the third housing (113) may be changed by an external force. Based on the first hinge assembly (121) and the second hinge assembly (122), the electronic device (101) may have a structure that can be folded more than once. In one embodiment, the housings, such as the first housing (111), the second housing (112), and the third housing (113), may be referred to as a housing assembly (or housing combination, housing part, and / or housing assembly), a sub-housing, a flat housing, and / or a rigid housing. In one embodiment, the hinge assembly, including the first hinge assembly (121) and the second hinge assembly (122), may be referred to as a hinge housing, a joint housing, and / or a flexible housing.
[0030] Referring to FIG. 1A and / or FIG. 1B, the first folding axis (131) may be a rotation axis of the first housing (111) and the second housing (112) connected through the first hinge assembly (121), and may be formed within the first hinge assembly (121). As the first housing (111) and / or the second housing (112) rotates around the first folding axis (131), the first angle (141) between the first housing (111), the first hinge assembly (121), and the second housing (112) may change. The second folding axis (132) may be a rotation axis of the second housing (112) and the third housing (113) connected through the second hinge assembly (122), and may be formed within the second hinge assembly (122). As the second housing (112) and / or the third housing (113) rotate about the second folding axis (132), the second angle (142) between the second housing (112), the second hinge assembly (122), and the third housing (113) can be changed. In terms of including a plurality of deformable folding axes, such as the first folding axis (131) and the second folding axis (132), the electronic device (101) can be referred to as a multi-foldable electronic device.
[0031] Referring to FIGS. 1A and / or 1B , according to one embodiment, an electronic device (101) may include a flexible display (150) disposed on one surface (e.g., a front surface of the electronic device (101)) of a first housing (111), a second housing (112), and a third housing (113). For example, the flexible display (150) may extend from the first housing (111) across the second housing (112) to the third housing (113). The flexible display (150) may form at least a portion of the front surfaces of the first housing (111), the second housing (112), and the third housing (113). For example, the flexible display (150) can be arranged from the first housing (111) across the first hinge assembly (121), the second housing (112), and the second hinge assembly (122) to the third housing (113).
[0032] In one embodiment, the first angle (141) may correspond to an angle between a first surface of a first housing (111) in which a flexible display (150) is disposed and a second surface of a second housing (112), which may be folded by a first folding axis (131) of a first hinge assembly (121). Hereinafter, the second angle (142) may correspond to an angle between a second surface of a second housing (112) in which a flexible display (150) is disposed and a third surface of a third housing (113), which may be folded by a second folding axis (132) of a second hinge assembly (122). In one embodiment, the flexible display (150) may be referred to as a display, a deformable display, and / or a deformable panel. An exemplary hardware configuration of an electronic device (101) for controlling a flexible display (150) is described with reference to FIG. 2a and / or FIG. 2b.
[0033] Referring to FIGS. 1A and / or 1B , according to one embodiment, an electronic device (101) may include a first speaker (161) and / or a third speaker (163) disposed in a first housing (111). The electronic device (101) may include a second speaker (162) and / or a fourth speaker (164) disposed in a third housing (113). The third speaker (163) may be disposed at a second edge of the first housing (111) opposite a first edge of the first housing (111) where the first speaker (161) is disposed. The fourth speaker (164) may be disposed at a second edge of the third housing (113) opposite a first edge of the third housing (113) where the second speaker (162) is disposed. Although the second speaker (162) disposed on one side of the third housing (113) where the flexible display (150) is disposed and the first speaker (161), the third speaker (163) and the fourth speaker (164) disposed on the side connected to the front of the electronic device (101) are exemplarily illustrated, the positions of the speakers (e.g., the first speaker (161) to the fourth speaker (164)) included in the electronic device (101) are not limited to the positions illustrated in FIG. 1A and / or FIG. 1B.
[0034] In one embodiment, the posture and / or shape of the electronic device (101) and / or the flexible display (150) can be distinguished by a first angle (141) and / or a second angle (142). Referring to FIGS. 1A and / or 1B , different shapes of the electronic device (101) supporting deformability based on multiple folding axes (e.g., a first folding axis (131) and / or a second folding axis (132)) are illustrated.
[0035] Referring to FIG. 1A, a first electronic device (101-1) is illustrated including a flexible display (150) that is visually completely covered by a first housing (111) to a third housing (113) folded along a first folding axis (131) and a second folding axis (132). Referring to FIG. 1A, different states (e.g., a first state (191), a second state (192), and / or a third state (193)) of the first electronic device (101-1) are illustrated, distinguished by a first angle (141) and a second angle (142). A first state (191) of the first electronic device (101-1) in which the first angle (141) and the second angle (142) are substantially straight angles (e.g., about 180º) may be referred to as a fully unfolded state, an opened state, a fully-opened state, an unfolded state, a flat state, an outspread state, and / or a planar state.
[0036] Referring to FIG. 1A, in the first state (191), the flexible display (150) arranged from the first housing (111) across the second housing (112) to the third housing (113) may have a substantially flat shape. In the first state (191), a single plane may be formed on the front surface of the electronic device (101) on which the flexible display (150) is arranged. In the first state (191), the directions of the front surfaces of the first housing (111), the second housing (112), and the third housing (113) may be parallel to each other and / or coincide with each other.
[0037] Referring to FIG. 1A, a second state (192) of the first electronic device (101-1) is illustrated, wherein at least one of the first angle (141) and / or the second angle (142) is less than a parallel angle. Such as the second state (192), the state of the first electronic device (101-1) in which the first angle (141) and / or the second angle (142) is less than a parallel angle may be referred to as an in-fold state, a sub-unfolded state (or sub-folded state), an intermediate state, and / or a concave state. The sub-folded state may include a state in which both the first angle (141) and the second angle (142) are less than a parallel angle and exceed 0°. Within the sub-fold state, the display areas of the flexible display (150) respectively disposed on the first housing (111) to the third housing (113) may face different directions. Referring to the second state (192), the flexible display (150) bent by the first hinge assembly (121) and the second hinge assembly (122) may include three flat portions separated by the first folding axis (131) and the second folding axis (132). For example, the flat portions of the flexible display (150) separated by the second hinge assembly (122) may face different, non-parallel directions.
[0038] Referring to FIG. 1A, the third state (193) of the first electronic device (101-1) in which the first angle (141) and the second angle (142) are substantially all 0° may be referred to as a fully folded state, a folded state, a closed state, and / or a fully-closed state. Within the third state (193), the flexible display (150) may be visually completely covered by the first housing (111) to the third housing (113). For example, within the folded state, the size of the flexible display (150) of the first electronic device (101-1) exposed to the outside may be substantially 0. Referring to FIG. 1A, an exemplary third state (193) is illustrated in which the front and rear surfaces of the third housing (113) on which a portion of the flexible display (150) is disposed are each covered by the first housing (111) and the second housing (112), but the embodiment is not limited thereto.
[0039] A first electronic device (101-1) including a flexible display (150) that is visually completely obscured within a folded state may include a cover display (152) disposed on a rear surface opposite to a front surface on which the flexible display (150) is disposed. Referring to FIG. 1A, according to one embodiment, the first electronic device (101-1) may include a cover display (152) disposed on a second surface (e.g., a rear surface of the third housing (113)) of the third housing (113) that is opposite to a first surface (e.g., a front surface of the third housing (113)) of the third housing (113) on which a portion of the flexible display (150) is disposed. The embodiment is not limited thereto, and the cover display (152) may be placed on the rear surface of the second housing (112) opposite to the front surface of the second housing (112) where a portion of the flexible display (150) is placed.
[0040] Referring to FIG. 1A, a first electronic device (101-1) including a flexible display (150) configured to be folded at an angle less than a parallel angle along a first folding axis (131) and a second folding axis (132) may be referred to as a G-shaped foldable electronic device. Referring to FIG. 1B, different forms of a second electronic device (101-2) including a flexible display (150) configured to be folded at an angle greater than a parallel angle along at least one of the first folding axis (131) and the second folding axis (132) are illustrated. The second electronic device (101-2) may be referred to as an S-shaped foldable electronic device.
[0041] Referring to FIG. 1B, different states (e.g., the fourth state (194) to the sixth state (196)) of the second electronic device (101-2) are illustrated, which are distinguished by the first angle (141) and the second angle (142). The fourth state (194) of the second electronic device (101-2) may correspond to the first state (191) of the first electronic device (101-1) of FIG. 1A. Within the fourth state (194), which corresponds to the unfolded state, a flat plane may be formed by the flexible display (150).
[0042] Referring to FIG. 1B, a fifth state (195) of the second electronic device (101-2) is illustrated, wherein the first angle (141) exceeds a parallel angle and the second angle (142) is substantially parallel. The state of the second electronic device (101-2) in which the first angle (141) and / or the second angle (142) exceed a parallel angle and are less than 360° may be referred to as an out-fold state, an intermediate state, a sub-fold state, and / or a convex state. Although only the first angle (141) among the first angle (141) and the second angle (142) is illustrated as exceeding a parallel angle, the embodiment is not limited thereto. Within the convex state including the fifth state (195), a plurality of planes formed by the flexible display (150) folded by the first hinge assembly (121) and / or the second hinge assembly (122) may face different directions.
[0043] Referring to FIG. 1B, the sixth state (196) of the second electronic device (101-2) in which the first angle (141) is substantially 360° and the second angle (142) is substantially 0° may be referred to as a fully folded state, a folded state, and / or a closed state. Within the sixth state (196), among the portions of the flexible display (150) disposed in each of the first housing (111) to the third housing (113), only the portion of the flexible display (150) disposed on the first housing (111) may be exposed to the outside.
[0044] According to one embodiment, the electronic device (101) can identify a state of the electronic device (101) (e.g., one of an unfolded state, a folded state, an in-fold state, and / or an out-fold state) indicated by a first angle (141) and a second angle (142) based on a sensor (e.g., sensor 250 of FIG. 2A). The sensor can include at least one of a 6-axis (6 degree-of-freedom (dof)) sensor, an inertial measurement unit (IMU), and / or a Hall sensor for detecting the first angle (141) and / or the second angle (142). Based on the switching between the states described with reference to FIGS. 1A and 1B, the electronic device (101) can display a screen on the flexible display (150) and / or the cover display (152).
[0045] According to one embodiment, the electronic device (101) may perform screen capture based on the posture and / or position and / or shape of the first housing (111), the second housing (112), and the third housing (113). Hereinafter, screen capture may refer to an operation of saving an image corresponding to a screen displayed on the flexible display (150) and / or the cover display (152). Screen capture may be referred to as a screen dump and / or a screen cast. The image saved by screen capture may be referred to as a screen shot. In one embodiment, including one or more folding axes (e.g., a first folding axis (131) and / or a second folding axis (132)) that are foldable, as shown in FIG. 1A and / or FIG. 1B, the electronic device (101) can display a screen on at least a portion of the flexible display (150) and / or the cover display (152) based on the one or more folding axes. An exemplary hardware configuration of the electronic device (101) for displaying a screen on at least a portion of the flexible display (150) and / or the cover display (152) is described with reference to FIG. 2A and / or FIG. 2B.
[0046] According to one embodiment, the electronic device (101) may store an image corresponding to the screen based on a touch input on the flexible display (150) and / or the cover display (152) while displaying the screen on the flexible display (150) and / or the cover display (152). Hereinafter, a designated touch input may refer to a touch input that triggers acquisition and / or storage of the image.
[0047] In one embodiment, in which a button disposed on a portion of the first housing (111) to the third housing (113) (e.g., a side between the front and / or the back of the multi-foldable housing where the flexible display (150) and / or the cover display (152) are disposed) is mapped to a function for screen capture, the accessibility of the button may depend on the posture of the first housing (111) to the third housing (113). For example, the button may be occluded by the posture of the first housing (111) to the third housing (113). Alternatively, a user who wishes to press the button may repeatedly check the position of the button depending on the posture of the first housing (111) to the third housing (113). According to one embodiment, the electronic device (101) can execute a function for screen capture in response to a designated touch input performed on the flexible display (150) and / or the cover display (152), independently of the button. The electronic device (101) reacting to the designated touch input can store an image corresponding to the screen displayed on the flexible display (150) and / or the cover display (152) without any additional action by the user to identify the location of the button. An exemplary operation of the electronic device (101) based on the designated touch input is described with reference to FIG. 3.
[0048] According to one embodiment, the electronic device (101) may select or determine at least one display on which a screen will be displayed, among the flexible display (150) and / or the cover display (152), based on the posture and / or shape of the first housing (111) to the third housing (113). The electronic device (101) may display the screen on at least a portion of the determined at least one display based on the posture and / or the shape. While executing multiple software applications based on multitasking, the electronic device (101) may display screens (e.g., windows and / or activities) provided from the multiple software applications on different portions of the display (e.g., the flexible display (150) and / or the cover display (152)). The electronic device (101) can display the screens on each of the flat portions separated by the first folding axis (131) and / or the second folding axis (132) on the flexible display (150).
[0049] According to one embodiment, the electronic device (101) may store an image corresponding to any one of the flat portions of the flexible display (150) defined by the first folding axis (131) and / or the second folding axis (132) based on a designated touch input. According to one embodiment, the electronic device (101) may acquire and / or store an image including all of the screens in response to the designated touch input while displaying the screens on each of the flexible display (150) and the cover display (152). Exemplary operations of the electronic device (101) for determining at least a portion of the screen to be stored based on the image in response to the designated touch input while displaying the screen on at least a portion of the flexible display (150) and / or the cover display (152) selected based on the posture and / or shape of the first housing (111) to the third housing (113) are described with reference to FIGS. 4 to 15.
[0050] As described above, the electronic device (101) can perform an operation related to screen capture based on physical characteristics of the electronic device (101) (e.g., the posture and / or shape of the electronic device (101) distinguished by the first housing (111) to the third housing (113). The operation can be initiated based on a designated touch input based on a drag gesture. Based on at least one of the designated touch input, the posture of the flexible display (150) folded by the first folding axis (131) and / or the second folding axis (132), at least a portion of the flexible display (150) exposed to the outside based on the posture, and / or the cover display (152) activated based on the posture, the electronic device (101) can perform a screen capture for at least a portion of the screen displayed through the flexible display (150) and / or the cover display (152). An electronic device (101) that supports screen capture based on a specified touch input can perform screen capture more quickly in response to a specified touch input.
[0051] Hereinafter, with reference to FIG. 2a and / or FIG. 2b, an exemplary hardware configuration of an electronic device (101) for performing screen capture described with reference to FIG. 1a and / or FIG. 1b is described.
[0052] FIG. 2A and / or FIG. 2B illustrate an example of a block diagram of an electronic device (101), according to one embodiment. The electronic device (101) of FIG. 1A and / or FIG. 1B may include hardware of the electronic device (101) described with reference to FIG. 2A and / or FIG. 2B , the electronic device (101) according to one embodiment may include at least one of a processor (210), a memory (220), one or more displays (e.g., a first display (230) and / or a second display (240)), or a sensor (250). The processor (210), the memory (220), the one or more displays, and the sensor (250) may be electronically and / or operably coupled with each other by an electronic component, such as a communication bus. An embodiment of an electronic device (101) including two displays, such as a first display (230) and a second display (240), is illustrated, but the embodiment is not limited thereto.
[0053] In one embodiment, the operative coupling of the hardware components of the electronic device (101) may mean that a direct connection or an indirect connection is established, either wired or wireless, between the hardware components such that a second hardware component is controlled by a first hardware component among the hardware components. Although illustrated based on different blocks, the embodiment is not limited thereto, and a portion of the hardware of FIG. 2A (e.g., at least a portion of the processor (210) and the memory (220)) may be included in a single integrated circuit such as a system on a chip (SoC). The hardware components of the electronic device (101), which are divided into blocks, may be located in or included in at least one of the first housing (111), the second housing (112), or the third housing (113) described with reference to FIG. 1A and / or FIG. 1B. The type and / or number of hardware components included in the electronic device (101) is not limited to that illustrated in FIG. 2A. For example, the electronic device (101) may include only some of the hardware components illustrated based on the blocks of FIG. 2a.
[0054] According to one embodiment, the processor (210) of the electronic device (101) may include hardware and / or circuitry for processing data based on one or more instructions. The hardware and / or circuitry for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). The number of processors (210) may be one or more. For example, the processor (210) may have a multi-core processor structure such as a dual core, a quad core, a hexa core, or an octa core.
[0055] Referring to FIG. 2A, a processor (210) is illustratively illustrated, as a non-limiting example, including a logical processor unit (LPU) (212) and / or a display processor unit (DPU) (214). The LPU (212) may include circuitry (e.g., an ALU and / or an FPU) within the processor (210) for performing computations or operations directed by instructions. Registers and / or circuitry (e.g., level 1 (L1), level 2 (L2), and / or level 3 (L3) cache memories) for storing data input to or output from the LPU (212) may be included in the processor (210). The DPU (214) may include circuitry for performing operations to generate a screen to be displayed on one or more displays (e.g., the first display (230) and / or the second display (240)) included in the electronic device (101). For example, the DPU (214) may generate a screen to be displayed, at least temporarily, on the one or more displays by synthesizing different image frames divided into layers. The layers may be provided from a software application executed by the LPU (212).
[0056] In one embodiment, the DPU (214) may be a circuit connected to a port and / or node connected to a display within the processor (210). The DPU (214) may additionally perform color correction of the generated screen. In one embodiment, the electronic device (101) may further include a circuit designed to perform calculations for 3D rendering and / or light source processing, such as a GPU (graphics processing unit). In the above embodiment, layers and / or graphical objects generated by the GPU may be composited with other layers by the DPU (214). The DPU (214) may provide a combination of the layers generated by the GPU and other layers to a display. The screen generated by the DPU (214) may be transmitted or provided to one or more displays without encoding. Based on the DPU (214), rendering may be performed for graphical objects to be displayed on one or more displays. Information about the screen, which is generated by the DPU (214) and can be displayed by one or more displays, can be stored in a buffer within the processor (210).
[0057] According to one embodiment, the memory (220) of the electronic device (101) may include hardware components for storing data and / or instructions input and / or output to the processor (210). The memory (220) may include, for example, a volatile memory (222) such as a random-access memory (RAM) and / or a non-volatile memory (224) such as a read-only memory (ROM). The volatile memory (222) may include, for example, at least one of a dynamic RAM (DRAM), a static RAM (SRAM), a cache RAM, and a pseudo SRAM (PSRAM). The non-volatile memory (224) may include, for example, at least one of a programmable ROM (PROM), an erasable PROM (EPROM), an electrically erasable PROM (EEPROM), a flash memory, a hard disk, a compact disc, a solid state drive (SSD), and an embedded multi-media card (eMMC).
[0058] Referring to FIG. 2A, a display including a first display (230) and / or a second display (240) can output visualized information to a user (e.g., screens of FIGS. 4, 6A to 6C, 8A to 8G, 10, 11A to 11B, 12A to 12B, and / or 14A to 14D). The number of displays included in the electronic device (101) is not limited to the embodiment of FIG. 2A. The flexible display (150) of FIG. 1A and / or FIG. 1B can correspond to the first display (230), and the cover display (152) of FIG. 1A can correspond to the second display (240). For example, the display may be controlled by a circuit within a processor (210) such as a DPU (214) and / or a circuit (or controller) such as a GPU (graphic processing unit) to output visualized information to the user.
[0059] In one embodiment, the display may include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs may include organic LEDs (OLEDs). The display may include electronic paper. The display may have an at least partially curved shape and / or a deformable shape, as described above with reference to FIGS. 1A and / or 1B . Hereinafter, an active area (or active region) and / or a displaying area (or displaying region) of the display may correspond to at least a portion of the display that includes one or more pixels that are enabled (or activated). The display may include a display panel (e.g., a first display panel (232) in the first display (230) and / or a second display panel (242) in the second display (240)) that includes one or more pixels. Through the display panel, a screen generated by the DPU (214) can be displayed.
[0060] In one embodiment, the display may include a sensor (e.g., a touch panel and / or a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger, a pen) that is in contact with or floating on the display panel. Referring to FIG. 2A, the first display (230) may include a first touch panel (234) for detecting an external object on the first display panel (232). Similarly, the second display (240) may include a second touch panel (244) for detecting an external object that is in contact with or floating on the second display panel (242). Based on the first touch panel (234), the LPU (212) of the processor (210) may detect an external object that is in contact with or floating on the first display panel (232). In response to detecting the external object, the electronic device (101) may execute a function related to a specific visual object corresponding to a location of the external object on the first display panel (232) among the visual objects displayed on the first display panel (232). Similarly, the LPU (212) may identify or receive a touch input related to a visual object displayed on the second display panel (242) based on information (e.g., sensor data) of the second touch panel (244).
[0061] According to one embodiment, the sensor (250) of the electronic device (101) may generate electrical information from non-electronic information related to the electronic device (101), which may be processed by the processor (210) (or the LPU (212)) and / or stored in the memory (220). For example, the sensor (250) may include a global positioning system (GPS) sensor for detecting a geographic location of the electronic device (101). In addition to the GPS method, the sensor (250) may generate information indicating the geographic location of the electronic device (101) based on a global navigation satellite system (GNSS), such as, for example, Galileo or Beidou (compass). The information may be stored in the memory (220), processed by the processor (210), and / or transmitted to another electronic device distinct from the electronic device (101) via a communication circuit. The sensor (250) is not limited to those described above, and may include an image sensor, an illuminance sensor, a proximity sensor, a grip sensor, a fingerprint sensor, and / or a time-of-flight (ToF) sensor for detecting electromagnetic waves including light.
[0062] In one embodiment, the processor (210) of the electronic device (101) may identify a pose, shape, and / or orientation of the electronic device (101) using the sensor (250). The processor (210) (e.g., the DPU (214)) may selectively activate at least one of the first display (230) and / or the second display (240) based on the pose and / or shape of the electronic device (101) identified using the sensor (250). The processor (210) (e.g., the DPU (214)) selectively activating at least one of the first display (230) and / or the second display (240) may include activating at least one of the pixels of the display.
[0063] In one embodiment, the sensor (250) configured to identify the attitude, shape, and / or orientation of the electronic device (101) may include a Hall sensor, a 6-degree of freedom (6 DoF) sensor, and / or an inertial measurement unit (IMU). The Hall sensor may include a magnet and a magnetic field sensor that measures a change in a magnetic field formed by the magnet. The magnet and the magnetic field sensor may be disposed in different parts (or portions) of the housing of the electronic device (101). Based on the change in the magnetic field measured by the magnetic field sensor, the Hall sensor may output sensor data representing a distance between the portions.
[0064] For example, in one embodiment where the electronic device (101) includes a deformable housing, the processor (210) of the electronic device (101) can use the magnets and the magnetic field sensors disposed in different parts of the housing (e.g., the first housing (111), the second housing (112), and / or the third housing (113) of FIGS. 1A and / or 1B) to identify a shape of the housing or a parameter associated with the shape (e.g., the first angle (141) and / or the second angle (142) of FIG. 1). For example, the Hall sensor can output sensor data indicative of the distance and / or the shape of the housing.
[0065] In one embodiment, the IMU may include an acceleration sensor, a gyro sensor, a geomagnetic sensor, or any combination thereof. The acceleration sensor may output an electrical signal representing gravitational acceleration and / or acceleration about each of a plurality of axes (e.g., x-axis, y-axis, and z-axis) that are perpendicular to each other. The gyro sensor may output an electrical signal representing an angular velocity (e.g., an angular velocity based on roll, pitch, and / or yaw) about each of the plurality of axes. An IMU capable of measuring motion in six directions (e.g., linear directions of the x-axis, y-axis, and z-axis and / or rotational directions of roll, pitch, and yaw) based on the acceleration sensor and / or the gyro sensor may be referred to as a six-axis sensor. The geomagnetic sensor can output an electrical signal representing the magnitude of a magnetic field formed in the electronic device (101) along each of a plurality of axes (e.g., the x-axis, the y-axis, and / or the z-axis). The processor (210) and / or the LPU (212) can repeatedly acquire data representing acceleration, angular velocity, and / or the magnitude of the magnetic field from the IMU based on a specified period (e.g., 1 millisecond). Using the Hall sensor and / or the IMU, the processor (210) can identify parameters related to the shape of the electronic device (101) (e.g., the first angle (141) and / or the second angle (142) of FIG. 1A and / or FIG. 1B). Based on the above parameters, the processor (210) can identify the current configuration of the electronic device (101) among designated configurations for distinguishing the configuration of the electronic device (101) (e.g., the unfolded state, the folded state, and / or the sub-folded state of FIG. 1A and / or FIG. 1B).For example, the processor (210) of the electronic device (101) can identify a first angle (141) between the first housing (111) and the second housing (112) of FIG. 1A and / or FIG. 1B and / or a second angle (142) between the second housing (112) and the third housing (113) using the sensor (250).
[0066] Although not shown, according to one embodiment, the electronic device (101) may include output means for outputting information in a form other than a visualized form. For example, the electronic device (101) may include a motor (or haptic actuator) for providing haptic feedback based on vibration. For example, the electronic device (101) may include one or more speakers (e.g., the first speaker (161), the second speaker (162), the third speaker (163), and the fourth speaker (164) of FIGS. 1A and / or 1B) for outputting audio signals.
[0067] According to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by the processor (210) (e.g., LPU (212) and / or DPU (214)) may be stored in the memory (220) of the electronic device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or a software application (hereinafter, an application). For example, the electronic device (101), the processor (210), and / or the LPU (212) may perform at least one of the operations of FIG. 3, FIG. 7, FIG. 9, FIG. 13, and / or FIG. 15 when a set of a plurality of instructions distributed in the form of an operating system, firmware, driver, and / or application is executed. Hereinafter, the fact that an application is installed in an electronic device (101) may mean that one or more instructions provided in the form of an application are stored in the memory (220) (e.g., non-volatile memory (224)) of the electronic device (101), and that the one or more applications are stored in a format executable by the processor (210) of the electronic device (101) (e.g., a file having an extension specified by the operating system of the electronic device (101).
[0068] In one embodiment, while displaying a screen on the first display (230) and / or the second display (240) using the DPU (214), the LPU (212) may identify a designated touch input using the first touch panel (234) and / or the second touch panel (244). In response to the designated touch input, information (e.g., information for displaying a screen) transmitted from the DPU (214) to one or more displays (e.g., the first display (230) and / or the second display (240)) may be stored in the memory (220) (e.g., the volatile memory (222) and / or the non-volatile memory (224)). The information stored in the memory (220) may be encoded based on a standard such as JPEG (Joint Photographic Experts Group). The processor (210) may store the information in the non-volatile memory (224) in the form of a file. By storing the above information, the processor (210) can perform a screen capture of the screen displayed on the activated first display (230) and / or second display (240) based on the posture and / or shape of the electronic device (101) detected by the sensor (250).
[0069] Referring to FIG. 2B, an exemplary connection relationship between the DPU (214) of the processor (210) and other circuits (e.g., non-volatile memory (224), volatile memory (222), first display (230) and / or second display (240)) is illustrated. The DPU (214) may be electrically connected to the volatile memory (222) via a bus interface (260). From the volatile memory (222), the DPU (214) may receive one or more graphical information to be included in a screen to be displayed on the display, such as a layer. The graphical information may be an image file (e.g., a file having a file extension of jpg and / or jpeg) and / or a video file (e.g., a file having a file extension of mpg) stored in the non-volatile memory (224). The DPU (214) may synthesize a plurality of layers received from the volatile memory (222) to generate a screen to be displayed on the display.
[0070] In one embodiment, the DPU (214) may perform white balance correction, screen compression, and / or sharpening, such as VDC (video electronics standards association (VESA) display compression), while compositing layers. A screen including the layers synthesized by the DPU (214) may be generated. The DPU (214) may output the generated screen via display stream interface (DSI) 0 (271) and / or DSI 1 (272). The DSI 0 (271) and / or DSI (272) may include one or more pins of the processor (210) of FIG. 2A. In one embodiment where the first display (230) is connected to the processor and / or DPU (214) via DSI 0 (271) and the second display (240) is connected to the processor and / or DPU (214) via DSI 1 (272), the screen can be output through at least one DSI among DSI 0 (271) and / or DSI 1 (272) determined (or selected) by the DPU (214) and / or the processor.
[0071] In one embodiment, the DPU (214) may be electrically connected to a USB-C display port (273) to support display expansion based on a wired communication protocol of USB (universal serial bus)-C. The USB-C display port (273) may extend to, or be electrically connected to, a port formed on a portion of a housing of the electronic device (e.g., a USB-C port). In one embodiment, upon detecting a third display connected via the USB-C display port (273), the DPU (214) may transmit information to the third display via the USB-C display port (273) to display a screen corresponding to the third display.
[0072] In one embodiment, the DPU (214) may include interfaces (e.g., DSI 0 (271), DSI 1 (272) and / or USB-C display port (273)) for providing a screen to a display connected to the DPU (214), as well as interfaces (e.g., write back (WB) ports (274, 275)) for storing the screen to a memory of an electronic device, such as a volatile memory (222). In one embodiment connected to two displays (e.g., a first display (230) and a second display (240)) via DSI 0 (271) and DSI 1 (272), the DPU (214) may be connected to WB ports (274, 275) for outputting screens provided to each of the displays.
[0073] In one embodiment, the WB port (274) may be configured to store a screen provided from the DPU (214) to the first display (230) via DSI 0 (271). The WB port (275) may be configured to store a screen provided from the DPU (214) to the second display (240) via DSI 1 (272). For example, a processor that receives a designated touch input for capturing a screen may obtain information corresponding to a screen provided to at least one display using at least one of the WB ports (274, 275). The obtained information may be transmitted to a memory (e.g., a volatile memory (222)) of the electronic device via an electrical connection between the WB ports (274, 275) and the bus interface (260).
[0074] The operation for capturing a screen, described with reference to FIGS. 3 to 15, may be performed based on information transmitted through an interface (e.g., WB ports (274, 275)) connecting the DPU (214) and the memory. The processor may edit the information stored in the volatile memory (222) through the interface, thereby generating an image file and / or a video file to be stored in the non-volatile memory (224). The image file and / or the video file may include the edited information.
[0075] Hereinafter, with reference to FIG. 3, an exemplary operation of a processor (210) (e.g., LPU (212) and / or DPU (214)) of an electronic device (101) for performing screen capture is described.
[0076] FIG. 3 illustrates a flowchart of an electronic device according to one embodiment. The electronic device (101) of FIG. 1A, FIG. 1B, and / or FIG. 2A and / or FIG. 2B, the processor (210) of FIG. 2A (e.g., LPU (212) and / or DPU (214)) may perform at least one of the operations described with reference to FIG. 3.
[0077] Referring to FIG. 3, in operation (310), a processor of an electronic device according to an embodiment may display a screen on one or more displays based on a state of the electronic device. The state of operation (310) may be distinguished by a posture and / or shape of the electronic device and / or a display of the electronic device (e.g., the flexible display (150) and / or the cover display (152) of FIG. 1A and / or FIG. 1B), as described with reference to FIG. 1A and / or FIG. 1B. The state of operation (310) may include, for example, an unfolded state, a sub-folded state (or an intermediate state), and / or a folded state. The state of operation (310) may be identified based on data from a sensor of the electronic device (e.g., the sensor (250) of FIG. 2A). One or more displays of the operation (310) may include the first display (230), the second display (240) of FIGS. 2A and / or 2B, the flexible display (150) of FIGS. 1A to 1B, and / or the cover display (152) of FIG. 1A.
[0078] Referring to FIG. 3, the processor may determine one or more displays and / or at least a portion of the displays on which a screen will be displayed based on the state of the operation (310). For example, the processor of the electronic device including the flexible display (150) and the cover display (152) of FIG. 1A may activate at least one of the flexible display (150) or the cover display (152) and deactivate the other based on the state of the operation (310). The processor may at least partially activate an activated display among the flexible display (150) or the cover display (152) based on the state of the operation (310). The embodiment is not limited thereto, and the processor may activate all of the flexible display (150) and the cover display (152) based on the state of the operation (31). While both the flexible display (150) and the cover display (152) are simultaneously activated, the processor can deactivate at least a portion of the flexible display (150) based on the state of the operation (310).
[0079] In one embodiment, activating the display by the processor may include transmitting a power signal exceeding a specified voltage to at least one of the circuitry of the display (e.g., the display panel and / or the touch panel) and / or pixels included in the display. Deactivating the display by the processor may include transmitting a power signal below the specified voltage to at least one of the circuitry and / or the pixels, or ceasing to transmit the power signal.
[0080] Referring to FIG. 3, in operation (320), a processor of an electronic device according to an embodiment may receive a touch input on one or more displays. The processor may receive the touch input of operation (320) on one or more displays on which a screen based on operation (310) is displayed. For example, a processor of an electronic device including a flexible display (150) and a cover display (152) of FIG. 1A may receive the touch input of operation (320) based on a touch panel of an activated display among the flexible display (150) and the cover display (152). In response to the touch input of operation (320), the processor may perform operation (330).
[0081] Referring to FIG. 3 , in operation (330), according to one embodiment, a processor of an electronic device may determine whether a designated touch input for capturing a screen has been received. The designated touch input of operation (330) may include a gesture based on the structure of the multi-foldable electronic device. The designated touch input of operation (330) may be detected based on a gesture that is different from a gesture mapped to a function of the electronic device (e.g., a function supported by a software application for displaying the screen of operation (310). In one embodiment, the designated touch input of operation (330) may include a drag gesture performed on a foldable area of a display (e.g., a flexible display (150) of FIGS. 1A and / or 1B), as described with reference to FIGS. 4 to 10 and / or FIGS. 11A and 11B . In one embodiment, the designated touch input of the operation (330) may include a drag gesture performed on the first display and / or the second display while displaying a screen using all of the first display and the second display spaced less than a designated distance from an edge of the first display, as described with reference to FIGS. 12A-12B and / or FIG. 13. In one embodiment, the designated touch input of the operation (330) may include a drag gesture performed on the display based on an external object within a designated shape and / or area range, such as a hand blade.
[0082] Referring to FIG. 3, if the touch input of operation (320) does not correspond to the specified touch input (330-No), the processor may perform operation (370). For example, if a touch input different from the specified touch input is received, the processor may perform operation (370). If the touch input of operation (320) corresponds to the specified touch input (330-Yes), the processor may perform operation (340).
[0083] Referring to FIG. 3, in operation (340), according to one embodiment, a processor of an electronic device may execute a first function for capturing a screen. The first function may include, based on the DPU (214) of FIG. 2A and / or FIG. 2B, an operation of storing information related to a screen to be displayed on one or more displays of operation (310) in a memory of the electronic device (e.g., memory (220) of FIG. 2A). Based on the execution of the first function, the processor may perform at least one of operations (350, 360) of FIG. 3.
[0084] Referring to FIG. 3, in operation (350), according to one embodiment, the processor of the electronic device may upload an image synthesized by the DPU for display on the screen to a volatile memory (e.g., the volatile memory 222 of FIG. 2A). Operation (350) may be referred to as a write back. The image uploaded to the volatile memory based on operation (350) may have the size of the display area (or active area) of one or more displays activated based on operation (310). For example, when all of the plurality of displays (e.g., the flexible display (150) and / or the cover display (152) of FIGS. 1A and / or 1B, the first display (230) and / or the second display (240) of FIGS. 2A and / or 2B) are activated, images corresponding to each of the plurality of displays may be uploaded from the DPU to the volatile memory based on operation (350).
[0085] The image uploaded based on the operation (340) may be modified based on a designated touch input received based on the operation (320). For example, the user may designate or select at least a portion of the screen displayed according to the operation (310) to be stored in the memory based on a path (or trajectory) of a drag gesture performed for the designated touch input. Based on the path, the processor may edit the image uploaded to the volatile memory. The processor may include an operation of obtaining or generating an image to be stored in the non-volatile memory (e.g., the non-volatile memory (224) of FIG. 2A) based on the editing of the image stored in the volatile memory. For example, the processor may crop the image and / or merge images uploaded to the volatile memory from multiple displays based on the designated touch input.
[0086] Referring to FIG. 3, in operation (360), according to one embodiment, a processor of an electronic device may store an image uploaded to volatile memory based on operation (350) in non-volatile memory (e.g., non-volatile memory (224) of FIG. 2A). If the processor changes one or more images uploaded to volatile memory based on a designated touch input, the processor may store the changed one or more images in non-volatile memory. The processor may store the image in non-volatile memory based on a format such as jpeg, tiff (tagged image file format), png (portable network graphics), bmp (bitmap), and / or gif (graphics interchange format).
[0087] Referring to FIG. 3, in operation (370), according to one embodiment, the processor of the electronic device may execute a second function different from the first function. The processor, which receives a touch input different from a designated touch input for capturing the screen, may execute the second function mapped to the touch input. The second function may be set by a software application that displays the screen of operation (310). The second function may be set by a system process and / or an operating system installed in the electronic device. The embodiment is not limited thereto, and if the touch input of operation (320) is not mapped to any function, the processor may not execute any function.
[0088] As described above, according to one embodiment, the processor of the electronic device may execute the first function of operation (340) based on a touch input performed on one or more displays on which the screen of operation (310) is displayed. The designated touch input for capturing the screen may be related to the structure of the multi-foldable housing of the electronic device. Hereinafter, exemplary operations of the electronic device related to the designated touch input set based on the structure of the multi-foldable housing will be described with reference to FIGS. 4 to 15.
[0089] FIG. 4 illustrates an operation of an electronic device (101) for receiving a designated touch input for capturing a screen displayed on a display (e.g., a flexible display (150)). The electronic device (101) of FIGS. 1A, 1B, and / or 2A and / or 2B may include the electronic device (101) of FIG. 4. The electronic device (101) and / or the processor (210) of FIGS. 2A and / or 2B may perform the operation of the electronic device (101) of FIG. 4. The operation of the electronic device (101) described with reference to FIG. 4 may be related to at least one of the operations of FIG. 3.
[0090] Referring to FIG. 4, exemplary states (401, 402) of an electronic device (101) included in a sub-fold state (e.g., the second state (192) of FIG. 1A and / or the fifth state (195) of FIG. 1B) between an unfolded state (e.g., the first state (191) of FIG. 1A and / or the fourth state (194) of FIG. 1B) and a folded state (e.g., the third state (193) of FIG. 1A and / or the sixth state (196) of FIG. 1B) are illustrated. The electronic device (101) can detect the posture and / or shape of the first housing (111), the second housing (112) and the third housing (113) using a sensor (e.g., the sensor (250) of FIG. 2A). The electronic device (101) can detect or calculate the first angle (141) and / or the second angle (142) based on the data of the sensor. Referring to FIG. 4, in each of the states (401, 402) in which the third housing (113) is rotated relative to the second housing (112), the electronic device (101) can detect, based on one or more sensors, the first hinge assembly (121) and / or the first angle (141) that is substantially unfolded by 180°, and can identify the second hinge assembly (122) and / or the second angle (142) that is bent by less than 180°.
[0091] In one embodiment, a designated touch input for capturing a screen displayed on the display may be identified based on a drag gesture performed on a portion of the display that is bendable by a multi-foldable housing. Referring to FIG. 4, a flexible display (150) that is bendable by a first hinge assembly (121) and / or a second hinge assembly (122) may include a first display area disposed on a first housing (111), a second display area disposed on a second housing (112), and a third display area disposed on a third housing (113). The flexible display (150) may be disposed on the first hinge assembly (121) and may include a first border area (or border region) (413) between the first display area and the second display area. The flexible display (150) is placed on the second hinge assembly (122) and may include a second boundary area (411) between the second display area and the third display area.
[0092] In one embodiment, a designated touch input for capturing a screen displayed on a display may be detected based on a drag gesture performed on a portion of a substantially curved display. In the exemplary state (401) of FIG. 4, the electronic device (101) may identify the designated touch input through the curved second boundary region (411) based on the rotation of the third housing (113) with respect to the second housing (112) among the first boundary region (413) and the second boundary region (411). The designated touch input received through the second boundary region (411) may include a drag gesture based on an external object that touches a point (p1) within the second boundary region (411) and moves along a path (412) to a point (p2) on the second boundary region (411). The path (412) of the drag gesture performed within the second boundary area (411) may be substantially the same as or parallel to the direction of the second folding axis (132).
[0093] In one embodiment, the electronic device (101) may identify a designated touch input in response to detecting a drag gesture based on a path (412) exceeding a specified distance within the second boundary area (411). For example, the electronic device (101) may identify a designated touch input based on an external object moving along a direction of the second folding axis (132) within the second boundary area (411) exceeding a specified distance. The specified distance may be less than or equal to the width and / or height of the second boundary area (411). For example, the specified distance may be a value to which a specified ratio is applied to the height of the second boundary area (411). The specified ratio may be set heuristically or may be set adaptively based on a model such as an artificial neural network. An electronic device (101) that detects an external object released on a point (p2) within the second boundary area (411) or separated from the flexible display (150) can initiate capturing of a screen displayed on the flexible display (150).
[0094] In one embodiment, in response to the specified touch input received through the second boundary area (411), the electronic device (101) may execute a first function to store an image (415) corresponding to at least a portion of a screen displayed on the flexible display (150). Referring to FIG. 4, the image (415) stored by the electronic device (101) may correspond to the entire screen displayed through the entire display area of the flexible display (150). For example, the width, height, size, aspect ratio, and / or extent of the image (415) may correspond to the width, height, size, aspect ratio, and / or extent of the entire display area of the flexible display (150).
[0095] Referring to FIG. 4, in an exemplary state (401) in which the first housing (111) is unfolded relative to the second housing (112) and the third housing (113) is rotated relative to the second housing (112), a first boundary region (413) between a first display region corresponding to the first housing (111) and a second display region corresponding to the second housing (112) may not be mapped to, or may not be disassociated or unlinked from, a designated touch input. For example, an electronic device (101) that detects a drag gesture based on an external object that comes into contact with a point (p3) within the first boundary region (413) and moves along a path (414) to a point (p4) within the first boundary region (413) may determine that a touch input different from the designated touch input has been detected. The electronic device (101) may, in response to the touch input, execute a second function different from the first function for capturing the screen. In response to the touch input received through the substantially flat first boundary area (413), the electronic device (101) may execute a function different from capturing the screen. For example, the electronic device (101) that detects a drag gesture performed within the first boundary area (413) along the path (414) may switch from state (401) to state (402). Within state (402), the electronic device (101) may display a user interface (UI) provided by a system process and / or an operating system, such as a notification panel.
[0096] As described above, according to one embodiment, the electronic device (101) can receive a designated touch input for capturing a screen through a portion of the flexible display (150) bent by the folding axis (the second boundary region (411) within the exemplary state (401) of FIG. 4). In one embodiment, the electronic device (101) can receive the designated touch input through a portion of the bent flexible display (150) based on a designated angular range. Hereinafter, an example of the designated angular range will be described with reference to FIG. 5.
[0097] FIG. 5 illustrates an example of an operation of an electronic device (101) to obtain information related to an angle (e.g., a first angle (141) and / or a second angle (142)) between housings (e.g., a first housing (111) to a third housing (113)). The electronic device (101) of FIGS. 1A, 1B, and / or 2A and / or 2B may include the electronic device (101) of FIG. 5. The electronic device (101) and / or the processor (210) of FIGS. 2A and / or 2B may perform the operation of the electronic device (101) described with reference to FIG. 5. The operation of the electronic device (101) described with reference to FIG. 5 may be related to at least one of the operations of FIG. 3.
[0098] Referring to FIG. 5, an exemplary appearance of an electronic device (101) in an unfolded state as viewed from the y-axis (or as viewed from the -y-axis) is illustrated. The electronic device (101) can identify a first angle (141) between a first housing (111) and a second housing (112) using one or more sensors (e.g., sensor (250) of FIG. 2A). The electronic device (101) can identify a second angle (142) between the second housing (112) and the third housing (113) using one or more sensors. The state of the electronic device (101) can be maintained in the unfolded state while both the first angle (141) and the second angle (142) maintain a designated angle (approximately 180°) corresponding to the unfolded state.
[0099] In one embodiment, the electronic device (101) can monitor changes in the state and / or shape of the electronic device (101) based on the first angle (141) and / or the second angle (142). For example, a user of the electronic device (101) can rotate the first housing (111) relative to the second housing (112), and / or rotate the third housing (113) relative to the second housing (112). When the user rotates the first housing (111) relative to the second housing (112), the electronic device (101) can identify the change in the first angle (141) using a sensor. Referring to FIG. 5, an angular range (511) can be formed based on a specified angle corresponding to an unfolded state. For example, the angular range (511) can be formed in a range of ± 30 º (e.g., 150 º to 210 º) based on 180 º.
[0100] Using a sensor to identify the rotation of the first housing (111) relative to the second housing (112), the electronic device (101) can detect or determine whether the first angle (141) changes beyond the angle range (511). The electronic device (101) that identifies the first angle (141) as having changed beyond the angle range (511) can switch from the unfolded state to another state.
[0101] Within the unfolded state, as the first housing (111) is rotated relative to the second housing (112), the first angle (141) may fall within one of angle ranges (512, 513) that are different from the angle range (511). The angle range (512) may be formed between 30° and 150°. The angle range (513) may be formed between 210° and 330°. While the first angle (141) falls within one of the angle ranges (512, 513), the processor may receive or identify a designated touch input through a first boundary region (e.g., the first boundary region (413) of FIG. 4) of the flexible display (150) disposed on the first folding axis (131). In response to a designated touch input received through the first boundary area, the electronic device (101) may perform a screen capture. For example, while the first angle (141) falls within one of the angle ranges (512, 513), the processor of the electronic device (101) may link, associate, and / or connect, or map, the first boundary area corresponding to the first angle (141) and the designated touch input.
[0102] In one embodiment, similar to the operation described above based on the first angle (141), the electronic device (101) can identify a change in the second angle (142). For example, when the user rotates the third housing (113) with respect to the second housing (112), the electronic device (101) can identify a change in the second angle (142) using a sensor. Referring to FIG. 5, the angular range compared to the second angle (142) may include at least one of an angular range (521) formed based on a designated angle corresponding to an unfolded state, and angular ranges (522, 523) different from the angular range (521). The angular range (521) may be formed in a range between 150º and 210º. The angular range (522) may be formed in a range between 30º and 150º. The angular range (523) can be formed in a range between 210º and 330º. While the second angle (142), which substantially corresponds to 180º based on the unfolded state, is changed from 180º to any one of the angular ranges (522, 523) for a period exceeding a designated period, the electronic device (101) can identify or receive a designated touch input through a boundary area (e.g., the second boundary area (411) of FIG. 4) on the second folding axis (132).
[0103] In response to a designated touch input received through the curved flexible display (150) at least one of the first hinge assembly (121) and / or the second hinge assembly (122), the electronic device (101) can store an image corresponding to a screen displayed on the flexible display (150). In one embodiment that displays a screen on the cover display (152), the electronic device (101) can store an image corresponding to the screen displayed on the cover display (152) in response to receiving a designated touch input through the flexible display (150) and / or receiving a designated touch input through the cover display (152). In one embodiment, the electronic device (101) can perform a screen capture of at least a portion of the flexible display (150) and / or the cover display (152) specified by the designated touch input.
[0104] The angular ranges (512, 513, 522, 523) compared with the first angle (141) and / or the second angle (142) to receive a designated touch input are not limited to the embodiment of FIG. 5. For example, the angular ranges (512, 522) compared with the first angle (141) and / or the second angle (142) of the flexible display (150) that bends less than 180° and the angular ranges (513, 523) compared with the second angle (142) and / or the second angle (142) of the flexible display (150) that bends more than 180° may have different sizes.
[0105] Hereinafter, with reference to FIGS. 6A to 6C, an exemplary operation of an electronic device (101) that receives a designated touch input through a boundary area determined by a first angle (141) and / or a second angle (142) is described.
[0106] FIGS. 6A, 6B, and 6C illustrate exemplary operations of an electronic device (101) for storing an image associated with a screen displayed on one or more displays (e.g., a flexible display (150) and / or a cover display (152)) based on a designated touch input. The electronic device (101) of FIGS. 1A, 1B, and / or 2A and / or 2B may include the electronic device (101) of FIGS. 6A to 6C. The electronic device (101) and / or the processor (210) of FIG. 2A may perform the operations of the electronic device (101) described with reference to FIGS. 6A to 6C. The operations of the electronic device (101) described with reference to FIGS. 6A to 6C may be related to at least one of the operations of FIG. 3.
[0107] Within the state (601) of FIG. 6A, the electronic device (101) may determine, using a sensor (e.g., sensor (250) of FIG. 2A), that the state of the electronic device (101) corresponds to an unfolded state. Within the state (601) corresponding to the unfolded state, the electronic device (101) may display a screen on the substantially unfolded flexible display (150) based on a software application executed by a processor (e.g., processor (210) of FIG. 2A) of the electronic device (101). Referring to FIG. 6A, an exemplary state (601) of the electronic device (101) displaying a screen including an image and / or a video is illustrated.
[0108] Within the exemplary state (601) of FIG. 6A, the electronic device (101) can display a screen based on the unfolded states of the first housing (111), the second housing (112), and the third housing (113). For example, within the state (601), the electronic device (101) can display a screen corresponding to the entire display area of the flexible display (150) in response to detecting and / or calculating the first angle (141) and / or the second angle (142) being substantially 180° (or the angle ranges (511, 521) of FIG. 5). While displaying the screen based on the unfolded state, the electronic device (101) can detect the rotation of the third housing (113) with respect to the second housing (112) using a sensor. From the state (601) corresponding to the unfolded state, the electronic device (101) that detects the rotation of the third housing (113) with respect to the second housing (112) can switch to the state (602).
[0109] Referring to FIG. 6A, within a state (602) in which a second angle (142) is identified within an angular range set to receive a designated touch input for capturing a screen (e.g., angular ranges (522, 523) of FIG. 5), the electronic device (101) may identify or receive the designated touch input through a boundary area (621) corresponding to the second angle (142). Referring to FIG. 6A, within the state (602), the electronic device (101) may identify the designated touch input based on a drag gesture of an external object moving from a point (p1) within the boundary area (621) to a point (p2) within the boundary area (621) along a path (622). Based on whether the external object moved to the point (p2) is spaced apart on the boundary area (621), the electronic device (101) can acquire or store an image (625) corresponding to the entire display area of the flexible display (150). For example, if the external object dragged to the point (p2) is spaced apart on the flexible display (150), the electronic device (101) can store an image (625) corresponding to the entire display area of the flexible display (150) (e.g., the entire display area extending from the first display area disposed on the first housing (111) to the third display area disposed on the third housing (113).
[0110] Within the exemplary state (602) of FIG. 6A, the electronic device (101) may display an acquired image (625) on the flexible display (150) in response to a designated touch input. For example, the electronic device (101) may display a thumbnail corresponding to the image (625) at least temporarily (e.g., for a designated period of several seconds). Based at least on the thumbnail, the electronic device (101) may receive an input to store it in a memory (e.g., the memory (220) and / or the non-volatile memory (224) of FIG. 2A). In response to the input, the electronic device (101) may stop displaying the thumbnail and store the image (625) in the memory.
[0111] In one embodiment, a portion of the flexible display (150) capable of receiving a designated touch input for capturing a screen is not limited to a boundary region formed by the first folding axis (131) and / or the second folding axis (132) (e.g., boundary region (621) of FIG. 6A). Referring to FIG. 6B, exemplary states (603, 604) of the first electronic device (101-1) including the entire flexible display (150) and the cover display (152) are illustrated. The first electronic device (101-1) of FIG. 6B may correspond to the first electronic device (101-1) of FIG. 1A.
[0112] Referring to FIG. 6B, exemplary states (603, 604) of the first electronic device (101-1) are illustrated, in which at least one of the first angle (141) or the second angle (142) corresponds to substantially 0°. States (603, 604) may be included in sub-fold states of the electronic device (101). A sub-fold state, such as state (603), in which the first angle (141) is reduced to substantially 0° and the second angle (142) corresponds to substantially 180°, may be referred to as a half-fold state. In the state (603) of FIG. 6b, since the first angle (141) substantially corresponds to 0°, the first display area of the flexible display (150) disposed on the first housing (111) and the second display area disposed on the second housing (112) may not be exposed to the outside and may be covered by the first housing (111) and the second housing (112). In the state (603) of FIG. 6b, only the third display area of the flexible display (150) disposed on the third housing (113) may be exposed to the outside.
[0113] In an exemplary state (603) of FIG. 6B, the first electronic device (101-1) may activate the flexible display (150). In the state (603), the first electronic device (101-1) may activate a third display area of the flexible display (150) disposed on the third housing (113). The first electronic device (101-1) may display a screen (e.g., screen A) on at least a portion of the activated flexible display (150). In the state (603), screen A displayed on the third display area of the flexible display (150) may be provided from a software application executed by the first electronic device (101-1). The width, height, aspect ratio, size, and / or area of screen A may correspond to the width, height, aspect ratio, size, and / or area of the third display area exposed to the outside in the state (603).
[0114] Referring to FIG. 6B, in state (603), the first electronic device (101-1) can receive or identify a designated touch input through a boundary area (631) corresponding to the second folding axis (132) adjacent to the third display area of the flexible display (150) exposed to the outside. Independently of whether the flexible display (150) is bent on the boundary area (631), the first electronic device (101-1) can identify the designated touch input. For example, the first electronic device (101-1) that identifies a drag gesture based on an external object that has moved more than a designated distance along the direction of the boundary area (631) on the boundary area (631) can store an image (635) corresponding to the A screen displayed on the third display area.
[0115] Referring to FIG. 6B, in a state (604) where the first angle (141) between the first housing (111) and the second housing (112) corresponds to substantially 180°, and the second angle (142) between the second housing (112) and the third housing (113) is reduced to substantially 0°, the first electronic device (101-1) can display the B screen on the first display area of the flexible display (150) disposed on the first housing (111). In the state (604), the first electronic device (101-1) can display the C screen on the cover display (152). The B screen and / or the C screen may be displayed based on the execution of one or more software applications executed by the first electronic device (101-1). For example, the B screen and the C screen may be displayed by a single software application. For example, the B screen and the C screen may be displayed by each of a plurality of software applications that are substantially executed simultaneously based on multitasking.
[0116] As in the state (604) of FIG. 6b, a state (604) in which the first angle (141) substantially corresponds to (or is maintained at) 180° and the second angle (142) is reduced to substantially 0° may be referred to as an inverted half-fold state. Within the inverted half-fold state, the first electronic device (101-1) may provide a UI based on both the flexible display (150) and the cover display (152). In the exemplary state (604) of FIG. 6b, since the first angle (141) substantially corresponds to 180°, the first display area disposed on the first housing (111) may be exposed to the outside. Within state (604), since the second angle (142) substantially corresponds to 0°, the second display area disposed on the second housing (112) and / or the third display area disposed on the third housing (113) may be covered by the second housing (112) and / or the third housing (113). Within state (604) of FIG. 6B, the first display area of the flexible display (150) on which screen B is displayed and the cover display (152) on which screen C is displayed may face substantially the same direction. For example, the directions of the normal (normal direction or normal vector) of the first display area and the normal of the cover display (152) may substantially coincide or be parallel within state (604).
[0117] Referring to FIG. 6B, in an exemplary state (604) of displaying screen B through the first display area of the flexible display (150) and displaying screen C on the cover display (152), the first electronic device (101-1) can receive or identify a designated touch input through a boundary area between the first display area and the cover display (152). The boundary area between the first display area and the cover display (152) can include a boundary area (641) that includes one edge (e.g., a right edge) of the first display area adjacent to the cover display (152) in the state (604). The boundary area between the first display area and the cover display (152) can include a boundary area (642) that includes one edge (e.g., a left edge) of the cover display (152) adjacent to the first display area in the state (604).
[0118] Within the exemplary state (604) of FIG. 6B, the first electronic device (101-1) can identify a designated touch input including a drag gesture in response to a drag gesture of an external object moving from point (p1) to point (p2) along a path (643) within a boundary area (641) and then moving away from the point (p2). Similarly, the first electronic device (101-1) can identify a designated touch input based on a drag gesture of an external object moving from point (p3) to point (p4) along a path (644) within a boundary area (642). In response to the above-described touch input, the first electronic device (101-1) may store an image (645) including all of the B screen and the C screen displayed through the flexible display (150) (e.g., the first display area) and the cover display (152) within the state (604). Referring to FIG. 6B, within the image (645), the B screen may be connected to one edge of the C screen.
[0119] Within the state (604) of FIG. 6B, the first electronic device (101-1) that has identified the designated touch input may generate or synthesize an image (645) to be stored in a memory (e.g., memory (220) of FIG. 2A) by merging a first image for the B screen displayed on the first display area and a second image for the C screen displayed on the second display area. The first image and the second image may be uploaded to the volatile memory of the first electronic device (101-1) based on the operation (350) of FIG. 3. The first electronic device (101-1) may generate the image (645) by combining or joining the first image and the second image based on the positional relationship between the first display area and the cover display (152) within the state (604). For example, the B screen and the C screen may be concatenated based on the positional relationship within the image (645). While displaying screens (e.g., screen B and / or screen C) on physically separated active areas (e.g., active areas of the first display area and / or cover display (152)), such as state (604) of FIG. 6b, the first electronic device (101-1) may store the screens based on a single image (645) in response to a designated touch input.
[0120] Referring to FIG. 6C, an exemplary state (605) of a bent electronic device (101) is illustrated based on the rotation of the first housing (111) relative to the second housing (112). Within the state (605) identifying a first angle (141) between the first housing (111) and the second housing (112) within the angular range (512) of FIG. 5 and a second angle (142) between the second housing (112) and the third housing (113) within the angular range (521) of FIG. 5, the flexible display (150) may include two flat portions (651, 652). Within the exemplary state (605) of executing multiple software applications based on multitasking, the electronic device (101) may map each of the multiple software applications to each of the portions (651, 652).
[0121] Referring to FIG. 6C, an exemplary state (605) of an electronic device (101) is illustrated, in which a first screen provided from a first software application for playing a video is displayed through a portion (651), and a second screen provided from a second software application for taking notes is displayed through a portion (652). The portion (651) may correspond to a first display area on a first housing (111). The portion (652) may include a second display area on a second housing (112) and a third display area on a third housing (113). A boundary area (653) between the portions (651, 652) may correspond to a boundary area between the first display area and the second display area (e.g., the first boundary area (413) of FIG. 4).
[0122] Within the exemplary state (605) of FIG. 6c, the direction (or orientation) of the first screen and the second screen displayed through each of the portions (651, 652) may be related to the direction of the electronic device (101) (e.g., the direction of the electronic device (101) detected by the sensor (250) of FIG. 2a). The electronic device (101) may detect or calculate the direction of the electronic device (101) using a sensor for identifying gravitational acceleration. Within the state (605) of FIG. 6c, when the rear surface of the electronic device (101), which is opposite to the front surface of the second housing (112) and the third housing (113) in which the flexible display (150) is disposed, is in contact with the ground, the electronic device (101) may detect the direction of the gravitational acceleration applied in the direction of the -z axis. Based on the direction of the above gravitational acceleration, the electronic device (101) can detect the posture of the electronic device (101) erected based on the rear surface of the second housing (112) and the third housing (113).
[0123] Within state (605) of FIG. 6C, according to one embodiment, the electronic device (101) may receive a designated touch input for capturing a screen through the boundary area (653). For example, the electronic device (101) may detect or identify the designated touch input based on an external object being dragged substantially parallel to the direction in which the boundary area (653) extends (e.g., the direction of the y-axis). In response to the designated touch input, the electronic device (101) may store an image corresponding to at least a portion of the flexible display (150).
[0124] In one embodiment, at least a portion of the flexible display (150) captured based on a specified touch input may be changed according to a setting value. The setting value may be adjusted by a specified software application (e.g., a software application included in an operating system, such as a setting application). Referring to FIG. 6C, based on the setting value, the electronic device (101) may store at least one of a first image (654) corresponding to the entire display area of the flexible display (150), a second image (655) corresponding to a portion (651), or a third image (656) corresponding to a portion (652). In a state (605) in which the electronic device (101) displays a first screen and a second screen on each of the portions (651, 652) based on multitasking, the second image (655) may correspond to the first screen, and the third image (656) may correspond to the second screen.
[0125] As described above, an electronic device (101) including a flexible display (150) having a relatively large size and / or area can receive a designated touch input for storing an image corresponding to the entire display area (or a portion of the display area) of the flexible display (150) through a portion (e.g., a border area (653)) of the flexible display (150).
[0126] Hereinafter, with reference to FIG. 7, an exemplary operation of the electronic device (101) described with reference to FIGS. 6a to 6c is described.
[0127] FIG. 7 illustrates a flowchart of an electronic device according to one embodiment. The electronic device (101) of FIG. 1A, FIG. 1B, and / or FIG. 2A and / or FIG. 2B, and the processor (210) of FIG. 2A (e.g., LPU (212) and / or DPU (214)) may perform at least one of the operations described with reference to FIG. 7. At least one of the operations of FIG. 7 may be related to an operation described with reference to FIG. 3 (e.g., operation (330)).
[0128] Referring to FIG. 7, in operation (710), a processor of an electronic device according to one embodiment may receive a touch input on an area of a display (e.g., the flexible display (150) and / or the cover display (152) of FIG. 1A and / or FIG. 1B) adjacent to a folding axis. Operation (710) may be performed while a screen is displayed through the display. The processor may perform operation (710) of FIG. 7 similarly to operation (320) of FIG. 3. The folding axis of operation (710) may include the first folding axis (131) and / or the second folding axis (132) of FIG. 1A and / or FIG. 1B. The area of the action (710) may include a boundary area between display areas arranged on housings connected to each other by a folding axis (e.g., the first boundary area (413), the second boundary area (411) of FIG. 4, the boundary area (621) of FIG. 6A, the boundary areas (631, 641, 642) of FIG. 6B, and / or the boundary area (653) of FIG. 6C). The touch input of the action (710) may be detected or received based on sensor data of a touch panel included in the display (e.g., the first touch panel (234) and / or the second touch panel (244) of FIG. 2A).
[0129] Referring to FIG. 7, in operation (720), a processor of an electronic device according to an embodiment may determine whether a touch input received based on operation (710) includes a drag gesture based on a direction in which a folding axis extends. For example, the processor may determine, using sensor data output from a touch panel, whether the touch input of operation (710) includes a drag gesture of operation (720). The processor may identify, using the sensor data, a drag gesture based on an external object moving in a direction parallel to or similar to the direction of the folding axis within the area of operation (710). For example, if an angular difference between a direction of a drag gesture included in a touch input received based on operation (710) and a direction of the folding axis is less than a specified angle, the processor may determine that the touch input includes a drag gesture of operation (720). Referring to FIG. 7, if the touch input received based on operation (710) includes a drag gesture based on the direction of the folding axis (720 - Yes), the processor may perform operation (730). If the touch input does not include the drag gesture (720 - No), the processor may perform operation (740).
[0130] Referring to FIG. 7, in operation (730), according to one embodiment, a processor of an electronic device may determine a received touch input as a designated touch input for capturing a screen. The processor performing operation (730) may execute a function corresponding to the designated touch input (e.g., a function for capturing a screen). For example, based on operation (730), the processor may perform at least one of operations (340, 350, 360) of FIG. 3. For example, image (415) of FIG. 4, image (625) of FIG. 6A, images (635, 645) of FIG. 6B, and first image (654), second image (655), and third image (656) of FIG. 6C may be generated by a processor that detects (or identifies) a designated touch input based on operation (730).
[0131] Referring to FIG. 7, in operation (740), according to one embodiment, a processor of an electronic device may determine a received touch input as a different touch input from a designated touch input. The processor performing operation (740) may not execute a function for capturing a screen, or may execute a function different from the function. For example, the processor may perform operation (370) of FIG. 3. The embodiment is not limited thereto, and if a touch input that is not mapped to any function is received, the processor may not execute any function.
[0132] Hereinafter, with reference to FIGS. 8A to 8G, exemplary operations of an electronic device for selectively capturing a portion of a screen displayed through a display based on a designated touch input of an operation (730) are described.
[0133] FIGS. 8A, 8B, 8C, 8D, 8E, 8F, and 8G illustrate exemplary states of an electronic device (101) receiving a specified touch input. The electronic device (101) of FIGS. 1A, 1B, and / or 2A and / or 2B may include the electronic device (101) of FIGS. 8A to 8G. The electronic device (101) and / or the processor (210) of FIG. 2A may perform the operations of the electronic device (101) described with reference to FIGS. 8A to 8G. The operations of the electronic device (101) described with reference to FIGS. 8A to 8G may be related to at least one of the operations of FIGS. 3 and / or 7.
[0134] Referring to FIG. 8A, exemplary states (801, 802) of an electronic device (101) including a flexible display (150) bent about a second folding axis (132) are illustrated. Within the states (801, 802), the electronic device (101) can display a screen based on the entire display area of the flexible display (150). Referring to FIG. 8A, exemplary states (801, 802) of the electronic device (101) displaying a screen including a video and / or an image are illustrated, but the embodiment is not limited thereto.
[0135] Referring to FIG. 8A, the electronic device (101) can receive or identify a designated touch input for capturing at least a portion of a screen displayed on the flexible display (150) through the boundary area (811) of the folded flexible display (150). Within the bent state (801) of the boundary area (811) on the second folding axis (132), the electronic device (101) can identify a drag gesture that is initiated at a point (p1) within the boundary area (811) and moves along a path (812) to a point (p2). The direction of the path (812) (or the direction of the drag gesture) can be parallel to or similar to the direction of the second folding axis (132) along which the boundary area (811) extends.
[0136] In state (801) of FIG. 8A, based on whether an external object moved along a path (812) moves away from the flexible display (150), the electronic device (101) can execute a function for screen capture. For example, if an external object moved to point (p2) moves away from point (p2), the electronic device (101) can initiate the function. For example, an image stored in the electronic device (101) based on the function can correspond to a screen displayed on the flexible display (150) when the external object moves away from the flexible display (150).
[0137] In one embodiment, when an external object moved along the direction of the second folding axis (132) comes into contact with a point (p2) within the boundary area (811) for a specified period of time, the electronic device (101) may switch to a state (802) for selecting a portion of the screen to be saved by the specified touch input. Within the state (801), based on whether the external object moved along the path (812) comes into contact with the point (p2) for a specified period of time, the electronic device (101) may switch to the state (802). Within the state (802), the electronic device (101) may display a visual object (821) guiding selection of one of the portions of the flexible display (150) separated by the boundary area (811) at one of both ends of the boundary area (811) adjacent to the point (p2) where the external object came into contact. Referring to FIG. 8A, the electronic device (101) may display a visual object (821) that guides selection of one of the portions of the flexible display (150) that are separated by the boundary area (811) where the external object is in contact, on an end point (e.g., an end point on the lower side of the flexible display (150)) adjacent to point (p2) among two end points of the boundary area (811). The visual object (821) may be referred to as a visual affordance, an affordance UI, and / or an affordance UX (user experience).
[0138] Referring to FIG. 8A, an exemplary form of a visual object (821) is illustrated that guides selection of any one of the flat portions of the flexible display (150) separated by a boundary area (811) (e.g., a portion including a first display area and a second display area and another portion corresponding to a third display area). The visual object (821) may have a semicircle shape centered on the lower end of the boundary area (811) adjacent to a point (p2). The visual object (821) may include shapes (e.g., triangles and / or arrows) pointing to each of the portions. The shapes may be arranged to guide that a screen capture is performed for any one of the portions based on an additional drag of an external object that has come into contact with the point (p2). Within state (802), in response to an external object being released within a visual object (821), the electronic device (101) can perform a screen capture of the entire display area of the flexible display (150). Within state (802), the electronic device (101) that has identified an external object being dragged outside a visual object (821) can perform a screen capture of any one of the portions of the flexible display (150) from which the external object is released.
[0139] Referring to FIG. 8A, in a state (802) of displaying a visual object (821), the electronic device (101) can identify an external object being moved (or dragged) from a point (p2) to any one of the flat portions of the flexible display (150). For example, the electronic device (101) that has identified an external object being dragged from a point (p2) to a point (p3) can store an image (825) corresponding to a portion of the flexible display (150) including the point (p3) (e.g., a portion of the flexible display (150) disposed on the first housing (111) and the second housing (112)) at the timing when the external object is moved away from the flexible display (150). Similarly, as the electronic device (101) moves from point (p2) to point (p4), it can identify an external object that has moved to a portion of the flexible display (150) disposed on the third housing (113), and store an image (826) corresponding to the third display area of the flexible display (150) disposed on the third housing (113).
[0140] An electronic device (101) receiving a designated touch input for capturing a portion of a flexible display (150) based on a visual object (821) can crop an image uploaded to a volatile memory (e.g., a volatile memory (222) of FIG. 2A) based on the operation (350) of FIG. 3 to generate an image (e.g., images (825, 826)) to be stored in a non-volatile memory (e.g., a non-volatile memory (224) of FIG. 2A).
[0141] For example, the DPU (e.g., DPU (214) of FIG. 2A and / or FIG. 2B) of the electronic device (101) may store an image corresponding to the entire display area of the flexible display (150) in volatile memory in response to the release of an external object dragged from point (p2) to point (p3). The DPU may segment or crop a portion corresponding to a portion of the flexible display (150) including point (p3) (e.g., a portion of the flexible display (150) including a first display area and a second display area) from the image stored in the volatile memory to obtain an image (825). The DPU may store the obtained image (825) in non-volatile memory.
[0142] Similarly, in response to the release of an external object dragged from point (p2) to point (p4), the electronic device (101) can upload an image corresponding to the entire display area of the flexible display (150) to volatile memory. The electronic device (101) can segment or crop a portion of the flexible display (150) including point (p4) (e.g., a portion of the flexible display (150) corresponding to the third display area) within the uploaded image to obtain an image (826). The obtained image (826) can be stored in non-volatile memory.
[0143] Within the exemplary state (802) of FIG. 8A, the electronic device (101) may, in response to an external object being dragged from a visual object (821), generate an image (e.g., one of the images (825, 826)) corresponding to a portion of the flexible display (150) that includes a point at which the external object is released (e.g., one of the points (p3, p4)). The portion of the flexible display (150) may correspond to one of the flat portions of the flexible display (150) that are delimited by a boundary area (811) corresponding to the visual object (821).
[0144] Referring to FIG. 8A, the designated touch input for capturing the screen may include a first drag gesture (e.g., the drag gesture of operation (720) of FIG. 7) based on an external object being dragged along the direction of the second folding axis (132) on a boundary area (811), a holding gesture based on an external object being held for a specified period of time at a terminal point (or end point) of the drag gesture, and a second drag gesture based on the external object being dragged from the terminal point to any one of the flat portions of the flexible display (150) separated by the boundary area (811). The electronic device (101) that has detected the holding gesture may switch from state (801) to state (802) of FIG. 8A. The screen capture based on the designated touch input may be performed in response to the termination of the second drag gesture.
[0145] Referring to FIG. 8A, an exemplary operation of an electronic device (101) for generating and / or storing an image for at least a portion of a screen provided by a software application is described, but the embodiment is not limited thereto. Referring to FIG. 8B, different states (803, 804) of an electronic device (101) displaying multiple screens (e.g., screen A, screen B, and screen C) based on multitasking are illustrated. The multiple screens may be displayed by each of multiple software applications executed by a processor of the electronic device (101) (e.g., processor 210 of FIG. 2A). A user may set the positions of the multiple screens based on flat portions of the flexible display (150).
[0146] Referring to FIG. 8B, exemplary states (803, 804) of an electronic device (101) including a flexible display (150) bent along a first folding axis (131) and a second folding axis (132) are illustrated. Within states (803, 804), the electronic device (101) can detect a designated touch input for capturing at least a portion of a screen displayed on the flexible display (150) through a first boundary area (831) and a second boundary area (832) corresponding to the first folding axis (131) and the second folding axis (132), respectively. For example, in a state (803), when an external object that has come into contact with a point (p1) within a first boundary region (831) moves to a point (p2) along a path (833) substantially parallel to the first folding axis (131) and then is separated from the flexible display (150), the electronic device (101) can identify a designated touch input based on the external object. In response to the designated touch input, the electronic device (101) can store an image (835) corresponding to the entire display area of the flexible display (150). For example, the image (835) can include all of screens A, B, and C displayed on the flexible display (150). Similarly, in response to a drag gesture performed within the boundary region (832) and along the direction of the second folding axis (132), the electronic device (101) can receive a designated touch input for screen capture of the entire display area of the flexible display (150).
[0147] In state (803) of FIG. 8B, if an external object that has moved along a path (833) to point (p2) remains in contact with point (p2) for a specified period of time (e.g., a few seconds), the electronic device (101) may switch to state (804) to receive an additional drag gesture that selects at least a portion of the flexible display (150) for screen capture. The electronic device (101) switched to state (804) may display a visual object (841) in a boundary area (831) adjacent to or including point (p2). A visual object (841) having a semicircle shape centered at one end of the boundary area (831) is illustrated as an example, but the embodiment is not limited thereto. Similar to the visual object (821) of FIG. 8A, the electronic device (101) may display a visual object (841) including shapes directed toward each of the flat portions of the flexible display (150) separated by a boundary area (831) corresponding to the point (p2).
[0148] Referring to FIG. 8B, in a state (804) of displaying a visual object (841), the electronic device (101) can identify an external object moving from a point (p2) to one of the flat portions of the flexible display (150). Among the three flat portions of the flexible display (150) defined by the first folding axis (131) and the second folding axis (132), the electronic device (101) can generate or store an image corresponding to at least one portion that overlaps a path (e.g., paths (842, 843, 844)) of the external object moving from the point (p2).
[0149] For example, when an external object that has moved from point (p2) to point (p3) on the first display area along the path (842) moves away from the flexible display (150), the electronic device (101) can store the first image (845) corresponding to the first display area. In the example, the electronic device (101) can obtain or store the first image (845) including the A screen among the A screen displayed on the first display area, the B screen displayed on the second display area, and the C screen displayed on the third display area.
[0150] For example, when an external object that has moved from point (p2) to point (p4) on the second display area along the path (843) is separated from the flexible display (150), the electronic device (101) can generate a second image (846) corresponding to the second display area. In the above example, the electronic device (101) can store the second image (846) corresponding to screen B displayed on the second display area among a plurality of screens displayed on the flexible display (150).
[0151] For example, an electronic device (101) that identifies an external object that has moved from a second display area to a point (p5) on a third display area along a path (944) from a point (p2) may generate a third image (847) corresponding to the second display area and the third display area in response to the external object being released at the point (p5). In the example, the electronic device (101) may obtain a third image (847) that includes screens B and C displayed on the second display area and the third display area, respectively, among the screens displayed on the flexible display (150).
[0152] Referring to FIG. 8B, a designated touch input for capturing at least a portion of the flexible display (150) may include a first drag gesture based on an external object moving along a path (833), a holding gesture based on the external object being in contact for a specified period of time from an end point of the first drag gesture, and a second drag gesture based on the external object moving from the end point along one of the paths (842, 843, 844). The electronic device (101) may determine, based on the path of the second drag gesture, at least one portion corresponding to an image to be stored in the electronic device (101) among the flat portions of the flexible display (150) defined by the first folding axis (131) and the second folding axis (132). The electronic device (101) may generate an image corresponding to at least one portion swept by the second drag gesture among the portions.
[0153] Referring to FIG. 8B, an embodiment of receiving a designated touch input through a first boundary area (831) formed on a first folding axis (131) is described, but the embodiment is not limited thereto. Referring to FIG. 8C, within a state (803), the electronic device (101) can identify a designated touch input based on a second boundary area (832) corresponding to a second folding axis (132). For example, within the state (803) of FIG. 8C, the electronic device (101) can detect or identify a drag gesture based on an external object moving from a point (p6) within the second boundary area (832) to a point (p7) along a path (834). When the external object that performed the above drag gesture is released from the point (p7), the electronic device (101) can store an image (835) including all of the screens (e.g., screen A, screen B, and screen C) displayed on the flexible display (150).
[0154] In the state (803) of FIG. 8c, when an external object that has moved along the path (834) to the point (p7) comes into contact with the point (p7) for a specified period of time, the electronic device (101) may display a visual object (851). The visual object (851) may be displayed on a portion of the flexible display (150) adjacent to the point (p7). The visual object (851) may be superimposed on at least one of a plurality of screens displayed on the flexible display (150). The visual object (851) may have a specified transparency (opacity or transparency) to minimize information obscured by the visual object (851). The visual object (851) of FIG. 8c may correspond to the visual object (821) of FIG. 8a and / or the visual object (841) of FIG. 8b.
[0155] Referring to FIG. 8C, in a state (805) in which a visual object (851) is displayed, the electronic device (101) may generate or store an image corresponding to at least one of three flat portions of the flexible display (150) based on a path (e.g., paths (852, 853, 854)) of an external object being dragged from a point (p7). The embodiment is not limited thereto, and the electronic device (101) that identifies an external object spaced apart from the point (p7) on the visual object (851) may generate or store an image (835) corresponding to the entire screens displayed on the flexible display (150).
[0156] In state (805) of FIG. 8c, the electronic device (101) that detects an external object that has moved to a point (p8) on a first display area of a flexible display (150) disposed on a first housing (111) along a path (852) can store a first image (855) that includes screens (e.g., screen A and screen B) disposed on the first display area overlapping the path (852) and the second display area of the flexible display (150) disposed on the second housing (112). The electronic device (101) can acquire the first image (855) based on the release of the external object at the point (p8).
[0157] In state (805) of FIG. 8c, the electronic device (101) that detects an external object that has moved from point (p7) to point (p9) along path (853) may, in response to the release of the external object, generate a second image (856) corresponding to a second display area including path (853). The second image (856) may include screen B displayed on the second display area among screens A to C displayed on the first to third display areas, respectively.
[0158] In state (805) of FIG. 8c, the electronic device (101) that has identified an external object that has moved from point (p7) to point (p10) along path (854) can acquire a third image (857) corresponding to a third display area overlapping path (854) when the external object is separated from point (p10). For example, the electronic device (101) can store the third image (857) including the C screen displayed on the third display area.
[0159] Within the state (805) of FIG. 8c, the electronic device (101) that has identified the specified touch input can crop an image corresponding to the entire display area of the flexible display (150) to generate an image (e.g., a first image (855), a second image (856), and / or a third image (857)) to be stored in the memory. The width, height, and / or size of the image divided by the cropping can be related to the path of the drag gesture included in the specified touch input (e.g., paths (852, 853, 854) of FIG. 8c). For example, the electronic device (101) can determine at least a portion of the flexible display (150) to be stored in the image based on the path of the drag gesture detected within the state (805) that displays the visual object (851), or after the timing of displaying the visual object (851).
[0160] Referring to FIGS. 8A to 8C , exemplary operations of an electronic device (101) for generating and storing an image corresponding to at least a portion of a flexible display (150) have been described, but the embodiment is not limited thereto. As described above with reference to FIGS. 1A and / or 2A and / or 2B , in one embodiment of an electronic device (101) including a plurality of displays (e.g., the flexible display (150), the cover display (152) of FIG. 1A , the first display (230) and the second display (240) of FIGS. 2A and / or 2B ), the electronic device (101) can simultaneously activate the plurality of displays and display a plurality of screens through the plurality of displays.
[0161] Referring to FIG. 8D , exemplary states (806, 807) of a first electronic device (101-1) including a flexible display (150) and a cover display (152) are illustrated. States (806, 807) of the first electronic device (101-1) of FIG. 8D may correspond to the inverted half-fold state described with reference to FIG. 6B . In state (806), the first electronic device (101-1) may display a B screen on a first display area of the flexible display (150) disposed on a first housing (111). In state (806), the first electronic device (101-1) may display a C screen on the cover display (152). The B screen and the C screen may be provided by one or more software applications executed by the first electronic device (101-1).
[0162] Within the state (806) of FIG. 8d, the first electronic device (101-1) may receive a designated touch input for capturing a screen displayed on the flexible display (150) and / or the cover display (152) through a boundary area (861) between the first display area where the B screen is displayed and another display area of the flexible display (150) covered by the third housing (113) and / or a boundary area (862) of the cover display (152) adjacent to the first display area. For example, the designated touch input may include a drag gesture that is initiated at a point (p1) within the boundary area (861) and stops at a point (p2) within the boundary area (861) along a path (863). In response to a designated touch input including the drag gesture, the first electronic device (101-1) may generate or store an image (865) including all of the B screen displayed on the first display area and the C screen displayed on the cover display (152). Within the image (865), the B screen and the C screen may be arranged based on the positional relationship between the first display area and the cover display (152).
[0163] In state (806) of FIG. 8d, if an external object that has moved along the path (863) to point (p2) comes into contact with point (p2) for a specified period of time, the first electronic device (101-1) may switch to state (807). In state (807), the first electronic device (101-1) may display a visual object (871) on a portion of the first display area adjacent to point (p2) and may display a visual object (872) on a portion of the cover display (152) adjacent to point (p2). The visual objects (871, 872) displayed on each of the flexible display (150) and the cover display (152) may have the shape of quadrants divided from a semicircle. The embodiment is not limited thereto. The visual objects (871, 872) of FIG. 8d may correspond to the visual object (821) of FIG. 8a, the visual object (841) of FIG. 8b, and / or the visual object (851) of FIG. 8c.
[0164] Referring to FIG. 8D , within the state (807) of displaying visual objects (871, 872), the first electronic device (101-1) can additionally identify a drag gesture based at least on an external object that has come into contact with a point (p2). Based on the additionally identified drag gesture, the first electronic device (101-1) can identify a designated touch input for selectively capturing one of the flexible display (150) and the cover display (152). For example, the first electronic device (101-1) that detects an external object moving from the point (p2) to the point (p3) along the path (873) can acquire or store a first image (875) corresponding to a B screen of the first display area that overlaps the path (873).
[0165] For example, when an external object that has come into contact with a point (p2) comes into contact with a point (p4) on a cover display (152), the first electronic device (101-1) can detect a designated touch input based on the external object coming into contact with the point (p4) based on at least one of a time difference between a first timing at which the external object is separated from the point (p2) and a second timing at which the external object comes into contact with the point (p4) and / or a distance between the points (p2, p4).
[0166] For example, if the time difference is less than the specified time difference and the distance is less than the specified distance, the first electronic device (101-1) can identify a designated touch input based on a drag gesture of an external object that has come into contact with the point (p4). Within the above example, if the time interval difference is greater than or equal to the specified time difference or the distance is greater than or equal to the specified distance, the first electronic device (101-1) can identify the end of the designated touch input. In response to the end of the designated touch input, the first electronic device (101-1) can perform a screen capture of the entire screen B displayed on the first display area of the flexible display (150) and the screen C displayed on the cover display (152), as shown in the image (865). Within the state (807), the first electronic device (101-1) that identifies the end of the designated touch input can at least temporarily stop displaying the visual objects (871, 872).
[0167] In state (807) of FIG. 8d, the first electronic device (101-1), which identifies an external object that has come into contact with the point (p4) within a specified time difference after the external object has been separated from the point (p2), may identify a designated touch input related to the cover display (152) based on a drag gesture of the external object that has come into contact with the point (p4). For example, based on the external object being dragged from the point (p4) to the point (p5) along the path (874), the first electronic device (101-1) may identify a designated touch input for capturing the screen C among the screen B displayed on the first display area and the screen C displayed on the cover display (152). In the above example, when the external object is separated from the point (p5), the first electronic device (101-1) may generate or store an image (876) corresponding to the screen C displayed on the cover display (152).
[0168] Within the states (806, 807) corresponding to the inverted half-fold state described with reference to FIG. 8D, the DPU (e.g., the DPU (214) of FIG. 2A and / or FIG. 2B) of the first electronic device (101-1) may, in response to a designated touch input, upload all of the first image corresponding to the B screen displayed on the first display area and the second image corresponding to the C screen displayed on the cover display (152) to a volatile memory (e.g., the volatile memory (222) of FIG. 2A and / or FIG. 2B). The first electronic device (101-1) may generate an image (865) by combining the first image and the second image uploaded to the volatile memory. The first electronic device (101-1) may generate one of the images (875, 876) by selecting one of the first image and the second image and discarding the other. The first electronic device (101-1) may combine or select the first image and the second image uploaded to the volatile memory based on the drag gesture described with reference to FIG. 8d.
[0169] Referring to FIG. 8E, within a state (806), the first electronic device (101-1) can identify a designated touch input based on a drag gesture performed within a boundary area (862). Within the exemplary state (806) of FIG. 8E, an exemplary drag gesture is illustrated moving from a point (p6) within the boundary area (862) along a path (864) to a point (p7) within the boundary area (862), although the embodiment is not limited thereto. Upon identifying a drag gesture along the path (864), the first electronic device (101-1) can, in response to a release of an external object that performed the drag gesture, perform a screen capture of at least one of the B screen and / or the C screen being displayed within the state (806). For example, in response to an external object being released on point (p7), the first electronic device (101-1) may generate or store an image (865) that includes all of screen B and screen C.
[0170] For example, a first electronic device (101-1) that identifies an external object that has been in contact with a point (p7) for a specified period of time may switch from state (806) to state (808). Within state (808), the first electronic device (101-1) may display a visual object (882) on a portion of the cover display (152) adjacent to point (p7). Within state (808), the first electronic device (101-1) may display a visual object (881) on a portion of the first display area adjacent to point (p7). The visual objects (881, 882) may correspond to the visual objects (871, 872) of FIG. 8D. Within a state (808) of displaying visual objects (881, 882), the first electronic device (101-1) can receive a drag gesture to selectively perform a screen capture of either the first display area or the cover display (152).
[0171] In the exemplary state (808) of FIG. 8E, when an external object that has contacted a point (p7) moves to a point (p8) along a path (883), the first electronic device (101-1) may store an image (886) corresponding to the C screen displayed on the cover display (152) where the external object has contacted. In the state (808), after identifying the release of the external object that has contacted the point (p7), the first electronic device (101-1) that detects an external object that has contacted a point (p9) less than a specified distance from the point (p7) within a specified time difference may receive a drag gesture for selectively performing a screen capture for the first display area based on the path (884) of the external object that has contacted the point (p9). For example, in response to a drag gesture that starts at point (p9) and stops at point (p10) on the first display area along the path (884), the first electronic device (101-1) may acquire or store an image (885) corresponding to the B screen displayed on the first display area.
[0172] Referring to FIGS. 8F and / or 8G , an exemplary state (809) of a second electronic device (101-2) including a flexible display (150) that can be folded at an angle exceeding 180º is illustrated. The state (809) of the second electronic device (101-2) of FIGS. 8F to 8G may be included in the sub-fold state described with reference to FIG. 1B . Within the state (809), the second electronic device (101-2) may detect a first angle (141) included in an angular range (513) and a second angle (142) included in an angular range (522) using a sensor (e.g., sensor (250) of FIG. 2A ). Within the folded state (809) by the first folding axis (131) and the second folding axis (132), the flexible display (150) may include three flat portions.
[0173] Referring to FIGS. 8F to 8G , an exemplary state (809) is illustrated in which the second electronic device (101-2) displays screen A, screen B, and screen C provided from a plurality of software applications executed by the second electronic device (101-2) on the first display area on the first housing (111), the second display area on the second housing (112), and the third display area on the third housing (113), respectively. The embodiment is not limited thereto, and the second electronic device (101-2) may display a single screen provided from a single software application on the entire flexible display (150) within a sub-fold state such as state (809). Within the exemplary state (809) of displaying screens A to C, a first border area (891) may be formed between screen A displayed on the first display area and screen B displayed on the second display area. Within the state (809), a second border area (892) can be formed between the B screen displayed on the second display area and the C screen displayed on the third display area.
[0174] Referring to FIG. 8F, within the state (809), the second electronic device (101-2) may receive a designated touch input through the first boundary area (891) formed on the first folding axis (131). For example, the designated touch input may include a drag gesture based on an external object moving from a point (p1) within the first boundary area (891) between the first display area and the second display area to a point (p2) within the first boundary area (891). The second electronic device (101-2) that detects the drag gesture may store an image (893) including all of screens A to C displayed on the flexible display (150) in response to the release of the external object on the point (p2). The second electronic device (101-2) that detects the drag gesture may switch to a state for selectively capturing at least one of the flat portions of the flexible display (150) in response to a hold gesture based on an external object that has been in contact with the point (p2) for a period of time exceeding a specified period. The second electronic device (101-2) that detects the hold gesture may display a visual object for guiding selection of the flat portions of the flexible display (150), such as the visual object (821) of FIG. 8A.
[0175] Referring to FIG. 8F, based on an additional drag gesture initiated at point (p2), the second electronic device (101-2) can obtain an image (e.g., images (894, 895, 896)) corresponding to a portion of the flexible display (150). For example, in response to a drag gesture from point (p2) to point (p3) on the first display area, the second electronic device (101-2) can store an image (894) corresponding to screen A on the first display area. For example, the second electronic device (101-2) that detects a drag gesture from point (p2) to point (p4) on the second display area can store an image (895) corresponding to screen B on the second display area. For example, a second electronic device (101-2) that detects a drag gesture based on an external object moving from point (p2) across a second display area to point (p5) on a third display area may store an image (896) that includes all of screen B on the second display area and screen C on the third display area.
[0176] Referring to FIG. 8G, within the state (809), the second electronic device (101-2) can detect or receive a designated touch input through a second boundary area (892) formed on the second folding axis (132). Referring to FIG. 8G, the designated touch input may include a drag gesture that is initiated at a point (p6) within the second boundary area (892) and stopped at a point (p7). When the second electronic device (101-2) detects the drag gesture and the release (or termination) of the drag gesture at the point (p7), the second electronic device (101-2) can store an image (893) corresponding to the entire display area of the flexible display (150). Instead of releasing the drag gesture, the second electronic device (101-2) that detects an external object in contact with the point (p7) for a period exceeding a specified period of time may, in response to an additional drag gesture performed by the external object, obtain or store an image (e.g., images (895, 897, 898)) corresponding to a portion of the flexible display (150).
[0177] Referring to FIG. 8G, a second electronic device (101-2) that detects a drag gesture from a point (p7) across a second display area toward a point (p8) on a first display area may acquire or store an image (897) that includes all of the second display area in which the drag gesture was identified and the A screen and the B screen displayed on the first display area. For example, a second electronic device (101-2) that detects a drag gesture from a point (p7) toward a point (p9) on a second display area may store an image (895) that includes the B screen corresponding to the second display area. For example, in response to a drag gesture from a point (p7) toward a point (p10) on a third display area, the second electronic device (101-2) may store an image (898) that includes the C screen displayed on the third display area. As with images (895, 897, 898), generating and / or storing an image corresponding to a portion of the display area of the flexible display (150) may be performed based on segmentation and / or cropping of an image for the entire display area of the flexible display (150) uploaded to a volatile memory. The segmentation and / or cropping of the image uploaded to the volatile memory may be performed based on a DPU of the second electronic device (101-2) (e.g., DPU (214) of FIG. 2A and / or FIG. 2B).
[0178] As described above, according to one embodiment, the electronic device (101) can selectively capture a portion of the entire display area of the relatively wide flexible display (150) (e.g., at least one of the flat portions of the flexible display (150) defined by the first folding axis (131) and / or the second folding axis (132)) in response to a designated touch input. The designated touch input can include a first drag gesture within a boundary area formed on the folding axis, a hold gesture for an end point of the first drag gesture, and a second drag gesture initiated at the end point of the first drag gesture after the hold gesture. The electronic device (101), which sequentially detects the first drag gesture, the hold gesture, and the second drag gesture in a time domain, can perform a screen capture in response to the end of the second drag gesture. Hereinafter, with reference to FIG. 9, an exemplary operation of the electronic device (101) described with reference to FIGS. 8a to 8g is described.
[0179] FIG. 9 illustrates a flowchart of an electronic device according to one embodiment. The electronic device (101) of FIG. 1A, FIG. 1B, and / or FIG. 2A and / or FIG. 2B, the processor (210) of FIG. 2A (e.g., LPU (212) and / or DPU (214)) may perform at least one of the operations described with reference to FIG. 9. At least one of the operations of FIG. 9 may be related to an operation (e.g., operation (330)) described with reference to FIG. 3 and / or FIG. 7. For example, operations (950, 960, 970, 980) of FIG. 9 may be performed based on operation (720) of FIG. 7.
[0180] Referring to FIG. 9 , within operation (950), a processor of an electronic device according to an embodiment may identify or determine whether a touch input received based on operation (710) is held on an area (e.g., a boundary area) where the touch input was received for a specified period of time. If the touch input received based on operation (710) includes a drag gesture of operation (720) (720-Yes), the processor may perform operation (950). The specified period of time of operation (950) may be several seconds long, such as, but not limited to, 0.5 to 1.5 seconds. Based on operation (950), the processor may detect a hold gesture performed after the drag gesture of operation (720) and performed at an end point of the drag gesture. If the touch input is maintained for more than a specified period of time on the area of the action (710) (950-Yes), the processor may perform action (960). If the touch input is maintained for less than a specified period of time on the area of the action (710) (950-No) (e.g., if the touch input ends within the specified period of time), the processor may perform action (980).
[0181] Referring to FIG. 9, in operation (960), according to one embodiment, a processor of an electronic device may display a visual object to guide selection of a portion of one or more displays. The visual object of operation (960) may include the visual object (821) of FIG. 8A, the visual object (841) of FIG. 8B, the visual object (851) of FIG. 8C, the visual objects (871, 872) of FIG. 8D, and / or the visual objects (881, 882) of FIG. 8E. The location at which the visual object of operation (960) is displayed may include a point at which a touch input is maintained, or may be adjacent to the point.
[0182] Referring to FIG. 9, in operation (970), according to one embodiment, a processor of an electronic device may store an image corresponding to a portion of a screen displayed through one or more displays based on a path of a touch input. The path of operation (970) may include paths (822, 823, 842, 843, 844, 852, 853, 853, 854, 871, 872, 883, 884) described with reference to FIGS. 8A to 8G. Based on the operation (970), the processor may generate an image to be stored in a memory (e.g., memory (220) and / or non-volatile memory (224) of FIGS. 2A and / or 2B) using one or more images for one or more screens provided by one or more displays (e.g., flexible display (150) and / or cover display (152) of FIGS. 1A and 1B, first display (230) and / or second display (240) of FIGS. 2A and / or 2B). Referring to FIGS. 8A to 8G, images (825, 826, 845, 846, 847, 856, 857, 875, 876, 885, 886, 894, 895, 896, 897, 898) can be stored in the electronic device based on the operation (970).
[0183] Referring to FIG. 9 , in operation (980), according to one embodiment, a processor of an electronic device may store an image corresponding to the entire screen displayed through one or more displays. For example, if an external object performing a touch input is separated from the display within a period of time less than a specified period of time, the processor may perform operation (980). Referring to FIGS. 8A to 8G , images (835, 865, 893) may be stored in the electronic device based on operation (980).
[0184] As described above, according to one embodiment, the processor of the electronic device can identify a designated touch input initiated at a point within an area formed on a display (e.g., border areas 811, 831, 832, 861, 862, 891, 892 as illustrated in FIGS. 8A to 8G). Based on a path of a drag gesture included in the designated touch input, the processor can perform a screen capture of one or more entire screens displayed on one or more displays. Based on the path, the processor can perform a screen capture of at least one of the flat portions of the flexible display. Based on the path, the processor can perform a screen capture to generate a single image from the plurality of displays.
[0185] The embodiment is not limited to one embodiment of an electronic device (101) receiving a designated touch input within a sub-folded state, as described above with reference to FIGS. 8A to 8G. Hereinafter, exemplary operations of an electronic device (101) receiving a designated touch input in an unfolded state are described with reference to FIGS. 10, 11A, and / or 11B.
[0186] FIG. 10 illustrates an operation of an electronic device (101) based on a touch input on an area of a display (e.g., a flexible display (150)) formed on a folding axis (e.g., a first folding axis (131) and / or a second folding axis (132)). The electronic device (101) of FIGS. 1A, 1B, and / or 2A and / or 2B may include the electronic device (101) of FIG. 10. The electronic device (101) and / or the processor (210) of FIG. 2A may perform the operation of the electronic device (101) described with reference to FIG. 10. The operation of the electronic device (101) described with reference to FIG. 10 may be related to at least one of the operations of FIGS. 3, 7, and / or 9.
[0187] Referring to FIG. 10, an exemplary state (1001) of an electronic device (101) corresponding to an unfolded state is illustrated. Although the exemplary state (1001) of the electronic device (101) is illustrated to display multiple screens (e.g., screen A, screen B, and screen C) based on multitasking on the flexible display (150), the embodiment is not limited thereto. For example, the electronic device (101) may display a screen provided by a single software application and occupying the entire display area of the flexible display (150) on the flexible display (150). Within the state (1001), the electronic device (101) may display the multiple screens on each of a first display area (1011) on a first housing (111), a second display area (1012) on a second housing (112), and a third display area (1013) on a third housing (113).
[0188] According to one embodiment, the electronic device (101) may detect a touch input based on an external object that comes into contact with a boundary area (e.g., the first boundary area (1021) and / or the second boundary area (1022)) between two display areas among the first display area (1011), the second display area (1012), and the third display area (1013) while displaying a screen on the flexible display (150). For example, in response to a touch input based on an external object that moves along a direction in which the boundary area extends, the electronic device (101) may store an image corresponding to at least a portion of the screen displayed on the flexible display (150).
[0189] In an exemplary state (1001) of FIG. 10, the electronic device (101) can detect a touch input based on an external object moving from a point (p1) within a first boundary area (1021) toward a point (p2) along the direction of the first folding axis (131). When the external object is separated from the point (p2) within the first boundary area (1021), the electronic device (101) can store an image corresponding to the entire display area of the flexible display (150) (e.g., the first display area (1011) to the third display area (1013)). When an external object moved to a point (p2) moves to a point (p3) on a first display area (1011) that is different from the first boundary area (1021) and is then separated from the flexible display (150), the electronic device (101) can store an image including the A screen displayed on the first display area (1011). When an external object moved to a point (p2) moves to a point (p4) on a second display area (1012) that is different from the first boundary area (1021) and is then separated from the flexible display (150), the electronic device (101) can store an image including the B screen displayed on the second display area (1012). When an external object moved to a point (p2) within the first boundary area (1021) moves across the second display area (1012) to a point (p5) on the third display area (1013) and is then separated from the flexible display (150), the electronic device (101) can store images including the B screen and the C screen displayed on each of the second display area (1012) and the third display area (1013).
[0190] In an exemplary state (1001) of FIG. 10, the electronic device (101) can detect an external object moving from a point (p6) in the second boundary area (1022) to a point (p7) along the direction of the second folding axis (132). When the external object is separated from the point (p7) in the second boundary area (1022), the electronic device (101) can store an image corresponding to the entire display area of the flexible display (150) (e.g., the first display area (1011) to the third display area (1013)). When the external object that has moved to the point (p7) moves to a point (p8) on a third display area (1013) that is different from the second boundary area (1022) and is then separated from the flexible display (150), the electronic device (101) can store an image including the C screen displayed on the third display area (1013). When an external object moved to a point (p7) moves to a point (p9) on the second display area (1012) next to the second boundary area (1022) and is then separated from the flexible display (150), the electronic device (101) can store an image including a B screen corresponding to the second display area (1012). When an external object moved to a point (p7) within the second boundary area (1022) moves across the second display area (1012) to a point (p10) on the first display area (1011) and is then separated from the flexible display (150), the electronic device (101) can store an image including an A screen and a B screen displayed on each of the first display area (1011) and the second display area (1012).
[0191] As described above, the electronic device (101) can receive a designated touch input without rotation based on the first hinge assembly (121) and / or the second hinge assembly (122) in the unfolded state. By setting a portion of the flexible display (150) (e.g., the first boundary area (1021) and / or the second boundary area (1022)) as an area for receiving the designated touch input, the electronic device (101) can receive the designated touch input without the rotation. The embodiment is not limited to a structure of the electronic device (101) including at least two folding axes (e.g., the first folding axis (131) and / or the second folding axis (132)). For example, an electronic device (101) including more than two folding axes or including one folding axis may also receive a designated touch input through a portion of the display that is adjacent to the folding axis and formed along the direction of the folding axis. Hereinafter, with reference to FIGS. 11A and 11B, an embodiment of an electronic device (101) including one folding axis is described.
[0192] FIGS. 11A and 11B illustrate the operation of an electronic device based on a touch input on an area of a display (e.g., a flexible display (150)) formed on a folding axis (e.g., a first folding axis (131)). Referring to FIGS. 11A and 11B , a third electronic device (101-3) and a fourth electronic device (101-4) including a single first folding axis (131) are illustrated. The third electronic device (101-3) and / or the fourth electronic device (101-4) may correspond to an example of the electronic device (101) described with reference to FIGS. 1A, 1B, and / or 2A and / or 2B. The operation of the third electronic device (101-3) and / or the fourth electronic device (101-4) described with reference to FIG. 11a and / or FIG. 11b may be performed by the processor (210) of FIG. 2a.
[0193] Referring to FIG. 11a, an exemplary exterior of a third electronic device (101-3) is illustrated, which includes a flexible display (150) having a width in the x-axis direction greater than a height in the y-axis direction and a foldable housing that can be folded by a first folding axis (131) extending along the y-axis direction. Referring to FIG. 3b, an exemplary exterior of a fourth electronic device (101-4) is illustrated, which includes a flexible display (150) having a height in the y-axis direction greater than a width in the x-axis direction and a foldable housing that can be folded by a first folding axis (131) extending along the x-axis direction.
[0194] Referring to FIG. 11a and / or FIG. 11b, the foldable housing of the third electronic device (101-3) and / or the fourth electronic device (101-4) may include a first housing (111), a second housing (112), and a first hinge assembly (121) between the first housing (111) and the second housing (112). Referring to FIG. 11a, the flexible display (150) of the third electronic device (101-3) may include a first display area (1111) on the first housing (111), a second display area (1112) on the second housing (112), and a boundary area (1113) between the first display area (1111) and the second display area (1112). When the first housing (111) and / or the second housing (112) are rotated based on the first hinge assembly (121), the boundary area (1113) of the flexible display (150) can be wheeled (or folded). When the first housing (111) and / or the second housing (112) are rotated, the boundary area (1113) of the flexible display (150) can be extended or contracted.
[0195] Referring to FIG. 11A, an exemplary state (1101) of a third electronic device (101-3) corresponding to an unfolded state is illustrated. The third electronic device (101-3) can receive a designated touch input for at least a portion of a display area of the flexible display (150) through a boundary area (1113). For example, the designated touch input can include a drag gesture that moves from a point (p1) within the boundary area (1113) to a point (p2) within the boundary area (1113) along the direction of the first folding axis (131). The third electronic device (101-3) that detects the drag gesture can store an image corresponding to the entire display area of the flexible display (150) when an external object that performed the drag gesture is separated from the point (p2). The third electronic device (101-3) that detects the drag gesture may store an image corresponding to the first display area (1111) (e.g., an image corresponding to screen A) when receiving an additional drag gesture from point (p2) to point (p3) on the first display area (1111). The third electronic device (101-3) that detects the drag gesture may store an image corresponding to the second display area (1112) (e.g., an image corresponding to screen B) when detecting an additional drag gesture from point (p2) to point (p4) on the second display area (1112).
[0196] In one embodiment of FIG. 11A, the third electronic device (101-3) may receive a designated touch input based on whether the first angle (141) is included in a designated angular range for receiving a designated touch input. For example, if the first angle (141) is included in any one of the angular ranges (512, 513) of FIG. 5, the third electronic device (101-3) may receive the designated touch input through the boundary area (1113). The embodiment is not limited thereto, and the third electronic device (101-3) may detect the designated touch input through the boundary area (1113) independently of the first angle (141).
[0197] Referring to FIG. 11B, an exemplary state (1102) of the fourth electronic device (101-4) corresponding to an unfolded state is illustrated. The flexible display (150) of the fourth electronic device (101-4) may include a first display area (1121) on the first housing (111), a second display area (1122) on the second housing (112), and a boundary area (1123) between the first display area (1121) and the second display area (1122). When the first housing (111) and / or the second housing (112) of the fourth electronic device (101-4) rotates, the boundary area (1123) of the flexible display (150) may fold.
[0198] Referring to FIG. 11B, the fourth electronic device (101-4) may acquire or store an image corresponding to at least a portion of the display area of the flexible display (150) based on a designated touch input initiated within the boundary area (1123). For example, within the boundary area, based on a drag gesture performed along the direction of the first folding axis (131), the fourth electronic device (101-4) may store an image corresponding to the entire display area of the flexible display (150). When an external object moved within the boundary area (1123) along the direction of the first folding axis (131) is dragged to the first display area (1121), the fourth electronic device (101-4) may store an image corresponding to the first display area (1121) (e.g., an image corresponding to screen A). When an external object moved within the boundary area (1123) along the direction of the first folding axis (131) is dragged to the second display area (1122), the fourth electronic device (101-4) can store an image corresponding to the second display area (1122) (e.g., an image corresponding to screen B).
[0199] In one embodiment of FIG. 11B, the fourth electronic device (101-4) may receive a designated touch input based on a first angle (141) between the first housing (111) and the second housing (112). For example, the fourth electronic device (101-4) may receive the designated touch input while the first angle (141) is within an angular range corresponding to a sub-folded state (e.g., angular ranges (512, 513) of FIG. 5). The embodiment is not limited thereto, and the fourth electronic device (101-4) may receive the designated touch input without rotation of the first housing (111) and / or the second housing (112) relative to the first hinge assembly (121) within a state (1102) corresponding to an unfolded state.
[0200] Hereinafter, with reference to FIG. 12a and / or FIG. 12b, exemplary operations of an electronic device (101) receiving a designated touch input related to the shape of a multi-foldable housing are described.
[0201] FIGS. 12A and 12B illustrate exemplary operations of an electronic device (101) that stores an image corresponding to at least one of screens displayed on a plurality of displays (e.g., a flexible display (150) and / or a cover display (152)). The electronic device (101) of FIGS. 1A, 1B, and / or 2A and / or 2B may include the electronic device (101) of FIGS. 12A and / or 12B. The electronic device (101) and / or the processor (210) of FIGS. 2A and / or 2B may perform the operations of the electronic device (101) described with reference to FIGS. 12A and / or 12B. The operations of the electronic device (101) described with reference to FIGS. 12A and / or 12B may be related to at least one of the operations of FIGS. 3, 7, and / or 9.
[0202] Referring to FIGS. 12A and 12B , exemplary states (1201, 1202) of an electronic device (101) included in a sub-fold state are illustrated. Within states (1201, 1202), an edge of a third housing (113) may come into contact with a first display area of a flexible display (150) disposed on a first housing (111). For example, by rotation of the first housing (111) to the third housing (113), an edge of the third housing (113) may come into contact with the first display area. When the edge of the third housing (113) comes into contact with the first display area, the first display area may be divided into two parts by the edge of the third housing (113). For example, the first display area may include a first portion covered by the second housing (112) and / or the third housing (113) and a second portion different from the first portion. A sub-fold state of the electronic device (101) in which the first display area is partially covered by an edge of the third housing (113), such as states (1201, 1202), may be referred to as a prism state (or prism slide state).
[0203] According to one embodiment, the electronic device (101) can identify a prism state, such as states (1201, 1202) of FIG. 12A and / or FIG. 12B, using one or more sensors (e.g., sensor (250) of FIG. 2A). Within the prism state, the electronic device (101) can display one or more screens on a cover display (152) disposed on a third housing (113) and a second portion of the flexible display (150) that is not covered by the third housing (113). Referring to FIG. 12A, an exemplary state (1201) of the electronic device (101) is illustrated displaying screen A on the cover display (152) and screen C on the second portion. Screen A and / or screen C may be provided from one or more software applications executed by the electronic device (101).
[0204] According to one embodiment, the electronic device (101) can detect a designated touch input based on an external object contacting a portion of the first display area that is in contact with the edge of the third housing (113). In the exemplary state (1201) of FIG. 12A, a boundary area (1211) corresponding to a portion of the first display area that is in contact with the edge of the third housing (113) is illustrated. The boundary area (1211) can be formed along a direction parallel to the edge of the third housing (113). The boundary area (1211) can be formed between a first portion and a second portion of the first display area that are covered by the third housing (113).
[0205] Referring to FIG. 12A, a designated touch input for capturing a screen (e.g., screen A and / or screen C) displayed on a flexible display (150) and / or a cover display (152) may include a drag gesture based on an external object along a direction of a boundary area formed on a flexible display (150) and / or a cover display (152). For example, the electronic device (101) may receive the drag gesture through a boundary area (1211) formed on a first display area, and / or a boundary area (1212) on a cover display (152) that includes an edge adjacent to the first display area. Referring to FIG. 12A, based on an external object that has moved from a point (p1) within a boundary area (1211) formed on a first display area to a point (p2) within the boundary area (1211) along a direction of the boundary area (1211), the electronic device (101) can store an image including at least one of screen A or screen C. The electronic device (101) can select at least one of screen A or screen C based on the release of the external object performing the drag gesture and / or the location at which the external object is released.
[0206] In the exemplary state (1201) of FIG. 12A, the electronic device (101) that detects an external object separated on a point (p2) within a boundary area (1211) can generate an image (1215) including both screen A and screen C. The electronic device (101) that detects an external object moving from point (p2) to point (p3) on the first display area of the flexible display (150) can store an image (1216) corresponding to screen C among screens A and C. The electronic device (101) that identifies an external object moving from point (p2) to point (p4) on the cover display (152) can store an image (1217) corresponding to screen A displayed on the cover display (152) in response to an external object moving from point (p4) to point (p5) on the cover display (152). Similar to the operation of the electronic device (101) described with reference to FIG. 6b, FIG. 8d and / or FIG. 8e, the electronic device (101) may determine whether to perform a screen capture based on the external object moving from point (p4) to point (p5) based on the distance between points (p2, p4) and / or the time difference between a first timing at which the external object is separated from point (p2) and a second timing at which the external object comes into contact with point (p4).
[0207] Referring to FIG. 12B, an exemplary state (1202) is illustrated for displaying screens on a cover display (152) and a second portion of a first display area using a software application for playing a video. Within state (1202), the electronic device (101) may display a first screen for playing a video on the cover display (152) and may display a second screen including one or more visual objects for controlling playing of the video (e.g., a play button, a fast forward button, and / or a rewind button) on a second portion of the first display area.
[0208] Referring to FIG. 12B, the electronic device (101) can receive a designated touch input through a boundary area (1221) of the first display area adjacent to the edge of the third housing (113) that is in contact with the first display area and a boundary area (1222) formed within the cover display (152) disposed on the third housing (113). For example, the designated touch input can include a drag gesture based on an external object moving from a point (p1) within the boundary area (1222) to a point (p2) within the boundary area (1222) along the direction in which the boundary area (1222) extends. In response to the release of the external object at the point (p2), the electronic device (101) can store an image (1225) corresponding to the entire second portion of the cover display (152) and the first display area.
[0209] A designated touch input received within the exemplary state (1202) of FIG. 12B may include a drag gesture for selecting either the cover display (152) or a second portion of the first display area. For example, when an external object contacting a point (p2) within the boundary area (1222) is dragged to a point (p3) on the cover display (152) that is distinct from the boundary area (1222), the electronic device (101) may acquire or store an image (1226) corresponding to the first screen displayed on the cover display (152). For example, the electronic device (101) may acquire the image (1226) in response to the release of the external object dragged to the point (p3). For example, if an external object that has come into contact with a point (p2) is moved to a point (p4) on the first display area within a specified period of time and then dragged to a point (p5) that is greater than a specified distance from the point (p4), the electronic device (101) may generate or store an image (1227) corresponding to a second screen displayed on a second portion of the first display area. The electronic device (101) may acquire the image (1227) in response to the release of the external object dragged to the point (p5).
[0210] As described above, the electronic device (101) including the multi-foldable housing can operate within a prism state that activates both the cover display (152) and the flexible display (150). Within the prism state, including the exemplary states (1201, 1202) illustrated in FIGS. 12A and / or 12B , the electronic device (101) can receive a designated touch input through the boundary regions (1211, 1212, 1221, 1222) formed on the flexible display (150) and the cover display (152), respectively. Based on the designated touch input, the electronic device (101) can perform a screen capture of at least one of the flexible display (150) and / or the cover display (152). In one embodiment including a button on a side of the multi-foldable housing (e.g., a side of the third housing (113) in contact with the first display area within states (1201, 1202) of FIGS. 12A and / or 12B), receiving an input for screen capture via the button may be restricted. In one embodiment, the electronic device (101) may perform screen capture independently of the button based on a designated touch input described with reference to FIGS. 12A and / or 12B.
[0211] Hereinafter, with reference to FIG. 13, an exemplary flowchart corresponding to the operation of the electronic device (101) described with reference to FIG. 12a and / or FIG. 12b is described.
[0212] FIG. 13 illustrates a flowchart of an electronic device according to one embodiment. The electronic device (101) of FIG. 1A, FIG. 1B, and / or FIG. 2A and / or FIG. 2B, the processor (210) of FIG. 2A (e.g., LPU (212) and / or DPU (214)) may perform at least one of the operations described with reference to FIG. 13. At least one of the operations of FIG. 13 may be related to an operation (e.g., operation (330)) described with reference to FIG. 3, FIG. 7, and / or FIG. 9.
[0213] Referring to FIG. 13, in operation (1310), a processor of an electronic device according to an embodiment may receive a touch input on border areas of adjacent displays while displaying a screen on the displays based on a prism state of a multi-foldable housing. The prism state of operation (1310) may include states (1201, 1202) described with reference to FIGS. 12A and 12B. The border areas of operation (1310) may include border areas (1211, 1212) of FIG. 12A, and / or border areas (1221, 1222) of FIG. 12B. A processor that receives or detects a touch input on the border areas may perform operation (1320).
[0214] Referring to FIG. 13, in operation (1320), a processor of an electronic device according to an embodiment may determine or identify whether a received touch input includes a drag gesture based on a direction in which a boundary region extends. If a drag gesture is identified that is parallel to or similar to the direction in which the boundary region extends (1320—Yes), the processor may perform operation (1330). If a drag gesture that is different from the direction in which the boundary region extends (1320—No), the processor may perform operation (1340). The drag gesture described with reference to FIGS. 12A and 12B may correspond to the drag gesture of operation (1320).
[0215] Referring to FIG. 13, in operation (1330), according to one embodiment, a processor of an electronic device may determine a received touch input as a designated touch input for capturing a screen. The processor may perform operation (1330) of FIG. 13 similarly to operation (730) of FIG. 7. For example, the processor may execute a first function for capturing a screen based on operation (1330). The processor executing the first function for capturing a screen may acquire images corresponding to each of the screens provided by the flexible display and the cover display using a DPU (e.g., DPU (224) of FIG. 2A and / or FIG. 2B). The processor's operation of acquiring the images may include an operation of storing the images in a volatile memory (e.g., volatile memory (222) of FIG. 2A and / or FIG. 2B). The processor may combine or select the images stored in the volatile memory to generate an image corresponding to the touch input. The generated image may be stored in non-volatile memory (e.g., non-volatile memory (224) of FIG. 2a and / or FIG. 2b).
[0216] Referring to FIG. 13, in operation (1340), according to one embodiment, a processor of an electronic device may determine a received touch input as a different touch input from a designated touch input. The processor may perform operation (1340) of FIG. 13 similarly to operation (740) of FIG. 7. For example, the processor may execute a second function different from the first function for screen capture based on operation (1340). For example, the processor may not execute any function different from the first function.
[0217] An embodiment of an electronic device that receives a designated touch input including a drag gesture performed along a direction on an area on a display extending in a straight line (e.g., a folding axis and / or an edge on the display) has been described, but the embodiment is not limited thereto. Hereinafter, with reference to FIGS. 14A to 14D, an embodiment of an electronic device that receives a designated touch input based on a gesture different from the drag gesture described above will be described.
[0218] FIGS. 14A, 14B, 14C, and 14D illustrate exemplary states of an electronic device (101) receiving a designated touch input for capturing a screen. The electronic device (101) of FIGS. 1A, 1B, and / or 2A and / or 2B may include the electronic device (101) of FIGS. 14A to 14B. The electronic device (101) and / or the processor (210) of FIGS. 2A and / or 2B may perform the operations of the electronic device (101) described with reference to FIGS. 14A and / or 14B. The operations of the electronic device (101) described with reference to FIGS. 14A and / or 14B may be related to at least one of the operations of FIGS. 3, 7, 9, and / or 13.
[0219] Referring to FIGS. 14A and 14B , exemplary states (1401, 1402) of an electronic device (101) included in a sub-fold state are illustrated. Within state (1401), the electronic device (101) can detect or identify a posture and / or shape of the first housing (111) to the third housing (113) folded less than 180° based on sensor data of one or more sensors (e.g., sensor (250) of FIG. 2A). Based on the sensor data, the electronic device (101) can calculate or obtain a first angle (141) and a second angle (142) included in the angular ranges (512, 522) of FIG. 5 .
[0220] Referring to FIG. 14A, an exemplary state (1401) of an electronic device (101) displaying a plurality of screens (e.g., screen A, screen B, and screen C) on three flat portions of a flexible display (150) separated by a first folding axis (131) and a second folding axis (132) is illustrated. For example, screen A may be displayed on a first display area of a flexible display (150) disposed on a first housing (111), screen B may be displayed on a second display area of a flexible display (150) disposed on a second housing (112), and screen C may be displayed on a third display area of a flexible display (150) disposed on a third housing (113). Although one embodiment of an electronic device (101) displaying multiple screens is described, the embodiment is not limited thereto, and an electronic device (101) displaying a single screen on the entire display area of a flexible display (150) can also perform the operation described with reference to FIG. 14a.
[0221] Within state (1401) of FIG. 14A, the electronic device (101) may detect or identify a designated touch input for capturing at least a portion of a display (e.g., the flexible display (150)) of the electronic device (101) based on an external object (e.g., a hand (1400)) contacting the flexible display (150). For example, the designated touch input may include a gesture of sweeping (or swiping) the display using a hand blade of the hand (1400) (or a side of the hand (1400)) (hereinafter, referred to as a sweep gesture and / or a hand blade gesture).
[0222] Referring to FIG. 14A, while the edge of a hand (1400) is in contact with the flexible display (150), the electronic device (101) can obtain information related to a contact area (1411) of the hand (1400) in contact with the flexible display (150) using a touch panel (e.g., the first touch panel (234) of FIG. 2A). The information can include numerical values for describing a plurality of points included in the contact area (1411). The numerical values can include coordinate values, an identifier (id), an index, and / or a key value. Based on sensor data of the touch panel, when a plurality of points exceeding a specified number (e.g., 4) are simultaneously detected, the electronic device (101) can obtain information including coordinate values of the plurality of points, and detect contact of the edge of the hand based on the contact area (1411). The above information may include numeric values for describing the size, area, shape, and / or outline of the contact surface (1411). The information may include numeric values representing the pressure (or force) of the hand (1400) pressing the contact surface (1411). Based on the above information, the electronic device (101) may determine that the hand edge of the hand (1400) has contacted the contact surface (1411) based on detecting a contact surface (1411) that has a specified shape, exceeds a specified threshold area, or is within a specified area range (e.g., an empirical area range for the hand edge).
[0223] In state (1401) of FIG. 14A, the electronic device (101) may acquire or store an image corresponding to at least one of the display areas (e.g., the first display area to the third display area) of the flexible display (150) defined by the first folding axis (131) and the second folding axis (132) based on a path along which a contacted external object moves on the flexible display (150) according to a specified shape (e.g., the shape of a hand blade). For example, the electronic device (101) may acquire or store an image corresponding to at least one display area including the path among the first display area, the second display area, and the third display area.
[0224] Referring to FIG. 14A, in a state (1401) in which a contact surface (1411) based on a hand (1400) in contact with a first display area is detected, the electronic device (101) can detect a contact surface (1411) that moves from the first display area across the second display area to a point (p1) in a third display area along a specified direction (e.g., a horizontal direction of the flexible display (150)). The electronic device (101) that detects a contact surface (1411) that moves from the first display area across the second display area to a point (p1) in the third display area can store an image (1415) corresponding to all of the display areas (e.g., the first display area, the second display area, and the third display area) that overlap with the path of the contact surface (1411). The image (1415) may match an image of the entire display area of the flexible display (150) uploaded to the volatile memory (222) based on the DPU (214) of FIG. 2a and / or FIG. 2b.
[0225] For example, when the electronic device (101) detects a contact surface (1411) that has moved from the first display area to a point (p2) in the second display area along a specified direction, the electronic device (101) may acquire or store an image (1416) corresponding to the first display area and the second display area among the display areas of the flexible display (150). The image (1416) may be acquired by cropping an image of the entire display area of the flexible display (150) uploaded to the volatile memory (222) based on the DPU (214) of FIG. 2A and / or FIG. 2B based on the width, height, and / or size of the first display area and the second display area.
[0226] For example, if the electronic device (101) detects a contact surface (1411) that was initially detected within the first display area and moved along a designated direction to a point (p3) within the first display area, the electronic device (101) may acquire an image (1417) corresponding to the first display area. The image (1417) may include only the A screen corresponding to the first display area. As described above, if the path along which the contact surface (1411) initially detected within the first display area moved is substantially the same as or similar to the designated direction, the electronic device (101) may generate an image that includes the first display area and at least one display area overlapping the path. The embodiment is not limited thereto, and the electronic device (101) that detects a hand edge that has made contact on another display area different from the first display area may also perform a screen capture according to the path of the contact surface of the hand edge.
[0227] Although exemplary operation of the electronic device (101) based on a hand edge moving in a horizontal direction has been described, the embodiment is not limited thereto. For example, the electronic device (101) may detect or identify a designated touch input for screen capture based on a hand edge moving in a direction different from the horizontal direction (e.g., a vertical direction).
[0228] Referring to FIG. 14B, an exemplary state (1402) of an electronic device (101) based on a vertically folded first folding axis (131) and an outspread second folding axis (132) is illustrated. Within the state (1402), the electronic device (101) can detect a first angle (141) of substantially 90° and a second angle (142) of substantially 180° using one or more sensors (e.g., sensor (250) of FIG. 2A). Within the exemplary state (1402) of FIG. 14B, the flexible display (150) can display screens provided from different software applications between two flat portions (e.g., the first portion (1421) and the second portion (1422)). For example, the electronic device (101) can display a first screen provided from a first software application for playing a video on a first portion (1421) corresponding to a first display area on a first housing (111), and can display a second screen provided from a second software application for taking notes on a second portion (1422) including a second display area on a second housing (112) and a third display area on a third housing (113).
[0229] Within the exemplary state (1402) of FIG. 14B, the electronic device (101) may receive or identify a designated touch input based on a contacted hand (1400) based on a designated shape. The designated touch input may include a sweep gesture based on the edge of the hand (1400). For example, in response to a sweep gesture that is initiated at a contact surface (1423) and moves to a point (p1) on the first portion (1421), the electronic device (101) may acquire or store an image (1425) of the first screen displayed on the first portion (1421). For example, in response to a sweep gesture that is initiated at a contact surface (1424) on a second portion (1422) and moves along a designated direction (e.g., in the direction of the y-axis) to a point (p2) on the second portion (1422), the electronic device (101) can generate an image (1426) of the second screen displayed on the second portion (1422). Although one embodiment of an electronic device (101) that receives a touch input based on a sweep gesture performed along the direction of the y-axis on different portions of a flexible display (150) is described, the direction of the sweep gesture received for screen capture is not limited to the direction of the y-axis of FIG. 14B.
[0230] Referring to FIG. 14C, an exemplary state (1403) of the first electronic device (101-1) corresponding to the half-fold state is illustrated. Within the state (1403), the first electronic device (101-1) can activate a viewable display area (e.g., a third display area of the flexible display (150) disposed on the third housing (113)) and display an A screen on the activated display area. Within the state (1403), the first electronic device (101-1) can detect or receive a sweep gesture performed on the display area of the flexible display (150) exposed to the outside. For example, the first electronic device (101-1) that detects a contact surface (1431) of a hand (1400) can detect the sweep gesture based on a path of the contact surface (1431). Referring to FIG. 14c, the first electronic device (101-1) that detects a contact surface (1431) moving in a direction parallel to the horizontal direction can acquire an image (1435) for screen A displayed on the display area. For example, the width, height, size, and / or area of the image (1435) can correspond to the width, height, size, and / or area of the display area of the flexible display (150) on which screen A is displayed.
[0231] Referring to FIG. 14D , an exemplary state (1404) of the first electronic device (101-1) corresponding to the inverted half-fold state is illustrated. Within the state (1404), the first electronic device (101-1) can display one or more screens (e.g., screen B and / or screen C) using the first display area of the flexible display (150) and the cover display (152) disposed on the first housing (111). Within the exemplary state (1404) of FIG. 14D , the first electronic device (101-1) can perform a screen capture of at least one of the one or more screens displayed through the flexible display (150) and the cover display (152) in response to a designated touch input including a sweep gesture.
[0232] For example, a first electronic device (101-1) that detects a contact surface (1441) based on an external object (e.g., a hand (1400)) on a first display area where a B screen is displayed may detect or receive a designated touch input including a sweep gesture in response to movement of the contact surface (1441) along a designated direction (e.g., a horizontal direction of the flexible display (150)). For example, a first electronic device (101-1) that detects a sweep gesture that stops at a point (p1) within the first display area may store an image (1445) corresponding to the B screen displayed through the first display area of the flexible display (150) among the flexible display (150) and the cover display (152).
[0233] For example, if a contact surface (1441) detected within the first display area moves across the first display area along a designated direction to a point (p4) within the cover display (152), the first electronic device (101-1) may generate an image (1446) including all of the B screen and the C screen displayed on each of the flexible display (150) and the cover display (152). Referring to FIG. 14D , within the image (1446), the B screen and the C screen may have a positional relationship corresponding to the positional relationship of the first display area and the cover display (152). According to one embodiment, the first electronic device (101-1) may synthesize an image (1446) including the B screen and the C screen connected to one edge of the B screen (the right edge of the B screen in one embodiment of FIG. 14D ) based on whether an external object that has come into contact with the first display area moves onto the cover display (152).
[0234] Referring to FIG. 14d, while an external object contacted through a contact surface (1441) moves from the first display area to a point (p4) within the cover display (152), the processor (e.g., the processor (210) of FIG. 2a) of the first electronic device (101-1) can detect sweep gestures from different touch panels (e.g., the first touch panel of the flexible display (150) and the second touch panel of the cover display (152). For example, while the external object is in contact with the first display area, the first electronic device (101-1) can detect a first sweep gesture of the external object based on the first touch panel of the flexible display (150). In the above example, when an external object that has come into contact with a point (p2) within the first display area is separated from the point (p2) and moves to a point (p3) within the cover display (152), the first electronic device (101-1) may determine the second sweep gesture detected on the cover display (152) and the first sweep gesture as one sweep gesture based on the distance between the points (p2, p3) and / or the time difference between the timings at which the external object is identified at each of the points (p2, p3). For example, the first electronic device (101-1) that detects the second sweep gesture based on the first sweep gesture and the external object moved from the point (p3) to the point (p4) may determine that it has received a designated touch input for generating an image (1446) corresponding to all screens displayed through the flexible display (150) and the cover display (152).
[0235] As described above, according to one embodiment, the electronic device (101) can display multiple screens using all of the multiple displays (e.g., the flexible display (150) and the cover display (152)) based on the multi-foldable housing. The electronic device (101) can generate or store an image corresponding to at least one of the multiple screens based on a sweep gesture detected through at least one of the multiple displays. Based on the sweep gesture, the electronic device (101) including the flexible display (150) having a relatively large size can improve the user experience related to screen capture.
[0236] Hereinafter, with reference to FIG. 15, an exemplary operation of the electronic device (101) described with reference to FIGS. 14a to 14d is described based on the flow diagram.
[0237] FIG. 15 illustrates a flowchart of an electronic device according to one embodiment. The electronic device (101) of FIG. 1A, FIG. 1B, and / or FIG. 2A and / or FIG. 2B, the processor (210) of FIG. 2A (e.g., LPU (212) and / or DPU (214)) may perform at least one of the operations described with reference to FIG. 15. At least one of the operations of FIG. 15 may be related to an operation (e.g., operation (330)) described with reference to FIG. 3, FIG. 7, FIG. 9, and / or FIG. 13.
[0238] Referring to FIG. 15, in operation (1510), a processor of an electronic device according to one embodiment may receive a touch input including a drag gesture based on contact with an external object. Operation (1510) may be performed while displaying one or more screens on one or more displays included in the electronic device (e.g., the flexible display (150) and / or the cover display (152) of FIGS. 1A and 1B , the first display (230) and / or the second display (240) of FIGS. 2A and / or 2B ). The processor may perform operation (1510) of FIG. 15 similarly to operation (320) of FIG. 3 and / or operation (710) of FIG. 7. The drag gesture of operation (1510) may be detected or identified based on sensor data of a touch panel included in a display.
[0239] Referring to FIG. 15, in operation (1520), a processor of an electronic device according to an embodiment may determine whether a touch input corresponds to a designated touch input based on a portion of an external object and a display that are in contact. The portion of the external object and the display that are in contact in operation (1520) may include a portion of the display that is in contact based on the edge of the hand, such as the contact surfaces (1411, 1423, 1424, 1431, 1441) of FIGS. 14A to 14D. The processor may detect the designated touch input in operation (1520) based on a direction and / or path along which the portion is moved, based on detecting the portion having a designated shape or a size exceeding a designated size. Based on detecting the designated touch input (1520-Yes), the processor may perform operation (1530). If a touch input different from the designated touch input is detected (1520-No), the processor may perform operation (1540). In one embodiment, the designated touch input of operation (1520) may include a sweep gesture as described with reference to FIGS. 14A-14D.
[0240] Referring to FIG. 15, in operation (1530), a processor of an electronic device according to an embodiment may determine a received touch input as a designated touch input for capturing a screen. The processor may perform operation (1530) similar to operation (730) of FIG. 7 and / or operation (1330) of FIG. 13. The processor, which detects and / or receives a designated touch input based on operation (1530), may execute a first function for capturing a screen, thereby performing a screen capture for one or more displays corresponding to a path and / or direction of a portion of operation (1520).
[0241] Referring to FIG. 15, in operation (1540), a processor of an electronic device according to one embodiment may determine a received touch input as a different touch input from a designated touch input. The processor may perform operation (1540) similar to operation (740) of FIG. 7 and / or operation (1340) of FIG. 13. For example, the processor may execute a second function different from the first function. For example, if the processor cannot identify any function mapped to the touch input, the processor may not execute any function.
[0242] As described above, according to one embodiment, the electronic device can receive a touch input for screen capture based on the shape of the foldable housing and / or display. The touch input can include a drag gesture performed on a foldable portion of the flexible display. The touch input can include a drag gesture performed on an area formed on a specified edge of the flexible display exposed to the outside. The touch input can include a drag gesture performed on an area formed on an edge of a cover display disposed on a housing rotated to cover the flexible display. The touch input can further include an additional drag gesture performed continuously after the drag gesture described above.
[0243] FIG. 16 is a block diagram of an electronic device (1601) within a network environment (1600) according to various embodiments. Referring to FIG. 16, in the network environment (1600), the electronic device (1601) may communicate with the electronic device (1602) via a first network (1698) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1604) or the server (1608) via a second network (1699) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1601) may communicate with the electronic device (1604) via the server (1608). According to one embodiment, the electronic device (1601) may include a processor (1620), a memory (1630), an input module (1650), an audio output module (1655), a display module (1660), an audio module (1670), a sensor module (1676), an interface (1677), a connection terminal (1678), a haptic module (1679), a camera module (1680), a power management module (1688), a battery (1689), a communication module (1690), a subscriber identification module (1696), or an antenna module (1697). In some embodiments, the electronic device (1601) may omit at least one of these components (e.g., the connection terminal (1678)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1676), camera module (1680), or antenna module (1697)) may be integrated into a single component (e.g., display module (1660)).
[0244] The processor (1620) may control at least one other component (e.g., a hardware or software component) of the electronic device (1601) connected to the processor (1620) by executing, for example, software (e.g., a program (1640)), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1620) may store commands or data received from other components (e.g., a sensor module (1676) or a communication module (1690)) in a volatile memory (1632), process the commands or data stored in the volatile memory (1632), and store result data in a non-volatile memory (1634). According to one embodiment, the processor (1620) may include a main processor (1621) (e.g., a central processing unit or an application processor) or an auxiliary processor (1623) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1621). For example, when the electronic device (1601) includes the main processor (1621) and the auxiliary processor (1623), the auxiliary processor (1623) may be configured to use less power than the main processor (1621) or to be specialized for a given function. The auxiliary processor (1623) may be implemented separately from the main processor (1621) or as a part thereof.
[0245] The auxiliary processor (1623) may control at least a portion of functions or states associated with at least one component (e.g., the display module (1660), the sensor module (1676), or the communication module (1690)) of the electronic device (1601), for example, on behalf of the main processor (1621) while the main processor (1621) is in an inactive (e.g., sleep) state, or together with the main processor (1621) while the main processor (1621) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1623) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1680) or a communication module (1690)). In one embodiment, the auxiliary processor (1623) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1601) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1608)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0246] The memory (1630) can store various data used by at least one component (e.g., the processor (1620) or the sensor module (1676)) of the electronic device (1601). The data can include, for example, software (e.g., the program (1640)) and input data or output data for commands related thereto. The memory (1630) can include volatile memory (1632) or non-volatile memory (1634).
[0247] The program (1640) may be stored as software in memory (1630) and may include, for example, an operating system (1642), middleware (1644), or an application (1646).
[0248] The input module (1650) can receive commands or data to be used in a component of the electronic device (1601) (e.g., a processor (1620)) from an external source (e.g., a user) of the electronic device (1601). The input module (1650) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0249] The audio output module (1655) can output audio signals to the outside of the electronic device (1601). The audio output module (1655) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0250] The display module (1660) can visually provide information to an external party (e.g., a user) of the electronic device (1601). The display module (1660) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (1660) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0251] The audio module (1670) can convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module (1670) can acquire sound through the input module (1650), output sound through the sound output module (1655), or an external electronic device (e.g., electronic device (1602)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1601).
[0252] The sensor module (1676) can detect the operating status (e.g., power or temperature) of the electronic device (1601) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1676) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0253] The interface (1677) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1601) with an external electronic device (e.g., the electronic device (1602)). In one embodiment, the interface (1677) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0254] The connection terminal (1678) may include a connector through which the electronic device (1601) may be physically connected to an external electronic device (e.g., the electronic device (1602)). In one embodiment, the connection terminal (1678) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0255] The haptic module (1679) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1679) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0256] The camera module (1680) can capture still images and videos. In one embodiment, the camera module (1680) may include one or more lenses, image sensors, image signal processors, or flashes.
[0257] The power management module (1688) can manage the power supplied to the electronic device (1601). According to one embodiment, the power management module (1688) can be implemented as at least a part of, for example, a power management integrated circuit (PMIC).
[0258] A battery (1689) may power at least one component of the electronic device (1601). In one embodiment, the battery (1689) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0259] The communication module (1690) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1601) and an external electronic device (e.g., electronic device (1602), electronic device (1604), or server (1608)), and the performance of communication through the established communication channel. The communication module (1690) may operate independently from the processor (1620) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1690) may include a wireless communication module (1692) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1694) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1604) via a first network (1698) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1699) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1692) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1696) to identify or authenticate the electronic device (1601) within a communication network such as the first network (1698) or the second network (1699).
[0260] The wireless communication module (1692) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency communications (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1692) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1692) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1692) may support various requirements specified in the electronic device (1601), an external electronic device (e.g., the electronic device (1604)), or a network system (e.g., the second network (1699)). According to one embodiment, the wireless communication module (1692) may support a peak data rate (e.g., 20 Gbps or more) for eMBB implementation, a loss coverage (e.g., 164 dB or less) for mMTC implementation, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC implementation.
[0261] The antenna module (1697) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1697) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1697) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1698) or the second network (1699), may be selected from the plurality of antennas by, for example, the communication module (1690). A signal or power may be transmitted or received between the communication module (1690) and the external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1697).
[0262] According to various embodiments, the antenna module (1697) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0263] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0264] According to one embodiment, commands or data may be transmitted or received between the electronic device (1601) and an external electronic device (1604) via a server (1608) connected to a second network (1699). Each of the external electronic devices (1602 or 1504) may be the same or a different type of device as the electronic device (1601). According to one embodiment, all or part of the operations executed in the electronic device (1601) may be executed in one or more of the external electronic devices (1602, 1504, or 1508). For example, when the electronic device (1601) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1601) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1601). The electronic device (1601) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1601) may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1604) may include an Internet of Things (IoT) device. The server (1608) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1604) or server (1608) may be included within the second network (1699). The electronic device (1601) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.
[0265] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0266] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0267] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0268] Various embodiments of the present document may be implemented as software (e.g., a program (1640)) including one or more instructions stored in a storage medium (e.g., an internal memory (1636) or an external memory (1638)) readable by a machine (e.g., an electronic device (1601)). For example, a processor (e.g., a processor (1620)) of the machine (e.g., an electronic device (1601)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0269] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0270] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added. The electronic device (1601) of FIG. 16 may be an example of the electronic device described with reference to FIGS. 1a, 1b, 2a, 2b, 3 to 15.
[0271] In one embodiment, a method for capturing a screen based on touch input suitable for a deformable housing and / or a flexible display may be required. According to one embodiment of the present invention, an electronic device (e.g., the electronic device (101) of FIGS. 1A to 1B and / or the electronic device (1601) of FIG. 16) as described above comprises a first housing (e.g., the first housing (111) of FIGS. 1A to 1B), a second housing rotatably coupled to the first housing (e.g., the second housing (112) of FIGS. 1A to 1B), a third housing rotatably coupled to the second housing (e.g., the third housing (113) of FIGS. 1A to 1B), a first display area (e.g., the first display area (1011) of FIG. 10) disposed on the first housing, a second display area (e.g., the second display area (1012) of FIG. 10) disposed on the second housing, and a third display area (e.g., the third display area (1011) of FIG. 10) disposed on the third housing. A flexible display including a region (1013) (e.g., a flexible display (150) of FIGS. 1A to 1B), a first sensor for detecting an angle between the first housing and the second housing (e.g., a sensor (250) of FIG. 2A), a second sensor for detecting an angle between the second housing and the third housing (e.g., a sensor (250) of FIG. 2A), a memory for storing instructions (e.g., a memory (220) of FIGS. 2A and / or 2B), and a processor for accessing the memory and executing the instructions (e.g., a processor (210) of FIG. 2A).The processor may be configured to detect a touch input based on an external object that comes into contact with a boundary area between two of the first display area, the second display area, and the third display area (e.g., the first boundary area (413) and / or the second boundary area (411) of FIG. 4) while displaying a screen on the flexible display. The processor may be configured to store an image corresponding to at least a portion of the screen in response to the touch input based on the external object moving along a direction in which the boundary area extends. According to one embodiment, the electronic device may execute a function for capturing a screen in response to the touch input based on the boundary area. The electronic device may receive a user input for capturing a screen independently of a button that may be obscured by rotation of the housing.
[0272] For example, the processor may be configured to detect rotation of the first housing relative to the second housing using the first sensor while displaying the screen based on unfolded states of the first housing, the second housing, and the third housing. The processor may be configured to execute a first function for storing the image corresponding to at least a portion of the screen in response to the touch input detected on a first boundary area between the first display area and the second display area, wherein the first display area is bent based on the rotation.
[0273] For example, the processor may be configured to execute a second function, different from the first function, in response to another touch input based on the external object moving along the direction in which the second boundary area extends, on a second boundary area between the second display area and the third display area, which is different from the first boundary area that is bent based on the rotation.
[0274] For example, the processor may be configured to store the image corresponding to all of the first display area, the second display area, and the third display area based on whether the external object moved along the direction is spaced from the boundary area.
[0275] For example, the processor may be configured to display a visual object guiding selection of one of the portions of the flexible display delimited by the boundary area where the external object contacts, on an end point adjacent to one of two end points of the boundary area, based on whether the external object moved along the direction contacts a point within the boundary area for a specified period of time.
[0276] For example, the processor may be configured to store the image corresponding to the first portion based on the external object moving from the point to the first portion among the portions while displaying the visual object.
[0277] For example, the electronic device may include a cover display (e.g., the cover display (152) of FIG. 1A) disposed on a second side of the third housing opposite the first side on which the third display area is disposed. The processor may be configured to display a first screen on at least a portion of the first display area of the flexible display and to display a second screen on the cover display within a sub-fold state of the first housing, the second housing, and the third housing detected based on the first sensor and the second sensor.
[0278] For example, the processor may be configured to store the image connected to one edge of the second screen based on the external object spaced apart on the boundary area while displaying the first screen and the second screen.
[0279] For example, the processor may be configured to store the image corresponding to the second screen among the first screen or the second screen in response to another touch input on the cover display based on the external object moved along the direction while displaying the first screen and the second screen.
[0280] For example, the processor may be configured to store the image corresponding to the first screen among the first screen or the second screen based on whether the external object moved along the direction moves from the boundary area onto the first display area while displaying the first screen and the second screen.
[0281] For example, the processor may be configured to acquire the image corresponding to at least a portion of the screen in response to the touch input based on the external object moving more than a specified distance along the direction.
[0282] In one embodiment, as described above, a method of an electronic device is provided, including a flexible display including a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing. The method may include an operation of detecting a touch input based on an external object contacting a boundary area between two display areas among the first display area, the second display area, and the third display area while a screen is displayed on the flexible display. The method may include an operation of storing an image corresponding to at least a portion of the screen in response to the touch input based on the external object moving along a direction in which the boundary area extends.
[0283] For example, the detecting operation may include detecting a rotation of the first housing relative to the second housing using a first sensor for detecting an angle between the first housing and the second housing while displaying the screen based on unfolded states of the first housing, the second housing, and the third housing. The storing operation may include executing a first function for storing the image corresponding to at least a portion of the screen in response to the touch input detected on a first boundary area between the first display area and the second display area, the touch input being bent based on the rotation.
[0284] For example, the method may include an operation of executing a second function, different from the first function, in response to another touch input based on the external object moving along the direction in which the second boundary area extends, on a second boundary area between the second display area and the third display area, which is different from the first boundary area that is bent based on the rotation.
[0285] For example, the storing operation may include storing the image corresponding to all of the first display area, the second display area, and the third display area based on whether the external object moved along the direction is spaced from the boundary area.
[0286] For example, the detecting action may include an action of displaying a visual object guiding a selection of one of the portions of the flexible display separated by the boundary area where the external object has made contact, on an end point adjacent to one of the two end points of the boundary area, based on whether the external object moved along the direction has made contact with a point within the boundary area for a specified period of time.
[0287] For example, the storing operation may include storing the image corresponding to the first portion based on the external object moving from the point to the first portion among the portions while displaying the visual object.
[0288] For example, the method may include an operation of displaying the first screen on at least a portion of the first display area of the flexible display within the sub-fold state of the first housing, the second housing, and the third housing, and displaying the second screen on a cover display disposed on a second surface opposite the first surface of the third housing on which the third display area is disposed.
[0289] For example, the saving operation may include an operation of saving the image connected to one edge of the second screen based on the external object spaced apart on the boundary area while the first screen and the second screen are displayed.
[0290] For example, the saving operation may include an operation of saving the image corresponding to the second screen among the first screen or the second screen in response to another touch input on the cover display based on the external object moved along the direction while displaying the first screen and the second screen.
[0291] For example, the saving operation may include an operation of saving the image corresponding to the first screen among the first screen or the second screen based on whether the external object moved along the direction moves from the boundary area onto the first display area while displaying the first screen and the second screen.
[0292] For example, the storing operation may include an operation of obtaining the image corresponding to at least a portion of the screen in response to the touch input based on the external object moving more than a specified distance along the direction.
[0293] According to one embodiment, as described above, an electronic device may include a flexible display including a first housing, a second housing rotatably coupled to the first housing, a third housing rotatably coupled to the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing, a first sensor for detecting an angle between the first housing and the second housing, a second sensor for detecting an angle between the second housing and the third housing, a memory for storing instructions, and a processor for accessing the memory to execute the instructions. The processor may be configured to detect a touch input based on an external object contacting the flexible display while displaying a screen on the flexible display. The processor may be configured to store an image corresponding to at least one display area including the path among the first display area, the second display area, and the third display area, based on a path along which the external object contacted according to a specified form moves on the flexible display.
[0294] For example, the electronic device may include a cover display disposed on a second surface opposite to the first surface of the third housing on which the third display area is disposed. The processor may be configured to display a first screen on the first display area and a second screen on the cover display based on sub-fold states of the first housing, the second housing, and the third housing. The processor may include:
[0295] The first screen may be configured to store the image connected to one edge of the second screen based on whether the external object contacting the first display area moves along the path onto the cover display.
[0296] In one embodiment, as described above, a method of an electronic device is provided, including a flexible display including a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing. The method may include an operation of detecting a touch input based on an external object contacting the flexible display while a screen is displayed on the flexible display. The method may include an operation of storing an image corresponding to at least one display area including a path along which the contacted external object moves on the flexible display according to a specified shape, among the first display area, the second display area, and the third display area.
[0297] For example, the method may include an operation of displaying a first screen on the first display area and displaying a second screen on a cover display disposed on a second side of the third housing opposite to the first side on which the third display area is disposed, based on sub-fold states of the first housing, the second housing, and the third housing. The storing operation may include an operation of storing the image connected to one edge of the second screen on the first screen based on whether the external object contacted on the first display area moves along the path onto the cover display.
[0298] According to one embodiment, an electronic device as described above may include a first housing, a second housing rotatably coupled to the first housing, a third housing rotatably coupled to the second housing, a flexible display including a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing, a cover display disposed on a second surface of the third housing opposite to a first surface of the third housing on which the third display area is disposed, a first sensor for detecting an angle between the first housing and the second housing, a second sensor for detecting an angle between the second housing and the third housing, a memory for storing instructions, and a processor for accessing the memory to execute the instructions. The processor may be configured to display a first screen on a portion of the first display area, which is different from a portion occluded by the third housing, among portions of the first display area divided by the edge, when one edge of the third housing is in contact with the first display area, and to display a second screen on the cover display. The processor may be configured to detect a touch input based on an external object that has contacted a portion of the first display area where the edge has contacted. The processor may be configured to store an image including at least one of the first screen or the second screen in response to the touch input based on the external object moving along the direction of the edge.
[0299] For example, the processor may be configured to store the image including the first screen among the first screen or the second screen based on whether the external object moved along the direction moves to a point on the first display area that is different from the portion.
[0300] For example, the processor may be configured to store the image including the second screen among the first screen or the second screen based on whether the external object moved along the direction moves onto the cover display.
[0301] In one embodiment, as described above, a method of an electronic device including a flexible display including a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing is provided. The method may include an operation of displaying a first screen on a portion of the first display area divided by an edge of the third housing that is different from a portion covered by the third housing, while an edge of the third housing is in contact with the first display area, and displaying a second screen on a cover display disposed on a second surface of the third housing opposite to a first surface on which the third display area is disposed. The method may include an operation of detecting a touch input based on an external object contacting a portion of the first display area that the edge is in contact with. The method may include an operation of storing an image including at least one of the first screen or the second screen in response to the touch input based on the external object moving along the direction of the edge.
[0302] For example, the saving operation may include saving the image including the first screen among the first screen or the second screen based on whether the external object moved along the direction moves to a point on the first display area that is different from the part.
[0303] For example, the saving operation may include an operation of saving the image including the second screen among the first screen or the second screen based on whether the external object moved along the direction moves onto the cover display.
[0304] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.
[0305] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.
[0306] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.
[0307] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above description. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.
[0308] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.
Claims
1. In an electronic device (101; 1601), First housing (111); A second housing (112) rotatably coupled to the first housing; A third housing (113) rotatably coupled with the second housing; A flexible display (150) including a first display area (1011) arranged on the first housing, a second display area (1012) arranged on the second housing, and a third display area (1013) arranged on the third housing; A first sensor (250) for detecting the angle between the first housing and the second housing; A second sensor (250) for detecting the angle between the second housing and the third housing; A memory comprising one or more storage media and storing instructions; and comprising at least one processor including a processing circuit; The above instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: While displaying a screen on the flexible display, detecting a touch input based on an external object coming into contact on a boundary area (411, 413) between two display areas among the first display area, the second display area and the third display area; Causing said touch input to be based on said external object moving along the direction in which said boundary area is extended, to store an image corresponding to at least a portion of said screen. Electronic devices.
2. In claim 1, the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: While displaying the screen based on the unfolded states of the first housing, the second housing and the third housing, detecting the rotation of the first housing with respect to the second housing using the first sensor; causing a first function to be executed to store the image corresponding to at least a portion of the screen in response to the touch input detected on the first boundary area between the first display area and the second display area based on the rotation; Electronic devices.
3. In claims 1 and 2, the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: In response to another touch input based on the external object moving along the direction in which the second boundary area is extended, on a second boundary area between the second display area and the third display area, which is different from the first boundary area that is bent based on the rotation, causing a second function that is different from the first function to be executed. Electronic devices.
4. In claims 1 to 3, the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Causing to store the image corresponding to all of the first display area, the second display area and the third display area based on whether the external object moved along the direction is spaced from the boundary area. Electronic devices.
5. In claims 1 to 4, the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Causing a visual object to be displayed, based on whether the external object moved along the direction comes into contact with a point within the boundary area for a specified period of time, on an end point adjacent to the point among two end points of the boundary area, guiding a selection of one of the portions of the flexible display separated by the boundary area where the external object comes into contact. Electronic devices.
6. In claims 1 to 5, the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: While displaying said visual object, based on said external object moving from said point to said first part among said parts, causing said image corresponding to said first part to be stored, Electronic devices.
7. In claims 1 to 6, a cover display (152) is further included, which is arranged on a second surface opposite to the first surface of the third housing on which the third display area is arranged. The above instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: Causing to display a first screen on at least a part of the first display area of the flexible display and to display a second screen on the cover display within the sub-fold state of the first housing, the second housing and the third housing detected based on the first sensor and the second sensor. Electronic devices.
8. In claims 1 to 7, the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: While displaying the first screen and the second screen, based on the external object spaced apart on the boundary area, causing the first screen to store the image connected to one edge of the second screen. Electronic devices.
9. In claims 1 to 8, the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: While displaying the first screen and the second screen, in response to another touch input on the cover display based on the external object moved along the direction, causing the image corresponding to the second screen among the first screen or the second screen to be stored. Electronic devices.
10. In claims 1 to 9, the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: While displaying the first screen and the second screen, based on whether the external object moved along the direction moves from the boundary area to the first display area, causing the image corresponding to the first screen among the first screen or the second screen to be stored. Electronic devices.
11. In claims 1 to 10, the instructions, when individually and / or collectively executed by the at least one processor, cause the electronic device to: In response to said touch input based on said external object moving beyond a specified distance along said direction, causing said image corresponding to at least a portion of said screen to be acquired, Electronic devices.
12. A method of an electronic device including a flexible display including a first housing, a second housing rotatably coupled with the first housing, a third housing rotatably coupled with the second housing, a first display area disposed on the first housing, a second display area disposed on the second housing, and a third display area disposed on the third housing, An operation of detecting a touch input based on an external object coming into contact on a boundary area between two display areas among the first display area, the second display area and the third display area while displaying a screen on the flexible display; In response to the touch input based on the external object moving along the direction in which the boundary area extends, the operation of storing an image corresponding to at least a portion of the screen, method.
13. In claim 12, the detecting operation comprises: An operation of detecting rotation of the first housing relative to the second housing using a first sensor for detecting an angle between the first housing and the second housing while displaying the screen based on the unfolded states of the first housing, the second housing and the third housing, The above saving action is, Including an operation of executing a first function for storing the image corresponding to at least a portion of the screen in response to the touch input detected on a first boundary area between the first display area and the second display area based on the rotation. method.
14. In claims 12 to 13, Further comprising an operation of executing a second function, which is different from the first function, in response to another touch input based on the external object moving along the direction in which the second boundary area is extended, on a second boundary area between the second display area and the third display area, which is different from the first boundary area that is bent based on the rotation. method.
15. In claims 12 to 14, the storing operation comprises: An operation of storing the image corresponding to all of the first display area, the second display area, and the third display area based on whether the external object moved along the direction is spaced from the boundary area. method.
Citation Information
Patent Citations
Mobile terminal and method for controlling the same
KR1020150125615A
Display device and operating method thereof
KR1020170036317A
Method of determining the location of a drone using 3D terrain location information and a drone thereof
KR1020230065732A
Platform server for book order and method of agent using the same
KR1020240117668A
User terminal device and method for displaying thereof
KR102156603B1