Electronic device and method for displaying content
The electronic device dynamically adjusts display modes based on folding angles and sensor data to optimize content exposure across various folding configurations, enhancing user interaction and experience in foldable electronic devices.
Patent Information
- Application Number
- PCT/KR2024/008711
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Priority Date
- 2023-08-03
- Filing Date
- 2024-06-24
- Publication Date
- 2025-01-02
AI Technical Summary
Foldable electronic devices face challenges in dynamically adjusting content display modes when folded in various configurations, leading to suboptimal user experiences due to inconsistent exposure of display areas.
An electronic device with multiple housings and hinges that adjusts display modes based on folding angles, activating partial areas of the first display and deactivating remaining areas, using sensors and cameras to determine the folding state and expose relevant content on secondary displays.
Enables seamless content presentation across different folding configurations by dynamically controlling display modes, ensuring optimal user interaction and content exposure regardless of the device's folded state.
Smart Images

Figure KR2024008711_02012025_PF_FP_ABST
Abstract
Description
Electronic device and method for displaying content
[0001] The present disclosure relates to an electronic device and method for displaying content, and more particularly, to an electronic device and method for displaying content as the electronic device is multi-folded.
[0002] With the advancement of multimedia and network technologies, electronic devices have become capable of providing a variety of services. Furthermore, users can now access diverse content through foldable electronic devices. Furthermore, by folding the device within a predetermined angle, users can view content displayed in various environments. Furthermore, when foldable electronic devices offer multi-folding capabilities, there is a need to provide users with appropriate content in various folding situations.
[0003] One embodiment of the present disclosure comprises: a first housing (12); a second housing (14) connected to the first housing through a first hinge (42); a third housing (16) connected to the second housing through a second hinge (44); a first display (20) disposed across the first housing, the second housing, and the third housing and exposed toward a first direction of the electronic device; a second display (30) disposed in the first housing and facing a second direction of the electronic device; a memory (1630) storing commands; And at least one processor (1620) operably connected to the first display and the second display and the memory; wherein the instructions, when executed by the at least one processor, cause the electronic device to: display an execution screen of an application on the second display; and, as the electronic device is multi-folded, identify whether one side of the first housing is located on a portion corresponding to the third housing among the entire area of the first display based on a first folding angle between the first housing and the second housing and a second folding angle of the second housing and the third housing; and, based on the identification of whether the one side of the first housing is located on the portion corresponding to the third housing, change the display mode of the first display from the first display mode to the second display mode, wherein the second display mode is a mode that controls an activated portion of the first display and a deactivated remaining portion of the first display based on a position on the portion of the first display where the one side of the first housing is located.
[0004] In addition, one embodiment of the present disclosure includes: an operation (210) of displaying an execution screen of an application on a second display (30) of an electronic device (10000); an operation (200) of identifying whether one side of the first housing is positioned on a portion corresponding to the third housing among the entire area of the first display (20) of the electronic device based on a first folding angle between the first housing and the second housing and a second folding angle of the second housing and the third housing, as the electronic device including the first housing (12), the second housing (14) and the third housing (16) is multi-folded; And, based on the identification that the one side of the first housing is located on the portion corresponding to the third housing, an operation (220, 230) of changing the display mode of the first display from the first display mode to the second display mode; wherein the first display is arranged across the first housing, the second housing, and the third housing and faces a first direction of the electronic device, the second display is arranged in the first housing and faces a second direction of the electronic device, and the second display mode is a mode that controls an activated portion of the first display and a deactivated remaining portion of the first display based on a position on the portion of the first display where the one side of the first housing is located. The present invention can provide a method for an electronic device to display an execution screen of an application.
[0005] In addition, one embodiment of the present disclosure includes: an operation (210) of displaying an execution screen of an application on a second display (30) of an electronic device (10000); an operation (200) of identifying whether one side of the first housing is positioned on a portion corresponding to the third housing among the entire area of the first display (20) of the electronic device based on a first folding angle between the first housing and the second housing and a second folding angle of the second housing and the third housing, as the electronic device including the first housing (12), the second housing (14) and the third housing (16) is multi-folded; And, based on the identification that the one side of the first housing is located on the portion corresponding to the third housing, an operation of changing the display mode of the first display from the first display mode to the second display mode (220, 230); wherein the first display is arranged across the first housing, the second housing, and the third housing and faces a first direction of the electronic device, the second display is arranged in the first housing and faces a second direction of the electronic device, and the second display mode is a mode that controls an activated portion of the first display and a deactivated remaining portion of the first display based on a position on the portion of the first display where the one side of the first housing is located. A computer-readable recording medium having recorded thereon a program for executing a method for causing an electronic device to display an execution screen of an application can be provided.
[0006] FIG. 1 is a diagram illustrating an example of displaying content on displays of an electronic device in which the folding state of the electronic device is changed by multi-folding according to one embodiment of the present disclosure.
[0007] FIG. 2 is a flowchart of a method for displaying content on at least one display exposed by multi-folding by an electronic device according to one embodiment of the present disclosure.
[0008] FIG. 3 is a flowchart of a method for identifying whether an electronic device according to one embodiment of the present disclosure is placed on a floor by multi-folding.
[0009] FIG. 4 is a drawing showing an example in which a first display of an electronic device according to one embodiment of the present disclosure is surrounded by housings by multi-folding.
[0010] FIG. 5 is a flowchart of a method for an electronic device according to one embodiment of the present disclosure to determine whether a portion of a first display is exposed.
[0011] FIG. 6 is a drawing showing an example in which a first display is surrounded by housings of an electronic device according to a folding angle of the electronic device according to one embodiment of the present disclosure.
[0012] FIG. 7 is a drawing showing a GUI displayed on a part of a first display of an electronic device as a part of a first display of the electronic device is exposed while an execution screen of an application for video conferencing is displayed on a second display of the electronic device according to one embodiment of the present disclosure.
[0013] FIG. 8 is a diagram illustrating a GUI displayed on a portion of a first display of an electronic device as a portion of the first display of the electronic device is exposed while video content is displayed on a second display of the electronic device according to one embodiment of the present disclosure.
[0014] FIG. 9 is a flowchart of a method for changing and displaying a GUI on a portion of a first display as the size of a portion of a first display exposed by multi-folding of an electronic device according to an embodiment of the present disclosure changes.
[0015] FIG. 10 is a drawing showing an example in which a GUI on a portion of a first display changes as the size of a portion of a first display exposed by multi-folding of an electronic device according to one embodiment of the present disclosure changes.
[0016] FIG. 11 is a diagram illustrating an example in which a GUI related to a sleep-inducing image is changed on a portion of a first display as the size of a portion of a first display exposed by multi-folding of an electronic device according to an embodiment of the present disclosure is changed.
[0017] FIG. 12 is a diagram illustrating an example in which a GUI for user input related to a video is changed on a part of a first display as the size of a part of a first display exposed by multi-folding of an electronic device according to one embodiment of the present disclosure is changed.
[0018] FIG. 13 is a diagram illustrating an example in which a GUI for user input related to game content is changed on a portion of a first display as the size of a portion of a first display exposed by multi-folding of an electronic device according to one embodiment of the present disclosure is changed.
[0019] FIG. 14 is a diagram illustrating an example in which a GUI for unlocking a lock screen on a portion of a first display changes as the size of a portion of a first display exposed by multi-folding of an electronic device according to an embodiment of the present disclosure changes.
[0020] FIG. 15 is a diagram illustrating an example of a GUI for displaying information related to a photo on a portion of a first display as the size of a portion of a first display exposed by multi-folding of an electronic device according to an embodiment of the present disclosure changes.
[0021] FIG. 16 is a flowchart of a method for changing and displaying a GUI on an exposed portion of a first display when an external input device of an electronic device according to one embodiment of the present disclosure is grasped by a user.
[0022] FIG. 17 is a flowchart of a method for changing and displaying a GUI on an exposed portion of a first display when an electronic device according to one embodiment of the present disclosure outputs notification information.
[0023] FIG. 18 is a flowchart of a method for changing and displaying a GUI on an exposed portion of a first display, taking into account whether an external input device of an electronic device according to one embodiment of the present disclosure is held by a user or whether the electronic device has output notification information.
[0024] FIG. 19 is a diagram illustrating an example in which a GUI related to notification information is displayed on an exposed portion of a first display when an electronic device according to one embodiment of the present disclosure receives notification information.
[0025] FIG. 20 is a diagram illustrating an example in which a GUI related to an external input device gripped by a user is displayed on an exposed portion of a first display when the external input device of an electronic device according to one embodiment of the present disclosure is gripped by a user.
[0026] FIG. 21 is a block diagram of an electronic device within a network environment according to various embodiments.
[0027] Below, embodiments of the present disclosure are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In addition, for the purpose of clearly explaining the present disclosure in the drawings, parts irrelevant to the description are omitted, and similar parts are designated with similar reference numerals throughout the specification.
[0028] The terms used in this disclosure are described as currently common terms, taking into account the functions mentioned herein. However, these terms may mean various other terms depending on the intentions of those skilled in the art, precedents, the emergence of new technologies, etc. Therefore, the terms used in this disclosure should not be interpreted solely based on their names, but rather based on the meanings of the terms and the overall content of this disclosure.
[0029] Additionally, while terms such as first, second, etc. may be used to describe various components, the components should not be limited by these terms. These terms are used to distinguish one component from another.
[0030] Throughout the specification, when a part is said to be "connected" to another part, this includes not only the cases where the parts are "directly connected" but also the cases where the parts are "electrically connected" with other elements intervening. Furthermore, when a part is said to "include" a component, this does not exclude other components, but rather includes other components, unless otherwise stated.
[0031] The phrases “in one embodiment” and the like appearing in various places throughout this disclosure do not necessarily all refer to the same embodiment.
[0032] An embodiment of the present disclosure may be represented by functional block configurations and various processing steps. Some or all of these functional blocks may be implemented by various hardware and / or software configurations that perform specific functions. For example, the functional blocks of the present disclosure may be implemented by one or more microprocessors or by circuit configurations for a given function. Furthermore, for example, the functional blocks of the present disclosure may be implemented in various programming or scripting languages. The functional blocks may be implemented by algorithms that execute on one or more processors. Furthermore, the present disclosure may employ conventional techniques for electronic configuration, signal processing, and / or data processing. Terms such as “mechanism,” “element,” “means,” and “configuration” may be used broadly and are not limited to mechanical and physical configurations.
[0033] Additionally, the connecting lines or connecting members between components depicted in the drawings are merely exemplary representations of functional connections and / or physical or circuit connections. In an actual device, connections between components may be represented by various functional connections, physical connections, or circuit connections that may be replaced or added.
[0034] The present disclosure will be described in detail with reference to the attached drawings below.
[0035] FIG. 1 is a diagram illustrating an example of displaying content on displays of an electronic device in which the folding state of the electronic device is changed by multi-folding according to one embodiment of the present disclosure.
[0036] Referring to the identification number 1 of FIG. 1, the electronic device (10000) may include a plurality of housings (12, 14, 16), a plurality of hinges (42, 44), a first display (20), and a second display (30). The plurality of housings (12, 14, 16) may include a first housing (12), a second housing (14), and a third housing (16). The plurality of hinges (42, 44) may include a first hinge (42) and a second hinge (44).
[0037] According to one embodiment, the first display (20) may be arranged to face a first direction (50) of the electronic device (10000). For example, the first display (20) may be a main display of the electronic device (10000), and the first display (20) may be arranged across the front of the first housing (12), the front of the second housing (14), and the front of the third housing (16), thereby being exposed to the outside of the electronic device (10000). The first display (20) may be a flexible display in which a portion corresponding to the first hinge (42) and a portion corresponding to the second hinge (44) may be foldable. For example, the first direction (50) may be a direction facing the front of the electronic device (10000) when the electronic device (10000) is in a fully unfolded state.
[0038] According to one embodiment, the second display (30) may be arranged to face a second direction (52) opposite to the first direction of the electronic device (10000). The second display (30) may be arranged on at least a portion of the rear surface of the first housing (12), thereby being exposed to the outside of the electronic device (10000). For example, the second display (30) may be a sub-display of the electronic device (10000), and the second direction (52) may be a direction facing the rear of the electronic device (10000) when the electronic device (10000) is in a fully unfolded state.
[0039] Referring to the identification number 2 of FIG. 1, the electronic device (10000) can be multi-folded by the first hinge (42) and the second hinge (44). For example, the first display (20) of the electronic device (10000) can be folded in a direction in which the first housing (12) and the second housing (14) face each other by the first hinge (42), and the first display (20) of the electronic device (10000) can be folded in a direction in which the second housing (14) and the third housing (16) face each other by the second hinge (44). For example, the electronic device (10000) may be multi-folded so that one side (31) of the first housing (12) is in contact with one side (21) of the third housing (16), and accordingly, as in the identification number 2 of FIG. 1, the entire area of the first display (20) of the electronic device (10000) may be surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (10000). According to one embodiment, the side surrounded by the first housing (12), the second housing (14), and the third housing (16) may be the inside of the electronic device (10000), and the side not surrounded by the first housing (12), the second housing (14), and the third housing (16) may be the outside of the electronic device (10000).
[0040] According to one embodiment, the entire area of the first display (20) of the electronic device (10000) may be surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (10000) so as not to be exposed to the outside of the electronic device (10000). In this case, only the second display (30) of the electronic device (10000) may be exposed to the outside of the electronic device (10000), and a predetermined content may be displayed only on the second display (30) of the electronic device (10000).
[0041] Referring to the identification number 3 of FIG. 1, as the folding angle between the first housing (12) and the second housing (14) decreases and the folding angle between the second housing (14) and the third housing (16) increases, a portion (22) of the entire area of the first display (20) may be exposed to the outside of the electronic device (10000). The portion (22) of the first display (20) exposed to the outside of the electronic device (10000) may be an area that is not surrounded by the first housing (12), the second housing (14), and the third housing among the entire area of the first display (20). In addition, the remaining area (23) of the first display (20) may be an area surrounded by the first housing (12), the second housing (14), and the third housing among the entire area of the first display (20).
[0042] According to one embodiment, for example, when a part (22) of the entire area of the first display (20) is exposed to the outside of the electronic device (10000), the display mode of the first display (20) may be changed from the first display mode to the second display mode. For example, the first display mode may be a display mode that activates the entire area of the first display (20). For example, the second display mode may be a mode that activates (e.g., turns ON) a part (22) of the first display (20) and deactivates (e.g., turns OFF) the remaining area (23).
[0043] According to one embodiment, as a portion (22) of the entire area of the first display (20) is exposed to the outside of the electronic device (10000), a user interface related to a predetermined content can be displayed on the exposed portion (22).
[0044] Although it has been described above that the display mode of the first display (20) changes from the first display mode to the second display mode as some areas (22) are exposed, the timing at which the display mode of the first display (20) changes is not limited thereto. For example, when the electronic device (10000) is multi-folded so that one side (31) of the first housing (12) comes into contact with one side (21) of the third housing (16), and the entire area of the first display (20) of the electronic device (10000) is surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (10000), the display mode of the first display (20) may change from the first display mode to the second display mode.
[0045] The electronic device (10000) is a foldable device that can be folded by a hinge, and may be, for example, a smartphone, a tablet PC, a mobile phone, a personal digital assistant (PDA), a laptop, a media player, a global positioning system (GPS) device, an e-book reader, a digital broadcasting terminal, a navigation device, a digital camera, a home appliance, or other mobile computing devices, but is not limited thereto.
[0046] FIG. 2 is a flowchart of a method for displaying content on at least one display exposed by multi-folding by an electronic device according to one embodiment of the present disclosure.
[0047] In operation 200, the electronic device (10000) can identify whether the electronic device (10000) is placed on the floor by multi-folding. According to one embodiment, the electronic device (10000) being placed on the floor may include being placed on the surface of an object. When the electronic device (10000) is placed on an object such as a table, shelf, or chair, it may be identified that the electronic device (10000) is placed on the floor. Multi-folding may include folding multiple parts of the electronic device (10000) by multiple hinges. For example, when the electronic device (10000) includes a first hinge (42) and a second hinge (44), the first display (20) of the electronic device (10000) can be folded in a direction in which the first housing (12) and the second housing (14) face each other by the first hinge (42), and the first display (20) of the electronic device (10000) can be folded in a direction in which the second housing (14) and the third housing (16) face each other by the second hinge (44).
[0048] According to one embodiment, the electronic device (10000) can identify whether the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) by multi-folding based on a first folding angle between the first housing (12) and the second housing (14) and a second folding angle of the second housing (14) and the third housing (16). For example, the electronic device (10000) can be multi-folded such that one side of the first housing (12) contacts one side of the third housing (16), and thus, the entire area of the first display (20) of the electronic device (10000) can be surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (10000). The entire area of the first display (20) of the electronic device (10000) may not be exposed to the outside of the electronic device (10000) by being surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (10000).
[0049] According to one embodiment, the electronic device (10000) can identify whether the electronic device (10000) is placed on the floor while the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) by multi-folding. The electronic device (10000) can identify whether the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) by multi-folding based on a first folding angle between the first housing (12) and the second housing (14) and a second folding angle of the second housing (14) and the third housing (16). The electronic device (10000) can identify whether the electronic device (10000) is placed on the floor by using at least one sensor (e.g., a gyro sensor, an acceleration sensor) and / or at least one camera within the electronic device (10000).
[0050] An example of determining whether an electronic device (10000) is placed on the floor by multi-folding will be described in more detail in FIGS. 3 and 4 described below.
[0051] Meanwhile, although the above description describes determining whether the electronic device (10000) is placed on the floor by multi-folding, it is not limited thereto. In operation 200 of FIG. 2, the electronic device (10000) can identify whether the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) by multi-folding, without determining whether the electronic device (10000) is placed on the floor by multi-folding. For example, the electronic device (10000) can identify whether one side of the first housing (12) is positioned on the first position of the first display (20) corresponding to the third housing (16) based on the first folding angle between the first housing (12) and the second housing (14) and the second folding angle of the second housing (14) and the third housing (16) as the electronic device (10000) is multi-folded. For example, the electronic device (10000) may determine that one side of the first housing (12) is positioned on one side of the third housing (16) or is positioned on the first display (20) within a first distance range from one side of the third housing (16), and that one side of the first housing (12) is positioned on the first position of the first display (20) corresponding to the third housing (16) and that the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) by multi-folding. For example, the first position may be a position on the first display (20) corresponding to the third housing (16) within a first distance range from one side of the third housing (16).
[0052] According to one embodiment, when the electronic device (10000) is multi-folded so that one side (31) of the first housing (12) comes into contact with one side (21) of the third housing (16), the entire area of the first display (20) of the electronic device (10000) is surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (10000), so that the display mode of the first display (20) can be changed from the first display mode to the second display mode. For example, the first display mode can be a display mode that activates the entire area of the first display (20). For example, the second display mode can be a mode that can activate a part of the area (22) of the first display (20) and deactivate the remaining area (23).
[0053] In operation 210, the electronic device (10000) can display an execution screen of an application on the second display (30). The electronic device (10000) can display an execution screen of an application on the second display (30) of the electronic device (10000) when the first display (20) of the electronic device (10000) is surrounded by a plurality of housings (12, 14, 16) of the electronic device by multi-folding. Alternatively, the electronic device (10000) can display an execution screen of an application on the second display (30) of the electronic device (10000) when the first display (20) of the electronic device (10000) is placed on the floor while being surrounded by a plurality of housings of the electronic device by multi-folding.
[0054] According to one embodiment, the application may be an application that supports a function of displaying an execution screen of the application on a second display (30) of the electronic device (10000) when the electronic device (10000) is multi-folded. When the first display (20) of the electronic device (10000) is surrounded by housings due to multi-folding while the execution screen of the application is displayed on the first display (20), the application may provide an execution screen to be displayed on the second display (30) of the electronic device (10000).
[0055] In operation S220, the electronic device (10000) can determine whether a portion of the first display (20) is exposed. In a case where the entire portion of the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) due to multi-folding, as the folding angles of the multi-folding of the electronic device (10000) change, a portion of the first display (20) of the electronic device (10000) may be exposed to the outside of the electronic device (10000). For example, as the folding angles of the multi-folding of the electronic device (10000) change while the first display (20) of the electronic device (10000) is surrounded by the first housing (12), the second housing (14), and the third housing (16), one end of the third housing (16) may slide on the first display (20) within the first housing (12). For example, as one end of the third housing (16) slides over the first display (20) within the first housing (12), a portion of the first display (20) within the first housing (12) may be exposed to the outside of the electronic device (10000).
[0056] According to one embodiment, when the entire area of the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) by multi-folding and the electronic device (10000) is placed on the floor, the electronic device (10000) can determine whether a portion of the first display (20) is exposed.
[0057] According to one embodiment, as the folding angles of the multi-folding change, the size of the exposed portion of the first display (20) may increase or decrease. For example, as the size of the exposed portion of the first display (20) increases, one side of the first housing (12) may be positioned on a second position or a third position of the first display (20) corresponding to the third housing (16). For example, the second position of the first display (20) corresponding to the third housing (16) may be a position that is greater than a first distance range from one side of the third housing (16) on the first display (20) corresponding to the third housing (16) and less than a second distance range. For example, the third position of the first display (20) corresponding to the third housing (16) may be a position that is greater than a second distance range from one side of the third housing (16) on the first display (20) corresponding to the third housing (16).
[0058] According to one embodiment, the electronic device (10000) can determine whether a portion of the first display (20) is exposed using at least one sensor within the electronic device (10000). The electronic device (10000) can determine whether a portion of the first display (20) is exposed using, for example, at least one of a gyro sensor, an acceleration sensor, or an angle sensor, but is not limited thereto.
[0059] In the above, it has been described that the display mode of the first display (20) changes from the first display mode to the second display mode as the entire area of the first display (20) of the electronic device (10000) is surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (10000), but this is not limited thereto. For example, as a partial area (22) among the entire area of the first display (20) is exposed to the outside of the electronic device (10000), the display mode of the first display (20) may change from the first display mode to the second display mode.
[0060] An example of an electronic device (10000) determining whether a portion of the first display (20) is exposed will be described in more detail in FIGS. 5 and 6, which will be described later.
[0061] In operation 230, the electronic device (10000) may display a UI related to an application on an exposed portion of the first display (20). According to one embodiment, when the entire area of the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) due to multi-folding, and a portion of the first display (20) is exposed, the electronic device (10000) may display a UI related to an application of an execution screen displayed on a second display (30) on the exposed portion of the first display (20). According to one embodiment, the UI may include a graphical user interface (GUI). According to one embodiment, when the entire area of the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) by multi-folding and the electronic device (10000) is placed on the floor, and a part of the first display (20) is exposed, the electronic device (10000) can display a UI related to an application of an execution screen displayed on a second display (30) on the exposed part of the first display (20). In this case, the electronic device (10000) can activate the exposed part of the first display (20) and deactivate the remaining unexposed area of the first display (20).
[0062] According to one embodiment, the UI associated with the application may include a UI provided by the application and / or a UI provided by another application associated with the application.
[0063] For example, the UI displayed on the exposed portion of the first display (20) may include a portion of the execution screen of the application displayed on the second display (30). For example, the UI displayed on the exposed portion of the first display (20) may include a UI provided by the application for controlling the application or for user input to the application. For example, the UI displayed on the exposed portion of the first display (20) may include at least a portion of the execution screen of the second application that is mainly used by the user in relation to the application.
[0064] According to one embodiment, as the folding angles of the multi-folding are changed, the size of the exposed portion of the first display (20) may increase or decrease, and as the size of the exposed portion of the first display (20) is increased or decreased, the UI displayed on the exposed portion may change. In this case, the electronic device (10000) may identify whether one side of the first housing (12) is positioned on the second position or the third position of the first display (20) corresponding to the third housing (16). Whether one side of the first housing (12) is positioned on the second position or the third position of the first display (20) corresponding to the third housing (16) may be identified by the electronic device (10000) based on the folding angles of the multi-folding.
[0065] According to one embodiment, the electronic device (10000) may control the first display (20) such that as the folding angles of the multi-folding are changed, the size of an activated exposed portion of the first display (20) increases and the size of a deactivated remaining unexposed portion of the first display (20) decreases. According to one embodiment, the electronic device (10000) may control the first display (20) such that as the folding angles of the multi-folding are changed, the size of an activated exposed portion of the first display (20) decreases and the size of a deactivated remaining unexposed portion of the first display (20) increases.
[0066] However, examples of UI displayed on an exposed portion of the first display (20) are not limited thereto, and examples of UI displayed on an exposed portion of the first display (20) will be described in more detail in FIGS. 7 to 20 below. In addition, although the displayed UI is described as being a GUI, the type of UI is not limited to GUI.
[0067] FIG. 3 is a flowchart of a method for identifying whether an electronic device according to one embodiment of the present disclosure is placed on a floor by multi-folding.
[0068] The operations of FIG. 3 may correspond to operation 200 of FIG. 2, but are not limited thereto.
[0069] In operation 300, the electronic device (10000) can identify a first folding angle between the first housing (12) and the second housing (14). For example, the electronic device (10000) can measure the first folding angle between the first housing (12) and the second housing (14) using an angle sensor disposed around the first hinge (42).
[0070] In operation 310, the electronic device (10000) can identify a second folding angle between the second housing (14) and the third housing (16). For example, the electronic device (10000) can measure the second folding angle between the second housing (14) and the third housing (16) using an angle sensor disposed around the second hinge (44).
[0071] In operation 320, the electronic device (10000) can identify whether the entire area of the first display (20) of the electronic device (10000) is surrounded by a plurality of housings based on the first folding angle and the second folding angle. According to one embodiment, the electronic device (10000) can identify whether one side of the first display (20) corresponding to one side of the first housing (12) to the third housing (16) is located at a first position on the first display (20). The electronic device (10000) can identify whether the entire area of the first display (20) of the electronic device (10000) is surrounded by a plurality of housings such that the first display (20) is not exposed to the outside of the electronic device (10000) based on the first folding angle and the second folding angle. For example, when the widths of the first housing (12), the second housing (14), and the third housing (16) are the same, and when the first folding angle is 60 degrees and the second folding angle is 60 degrees, the electronic device (10000) can determine that the first display (20) is surrounded by the first housing (12), the second housing (14), and the third housing (16) when one side of the first housing (12) and one side of the third housing (16) are in contact. However, the folding angles for determining that the first display (20) is surrounded by the first housing (12), the second housing (14), and the third housing (16) are not limited thereto. For example, when the widths of the first housing (12), the second housing (14), and the third housing (16) are different, the folding angles for determining that the first display (20) is surrounded by the first housing (12), the second housing (14), and the third housing (16) may be different from the folding angles when the widths of the first housing (12), the second housing (14), and the third housing (16) are the same.
[0072] For example, even if one side of the first housing (12) does not physically contact one side of the third housing (16), if the first folding angle is within an angular range near 60 degrees including 60 degrees and the second folding angle is within an angular range near 60 degrees including 60 degrees, the electronic device (10000) can determine that the first display (20) is surrounded by the first housing (12), the second housing (14), and the third housing (16) and is not exposed to the outside. Alternatively, for example, by identifying that one side of the first housing (12) and one side of the third housing (16) have been in contact through a separate sensor or a separate detection device, the electronic device (10000) can determine that the first display (20) is surrounded by the first housing (12), the second housing (14), and the third housing (16) and is not exposed to the outside.
[0073] An example in which the first display (20) of the electronic device (10000) is surrounded by a plurality of housings of the electronic device (10000) will be described in more detail in FIGS. 4 and 6 below.
[0074] In operation 330, the electronic device (10000) can identify whether the shaking state of the electronic device (10000) is a stable state. The shaking state of the electronic device (10000) may be a state of the electronic device (10000) regarding whether the electronic device (10000) is shaking. In addition, a state in which the electronic device (10000) is not moving may be a stable state. For example, when the electronic device (10000) is placed on the floor and is not moving, the shaking state of the electronic device (10000) may be determined to be a stable state. For example, when the electronic device (10000) is placed on a stand and is not moving, the shaking state of the electronic device (10000) may be determined to be a stable state.
[0075] In operation 340, the electronic device (10000) can identify whether the rear side of the third housing (16) is facing the floor. The electronic device (10000) can identify whether the rear side of the third housing (16) is facing the floor using a sensor within the electronic device (10000). For example, the electronic device (10000) can identify whether the electronic device (10000) is placed on the floor with the rear side of the third housing (16) facing the floor using a gyro sensor within the electronic device (10000). Alternatively, for example, the electronic device (10000) can identify whether the electronic device (10000) is placed on the floor with the rear side of the third housing (16) facing the floor based on a direction in which a camera disposed in the second housing (14) of the electronic device (10000) is facing.
[0076] According to one embodiment, it may be determined whether to display an execution screen of an application on the second display (30) based on at least one of whether the shaking state of the electronic device (10000) of the electronic device (10000) is stable or whether the rear surface of the third housing (16) is facing the floor and whether the entire area of the first display (20) is surrounded by a plurality of housings.
[0077] In Fig. 3, it is described that the shaking state of the electronic device (10000) in operation 330 is determined to be stable, and in operation 340, the electronic device (10000) is determined to be the rear surface of the third housing (16), but this is not limited thereto. Operations 330 and 340 of Fig. 3 may be omitted.
[0078] FIG. 4 is a drawing showing an example in which a first display of an electronic device according to one embodiment of the present disclosure is surrounded by housings by multi-folding.
[0079] Identification number 4 of FIG. 4 indicates a state in which the electronic device (10000) according to one embodiment is fully folded, identification number 6 of FIG. 4 indicates a state in which the first display (20) of the electronic device (10000) according to one embodiment is surrounded by the first housing (12), the second housing (14), and the third housing (16) and is not exposed to the outside, and identification number 5 of FIG. 4 indicates an intermediate state in which the electronic device (10000) according to one embodiment changes from a state of identification number 4 of FIG. 4 to a state of identification number 6 of FIG. 4.
[0080] According to one embodiment, when the electronic device (10000) is in a fully folded state, as the folding angle between the first housing (12) and the second housing (14) and the folding angle between the second housing (14) and the third housing (16) increase, the first display (20) of the electronic device (10000) may be surrounded by the first housing (12), the second housing (14) and the third housing (16) and not be exposed to the outside.
[0081] FIG. 5 is a flowchart of a method for an electronic device according to one embodiment of the present disclosure to determine whether a portion of a first display is exposed.
[0082] The operations of FIG. 5 may correspond to operation 220 of FIG. 2, but are not limited thereto.
[0083] In operation 500, the electronic device (10000) can identify a first folding angle between the first housing (12) and the second housing (14). For example, the electronic device (10000) can measure the first folding angle between the first housing (12) and the second housing (14) using an angle sensor disposed around the first hinge (42). For example, the electronic device (10000) can measure the first folding angle between the first housing (12) and the second housing (14) as the folding state of the electronic device (10000) is changed by the user in a state where the first display (20) is surrounded by the first housing (12), the second housing (14), and the third housing (16).
[0084] In operation 510, the electronic device (10000) can identify a second folding angle between the second housing (14) and the third housing (16). For example, the electronic device (10000) can measure the second folding angle between the second housing (14) and the third housing (16) using an angle sensor disposed around the second hinge (44). For example, the electronic device (10000) can measure the second folding angle between the second housing (14) and the third housing (16) as the folding state of the electronic device (10000) is changed by the user in a state where the first display (20) is surrounded by the first housing (12), the second housing (14), and the third housing (16).
[0085] In operation 520, the electronic device (10000) can identify whether a portion of the first display is exposed based on the first folding angle and the second folding angle. As the folding state of the electronic device (10000) changes, a portion of the entire area of the first display (20) surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (10000) can be exposed to the outside of the electronic device (10000). In this case, the electronic device (10000) can identify whether a portion of the first display (20) is exposed to the outside of the electronic device (10000) based on the first folding angle and the second folding angle. Additionally, the electronic device (10000) can identify whether the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) by multi-folding. For example, the electronic device (10000) can identify whether one side of the first housing (12) is positioned on the first position of the first display (20) corresponding to the third housing (16) as the electronic device (10000) is multi-folded. For example, when one side of the first housing (12) is positioned on one side of the third housing (16) or is positioned on the first display (20) within a first distance range from one side of the third housing, the electronic device (10000) can determine that one side of the first housing (12) is positioned on the first position of the first display (20) corresponding to the third housing (16) and that the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000) by multi-folding.
[0086] In operation 530, the electronic device (10000) can identify the size of an exposed portion of the first display based on the first folding angle and the second folding angle. The electronic device (10000) can identify the size of an exposed portion of the first display (20) based on the first folding angle and the second folding angle. Depending on the first folding angle and the second folding angle, the size of the exposed portion of the first display (20) can be preset according to the sizes of the first housing (12), the second housing (14), and the third housing (16) of the electronic device (10000). For example, depending on the combination of the first folding angle and the second folding angle, the size of the exposed portion of the first display (20) can be preset.
[0087] According to one embodiment, the electronic device (10000) can identify the size of a portion of the exposed first display (20) by determining where one side of the first housing (12) is positioned on the first display (20) corresponding to the third housing (16). For example, the electronic device (10000) can identify whether one side of the first housing (12) is positioned on the first position, the second position, or the third position on the first display (20) corresponding to the third housing (16). For example, whether one side of the first housing (12) is positioned on the first position, the second position, or the third position of the first display (20) corresponding to the third housing (16) can be identified based on the folding angles of the multi-folding of the electronic device (10000). For example, as the size of the exposed portion of the first display (20) increases, one side of the first housing (12) can move from the first position of the first display (20) corresponding to the third housing (16) to the second position or the third position. For example, the second position of the first display (20) corresponding to the third housing (16) can be a position on the first display (20) corresponding to the third housing (16) that is greater than the first distance range and less than the second distance range from the one side of the third housing (16). For example, the third position of the first display (20) corresponding to the third housing (16) may be a position that is greater than the second distance range and less than the third distance range from one side of the third housing (16) on the first display (20) corresponding to the third housing (16).
[0088] FIG. 6 is a drawing showing an example in which a first display is surrounded by housings of an electronic device according to a folding angle of the electronic device according to one embodiment of the present disclosure.
[0089] Referring to the identification number 7 of FIG. 6, the sizes of the first housing (12), the second housing (14), and the third housing (16) may be the same, the first folding angle between the first housing (12) and the second housing (14) may be 60 degrees, and the folding angle between the second housing (14) and the third housing (16) may be 60 degrees. In this case, the entire area of the first display (20) of the electronic device (10000) may be surrounded by the first housing (12), the second housing (14), and the third housing (16). Accordingly, the entire area of the first display (20) of the electronic device (10000) may not be exposed to the outside of the electronic device (10000). For example, one side (31) of the first housing (12) may come into contact with one side (21) of the third housing (16). In addition, it can be determined that one side (31) of the first housing (12) is located on the first position of the first display (20) corresponding to the third housing (16). In FIG. 6, it has been described that when one side (31) of the first housing (12) comes into contact with one side (21) of the third housing (16), it is determined that one side (31) of the first housing (12) is located on the first position of the first display (20) corresponding to the third housing (16), but it is not limited thereto. For example, when one side (31) of the first housing (12) is located on the first display (20) within the first distance range from one side (21) of the third housing, it can be determined that one side of the first housing (12) is located on the first position of the first display (20) corresponding to the third housing (16).
[0090] Referring to the identification number 8 of FIG. 6, the sizes (e.g., widths of the housings) of the first housing (12), the second housing (14), and the third housing (16) may be the same, the first folding angle between the first housing (12) and the second housing (14) may be 20 degrees, and the folding angle between the second housing (14) and the third housing (16) may be 80 degrees. In this case, a part (22) of the entire area of the first display (20) of the electronic device (10000) may not be surrounded by the first housing (12), the second housing (14), and the third housing (16). Accordingly, a part (22) of the first display (20) of the electronic device (10000) may be exposed to the outside of the electronic device (10000). Additionally, for example, as the size of the exposed portion of the first display (20) increases, one side (31) of the first housing (12) may be positioned on the second or third position of the first display (20) corresponding to the third housing (16).
[0091] Referring to identification number 9 of FIG. 6, the sizes of the first housing (12), the second housing (14), and the third housing (16) may be the same, the first folding angle between the first housing (12) and the second housing (14) may be 70 degrees, and the folding angle between the second housing (14) and the third housing (16) may be 80 degrees. In this case, the entire area of the first display (20) of the electronic device (10000) may not be surrounded by the first housing (12), the second housing (14), and the third housing (16).
[0092] FIG. 7 is a drawing showing a GUI displayed on a part of a first display of an electronic device as a part of a first display of the electronic device is exposed while an execution screen of an application for video conferencing is displayed on a second display of the electronic device according to one embodiment of the present disclosure.
[0093] Referring to FIG. 7, when the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000), an execution screen (70) of an application for video conferencing can be displayed on the second display (30) of the electronic device (10000). When the execution screen of the application for video conferencing is displayed on the first display (20) of the electronic device (10000) in a state where the electronic device (10000) is not folded, when the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000), an execution screen (70) of an application for video playback can be displayed on the second display (30) of the electronic device (10000). Thereafter, as a portion (22) of the first display (20) of the electronic device (10000) is exposed, the execution screen (70) of the application for video conferencing may be changed, and the changed execution screen (72) may be displayed on the second display (30) of the electronic device (10000). In addition, a GUI (74) related to the application for video conferencing may be displayed on the exposed portion (22) of the first display. For example, a GUI (74) including objects for controlling a video conference within the execution screen (70) of the application for video conferencing may be removed within the changed execution screen (72), and the GUI (74) may be displayed on the exposed portion (22).
[0094] FIG. 8 is a diagram illustrating a GUI displayed on a portion of a first display of an electronic device as a portion of the first display of the electronic device is exposed while video content is displayed on a second display of the electronic device according to one embodiment of the present disclosure.
[0095] Referring to FIG. 8, when the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000), the execution screen (80) of the application for video playback can be displayed on the second display (30) of the electronic device (10000). When the electronic device (10000) is not folded and the execution screen (80) of the application for video playback is being displayed on the first display (20) of the electronic device (10000), when the first display (20) of the electronic device (10000) is surrounded by the housings of the electronic device (10000), the execution screen (80) of the application for video playback can be displayed on the second display (30) of the electronic device (10000). Thereafter, as a portion (22) of the first display (20) of the electronic device (10000) is exposed, the execution screen (80) of the application for video playback is maintained, and a GUI (82) for controlling the video being played can be displayed on the portion (22) of the exposed first display. For example, the GUI (82) for controlling the video being played may be a GUI for changing the playback position of the video, but is not limited thereto.
[0096] In FIGS. 7 and 8, examples of content displayed on a second display (30) of the electronic device (10000) and a portion of the first display (20) of the electronic device (10000) are described, but are not limited thereto, when a portion of the first display (20) of the electronic device (10000) is exposed as the folding angle of the electronic device (10000) changes while the first display (20) of the electronic device (10000) is surrounded by housings.
[0097] FIG. 9 is a flowchart of a method for changing and displaying a GUI on a portion of a first display as the size of a portion of a first display exposed by multi-folding of an electronic device according to an embodiment of the present disclosure changes.
[0098] Actions 900 to 930 of FIG. 9 may be performed after action 220 of FIG. 2, but are not limited thereto.
[0099] In operation 900, the electronic device (10000) can determine whether the size of the exposed portion is within a first range. For example, the electronic device (10000) can determine whether one side (31) of the first housing (12) is located at a position greater than the first distance range and less than the second distance range from one side (21) of the third housing (16). As the folding angle of the electronic device (10000) changes, a portion of the first display (20) is exposed, and thus the electronic device (10000) can identify the size of the exposed portion of the first display (20). According to one embodiment, the size of the exposed portion of the first display (20) can be determined based on a combination of folding angles of the electronic device (10000). For example, based on the first folding angle between the first housing (12) and the second housing (14), the second folding angle between the second housing (14) and the third housing (16), the size of the first housing (12), the size of the second housing (14), and the size of the third housing (16), the electronic device (10000) can calculate the size of a portion of the exposed first display (20). In addition, the electronic device (10000) can determine whether the size of the portion of the exposed first display (20) is within the first range by comparing the size of the portion of the exposed first display (20) with a preset first range. For example, the first range may be a range preset for displaying a first GUI related to an application.
[0100] In operation 910, the electronic device (10000) may display a first GUI related to an application on a portion of the exposed area. The first GUI to be displayed on the portion of the exposed area having a size within the first range may be a GUI preset by the application, and in this case, the application may be an application that supports a function of displaying an additional GUI on the portion of the exposed area.
[0101] According to one embodiment, the electronic device (10000) may display a first GUI provided by an application and for controlling the operation of the application on an exposed portion having a size within a first range. For example, the electronic device (10000) may display a first GUI including objects for selecting functions of the application and / or objects for user input to the application on an exposed portion having a size within the first range.
[0102] According to one embodiment, the electronic device (10000) may display a first GUI provided by a second application related to the operation of an application on an exposed portion having a size within a first range. For example, the first GUI may include objects provided by another application for user input to the application. In this case, for example, the other application may be an application that provides key input, and the first GUI may be a GUI of a numeric keypad for numeric input.
[0103] According to one embodiment, the electronic device (10000) may display a first GUI including objects for executing other applications associated with the application on an exposed portion having a size within a first range. For example, the electronic device (10000) may display a first GUI including icons for executing other preset applications that are likely to be executed together with the application.
[0104] Examples of a first GUI displayed on an exposed portion having a size within the first range are not limited thereto, and a first GUI including various objects may be displayed on an exposed portion having a size within the first range.
[0105] In operation 920, the electronic device (10000) can determine whether the size of the exposed portion is within the second range. For example, the electronic device (10000) can determine whether one side (31) of the first housing (12) is located at a position greater than the second distance range and less than the third distance range from one side (21) of the third housing (16). As the size of the exposed portion of the first display (20) increases due to a change in the folding angle of the electronic device (10000), the electronic device (10000) can identify the size of the exposed portion of the first display (20). According to one embodiment, the size of the exposed portion of the first display (20) can be determined based on a combination of folding angles of the electronic device (10000). For example, based on the first folding angle between the first housing (12) and the second housing (14), the second folding angle between the second housing (14) and the third housing (16), the size of the first housing (12), the size of the second housing (14), and the size of the third housing (16), the electronic device (10000) can calculate the size of a portion of the exposed first display (20). In addition, the electronic device (10000) can determine whether the size of the portion of the exposed first display (20) is within a second range by comparing the size of the portion of the exposed first display (20) with a preset second range. For example, the second range may be a preset range for displaying a second GUI related to an application. In addition, the second range of the portion of the exposed area may be larger than the first range of the portion of the exposed area.
[0106] In operation 930, the electronic device (10000) may display a second GUI related to the application on the exposed portion. As the size of the exposed portion having a size within the first range is identified to increase to a size within the first range, the electronic device (10000) may display the second GUI on the portion of the first display (20). The second GUI to be displayed on the exposed portion may be a GUI preset by the application, and in this case, the application may be an application that supports a function of displaying an additional GUI on the exposed portion.
[0107] According to one embodiment, the electronic device (10000) may display a second GUI provided by an application and for controlling the operation of the application on an exposed portion having a size within a second range. For example, the electronic device (10000) may display a second GUI including objects for selecting functions of the application and / or objects for user input to the application, which may be a GUI including more objects than the first GUI.
[0108] According to one embodiment, the electronic device (10000) may display a second GUI provided by another application related to the operation of the application on an exposed portion having a size within a second range. For example, the second GUI may include objects provided by the other application for user input to the application. In this case, for example, the other application may be an application that provides key input, and the second GUI may be a GUI of a keyboard capable of character input.
[0109] According to one embodiment, the electronic device (10000) may display a second GUI including objects for executing other applications associated with the application and / or execution screens of the other applications on an exposed portion having a size within a second range. For example, the electronic device (10000) may display a second GUI including icons for executing other preset applications that are likely to be executed together with the application and / or execution screens of the other applications.
[0110] Examples of a second GUI displayed on an exposed portion having a size within the second range are not limited thereto, and a second GUI including various objects may be displayed on an exposed portion having a size within the second range.
[0111] FIG. 10 is a drawing showing an example in which a GUI on a portion of a first display changes as the size of a portion of a first display exposed by multi-folding of an electronic device according to one embodiment of the present disclosure changes.
[0112] Referring to FIG. 10, when the size of the exposed portion (22) of the first display (20) is within the first range, an execution screen (100) of an application may be displayed on the second display (30), and a GUI (102) including objects for selecting words to be input into the application may be displayed on the exposed portion (22) of the first display (20). In this case, the execution screen (100) of the application displayed on the second display (30) may be, for example, an execution screen of an application capable of receiving a user's character input. For example, the execution screen (100) of the application displayed on the second display (30) may be, but is not limited to, an application for schedule management.
[0113] Thereafter, when the size of the exposed portion (22) increases as the folding angle of the electronic device (10000) is changed by the user, and the size of the exposed portion (22) is included within the second range, a GUI (104) of a keyboard application for receiving user input for the application can be displayed on the exposed portion (22) of the first display (20).
[0114] FIG. 11 is a diagram illustrating an example in which a GUI related to a sleep-inducing image is changed on a portion of a first display as the size of a portion of a first display exposed by multi-folding of an electronic device according to an embodiment of the present disclosure is changed.
[0115] Referring to FIG. 11, when the size of an exposed portion (22) of the first display (20) is within the first range, an execution screen (110) of an application for displaying an image for inducing sleep may be displayed on the second display (30), and a GUI (112) including objects for changing the theme of the image for inducing sleep may be displayed on the exposed portion (22) of the first display (20).
[0116] Thereafter, when the size of the exposed portion (22) increases due to a change in the folding angle of the electronic device (10000) by the user, and the size of the exposed portion (22) is included within the second range, a GUI (114) for tuning the properties of an image for inducing sleep can be displayed on the exposed portion (22) of the first display (20).
[0117] FIG. 12 is a diagram illustrating an example in which a GUI for user input related to a video is changed on a part of a first display as the size of a part of a first display exposed by multi-folding of an electronic device according to one embodiment of the present disclosure is changed.
[0118] Referring to FIG. 12, when the size of an exposed portion (22) of the first display (20) is within the first range, an execution screen (120) of an application for displaying a web video may be displayed on the second display (30), and a simple GUI (122) including video information of the web video and an object for evaluating the web video may be displayed on the exposed portion (22) of the first display (20).
[0119] Thereafter, when the size of the exposed portion (22) increases due to a change in the folding angle of the electronic device (10000) by the user, and the size of the exposed portion (22) falls within the second range, a GUI (124) for checking comments on a web video and writing comments may be displayed on the exposed portion (22) of the first display (20). For example, the GUI (124) may include a keyboard for receiving user input, but is not limited thereto.
[0120] FIG. 13 is a diagram illustrating an example in which a GUI for user input related to game content is changed on a portion of a first display as the size of a portion of a first display exposed by multi-folding of an electronic device according to one embodiment of the present disclosure is changed.
[0121] Referring to FIG. 13, when the size of an exposed portion (22) of a first display (20) is within a first range, a game application execution screen (130) may be displayed on a second display (30), and a GUI (132) for simple manipulation of game content may be displayed on an exposed portion (22) of the first display (20). For example, the game content may be game content that is automatically controlled without requiring a long period of user input, but is not limited thereto.
[0122] Thereafter, when the size of the exposed portion (22) increases as the folding angle of the electronic device (10000) is changed by the user, and the size of the exposed portion (22) is included within the second range, a GUI (134) including a controller that allows the user to actively manipulate game content can be displayed on the exposed portion (22) of the first display (20).
[0123] FIG. 14 is a diagram illustrating an example in which a GUI for unlocking a lock screen on a portion of a first display changes as the size of a portion of a first display exposed by multi-folding of an electronic device according to an embodiment of the present disclosure changes.
[0124] Referring to FIG. 14, when the size of the exposed portion (22) of the first display (20) is within the first range, a lock screen (1400) may be displayed on the second display (30), and a GUI (1402) including a numeric keypad for entering numbers to unlock the lock screen (140) may be displayed on the exposed portion (22) of the first display (20). For example, the lock screen (1400) on the second display (30) may provide the function of a dashboard that provides designated information (e.g., current time, weather, message notifications, schedule notifications, and / or remaining battery level), but is not limited thereto.
[0125] Thereafter, when the size of the exposed portion (22) increases due to a change in the folding angle of the electronic device (10000) by the user, and the size of the exposed portion (22) is included within the second range, a GUI (1404) including a keyboard for entering characters to unlock the lock screen (1400) may be displayed on the exposed portion (22) of the first display (20).
[0126] FIG. 15 is a diagram illustrating an example of a GUI for displaying information related to a photo on a portion of a first display as the size of a portion of a first display exposed by multi-folding of an electronic device according to an embodiment of the present disclosure changes.
[0127] Referring to FIG. 15, when the size of an exposed portion (22) of the first display (20) is within the first range, a photo image (1500) provided by a gallery application may be displayed on the second display (30), and a GUI (1502) including simple image information (e.g., shooting date, shooting location, and / or file name) about the photo image may be displayed on the exposed portion (22) of the first display (20).
[0128] Thereafter, when the size of the exposed portion (22) increases due to a change in the folding angle of the electronic device (10000) by the user, and the size of the exposed portion (22) falls within the second range, a GUI (1504) including a map indicating a location where a photographic image was taken may be displayed on the exposed portion (22) of the first display (20). For example, location information where the photographic image (1500) was taken may be provided from a gallery application to a map application, and the GUI (1504) may be displayed by the map application.
[0129] In FIGS. 10 to 15, examples are described in which a GUI on a portion of a first display changes as the size of a portion of a first display exposed by multi-folding of an electronic device changes, but the present invention is not limited thereto.
[0130] For example, the application displayed on the second display (30) may be a banking application. In this case, if the size of the exposed portion (22) of the first display (20) falls within the first range, a GUI for selecting an account number stored in the clipboard may be displayed on the exposed portion (22) of the first display (20). Thereafter, if the size of the exposed portion (22) increases as the user changes the folding angle of the electronic device (10000), and if the size of the exposed portion (22) falls within the second range, an execution screen of another application related to the banking application may be displayed on the exposed portion (22) of the first display (20). For example, a memo application and a calculator application related to the banking application may be displayed on the exposed portion (22), and the user may calculate a remittance amount through the execution screen of the calculator application.
[0131] For example, the application displayed on the second display (30) may be an application for stock trading. In this case, if the size of the exposed portion (22) of the first display (20) falls within the first range, a GUI including personal information related to stock trading may be displayed on the exposed portion (22) of the first display (20). The GUI including simple personal information related to stock trading may include, for example, the user's rate of return and account information. Thereafter, if the size of the exposed portion (22) increases due to a change in the folding angle of the electronic device (10000) by the user, and the size of the exposed portion (22) falls within the second range, a GUI including detailed objects for controlling stock trading may be displayed on the exposed portion (22) of the first display (20). For example, the GUI including detailed objects for controlling stock trading may include, for example, objects for checking information necessary for buying and selling stocks and executing the buying and selling.
[0132] FIG. 16 is a flowchart of a method for changing and displaying a GUI on an exposed portion of a first display when an external input device of an electronic device according to one embodiment of the present disclosure is grasped by a user.
[0133] Actions 1100 and 1110 of FIG. 16 may be performed after action 220 of FIG. 2, but are not limited thereto.
[0134] In operation 1100, the electronic device (10000) can determine whether the external input device of the electronic device (10000) has been gripped by the user. The electronic device (10000) can determine that the external input device has been gripped by the user because the external input device and the electronic device (10000) are connected via short-range wireless communication. For example, the external input device of the electronic device (10000) may be a stylus pen. In this case, because the stylus pen is connected to the electronic device (10000) via short-range wireless communication, the electronic device (10000) can determine that the external input device has been gripped by the user.
[0135] According to one embodiment, the electronic device (10000) may determine that the external input device has been gripped by the user when an external input device that is attachable to the electronic device (10000) is detached from the electronic device (10000) and the external input device and the electronic device (10000) are connected by short-range wireless communication. For example, the external input device of the electronic device (10000) may be a stylus pen inserted into the electronic device (10000). In this case, when the stylus pen inserted into the electronic device (10000) is detached from the electronic device (10000) and short-range communication is connected between the stylus pen and the electronic device (10000), the electronic device (10000) may determine that the external input device has been gripped by the user.
[0136] Although the above description describes an electronic device (10000) determining that an external input device has been grasped by a user, the present invention is not limited thereto. The electronic device (10000) may also determine that an external input device wirelessly connected to the electronic device (10000) is being used by a user.
[0137] In operation 1110, the electronic device (10000) may display a third GUI for user input via an external input device on an exposed portion of the first display (20). The third GUI may be a GUI for receiving user input via the external input device. For example, the third GUI may be a GUI of an application for receiving handwriting input via a stylus pen, but is not limited thereto. According to one embodiment, when it is determined that the external input device has been gripped by the user, the third GUI may be displayed on the exposed portion of the first display (20) with priority over other GUIs. For example, when it is determined that the external input device has been gripped by the user, the first GUI and the second GUI may not be displayed on the exposed portion of the first display (20) and the third GUI may be displayed with priority.
[0138] FIG. 17 is a flowchart of a method for changing and displaying a GUI on an exposed portion of a first display when an electronic device according to one embodiment of the present disclosure outputs notification information.
[0139] Actions 1200 and 1210 of FIG. 17 may be performed after action 220 of FIG. 2, but are not limited thereto.
[0140] In operation 1200, the electronic device (10000) can determine whether notification information has been output. The electronic device (10000) can output notification information generated within the electronic device (10000) and / or notification information received from outside the electronic device (10000). According to one embodiment, the electronic device (10000) can display the notification information on the second display (30). For example, the electronic device (10000) can display notification information generated by at least one application within the electronic device (10000) on the second display (30). Alternatively, for example, the electronic device (10000) can display notification information for notifying a message received from an external electronic device (10000) on the second display (30).
[0141] In operation 1210, the electronic device (10000) may display a fourth GUI for user input regarding a notification on an exposed portion of the first display (20). The fourth GUI may be a GUI for receiving user input related to notification information. For example, if the notification information is notification information indicating a message received from an external electronic device, the fourth GUI may include at least a portion of the execution screen of a message application. In addition, for example, if the notification information is notification information for notifying a schedule registered in a calendar application, the fourth GUI may include at least a portion of the execution screen of the calendar application. However, the type of notification information and the type of the fourth GUI are not limited thereto.
[0142] According to one embodiment, when notification information is output, the fourth GUI may be displayed on an exposed portion of the first display (20) with priority over other GUIs. For example, when notification information is output, the electronic device (10000) may display the fourth GUI with priority over other GUIs without displaying the first GUI and the second GUI on an exposed portion of the first display (20).
[0143] FIG. 18 is a flowchart of a method for changing and displaying a GUI on an exposed portion of a first display, taking into account whether an external input device of an electronic device according to one embodiment of the present disclosure is held by a user or whether the electronic device has output notification information.
[0144] Actions 1300 to 1330 of FIG. 18 may be performed after action 220 of FIG. 2, but are not limited thereto.
[0145] In operation 1300, the electronic device (10000) can determine whether an external input device has been grasped by the user. Operation 1300 may correspond to operation 1100.
[0146] When it is determined that the external input device of the electronic device (10000) has been grasped by the user, the electronic device (10000) may display a third GUI for user input via the external input device on an exposed portion of the first display (20) in operation 1310. Operation 1310 may correspond to operation 1110.
[0147] As it is determined that the external input device of the electronic device (10000) has not been grasped by the user, the electronic device (10000) may determine in operation 1320 whether notification information has been output. Operation 1320 may correspond to operation 1200.
[0148] As it is determined that the electronic device (10000) has output notification information, the electronic device (10000) may display a fourth GUI for user input regarding the notification on an exposed portion of the first display (20) in operation 1330. Operation 1330 may correspond to operation 1210.
[0149] As it is determined that the electronic device (10000) did not output notification information, in operation 1340, the electronic device (10000) may display a first GUI or a second GUI related to the application on an exposed portion of the first display (20). For example, if the size of the exposed portion of the first display (20) is within a first range, the electronic device (10000) may display the first GUI on the exposed portion of the first display (20). Alternatively, if the size of the exposed portion of the first display (20) is within a second range, the electronic device (10000) may display the second GUI on the exposed portion of the first display (20).
[0150] Although FIG. 18 describes that the electronic device (10000) displays the third GUI with priority over the fourth GUI, this is not limited thereto. The electronic device (10000) may display the fourth GUI with priority over the third GUI.
[0151] FIG. 19 is a diagram illustrating an example in which a GUI related to notification information is displayed on an exposed portion of a first display when an electronic device according to one embodiment of the present disclosure receives notification information.
[0152] Referring to identification number 141 of FIG. 19, when the electronic device (10000) receives a message from an external electronic device (10000), the electronic device (10000) can display notification information (145) notifying the received message on the second display (30) of the electronic device (10000).
[0153] Thereafter, with reference to the identification number 142 of FIG. 19, when the folding angle of the electronic device (10000) is changed by the user so that the size of the exposed area (22) of the first display (20) falls within the first range (e.g., when one side (31) of the first housing (12) is positioned at a position greater than the first distance range and less than the second distance range from one side (21) of the third housing (16), the electronic device (10000) may display a GUI (147) for selecting a text for message transmission on the exposed area (22) of the first display (20). In this case, for example, the electronic device (10000) may display a GUI for displaying a received message and displaying a text selected by the user as a message to be transmitted on the second display (30) of the electronic device (10000).
[0154] Thereafter, with reference to the identification number 143 of FIG. 19, when the folding angle of the electronic device (10000) is changed by the user so that the size of the exposed area (22) of the first display (20) falls within the second range (e.g., when one side (31) of the first housing (12) is positioned at a position greater than the second distance range and less than the third distance range from one side (21) of the third housing (16), the electronic device (10000) may display a GUI (148) of a keyboard for inputting text for message transmission on the exposed area (22) of the first display (20). In this case, for example, the electronic device (10000) may display a GUI for displaying a received message and a message input via the keyboard on the second display (30) of the electronic device (10000).
[0155] FIG. 20 is a diagram illustrating an example in which a GUI related to an external input device gripped by a user is displayed on an exposed portion of a first display when the external input device of an electronic device according to one embodiment of the present disclosure is gripped by a user.
[0156] Referring to identification number 151 of FIG. 20, the electronic device (10000) can display an execution screen (154) of an application for video playback. Lecture content can be displayed within the execution screen (154) of the application for video playback.
[0157] Thereafter, referring to the identification number 153 of FIG. 20, when the folding angle of the electronic device (10000) is changed by the user, and the first display (20) of the electronic device (10000) is exposed, the electronic device (10000) can identify that the stylus pen (155) has been held by the user. Thereafter, the electronic device (10000) can display an execution screen (156) of an application for receiving a user's handwriting input via the stylus pen (155) on the exposed area (22) of the first display (20).
[0158] According to one embodiment, a method for an electronic device to display an execution screen of an application comprises: an operation (210) of displaying an execution screen of an application on a second display (30) of the electronic device (10000); an operation (200) of identifying whether one side of the first housing is positioned on a portion corresponding to the third housing among the entire area of the first display (20) of the electronic device by multi-folding the electronic device including a first housing (12), a second housing (14), and a third housing (16); And an operation (220, 230) of changing the display mode of the first display from the first display mode to the second display mode based on identification that the one side of the first housing is located on the portion corresponding to the third housing, wherein the first display is arranged across the first housing, the second housing, and the third housing and faces a first direction of the electronic device, the second display is arranged in the first housing and faces a second direction of the electronic device, and the second display mode may be a mode that controls an activated portion of the first display and a deactivated remaining portion of the first display based on a position on the portion of the first display where the one side of the first housing is located.
[0159] According to one embodiment, the electronic device is multi-folded by the first hinge between the first housing and the second housing, and the second hinge between the second housing and the third housing, and the activated portion may be an area exposed to the outside of the electronic device from the portion where the one side of the first housing is located among the entire area of the first display.
[0160] According to one embodiment, the method may further include: an operation of deactivating an entire area of the first display when the one side of the first housing is positioned at a first position on the portion of the first display.
[0161] According to one embodiment, when the one side of the first housing is positioned at the first position, the size of the area of the first display exposed to the outside of the electronic device may be smaller than a specified threshold.
[0162] According to one embodiment, the method may further include: activating the partial area of the first display and deactivating the remaining portion of the first display when the first side is located at a second position on the portion of the first display; and displaying a first UI related to the application on the activated partial area.
[0163] According to one embodiment, the method may further include: an operation of enlarging the activated portion of the first display when the first side is located at a third position on the portion of the first display; and an operation of displaying a second UI related to the application on the expanded activated portion of the first display.
[0164] According to one embodiment, when the size of the partial region is within a first range, the first UI is displayed on the partial region, and as the size of the partial region increases to a second range that is larger than the first range, the first UI can be changed to the second UI.
[0165] According to one embodiment, the electronic device may further include: an operation of identifying that an external input device for the electronic device is held by a user; and an operation of displaying a third UI for receiving a user input by the external input device on the partial region when the holding is identified.
[0166] According to one embodiment, when the electronic device outputs notification information, the electronic device may further include an operation of displaying a fourth UI for user input for the notification information on the partial area.
[0167] FIG. 21 is a block diagram of an electronic device (1601) within a network environment (1600) according to various embodiments. Referring to FIG. 21, in the network environment (1600), the electronic device (1601) may communicate with the electronic device (1602) via a first network (1698) (e.g., a short-range wireless communication network), or may communicate with the electronic device (1604) or a server (1608) via a second network (1699) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1601) may communicate with the electronic device (1604) via the server (1608). According to one embodiment, the electronic device (1601) may include a processor (1620), a memory (1630), an input module (1650), an audio output module (1655), a display module (1660), an audio module (1670), a sensor module (1676), an interface (1677), a connection terminal (1678), a haptic module (1679), a camera module (1680), a power management module (1688), a battery (1689), a communication module (1690), a subscriber identification module (1696), or an antenna module (1697). In some embodiments, the electronic device (1601) may omit at least one of these components (e.g., the connection terminal (1678)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1676), camera module (1680), or antenna module (1697)) may be integrated into a single component (e.g., display module (1660)).
[0168] The processor (1620) may control at least one other component (e.g., a hardware or software component) of the electronic device (1601) connected to the processor (1620) by executing, for example, software (e.g., a program (1640)), and may perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1620) may store commands or data received from other components (e.g., a sensor module (1676) or a communication module (1690)) in a volatile memory (1632), process the commands or data stored in the volatile memory (1632), and store result data in a non-volatile memory (1634). According to one embodiment, the processor (1620) may include a main processor (1621) (e.g., a central processing unit or an application processor) or an auxiliary processor (1623) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1621). For example, when the electronic device (1601) includes the main processor (1621) and the auxiliary processor (1623), the auxiliary processor (1623) may be configured to use less power than the main processor (1621) or to be specialized for a given function. The auxiliary processor (1623) may be implemented separately from the main processor (1621) or as a part thereof.
[0169] The auxiliary processor (1623) may control at least a portion of functions or states associated with at least one component (e.g., the display module (1660), the sensor module (1676), or the communication module (1690)) of the electronic device (1601), for example, on behalf of the main processor (1621) while the main processor (1621) is in an inactive (e.g., sleep) state, or together with the main processor (1621) while the main processor (1621) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1623) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1680) or a communication module (1690)). In one embodiment, the auxiliary processor (1623) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1601) where the artificial intelligence is performed, or can be performed through a separate server (e.g., server (1608)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.
[0170] The memory (1630) can store various data used by at least one component (e.g., the processor (1620) or the sensor module (1676)) of the electronic device (1601). The data can include, for example, software (e.g., the program (1640)) and input data or output data for commands related thereto. The memory (1630) can include volatile memory (1632) or non-volatile memory (1634).
[0171] The program (1640) may be stored as software in memory (1630) and may include, for example, an operating system (1642), middleware (1644), or an application (1646).
[0172] The input module (1650) can receive commands or data to be used in a component of the electronic device (1601) (e.g., a processor (1620)) from an external source (e.g., a user) of the electronic device (1601). The input module (1650) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0173] The audio output module (1655) can output audio signals to the outside of the electronic device (1601). The audio output module (1655) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.
[0174] The display module (1660) can visually provide information to an external party (e.g., a user) of the electronic device (1601). The display module (1660) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (1660) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.
[0175] The audio module (1670) can convert sound into an electrical signal, or vice versa. According to one embodiment, the audio module (1670) can acquire sound through the input module (1650), output sound through the sound output module (1655), or an external electronic device (e.g., electronic device (1602)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1601).
[0176] The sensor module (1676) can detect the operating status (e.g., power or temperature) of the electronic device (1601) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1676) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0177] The interface (1677) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1601) with an external electronic device (e.g., the electronic device (1602)). In one embodiment, the interface (1677) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0178] The connection terminal (1678) may include a connector through which the electronic device (1601) may be physically connected to an external electronic device (e.g., the electronic device (1602)). In one embodiment, the connection terminal (1678) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0179] The haptic module (1679) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1679) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.
[0180] The camera module (1680) can capture still images and videos. In one embodiment, the camera module (1680) may include one or more lenses, image sensors, image signal processors, or flashes.
[0181] The power management module (1688) can manage the power supplied to the electronic device (1601). According to one embodiment, the power management module (1688) can be implemented as at least a part of, for example, a power management integrated circuit (PMIC).
[0182] A battery (1689) may power at least one component of the electronic device (1601). In one embodiment, the battery (1689) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0183] The communication module (1690) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1601) and an external electronic device (e.g., electronic device (1602), electronic device (1604), or server (1608)), and the performance of communication through the established communication channel. The communication module (1690) may operate independently from the processor (1620) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1690) may include a wireless communication module (1692) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1694) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1604) via a first network (1698) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1699) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a local area network or a wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1692) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1696) to identify or authenticate the electronic device (1601) within a communication network such as the first network (1698) or the second network (1699).
[0184] The wireless communication module (1692) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency communications (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1692) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1692) may support various technologies for securing performance in high-frequency bands, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1692) may support various requirements specified in the electronic device (1601), an external electronic device (e.g., the electronic device (1604)), or a network system (e.g., the second network (1699)). According to one embodiment, the wireless communication module (1692) may support a peak data rate (e.g., 20 Gbps or more) for eMBB implementation, a loss coverage (e.g., 164 dB or less) for mMTC implementation, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC implementation.
[0185] The antenna module (1697) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1697) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1697) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1698) or the second network (1699), may be selected from the plurality of antennas by, for example, the communication module (1690). A signal or power may be transmitted or received between the communication module (1690) and the external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1697).
[0186] According to various embodiments, the antenna module (1697) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.
[0187] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).
[0188] According to one embodiment, commands or data may be transmitted or received between the electronic device (1601) and an external electronic device (1604) via a server (1608) connected to a second network (1699). Each of the external electronic devices (1602 or 1704) may be the same or a different type of device as the electronic device (1601). According to one embodiment, all or part of the operations executed in the electronic device (1601) may be executed in one or more of the external electronic devices (1602, 1704, or 1708). For example, when the electronic device (1601) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1601) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1601). The electronic device (1601) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1601) may provide an ultra-low latency service using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1604) may include an Internet of Things (IoT) device. The server (1608) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1604) or server (1608) may be included within the second network (1699). The electronic device (1601) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.
[0189] According to one embodiment, the electronic device (1601) of FIG. 16 may be the electronic device (10000), and the electronic device (1601) may perform the functions of the electronic devices (10000) of FIGS. 1 to 20. In this case, the display module (1660) of the electronic device (1601) may include a first display (20) and a second display (30). In addition, the electronic device (1602) may include a plurality of hinges (42, 44, 46).
[0190] According to one embodiment, the processor (1620) of the electronic device (1601) can identify whether the electronic device (1601) is placed on the floor by multi-folding. Multi-folding can include folding multiple parts of the electronic device (1601) by multiple hinges. For example, when the electronic device (1601) includes a first hinge (42) and a second hinge (44), the first display (20) of the electronic device (1601) can be folded in a direction in which the first housing (12) and the second housing (14) face each other by the first hinge (42), and the first display (20) of the electronic device (1601) can be folded in a direction in which the second housing (14) and the third housing (16) face each other by the second hinge (44).
[0191] According to one embodiment, the processor (1620) can identify whether the first display (20) of the electronic device (1601) is surrounded by the housings of the electronic device (1601) by multi-folding. For example, the electronic device (1601) can be multi-folded such that one side of the first housing (12) comes into contact with one side of the third housing (16), and thus, the entire area of the first display (20) of the electronic device (1601) can be surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (1601). Since the entire area of the first display (20) of the electronic device (1601) is surrounded by the first housing (12), the second housing (14), and the third housing (16) of the electronic device (1601), it can not be exposed to the outside of the electronic device (1601).
[0192] According to one embodiment, the processor (1620) can identify whether the electronic device (1601) is placed on the floor when the first display (20) of the electronic device (1601) is surrounded by the housings of the electronic device (1601) by multi-folding. The processor (1620) can identify whether the electronic device (1601) is placed on the floor by using at least one sensor module (1676) (e.g., a gyro sensor, an acceleration sensor) and / or at least one camera module (1680) within the electronic device (1601).
[0193] According to one embodiment, the processor (1620) may display an execution screen of an application on the second display (30). The processor (1620) may display an execution screen of an application on the second display (30) of the electronic device (1601) when the first display (20) of the electronic device (1601) is surrounded by a plurality of housings (12, 14, 16) of the electronic device by multi-folding. Alternatively, the electronic device (1601) may display an execution screen of an application on the second display (30) of the electronic device (1601) when the first display (20) of the electronic device (1601) is placed on the floor while being surrounded by a plurality of housings of the electronic device by multi-folding.
[0194] According to one embodiment, the application may be an application that supports a function of displaying an execution screen of the application on a second display (30) of the electronic device (1601) when the electronic device (1601) is multi-folded. When the first display (20) of the electronic device (1601) is surrounded by housings due to multi-folding while the execution screen of the application is displayed on the first display (20), the application may provide an execution screen to be displayed on the second display (30) of the electronic device (1601).
[0195] According to one embodiment, the processor (1620) may determine whether a portion of the first display (20) is exposed. In a case where the entire portion of the first display (20) of the electronic device (1601) is surrounded by the housings of the electronic device (1601) due to multi-folding, as the folding angles of the multi-folding of the electronic device (1601) change, a portion of the first display (20) of the electronic device (1601) may be exposed to the outside of the electronic device (1601). For example, as the folding angles of the multi-folding of the electronic device (1601) change while the first display (20) of the electronic device (1601) is surrounded by the first housing (12), the second housing (14), and the third housing (16), one end of the third housing (16) may slide on the first display (20) within the first housing (12). For example, as one end of the third housing (16) slides over the first display (20) within the first housing (12), a portion of the first display (20) within the first housing (12) may be exposed to the outside of the electronic device (1601).
[0196] According to one embodiment, when the entire area of the first display (20) of the electronic device (1601) is surrounded by the housings of the electronic device (1601) by multi-folding and the electronic device (1601) is placed on the floor, the processor (1620) can determine whether a portion of the first display (20) is exposed.
[0197] According to one embodiment, as the folding angles of the multi-folding are changed, the size of an exposed portion of the first display (20) may increase or decrease.
[0198] According to one embodiment, the processor (1620) may determine whether a portion of the first display (20) is exposed using at least one sensor within the electronic device (1601). The processor (1620) may determine whether a portion of the first display (20) is exposed using, for example, at least one of a gyro sensor, an acceleration sensor, or an angle sensor, but is not limited thereto.
[0199] According to one embodiment, for example, the processor (1620) may determine whether a portion of the first display (20) is exposed, as in FIGS. 5 and 6 .
[0200] According to one embodiment, the processor (1620) may display a GUI related to an application on an exposed portion of the first display (20). According to one embodiment, when the entire area of the first display (20) of the electronic device (1601) is surrounded by the housings of the electronic device (1601) due to multi-folding, and a portion of the first display (20) is exposed, the processor (1620) may display a GUI related to an application of an execution screen displayed on the second display (30) on the exposed portion of the first display (20). According to one embodiment, when the entire area of the first display (20) of the electronic device (1601) is surrounded by the housings of the electronic device (1601) by multi-folding and the electronic device (1601) is placed on the floor, the processor (1620) may display a GUI related to an application of an execution screen displayed on the second display (30) on the exposed area of the first display (20) when a part of the first display (20) is exposed.
[0201] According to one embodiment, a GUI associated with an application may include a GUI provided by the application and / or a GUI provided by another application associated with the application.
[0202] For example, the GUI displayed on the exposed portion of the first display (20) may include a portion of the execution screen of an application being displayed on the second display (30). For example, the GUI displayed on the exposed portion of the first display (20) may include a GUI provided by an application for controlling the application or for user input to the application. For example, the GUI displayed on the exposed portion of the first display (20) may include a GUI provided by another application for controlling the application or for user input to the application. For example, the GUI displayed on the exposed portion of the first display (20) may include at least a portion of the execution screen of another application that is mainly used by the user in relation to the application.
[0203] According to one embodiment, as the folding angles of the multi-folding change, the size of the exposed portion of the first display (20) may increase or decrease, and as the size of the exposed portion of the first display (20) increases or decreases, the GUI displayed on the exposed portion may change.
[0204] However, examples of GUIs displayed on an exposed portion of the first display (20) are not limited thereto, and for example, the processor (1620) may display GUIs on an exposed portion of the first display (20), as in FIGS. 7 to 20.
[0205] According to one embodiment, an electronic device (e.g., 10000, 1601) comprises: a first housing (12); a second housing (14) connected to the first housing via a first hinge (42); a third housing (16) connected to the second housing via a second hinge (44); a first display (20) disposed across the first housing, the second housing, and the third housing and exposed toward a first direction of the electronic device; a second display (30) disposed in the first housing and facing a second direction of the electronic device; a memory (1630) for storing commands; And at least one processor (1620) operably connected to the first display and the second display and the memory; wherein the instructions, when executed by the at least one processor, cause the electronic device to: display an execution screen of an application on the second display, identify whether one side of the first housing is located on a portion corresponding to the third housing among the entire area of the first display due to the multi-folding of the electronic device, and change a display mode of the first display from the first display mode to a second display mode based on the identification of whether the one side of the first housing is located on the portion corresponding to the third housing, wherein the second display mode may be a mode that controls an activated portion of the first display and a deactivated remaining area of the first display based on a position on the portion of the first display where the one side of the first housing is located.According to one embodiment, an electronic device (e.g., 10000, 1601) comprises: a first housing (12); a second housing (14) connected to the first housing via a first hinge (42); a third housing (16) connected to the second housing via a second hinge (44); a first display (20) disposed across the first housing, the second housing, and the third housing and exposed toward a first direction of the electronic device; a second display (30) disposed in the first housing and facing a second direction of the electronic device; a memory (1630) for storing commands; And at least one processor (1620) operably connected to the first display and the second display and the memory; wherein the instructions, when executed by the at least one processor, cause the electronic device to: display an execution screen of an application on the second display, identify whether one side of the first housing is located on a portion corresponding to the third housing among the entire area of the first display due to the multi-folding of the electronic device, and change a display mode of the first display from the first display mode to a second display mode based on the identification of whether the one side of the first housing is located on the portion corresponding to the third housing, wherein the second display mode may be a mode that controls an activated portion of the first display and a deactivated remaining area of the first display based on a position on the portion of the first display where the one side of the first housing is located.
[0206] According to one embodiment, the electronic device is multi-folded by the first hinge between the first housing and the second housing, and the second hinge between the second housing and the third housing, and the activated portion may be an area exposed to the outside of the electronic device from the portion where the one side of the first housing is located among the entire area of the first display.
[0207] According to one embodiment, the instructions, when executed by the at least one processor, cause the electronic device to: deactivate an entire area of the first display when the one side of the first housing is positioned at a first location on the portion of the first display.
[0208] According to one embodiment, when the one side of the first housing is positioned at the first position, the size of the area of the first display exposed to the outside of the electronic device may be smaller than a specified threshold.
[0209] According to one embodiment, the instructions, when executed by the at least one processor, cause the electronic device to: When the instructions, when executed by the at least one processor, cause the electronic device to: activate the portion of the first display when the first side is located at a second location on the portion of the first display, deactivate the remaining portion of the first display, and display a first UI related to the application on the activated portion.
[0210] According to one embodiment, the instructions, when executed by the at least one processor, cause the electronic device to: When executed by the at least one processor, cause the electronic device to: enlarge the activated portion as the first side is located at a third position on the portion of the first display, and display a second UI related to the application on the enlarged activated portion.
[0211] According to one embodiment, when the size of the partial region is within a first range, the first UI is displayed on the partial region, and as the size of the partial region increases to a second range that is larger than the first range, the first UI can be changed to the second UI.
[0212] According to one embodiment, the instructions, when executed by the at least one processor, cause the electronic device to: identify that an external input device for the electronic device is held by a user, and upon identifying that the holding is performed, display a third UI for receiving a user input by the external input device on the partial region.
[0213] According to one embodiment, the instructions, when executed by the at least one processor, cause the electronic device to: When the instructions, when executed by the at least one processor, cause the electronic device to: display a fourth UI for user input for the notification information on the partial region when the electronic device outputs notification information.
[0214] According to one embodiment, the instructions, when executed by the at least one processor, cause the electronic device to: identify whether the electronic device is placed on a floor with the third housing facing the floor, and change the display mode of the first display from the first display mode to the second display mode when the electronic device is placed on the floor.
[0215] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.
[0216] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.
[0217] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0218] Various embodiments of the present document may be implemented as software (e.g., a program (1640)) including one or more instructions stored in a storage medium (e.g., an internal memory (1636) or an external memory (1638)) readable by a machine (e.g., an electronic device (1601)). For example, a processor (e.g., a processor (1620)) of the machine (e.g., an electronic device (1601)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.
[0219] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.
[0220] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In electronic devices, First housing (12); A second housing (14) connected to the first housing through the first hinge (42); A third housing (16) connected to the second housing through the second hinge (44); A first display (20) arranged across the first housing, the second housing and the third housing and exposed toward a first direction of the electronic device; A second display (30) disposed in the first housing and facing the second direction of the electronic device; Memory (1630) for storing commands; and At least one processor (1620) operably connected to the first display, the second display, and the memory; Including, The above instructions, when executed by the at least one processor, cause the electronic device to: Display the application's execution screen on the second display, As the electronic device is multi-folded, based on the first folding angle between the first housing and the second housing and the second folding angle of the second housing and the third housing, it is identified whether one side of the first housing is located on a portion corresponding to the third housing among the entire area of the first display, Based on identification that the one side of the first housing is positioned on the portion corresponding to the third housing, the display mode of the first display is changed from the first display mode to the second display mode, An electronic device wherein the second display mode is a mode that controls an activated portion of the first display and a deactivated remaining portion of the first display based on a position on the portion of the first display where the one side of the first housing is located.
2. In paragraph 1, The electronic device is multi-folded by the first hinge between the first housing and the second housing, and the second hinge between the second housing and the third housing, An electronic device, wherein the above-described activated portion is an area exposed to the outside of the electronic device from the portion where the one side of the first housing is located among the entire area of the first display.
3. In either of paragraph 1 and paragraph 2 above, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device, wherein when said one side of said first housing is positioned at a first position on said portion of said first display, the entire area of said first display is deactivated.
4. In paragraph 3, An electronic device, wherein when the one side of the first housing is positioned at the first position, the size of an area of the first display exposed to the outside of the electronic device is smaller than a specified threshold.
5. In any one of paragraphs 1 to 4, The above instructions, when executed by the at least one processor, cause the electronic device to: When the above one side is located at a second position on the above part of the first display, the above part of the first display is activated and the remaining part of the first display is deactivated. An electronic device that displays a first UI related to the application on the activated portion of the above.
6. In paragraph 5, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device, wherein the activated portion is expanded when the one side is located at a third position on the portion of the first display, and a second UI related to the application is displayed on the expanded activated portion.
7. In paragraph 6, If the size of the activated portion is within the first range, the first UI is displayed on the activated portion, An electronic device, wherein the first UI is changed to the second UI as the size of the activated portion increases to a second range greater than the first range.
8. In any one of paragraphs 1 to 7, The above instructions, when executed by the at least one processor, cause the electronic device to: Identifies that an external input device for said electronic device is grasped by the user, An electronic device, wherein, upon identification of the above-mentioned phage, a third UI for receiving a user input by the external input device is displayed on the activated portion of the area.
9. In any one of paragraphs 1 to 8, The above instructions, when executed by the at least one processor, cause the electronic device to: An electronic device, wherein, when the electronic device outputs notification information, a fourth UI for user input regarding the notification information is displayed on the partial area.
10. In any one of paragraphs 1 to 9, The above instructions, when executed by the at least one processor, cause the electronic device to: Identifying whether the electronic device is placed on the floor with the third housing facing the floor, An electronic device, wherein the display mode of the first display is changed from the first display mode to the second display mode when the electronic device is placed on the floor.
11. A method for an electronic device to display an application execution screen, An operation (210) of displaying an application execution screen on a second display (30) of the above electronic device (10000); An operation (200) of identifying whether one side of the first housing is positioned on a portion corresponding to the third housing among the entire area of the first display (20) of the electronic device based on a first folding angle between the first housing and the second housing and a second folding angle of the second housing and the third housing, as the electronic device including the first housing (12), the second housing (14) and the third housing (16) is multi-folded; and An operation (220, 230) of changing the display mode of the first display from the first display mode to the second display mode based on identification of whether the one side of the first housing is positioned on the portion corresponding to the third housing; Including, The first display is arranged across the first housing, the second housing and the third housing and faces a first direction of the electronic device, and the second display is arranged in the first housing and faces a second direction of the electronic device. A method according to claim 1, wherein the second display mode is a mode that controls an activated portion of the first display and a deactivated remaining portion of the first display based on a position on the portion of the first display where the one side of the first housing is located.
12. In paragraph 11, The electronic device is multi-folded by the first hinge between the first housing and the second housing, and the second hinge between the second housing and the third housing, A method according to claim 1, wherein the above-described activated portion is an area exposed to the outside of the electronic device from a portion of the entire area of the first display where the one side of the first housing is located.
13. In any one of paragraphs 11 and 12, An operation of deactivating an entire area of the first display when the one side of the first housing is positioned at a first position on the portion of the first display; A method further comprising:
14. In paragraph 13, A method, wherein when the one side of the first housing is positioned at the first position, the size of an area of the first display exposed to the outside of the electronic device is smaller than a specified threshold.
15. An operation (210) of displaying an application execution screen on a second display (30) of an electronic device (10000); An operation (200) of identifying whether one side of the first housing is positioned on a portion corresponding to the third housing among the entire area of the first display (20) of the electronic device based on a first folding angle between the first housing and the second housing and a second folding angle of the second housing and the third housing, as the electronic device including the first housing (12), the second housing (14) and the third housing (16) is multi-folded; and An operation (220, 230) of changing the display mode of the first display from the first display mode to the second display mode based on identification of whether the one side of the first housing is positioned on the portion corresponding to the third housing; Including, The first display is arranged across the first housing, the second housing and the third housing and faces a first direction of the electronic device, and the second display is arranged in the first housing and faces a second direction of the electronic device. A computer-readable recording medium storing a program for executing a method for an electronic device to display an execution screen of an application, wherein the second display mode is a mode for controlling an activated portion of the first display and a deactivated remaining portion of the first display based on a position on the portion of the first display where the one side of the first housing is located.
Citation Information
Patent Citations
Apparatus for reducing odor using water
KR1020240130382A
Lateral pressure binder of formwork for beam, column and wall construction
KR1020240131189A
Electronic device and method for executing function according to transformation of display in the electronic device
KR102516590B1
Transporting Apparatus For Tray And System For Automatic Dividing Ceramic Substrate Including Thereof
KR102637352B1
Expandable display mobile device
US20220311848A1