Multi-foldable electronic device, method, and non-transitory computer-readable storage medium for user interaction based on multi-modal input

Abstract

An electronic device is disclosed. The electronic device may identify a position where a third housing part is in contact with a first housing part, on the basis of an angle between the first housing part and a second housing part and another angle between the second housing part and the third housing part. The electronic device may identify an exposed partial area of a flexible display according to the identified position. On the basis of identifying that the size of the partial area is greater than or equal to a reference size, the electronic device may display, in the partial area, one or more visual objects for obtaining a touch input for controlling an application being executed. On the basis of identifying that the size of the partial area is less than the reference size, the electronic device may display, in the partial area, another visual object guiding that another type of input distinct from the touch input for controlling the application is possible.

Description

Multifoldable electronic device, method, and non-transient computer-readable storage medium for user interaction based on multimodal input

[0001] The following descriptions relate to a multi-foldable electronic device, a method, and a non-transient computer-readable storage medium for user interaction based on multimodal input.

[0002] A multi-foldable electronic device may include housing parts that are rotatably coupled and a foldable display. The display may be bent according to the rotation of the housing parts. The multi-foldable electronic device may include two or more hinge assemblies that rotatably connect the housing parts. The two or more hinge assemblies may provide various states of the electronic device.

[0003] An electronic device is disclosed. The electronic device may include a housing comprising a first housing part, a second housing part rotatably coupled to the first housing part, and a third housing part rotatably coupled to the second housing part; a flexible display disposed across the front of the first housing part, the front of the second housing part, and the front of the third housing part; at least one processor comprising a first sensor associated with the first housing part, a second sensor associated with the second housing part, a third sensor associated with the third housing part, and a processing circuit; and a memory comprising one or more storage media for storing instructions. The first housing part may be configured to be located between the second housing part and the third housing part when the electronic device is in a multiple folding state. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify an angle between the first housing part and the second housing part based on a first value identified through the first sensor and a second value identified through the second sensor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify another angle between the second housing part and the third housing part based on the second value identified through the second sensor and a third value identified through the third sensor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify a location where the third housing part contacts the first housing part based on the angle and the other angle.When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to identify a portion of the flexible display exposed according to the identified location. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to display one or more visual objects for obtaining touch input to control an application running in the portion of the area, based on the identification that the size of the portion of the area is greater than or equal to a reference size. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause to display other visual objects guiding that a different type of input, distinct from the touch input for controlling the application, is possible in the portion of the area, based on the identification that the size of the portion of the area is less than the reference size.

[0004] A method is disclosed. The method may be performed by an electronic device comprising a housing and a flexible display. The housing comprises a first housing part, a second housing part rotatably coupled to the first housing part, and a third housing part rotatably coupled to the second housing part, wherein the first housing part is configured to be positioned between the second housing part and the third housing part when the electronic device is in a multiple folding state, and the flexible display may be disposed across the front of the first housing part, the front of the second housing part, and the front of the third housing part. The method may include an operation of identifying an angle between the first housing part and the second housing part based on a first value identified through a first sensor and a second value identified through a second sensor. The method may include an operation of identifying another angle between the second housing part and the third housing part based on the second value identified through the second sensor and a third value identified through a third sensor. The above method may include an operation of identifying a position where the third housing part contacts the first housing part based on the angle and the other angle. The above method may include an operation of identifying a portion of the flexible display that is exposed according to the identified position. The above method may include an operation of displaying one or more visual objects to obtain touch input for controlling an application running in the portion area based on the identification that the size of the portion area is greater than or equal to a reference size. The above method may include an operation of displaying another visual object that guides that a different type of input, distinct from the touch input for controlling the application, is possible in the portion area based on the identification that the size of the portion area is less than the reference size.

[0005] A non-transitory computer-readable storage medium is disclosed. The non-transitory computer-readable storage medium may store a program comprising instructions. When the instructions are executed individually or collectively by at least one processor, the electronic device may cause an angle between a first housing part and a second housing part to be identified based on a first value identified through a first sensor and a second value identified through a second sensor. When the instructions are executed individually or collectively by the at least one processor, the electronic device may cause another angle between the second housing part and a third housing part to be identified based on the second value identified through the second sensor and a third value identified through a third sensor. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify a location where the third housing part contacts the first housing part based on the angle and the other angle. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to identify a portion of the exposed flexible display according to the identified location. When the above instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to display one or more visual objects to obtain touch input for controlling an application running in the portion of the area based on the identification that the size of the portion of the area is greater than or equal to a reference size.When the above instructions are executed individually or collectively by the at least one processor, the electronic device may cause another visual object to display that guides that a different type of input, distinct from the touch input for controlling the application, is possible in the part area based on the identification that the size of the part area is less than the reference size.

[0006] FIG. 1a illustrates an example of a first state of an electronic device according to one embodiment.

[0007] FIG. 1b illustrates an example of a second state of an electronic device according to one embodiment.

[0008] FIG. 1c illustrates an example of a third state of an electronic device according to one embodiment.

[0009] FIG. 2a is a plan view of an electronic device with a flexible display removed, according to one embodiment.

[0010] FIG. 2b is a rear view of an electronic device with the rear cover and display removed, according to one embodiment.

[0011] FIG. 3a illustrates an electronic device having a first form according to one embodiment.

[0012] FIG. 3b illustrates a screen displayed by an electronic device having a first form according to one embodiment.

[0013] FIG. 3c illustrates a screen displayed by an electronic device having a first form according to one embodiment.

[0014] FIG. 4a illustrates an electronic device having a first form according to one embodiment.

[0015] FIG. 4b illustrates a screen displayed by an electronic device having a first form according to one embodiment.

[0016] FIG. 5a illustrates an electronic device having a first form according to one embodiment.

[0017] FIG. 5b illustrates an electronic device having a first form according to one embodiment.

[0018] FIG. 5c illustrates an electronic device having a first form according to one embodiment.

[0019] FIGS. 6a to 6c illustrate an example in which an electronic device guides a user to adjust an angle through a user interaction area according to one embodiment.

[0020] FIGS. 7a and 7b illustrate examples of camera angles according to the positional relationship between an electronic device and a user, according to one embodiment.

[0021] FIGS. 8A and 8B illustrate examples of UIs in which an electronic device guides a change in camera angle according to one embodiment.

[0022] Figure 9a illustrates an example of user voice input.

[0023] FIGS. 9b and 9c illustrate examples of a UI in which an electronic device guides a change in camera angle according to voice input, according to one embodiment.

[0024] Figure 10a illustrates an example of user voice input.

[0025] FIGS. 10b to 10e illustrate examples of a UI in which an electronic device guides a change in camera angle according to voice input, according to one embodiment.

[0026] FIGS. 11a to 11c illustrate examples of UIs in which an electronic device changes according to the size of a user interaction area, according to one embodiment.

[0027] FIGS. 12a to 12c illustrate examples of UIs in which an electronic device changes according to the size of a user interaction area, according to one embodiment.

[0028] FIGS. 13a to 13d illustrate examples of UIs in which an electronic device changes according to the size of a user interaction area, according to one embodiment.

[0029] FIGS. 14a to 14d illustrate examples of UIs in which an electronic device changes according to the size of a user interaction area, according to one embodiment.

[0030] FIGS. 15a and 15b illustrate an example in which an electronic device, according to one embodiment, displays a UI through a user interaction area while having a U-shaped form.

[0031] FIG. 16 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0032] FIG. 17 is a block diagram of an electronic device in a network environment according to various embodiments.

[0033] FIG. 1a illustrates an example of a first state of an electronic device according to one embodiment. FIG. 1b illustrates an example of a second state of an electronic device according to one embodiment. FIG. 1c illustrates an example of a third state of an electronic device according to one embodiment.

[0034] Referring to FIGS. 1a, 1b, and 1c, the electronic device (100) may include a housing structure (101), a flexible display (140), a first hinge structure (150), a second hinge structure (160), and a display (170). The housing structure (101) may include a first housing part (110), a second housing part (120), and a third housing part (130).

[0035] The first housing part (110) can be rotatably coupled to the second housing part (120) by the first hinge structure (150). The second housing part (120) and the first housing part (110) can be rotated about the first hinge structure (150). While the first housing part (110) is rotated about the first hinge structure (150), the second housing part (120) can be rotated about the first hinge structure (150). For example, when the second housing part (120) and the first housing part (110) are rotated about the first hinge structure (150), the angular displacement of the second housing part (120) may be substantially the same as the angular displacement of the first housing part (110).

[0036] The third housing part (130) can be rotatably coupled to the second housing part (120) by the second hinge structure (160). The second housing part (120) and the third housing part (130) can be rotated about the second hinge structure (160). While the second housing part (120) is rotated about the second hinge structure (160), the third housing part (130) can be rotated about the second hinge structure (160). For example, when the second housing part (120) and the third housing part (130) are rotated about the second hinge structure (160), the angular displacement (or angular change) of the second housing part (120) may be substantially the same as the angular displacement of the third housing part (130).

[0037] The first hinge structure (150) and the second hinge structure (160) can change the state of the electronic device. The first hinge structure (150) and the second hinge structure (160) can provide (or enable) a first state (100a) of the electronic device (100) (or a first state (100a) of the housing structure (101). The first state (100a) of the electronic device (100) (or a first state (100a)) of the housing structure (101) can be described as an unfolded state (or unfolded state) of the electronic device (100) (or housing structure (101)). Within the first state (100a), the front of the first housing part (110), the front of the second housing part (120), and the front of the third housing part (130) can define the front of the electronic device (100). In the first state (100a), the front of the first housing part (110), the front of the second housing part (120), and the front of the third housing part (130) may face in the same direction. In the first state (100a), the electronic device (100) may provide the user with a large display area of ​​the flexible display (140).

[0038] The first hinge structure (150) and the second hinge structure (160) can provide a second state (100b) of the electronic device (100). The second state (100b) of the electronic device (100) can be described as a state in which the electronic device (100) is partially folded and partially unfolded (or a single folding state or a half folding state). For example, in the second state (100b), the front of the second housing part (120) and the front of the third housing part (130) may face in the same direction, and the front of the first housing part (110) and the front of the second housing part (120) may face in opposite directions. For example, in the second state (100b), the first housing part (110) and the second housing part (120) may be folded, and the second housing part (120) and the third housing part (130) may be unfolded. In the second state (100b), the electronic device (100) can provide visual information through a part of the flexible display (140) (e.g., a third display area (140c)).

[0039] The electronic device (100) can change from a first state (100a) to a third state (100c) through a second state (100b). The electronic device (100) can change from a first state (100a) which is an unfolded state to a second state (100b) which is a partially unfolded state. For example, the electronic device (100) can change from a first state (100a) in which the first housing part (110), the second housing part (120), and the third housing part (130) face the same direction to a second state (100b) in which the front of the first housing part (110) faces the front of the second housing part (120). The electronic device (100) can change from a second state (100b) which is a partially unfolded state to a third state (100c) which is a folded state. For example, when changing from the second state (100b) to the third state (100c), the folded first housing part (110) and the second housing part (120) can be placed on the third housing part (130).

[0040] The first hinge structure (150) and the second hinge structure (160) can provide a third state (100c) of the electronic device (100) (or a third state (100c) of the housing structure (101). The third state (100c) of the electronic device (100) (or a third state (100c) of the housing structure (101)) can be described as a folded state (or a folded state or a multi-folded state) of the electronic device (100) (or the housing structure (101)). In the third state (100c), the front of the first housing part (110) and the front of the second housing part (120) may face in opposite directions, and the front of the second housing part (120) and the front of the third housing part (130) may face in opposite directions. In the third state (100c), the front of the first housing part (110) and the front of the third housing part (130) may face each other in the same direction. For example, in the third state (100c), the front of the second housing part (120) may face the front of the first housing part (110), and the front of the third housing part (130) may face the rear of the first housing part (110). In the third state (100c), the rear of the second housing part (120) may be exposed to the outside. A display (170) may be placed on the rear of the second housing part (120). In the third state (100c), the rear of the third housing part (130) may be exposed to the outside. A camera (175) may be placed on the rear of the third housing part (130). In the third state (100c), the electronic device (100) can be folded to improve portability and can provide visual information through a display (170) placed on the rear of the second housing part (120).

[0041] The electronic device (100) may further include a key button (139). The key button (139) may be exposed from a structure (e.g., an opening) formed on the side of the third housing part (130) and may partially protrude outside the electronic device (100). The key button (139) may provide physical input to a processing circuit inside the electronic device (100) by pressure transmitted from the outside. The key button (139) may not be included in the electronic device (100) and may be implemented in other forms, such as a soft key displayed on a flexible display (140) or a display (170).

[0042] The key button (139) may be positioned on the side of the third housing part (130) so as to be exposed to the outside in the third state (100c). As the key button (139) is positioned on the side of the third housing part (130), it may be positioned in the direction in which the side of the third housing part (130) faces. Even if the display (170) in the third state (100c) is changed to the first state (100a) by a user, the position of the key button (139) positioned on the side of the third housing part (130) may not be moved. For example, referring to FIG. 1a, in the first state (100a), when the flexible display (140) is viewed from above, the key button (139) may be positioned on the right side. Referring to FIG. 1c, in the third state (100c), when viewing the display (170) from above, the key button (139) can be positioned on the right.

[0043] The flexible display (140) can define the appearance of the electronic device (100) at least partially. The flexible display (140) can be partially disposed within the housing structure (101). The flexible display (140) can define the front of the electronic device (100). The flexible display (140) may include a first unbendable portion (141), a second unbendable portion (142), a third unbendable portion (143), a first bendable portion (144), and a second bendable portion (145). The first unbendable portion (141) of the flexible display (140) can be disposed on the front of the first housing part (110). The second unbendable portion (142) of the flexible display (140) can be disposed on the front of the second housing part (120). A third unbendable portion (143) of the flexible display (140) may be placed on the front of the third housing part (130). A first bendable portion (144) of the flexible display (140) may be placed between the first unbendable portion (141) and the second unbendable portion (142) of the flexible display (140). For example, the first bendable portion (144) of the flexible display (140) may be placed on a first hinge structure (150) connecting the first housing part (110) and the second housing part (120). A second bendable portion (145) of the flexible display (140) may be placed between the second unbendable portion (142) and the third unbendable portion (143) of the flexible display (140). For example, the second bendable portion (145) of the flexible display (140) may be placed on a second hinge structure (160) connecting the second housing part (120) and the third housing part (130).

[0044] The first hinge structure (150) and the second hinge structure (160) may have the first unbendable portion (141) of the flexible display (140), the second unbendable portion (142) of the flexible display (140), and the third unbendable portion (143) of the flexible display (140) oriented substantially in the same direction. In the first state (100a), the first bendable portion (144) and the second bendable portion (145) may be positioned in substantially the same horizontal plane as the first unbendable portion (141), the second unbendable portion (142), and the third unbendable portion (143).

[0045] The first hinge structure (150) and the second hinge structure (160) can provide a second state (100b) of the electronic device (100). In the second state (100b), the first unbendable portion (141) of the flexible display (140) may face the second unbendable portion (142) of the flexible display (140), and the third unbendable portion (143) of the flexible display (140) may face the same direction as the second unbendable portion (142) of the flexible display (140). For example, the second unbendable portion (142) and the third unbendable portion (143) may be positioned substantially on the same horizontal plane.

[0046] In the second state (100b), the first bendable portion (144) of the flexible display (140) is bent by the first hinge structure (150), so that the first bendable portion (144) of the flexible display (140) can be folded such that the first unbendable portion (141) of the flexible display (140) and the second unbendable portion (142) of the flexible display (140) face in different directions.

[0047] In the second state (100b), the second bendable portion (145) of the flexible display (140) is maintained in an unfolded state by the second hinge structure (160), so that the second bendable portion (145) of the flexible display (140) can be unfolded such that the second unbendable portion (142) of the flexible display (140) and the third unbendable portion (143) of the flexible display (140) face each other in the same direction.

[0048] The first hinge structure (150) and the second hinge structure (160) can provide a third state (100c) of the electronic device (100). In the third state (100c), the second unbendable portion (142) of the flexible display (140) faces the first unbendable portion (141) of the flexible display (140), and the third unbendable portion (143) of the flexible display (140) may face the rear of the first housing part (110).

[0049] In the third state (100c), the first bendable portion (144) of the flexible display (140) is bent by the first hinge structure (150), so that the first bendable portion (144) of the flexible display (140) can be folded such that the first unbendable portion (141) of the flexible display (140) and the second unbendable portion (142) of the flexible display (140) face in different directions.

[0050] In the third state (100c), the second bendable portion (145) of the flexible display (140) is bent by the second hinge structure (160), so that the second bendable portion (145) of the flexible display (140) can be folded such that the second unbendable portion (142) of the flexible display (140) and the third unbendable portion (143) of the flexible display (140) face in different directions. The second bendable portion (145) may further include a first deformation portion (145a), a second deformation portion (145b), and a flat portion (145c). The first deformation portion (145a) may be positioned between the planar portion (145c) and the second unbendable portion (142), and the second deformation portion (145b) may be positioned between the planar portion (145c) and the third unbendable portion (143). The planar portion (145c) may be positioned between the first deformation portion (145a) and the second deformation portion (145b). The planar portion (145c) may be supported by a support plate (e.g., the support plate (264) of FIG. 2a) that is distinct from the hinge plates of the second hinge structure (160) (e.g., the third hinge plate (262) and the fourth hinge plate (263) of FIG. 2a). Regardless of the state of the electronic device (100), the planar portion (145c) may remain flat. The first deformation part (145a) and the second deformation part (145b) are unfolded in the first state (100a) and the second state (100b), and in the third state (100c), the first deformation part (145a) and the second deformation part (145b) can be bent so that the second unbendable part (142) and the third unbendable part (143) face in different directions. In the third state (100c), the first housing part (110) can be positioned between the second housing part (120) and the third housing part (130). In the third state (100c), the second bendable part (145) of the flexible display (140) positioned on the second hinge structure (160) can be partially facing the side (110c) of the first housing part (110).

[0051] The display area of ​​the flexible display (140) may include a first display area (140a), a second display area (140b), and a third display area (140c). The display area represents an area capable of providing visual information from the flexible display (140). In a first state (100a), the entire display area of ​​the flexible display (140) may be visible from the front of the housing structure (101). For example, in a first state (100a), the first display area (140a), the second display area (140b), and the third display area (140c) of the flexible display (140) may be visually exposed. The electronic device (100) may provide a large display area to the user that includes the first display area (140a), the second display area (140b), and the third display area (140c).

[0052] In the second state (100b), the display area of ​​the flexible display (140) may be partially visible from the front of the third housing part (130). For example, the third display area (140c) may be visually exposed, while the first display area (140a) and the second display area (140b) may not be visually exposed.

[0053] In the third state (100c), the display area of ​​the flexible display (140) may not be visible. For example, in the third state (100c), the first display area (140a), the second display area (140b), and the third display area (140c) of the flexible display (140) may not be visually exposed.

[0054] In a non-limiting example, when the flexible display (140) is used to display a screen within a first state (100a) of the electronic device (100), the first display area (140a), the second display area (140b), and the third display area (140c) of the flexible display (140) may be activated. In a non-limiting example, within a third state (100c), the first display area (140a), the second display area (140b), and the third display area (140c) of the flexible display (140) may be deactivated. In a non-limiting example, within a second state (100b) of the electronic device (100), when the flexible display (140) is used to display a screen, the third display area (140c) is activated, and the first display area (140a) and the second display area (140b) of the flexible display (140) may be deactivated.

[0055] In a non-limiting example, when the flexible display (140) is used to display a screen within a first state (100a) of the electronic device (100), the first display area (140a), the second display area (140b), and the third display area (140c) of the flexible display (140) may display visual information. In a non-limiting example, within a third state (100c), the first display area (140a), the second display area (140b), and the third display area (140c) of the flexible display (140) may provide a black image. As a non-limiting example, in a second state (100b) of the electronic device (100), when the flexible display (140) is used to display a screen, the third display area (140c) provides visual information, and the first display area (140a) and the second display area (140b) of the flexible display (140) may provide a black image.

[0056] FIG. 2a is a plan view of an electronic device with a flexible display removed according to one embodiment. FIG. 2b is a rear view of an electronic device with a rear cover and a display removed according to one embodiment.

[0057] Referring to FIGS. 2a and 2b, the electronic device (100) may include a first hinge structure (150) and a second hinge structure (160). The first width (w1) of the first hinge structure (150) may be narrower than the second width (w2) of the second hinge structure (160). The difference between the first width (w1) of the first hinge structure (150) and the second width (w2) of the second hinge structure (160) may be equal to or greater than the thickness of the first housing part (110). For example, the second hinge structure (160) may have a second width (w2) that is wider than the first width (w1) so that, according to the third state (100c), the first housing part (110) is positioned between the second housing part (120) and the third housing part (130). The first hinge structure (150) may be referred to as a narrow hinge structure in that it has a narrower width than the second hinge structure (160). The second hinge structure (160) may be referred to as a wide hinge structure in that it has a wider width than the first hinge structure (150).

[0058] The first hinge structure (150) may include a first set of gears (251), a first hinge plate (252), and a second hinge plate (253). The first hinge plate (252) may be coupled to a first support portion (111) of the first housing part (110). The second hinge plate (253) may be coupled to a second support portion (121) of the second housing part (120). The gears (g11, g12, g13, g14) included in the first set of gears (251) may be configured to rotate the first hinge plate (252) and the second hinge plate (253). For example, the gears (g11, g12, g13, g14) included in the first set of gears (251) can rotate the second hinge plate (253) (or the second housing part (120)) in conjunction with the rotation of the first hinge plate (252) (or the first housing part (110)). After the first hinge plate (252) (or the first housing part (110)) is rotated, the gears (g11, g12, g13, g14) included in the first set of gears (251) can be rotated according to the rotation of the first hinge plate (252) (or the first housing part (110)). The second hinge plate (253) (or the second housing part (120)) may be rotated in conjunction with the rotation of the first hinge plate (252) according to the rotation of the gears included in the first set of gears (251). The gears (g11, g12, g13, g14) included in the first set of gears (251) may include a first gear (g11), a second gear (g12), a third gear (g13), and a fourth gear (g14). The first gear (g11) may be positioned adjacent to the first hinge plate (252), and the fourth gear (g14) may be positioned adjacent to the second hinge plate (253). The second gear (g12) and the third gear (g13) may be positioned between the first gear (g11) and the fourth gear (g14).The first gear (g11), the second gear (g12), the third gear (g13), and the fourth gear (g14) can be engaged sequentially. Depending on the first rotational direction (e.g., clockwise) of the first gear (g11), the second gear (g12) engaged with the first gear (g11) can be rotated in a second rotational direction (e.g., counterclockwise) opposite to the first rotational direction. Depending on the second rotational direction of the second gear (g12), the third gear (g13) engaged with the second gear (g12) can be rotated in the first rotational direction. Depending on the first rotational direction of the third gear (g13), the fourth gear (g14) engaged with the third gear (g13) can be rotated in the second rotational direction. As the first gear (g11) and the fourth gear (g14) rotate in different directions, the first housing part (110) connected to the first hinge plate (252) and the second housing part (120) connected to the second hinge plate (253) can be folded or unfolded.

[0059] The second hinge structure (160) may include a second set of gears (261), a third hinge plate (262), a fourth hinge plate (263), and a support plate (264). The third hinge plate (262) may be coupled to the second support portion (121) of the second housing part (120). The fourth hinge plate (263) may be coupled to the third support portion (131) of the third housing part (130). The gears (g21, g22, g23, g24, g25, g26) included in the second set of gears (261) may be configured to rotate the third hinge plate (262) and the fourth hinge plate (263). For example, the gears (g21, g22, g23, g24, g25, g26) included in the second set of gears (261) can rotate the fourth hinge plate (263) (or the third housing part (130)) in conjunction with the rotation of the third hinge plate (262) (or the second housing part (120)). After the third hinge plate (262) (or the second housing part (120)) is rotated, the gears (g21, g22, g23, g24, g25, g26) included in the second set of gears (261) can be rotated according to the rotation of the third hinge plate (262) (or the second housing part (120)). The fourth hinge plate (263) (or the third housing part (130)) can be rotated in conjunction with the rotation of the third hinge plate (262) according to the rotation of the gears (g21, g22, g23, g24, g25, g26) included in the second set (261) of gears.

[0060] The gears (g21, g22, g23, g24, g25, g26) included in the second set (261) of gears may include a first gear (g21), a second gear (g22), a third gear (g23), a fourth gear (g24), a fifth gear (g25), and a sixth gear (g26). The first gear (g21) may be positioned adjacent to the third hinge plate (262), and the sixth gear (g26) may be positioned adjacent to the fourth hinge plate (263). The second gear (g22), the third gear (g23), the fourth gear (g24), and the fifth gear (g25) may be positioned between the first gear (g21) and the sixth gear (g26). The first gear (g21), second gear (g22), third gear (g23), fourth gear (g24), fifth gear (g25), and sixth gear (g26) can be engaged sequentially. Depending on the first rotational direction (e.g., clockwise) of the first gear (g21), the second gear (g22) engaged with the first gear (g21) can be rotated in a second rotational direction (e.g., counterclockwise) opposite to the first rotational direction. Depending on the second rotational direction of the second gear (g22), the third gear (g23) engaged with the second gear (g22) can be rotated in the first rotational direction. Depending on the first rotational direction of the third gear (g23), the fourth gear (g24) engaged with the third gear (g23) can be rotated in the second rotational direction. Depending on the rotation of the fourth gear (g24) in the second rotational direction, the fifth gear (g25) engaged with the fourth gear (g24) can be rotated in the first rotational direction. Depending on the rotation of the fifth gear (g25) in the first rotational direction, the sixth gear (g26) engaged with the fifth gear (g25) can be rotated in the second rotational direction. As the first gear (g21) and the sixth gear (g26) rotate in different directions, the second housing part (120) connected to the third hinge plate (262) and the third housing part (130) connected to the fourth hinge plate (263) can be folded or unfolded.

[0061] The first hinge structure (150) and the second hinge structure (160) may further include a spiral structure. The spiral structure may include a spiral groove formed in each hinge plate or a rotating member connected to the hinge plate and a moving member sliding along the spiral groove. The hinge plates connected to the hinge structure may be configured to rotate by substantially the same angular displacement through the spiral structure.

[0062] The electronic device (100) may include a first printed circuit board (271), a second printed circuit board (272), and a third printed circuit board (273).

[0063] A first printed circuit board (271) may be placed on a first support portion (111) of a first housing part (110). Hardware components within the first housing part (110) may be mounted on the first printed circuit board (271). A second printed circuit board (272) may be placed on a second support portion (121) of a second housing part (120). A third printed circuit board (273) may be placed on a third support portion (131) of a third housing part (130). Hardware components within the third housing part (130) may be mounted on the third printed circuit board (273).

[0064] Hardware components placed on the first printed circuit board (271) may support or operate independently of hardware components placed on the second printed circuit board (272) and / or hardware components placed on the third printed circuit board (273).

[0065] Hardware components placed on the second printed circuit board (272) may support or operate independently of hardware components placed on the first printed circuit board (271) or the third printed circuit board (273). Hardware components placed on the second printed circuit board (272) may include a speaker, a front camera, and / or a display driving circuit.

[0066] Hardware components disposed on the third printed circuit board (273) may include at least one processor including a processing circuit (e.g., application processor (AP), communication processor (CP)), memory including one or more storage media, communication circuits, and a rear camera (175). The rear camera (175) may be exposed through a structure (e.g., an opening) on ​​the rear of the third housing part (130).

[0067] The electronic device (100) may further include a sub-printed circuit board (275) and flexible printed circuit boards (280, 290). The sub-printed circuit board (275) may be placed in at least some of the first housing part (110), the second housing part (120), and the third housing part (130). The flexible printed circuit boards (280, 290) may include a first flexible printed circuit board (280) and a second flexible printed circuit board (290). The first flexible printed circuit board (280) may electrically connect the printed circuit boards placed in each of the housing parts (110, 120, 130). The second flexible printed circuit board (290) may connect the printed circuit board in the housing part where the sub-printed circuit board (275) is placed with the sub-printed circuit board (275) by means of the second flexible printed circuit board (290).

[0068] Components within the electronic device (100) may be connected to at least one processor within a third printed circuit board (273) via flexible printed circuit boards (280, 290). For example, a signal received from an antenna placed in the third housing part (130) may be transmitted to the third printed circuit board (273) where at least one processor (e.g., AP or CP) is placed via a signal path (a) provided by the first flexible printed circuit board (280). A driving circuit for a flexible display (140) placed in the first housing part (110) may be connected to the third printed circuit board (273) where at least one processor (e.g., AP) is placed via a sub-printed circuit board (275) and a signal path (b) provided by the first flexible printed circuit board (280). A driving circuit for a display (170) connected to a sub-printed circuit board (275) placed in a second housing part (120) can be electrically connected to a third printed circuit board (273) on which at least one processor (e.g., AP) is placed, through a signal path (c) provided by the sub-printed circuit board (275), the first flexible printed circuit board (280), and the second flexible printed circuit board (290).

[0069] The electronic device (100) may further include batteries. Each of the batteries may be attached to support parts (111, 121, 131) included in the housing parts (110, 120, 130). The support parts (111, 121, 131) may support rechargeable batteries.

[0070] The arrangement of hardware components is exemplary, and unlike the above, the rear camera (175) and the second printed circuit board (272) may be placed in the third housing part (130), and the third printed circuit board (273) may be placed in the second housing part (120).

[0071] The first housing part (110) and the third housing part (130) are shown to rotate in opposite directions relative to the second housing part (120), but are not limited thereto. For example, while changing from the first state (100a) to the third state (100c), the first housing part (110) may rotate counterclockwise relative to the second housing part (120), and the third housing part (130) may rotate counterclockwise relative to the second housing part (120). As the first housing part (110) and the third housing part (130) rotate in the same direction, a portion of the display area of ​​the flexible display (140) within the second state may be visually exposed.

[0072] FIG. 3a illustrates an electronic device having a first form according to one embodiment. FIG. 3b illustrates a screen displayed by an electronic device having a first form according to one embodiment. FIG. 3c illustrates a screen displayed by an electronic device having a first form according to one embodiment.

[0073] FIGS. 3a and FIGS. 3b can be explained with reference to FIGS. 1a to 2b.

[0074] FIG. 3a may show the shape formed by the electronic device (100) as the housing structure (101) (or, first housing part (110), second housing part (120), and third housing part (130)) of the electronic device (100) is partially folded (e.g., first shape (e.g., triangular prism shape or prism shape).

[0075] In one embodiment, the electronic device (100) can identify the orientation of the electronic device (100) through a sensor (e.g., the sensor module (1776) of FIG. 17). For example, the electronic device (100) can identify the orientation of each of the first housing part (110), the second housing part (120), and the third housing part (130) through a sensor (e.g., the sensor module (1776) of FIG. 17). In one embodiment, the sensor (e.g., the sensor module (1776) of FIG. 17) can be placed in each of the first housing part (110), the second housing part (120), and the third housing part (130). In one embodiment, the sensor (e.g., the sensor module (1776) of FIG. 17) can be an inertial measurement unit (IMU) sensor, a gyroscope sensor, a geomagnetic sensor, and / or an accelerometer sensor.

[0076] For example, the electronic device (100) can identify angles between the first housing part (110), the second housing part (120), or the third housing part (130) based on the orientation of the first housing part (110), the second housing part (120), and / or the orientation of the third housing part (130). However, the embodiments are not limited thereto. For example, the electronic device (100) can identify angles between the first housing part (110) and the second housing part (120) based on the degree of rotation of the gears (g11, g12, g13, g14). For example, the electronic device (100) can identify angles between the second housing part (120) and the third housing part (130) based on the degree of rotation of the gears (g21, g22, g23, g24, g25, g26).

[0077] In one embodiment, the electronic device (100) can determine whether the electronic device (100) has a first shape (e.g., a triangular prism shape, or a prism shape) based on the orientation of the electronic device (100). For example, the electronic device (100) can determine whether the electronic device (100) has a first shape based on the orientation of the first housing part (110), the second housing part (120), and / or the orientation of the third housing part (130). For example, the electronic device (100) can determine whether the electronic device (100) has a first shape based on the orientation of the first housing part (110), the second housing part (120), and / or the orientation of the third housing part (130).

[0078] For example, the electronic device (100) can determine whether the electronic device (100) has a first shape based on angles between the first housing part (110), the second housing part (120), or the third housing part (130). For example, the electronic device (100) can determine whether the electronic device (100) has a first shape based on a first angle (311) between the first housing part (110) and the second housing part (120), a second angle (321) between the second housing part (120) and the third housing part (130), and a third angle (331) between the third housing part (130) and the first housing part (110). For example, the electronic device (100) can determine whether the first angle (311) is within the first angle range (e.g., an angle range that makes the distance between the second hinge structure (160) and the first housing part (110) greater than or equal to a reference distance) (e.g., 120 degrees or less) and whether the second angle (321) is within the second angle range (e.g., greater than 0 and less than 90 degrees).

[0079] For example, the electronic device (100) can determine whether the electronic device (100) has a first shape based on the position where the first housing part (110) contacts the third housing part (130) or the position where the third housing part (130) contacts the first housing part (110). Referring to FIG. 3a, as the second housing part (120) is partially folded with respect to the first housing part (110) and partially folded with respect to the third housing part (130), the electronic device (100) may be configured to have a first shape (or a rounded first shape).

[0080] In one embodiment, the electronic device (100) can identify the posture of the electronic device (100) (or the posture of each of the first housing part (110), the second housing part (120), and the third housing part (130)) through a sensor (e.g., the sensor module (1776) of FIG. 17). For example, the electronic device (100) can identify the posture of the electronic device (101) while it has a first shape (or the posture of each of the first housing part (110), the second housing part (120), and the third housing part (130)) through a sensor (e.g., the sensor module (1776) of FIG. 17). For example, the posture of the electronic device (101) may be a portrait posture (e.g., a posture in which the height direction (e.g., the y-axis direction in FIG. 2a or FIG. 2b) predefined for the electronic device (101) is perpendicular to the ground), or a landscape posture (e.g., a posture in which the width direction (e.g., the x-axis direction in FIG. 2a or FIG. 2b) predefined for the electronic device (101) is perpendicular to the ground).

[0081] For example, referring to FIG. 3a, the second housing part (120) is partially folded with respect to the first housing part (110) and the third housing part (130), respectively, so that the first housing part (110) and the third housing part (130) can come into contact with each other. For example, a part of the third housing part (130) (e.g., at least a part of the side wall of the third housing part (130)) may be attached so as to come into contact with a part of the first housing part (110) (e.g., the first unbendable part (141) of the flexible display (140) within the first housing part (110), or the first display area (140a)). The length of the opposite side of the second angle (321) may be shorter than the width of the first housing part (110) (or the first unbendable part (141), the first display area (140a)).

[0082] In one embodiment, the first angle (311) may be greater than the second angle (321). In one embodiment, the angle added to the first angle (311) and the second angle (321) may be less than 180 degrees. In one embodiment, the angle added to the first angle (311), the second angle (321), and the third angle (331) may correspond to 180 degrees. In one embodiment, the angle added to the first angle (311) and the second angle (321) may be less than 180 degrees. In one embodiment, the second angle (321) may be greater than 0 degrees. In one embodiment, the first angle (311) may be less than 180 degrees. For example, the first angle (311) and the third angle (331) may be greater than 60 degrees, and the second angle (321) may be less than 60 degrees. For example, the first angle (311) and the third angle (331) may be substantially the same as each other. For example, the cross-section of the first shape formed by the electronic device (100) in FIG. 3a may correspond to a substantially isosceles triangle in which the first angle (311) and the third angle (331) are substantially the same.

[0083] In one embodiment, as the electronic device (100) in FIG. 3a has a first shape, some areas of the flexible display (140) of the electronic device (100) may be exposed or protrude out of the first shape.

[0084] For example, referring to FIG. 3a, the electronic device (100) can identify the width (w3) of the first display area (140a) of the first housing part (110) located within the first form and / or the width (w4) of the first display area (140a) of the first housing part (110) located outside the first form, based on the position where the third housing part (130) contacts the first housing part (110) (or angles between the housing parts (110, 120, 130)).

[0085] For example, the electronic device (100) can determine a user interaction area exposed (or protruding) from a first shape of the first housing part (110) based on widths (w3, w4) identified according to the position where the third housing part (130) contacts the first housing part (110) (or angles between the housing parts (110, 120, 130)). For example, the size (or width) of the user interaction area may increase as the width (w3) decreases (or as the width (w4) increases).

[0086] In one embodiment, the electronic device (100) may provide various user experiences (UX) through a portion of the first form of the flexible display (140) that is exposed or protrudes outward. For example, the electronic device (100) may display a screen corresponding to the function and / or application being provided by the electronic device (100) to the user and / or application being run in a user interaction area exposed (or protruding) from the first form within the flexible display (140), based on the function and / or application being run by the electronic device (100) having the first form being provided to the user. Hereinafter, the portion may be referred to as the exposed flexible display (140). In one embodiment, the electronic device (101) may display one or more user interfaces (UI) arranged (or aligned) in a designated horizontal direction (e.g., the x-axis direction of FIG. 2a or FIG. 2b) on the exposed flexible display (140) during a landscape pose. In one embodiment, the electronic device (101) may display one or more UIs arranged (or aligned) in a designated vertical direction (e.g., the y-axis direction of FIG. 2a or FIG. 2b) on a flexible display (140) exposed during a portrait pose. Below, an electronic device (101) may be exemplified of displaying one or more UIs arranged (or aligned) in a designated horizontal direction (e.g., the x-axis direction of FIG. 2a or FIG. 2b) on a flexible display (140) exposed.

[0087] In one embodiment, the electronic device (100) may display one or more visual objects to obtain touch inputs for controlling an application running in a portion of the area, based on the identification that the size of a portion of the area is greater than or equal to a reference size. For example, the electronic device (100) may control an application running by executing a function assigned to one or more visual objects based on obtaining touch inputs for one or more visual objects. In one embodiment, the reference size may be set based on the accuracy of the touch input for the visual object. For example, the reference size may be a size such that each of the visual objects has a size in which a touch input greater than or equal to the reference accuracy is obtained.

[0088] In one embodiment, the electronic device (100) may display another visual object in the part area that guides that another type of input, distinct from the touch input for controlling the application, is possible based on the identification that the size of the part area is less than the reference size. For example, the other type of input may include voice input and / or gesture input. For example, when the size of the part area is less than the reference size, the electronic device (100) may display another visual object in the part area that guides that another type of input is possible without displaying one or more visual objects for obtaining touch input.

[0089] In one embodiment, the electronic device (100) may display one or more visual objects for obtaining touch input and / or other visual objects guiding that other types of input are possible, based on the distance between the electronic device (100) and the user. For example, if the user is located more than a reference distance (e.g., 1 meter) away from the electronic device (100) where touch input is not easy, other visual objects guiding that other types of input are possible may be displayed. For example, if the user is within a reference distance (e.g., 1 meter) from the electronic device (100), one or more visual objects for obtaining touch input may be displayed.

[0090] In one embodiment, when guiding that a different type of input is possible, the electronic device (100) may output a voice signal guiding that a different type of input is possible through a speaker (e.g., the sound output module (1755) of FIG. 17). In one embodiment, the electronic device (100) may output a voice signal at a larger volume (or loudness) as the distance between the user and the electronic device (100) increases.

[0091] For example, referring to FIGS. 3b and FIGS. 3c, the electronic device (100) may determine a portion of a first display area (140a) that is exposed or protruding out of a first form as a user interaction area (350). For example, the electronic device (100) may display a screen corresponding to a function that the electronic device (100) is providing to the user, and / or an application that is running, in the user interaction area (350).

[0092] For example, referring to FIG. 3b, the electronic device (100) may display a screen including an icon (361) of an application running in a user interaction area (350) and visual objects related to functions provided by the application running. For example, referring to FIG. 3b, if the application running is a camera application, the visual objects may include a preview image (363) captured through a camera (175), a control element (365) for controlling image capture, and / or a control element (367) for setting a value of the camera (175) for image capture.

[0093] In one embodiment, the electronic device (100) may display a visual object for the electronic device (100) to interact with a user in a user interaction area (350). In one embodiment, the electronic device (100) may display a visual object for the electronic device (100) to interact with a user in a user interaction area (350) based on the distance between the electronic device (100) and the user. In one embodiment, the electronic device (100) may display a visual object for the electronic device (100) to interact with a user in a user interaction area (350) based on the distance between the electronic device (100) and the user exceeding a threshold distance (e.g., a distance at which it is not easy for the user to touch the display (170) of the electronic device (100). For example, the electronic device (100) interacting with the user may include visually providing a guide to the user. For example, the electronic device (100) interacting with the user may include visually providing a guide to the user indicating that other types of input (e.g., voice input, and / or gesture input) distinct from touch input are available.

[0094] For example, referring to FIG. 3c, the electronic device (100) may display a screen in a user interaction area (350) that includes an icon (371) of a running application, visual objects related to functions provided by the running application, and visual objects (377) for interacting with the user. For example, referring to FIG. 3c, if the running application is a camera application, the visual objects may include a preview image (373) captured through a camera (175) and / or a control element (375) for controlling image capture. For example, referring to FIG. 3c, if the running application is a camera application, the visual objects (377) for interacting with the user may guide multimodal input (e.g., voice input and / or gesture input). For example, a visual object (377) for interacting with the user can guide multimodal input (e.g., voice input and / or gesture input) through the phrase “Try operating ‘stop shooting’ with voice or gesture.”

[0095] In one embodiment, while the electronic device (100) displays a screen of an application in a user interaction area (350), a flexible display (140) that is not exposed can be turned off (or disabled).

[0096] FIG. 4a illustrates an electronic device having a first form according to one embodiment. FIG. 4b illustrates a screen displayed by an electronic device having a first form according to one embodiment.

[0097] FIGS. 4a and FIGS. 4b can be explained with reference to FIGS. 1a to FIGS. 3b.

[0098] FIG. 4a may show the shape (e.g., first shape) formed by the electronic device (100) as the housing structure (101) (or, first housing part (110), second housing part (120), and third housing part (130)) of the electronic device (100) is partially folded. For example, the first angle (411) of FIG. 4a may be smaller than the first angle (311) of FIG. 3a. For example, the second angle (421) of FIG. 4a may be larger than the second angle (321) of FIG. 3a. For example, the third angle (431) of FIG. 4a may be smaller than the third angle (331) of FIG. 3a. For example, the width (w5) of the first display area (140a) of the first housing part (110) on the inner surface of the first form of the electronic device (100) of FIG. 4a may be larger than the width (w3) of the first display area (140a) of the first housing part (110) on the inner surface of the first form of the electronic device (100) of FIG. 3a. For example, the width (w6) of the first display area (140a) of the first housing part (110) protruding from the first form of the electronic device (100) of FIG. 4a may be smaller than the width (w4) of the first display area (140a) of the first housing part (110) protruding from the first form of the electronic device (100) of FIG. 3a.

[0099] For example, referring to FIG. 4a, the electronic device (100) can identify the width (w5) of the first display area (140a) of the first housing part (110) located within the first shape and / or the width (w6) of the first display area (140a) of the first housing part (110) located outside the first shape, based on the position where the third housing part (130) contacts the first housing part (110).

[0100] For example, the electronic device (100) can determine a user interaction area exposed (or protruding) from a first shape of the first housing part (110) based on widths (w5, w6) identified according to the position where the third housing part (130) contacts the first housing part (110). For example, the size (or width) of the user interaction area may increase as the width (w3) decreases (or as the width (w4) increases).

[0101] In one embodiment, the electronic device (100) may display a screen corresponding to the function and / or application being run by the electronic device (100) being run by the user in a user interaction area exposed (or protruding) from the first form within the flexible display (140), based on the function and / or application being run by the electronic device (100) having the first form being run by the user.

[0102] For example, referring to FIG. 4b, the electronic device (100) may determine a portion of a first display area (140a) that is exposed or protruding out of a first form as a user interaction area (440). For example, the electronic device (100) may display a screen corresponding to a function that the electronic device (100) is providing to the user and / or an application that is running in the user interaction area (440).

[0103] In one embodiment, the electronic device (100) can display a visual object for the electronic device (100) to interact with a user in the user interaction area (440) based on the width of the user interaction area (440) (or the width of the first display area (140a) exposed outside of the first form) being less than or equal to a specified width.

[0104] For example, referring to FIG. 4b, the electronic device (100) may display a screen including an icon (451) of an application running in a user interaction area (440), visual objects related to functions provided by the application running, and a visual object (455) for interacting with the user. For example, referring to FIG. 4b, if the application running is a camera application, the visual objects may include a preview image (453) captured through the camera (175). For example, referring to FIG. 4b, if the application running is a camera application, the visual object (455) for interacting with the user may guide multimodal input (e.g., voice input and / or gesture input). For example, the visual object (455) for interacting with the user may guide multimodal input (e.g., voice input and / or gesture input) through the phrase “Try operating ‘Stop shooting’ with voice or gesture.”

[0105] In one embodiment, the electronic device (100) may display visual objects for the electronic device (100) to interact with a user based on the size of the user interaction area (440). In one embodiment, the electronic device (100) may display visual objects for the electronic device (100) to interact with a user in the user interaction area (350) based on the size of the user interaction area (440) being less than a threshold size (e.g., a size not sufficient to display visual objects). In one embodiment, the electronic device (100) may not display some of the visual objects shown in FIG. 3b or FIG. 3c based on the size of the user interaction area (440) being less than a threshold size (e.g., a size not sufficient to display visual objects). For example, as the size of the user interaction area (440) in FIG. 4b is smaller than the size of the user interaction area (350) in FIG. 3b or FIG. 3c, some of the visual objects shown in FIG. 3b or FIG. 3c may not be displayed in the user interaction area (440).

[0106] FIG. 5a illustrates an electronic device having a first form according to one embodiment. FIG. 5b illustrates an electronic device having a first form according to one embodiment. FIG. 5c illustrates an electronic device having a first form according to one embodiment.

[0107] FIGS. 5a to 5c can be explained with reference to FIGS. 1a to 4b.

[0108] FIGS. 5a to 5c may show the appearance (e.g., first form) formed by the electronic device (100) as the housing structure (101) (or, first housing part (110), second housing part (120), and third housing part (130)) of the electronic device (100) is partially folded.

[0109] For example, the electronic device (100) can determine a user interaction area of ​​a first display area (140a) exposed (or protruding) from a first form based on the position where the third housing part (130) contacts the first housing part (110).

[0110] For example, referring to FIG. 5a, the electronic device (100) may not display a screen corresponding to a function being provided to the user and / or an application being executed in the user interaction area based on the fact that the size (or width) of the user interaction area of ​​the first display area (140a) is less than or equal to a threshold size that is smaller than a reference size (or reference width). For example, the electronic device (100) may turn off (or disable) the first display area (140a) including the user interaction area based on the fact that the size (or width) of the user interaction area of ​​the first display area (140a) is less than or equal to a threshold size that is smaller than a reference size (or reference width). For example, the electronic device (100) may turn off (or disable) the entire flexible display (140) including the user interaction area based on the fact that the size (or width) of the user interaction area of ​​the first display area (140a) is less than or equal to a threshold size that is smaller than a reference size (or reference width). In one embodiment, the threshold size may be a minimum size to ensure the accuracy of the touch input. For example, the electronic device (100) may interact with the user through a component located in the third housing part (130) (e.g., a light-emitting element (e.g., a flash) placed adjacent to the camera (175)) based on the fact that the size (or width) of the user interaction area of ​​the first display area (140a) is less than or equal to a threshold size that is smaller than a reference size (or reference width). For example, if the application currently running is a camera application, the electronic device (100) can indicate that shooting is taking place through a light-emitting element (e.g., through the blinking of the light-emitting element).

[0111] For example, referring to FIGS. 5b and 5c, the electronic device (100) may turn off (or deactivate) the first display area (140a) when the third housing part (130) does not come into contact with the first housing part (110) and the length of the opposite side of the angle between the second housing part (120) and the third housing part (130) is longer than the length of the first housing part (110). For example, referring to FIGS. 5b and 5c, the electronic device (100) may turn off (or deactivate) the first display area (140a) when the first display area (140a) is not exposed or protruding from the first form.

[0112] FIGS. 6a to 6c illustrate an example in which an electronic device guides a user to adjust an angle through a user interaction area according to one embodiment.

[0113] FIGS. 6a to 6c can be explained with reference to FIGS. 1a to 5c.

[0114] In one embodiment, with reference to FIGS. 6a through 6c, the electronic device (100) can identify a location (610) where the third display area (140c) contacts the first display area (140a). For example, the electronic device (100) can identify a location (610) where the third display area (140c) contacts the first display area (140a) based on the orientations (or angles (e.g., angles (311, 321, 331)) of the housing parts (110, 120, 130) of the electronic device (100).

[0115] In one embodiment, the electronic device (100) can identify a user interaction area (620) in the first display area (140a) based on a position (610) in contact with the first display area (140a). For example, the electronic device (100) can identify a user interaction area (620) exposed from the first form based on a position (610) in contact with the first display area (140a). For example, the electronic device (100) can identify an area of ​​width (611, 615, 651) that is covered by the third housing part (130) and an area of ​​width (613, 617, 655) that is not covered by the third housing part (130) in the first display area (140a) based on a position (610) in contact with the first display area (140a). In one embodiment, the electronic device (100) can identify an area of ​​width (613, 617, 655) that is not obscured by the third housing part (130) as a user interaction area (620).

[0116] In one embodiment, the electronic device (100) may display a screen of a running application in a user interaction area (620). In one embodiment, the screen displayed in the user interaction area (620) may include an icon (631) of the running application and visual objects related to functions provided by the running application. For example, referring to FIGS. 6a through 6c, if the running application is a camera application, the visual objects may include a preview image (633) captured through a camera (175) and a visual object (635) for interacting with the user.

[0117] In one embodiment, a visual object (635) for interacting with a user may guide the user in an operation to utilize the application currently running. However, the embodiment is not limited thereto. For example, a visual object (635) for interacting with a user may guide multimodal input (e.g., voice input and / or gesture input).

[0118] In one embodiment, the electronic device (100) may provide suggestions related to the functions of the application through a user interaction area (620). In one embodiment, the electronic device (100) may provide suggestions related to the functions of the application through a visual object (635) for interacting with a user within the user interaction area (620). For example, if the running application is a camera application, the electronic device (100) may suggest adjusting settings related to the camera (175) (e.g., camera composition, camera angle) through the visual object (635). For example, referring to FIG. 6a, the electronic device (100) may suggest adjusting settings related to the camera (175) (e.g., camera composition, camera angle) by displaying the phrase “Try setting the angle to the guideline so your face comes out better” on the visual object (635) for interacting with the user. For example, referring to FIG. 6b, the electronic device (100) can suggest adjusting settings related to the camera (175) (e.g., camera composition, camera angle) by displaying the phrase “Please tilt the angle further in the direction of the arrow so that the face comes out better” on a visual object (635) for interacting with the user.

[0119] In one embodiment, the electronic device (100) may determine suggestions related to the functions of an application based on a profile and / or context information about a user. In one embodiment, the profile about the user may include the type of electronic device used by the user (e.g., tablet, smartwatch, family hub, PC, TV, AR (augmented reality) device, earbuds), the usage history of the application, the user's preferences (e.g., the user's lifestyle patterns), and / or the user's biometric information (e.g., stress, body temperature, heart rate, body shape, and / or posture). For example, the profile about the user may indicate inferred tendencies and / or interests about the user. In one embodiment, the context information may include the user's situation information (e.g., commuting to work, working), information about the user's surroundings (e.g., presence of friends), current time, and / or location information.

[0120] In one embodiment, the electronic device (100) may propose the execution of a function corresponding to a user’s tendencies and / or interests determined based on a user’s profile and / or context information among a plurality of functions that an application running may provide.

[0121] In one embodiment, the electronic device (100) can guide the user's operation of the electronic device (100) by providing suggestions related to the function of the application through the user interaction area (620). For example, the user's operation of the electronic device (100) may include changing the orientation of the electronic device (100) (e.g., changing the first to third angles). For example, if the application currently running is a camera application, the electronic device (100) may display visual objects through the user interaction area (620) to change the position where the third housing part (130) contacts the first housing part (110) (or further unfold or further fold the third housing part (130)). For example, referring to FIG. 6a, the electronic device (100) can display visual objects (640, 641, 643, 645) for further unfolding the third housing part (130) through the user interaction area (620). For example, referring to FIG. 6b, the electronic device (100) can display a visual object (649) for further folding the third housing part (130) through the user interaction area (620).

[0122] In one embodiment, the visual object (640) may indicate the location where the third housing part (130) must come into contact with the first housing part (110) for adjusting the camera angle. In one embodiment, the visual object (640) may be a layer for changing the color of the user interaction area (620). For example, to indicate the location where the third housing part (130) must come into contact with the first housing part (110), the visual object (640) may be set to have a color different from the background color of the user interaction area (620). For example, the visual object (640) may overlap with visual objects displayed within the user interaction area (620) (e.g., an icon (631), a preview image (633), and a visual object (635) for interacting with the user).

[0123] In one embodiment, visual objects (641, 643, 645, 649) may indicate the direction in which the third housing part (130) must move (or unfold) (or fold) to adjust the camera angle. In one embodiment, the visual objects (641, 643, 645, 649) may include a symbol and / or phrase to indicate the direction. For example, the visual objects (641, 643, 645, 649) may be displayed in an area that does not overlap with the visual objects displayed within the user interaction area (620) (e.g., an icon (631), a preview image (633), and a visual object (635) for interacting with the user).

[0124] In one embodiment, the electronic device (100) can identify that the user operates the electronic device (100) after providing a suggestion related to the function of the application through the user interaction area (620). For example, the electronic device (100) can identify that the user operates the electronic device (100) according to the provided suggestion.

[0125] In one embodiment, the electronic device (100) may respond to the user's operation through a visual object (635) for interacting with the user based on identifying that the user is operating the electronic device (100). For example, referring to FIG. 6c, the electronic device (100) may indicate that the adjustment of settings related to the camera (175) (e.g., camera composition, camera angle) is completed (or successful) by displaying the phrase “Well done! Your face is now visible” on the visual object (635) for interacting with the user.

[0126] FIGS. 7a and 7b illustrate examples of camera angles according to the positional relationship between an electronic device and a user, according to one embodiment.

[0127] FIGS. 7a and FIGS. 7b can be explained with reference to FIGS. 1a through 6c.

[0128] The states (701, 703, 705) of FIG. 7a may indicate a change in camera angle according to the degree of folding of the electronic device (100). For example, referring to state (701) of FIG. 7a, it can be seen that the face and upper body of the user (700) are located within the camera angle (710) of the electronic device (100). Referring to state (703) of FIG. 7a, it can be seen that the face of the user (700) is located at the bottom of the camera angle (730) of the electronic device (100). Referring to state (705) of FIG. 7a, it can be seen that part of the face of the user (700) is out of the camera angle (750) of the electronic device (100).

[0129] The states (701, 707, 709) of FIG. 7b may indicate a change in the position (or height) of the user (700) when the electronic device (100) has the same degree of folding. For example, referring to state (707) of FIG. 7b, it can be seen that as the user (700) is positioned relatively below the electronic device (100), part of the user's (700) face is out of the camera angle (710) of the electronic device (100). For example, referring to state (709) of FIG. 7b, it can be seen that as the user (700) is positioned relatively far from the electronic device (100), the user's (700) face is located at the bottom of the camera angle (710) of the electronic device (100).

[0130] In one embodiment, the electronic device (100) can determine the camera angle and / or camera type (e.g., telephoto, wide-angle, ultra-wide-angle) desired by the user (700). For example, the electronic device (100) can determine the camera angle and / or camera type (e.g., telephoto, wide-angle, ultra-wide-angle) desired by the user (700) based on the shooting mode of the camera selected by the user (700) (e.g., portrait, normal shooting, video), the shooting composition (e.g., portrait, landscape, animal, building), and / or the purpose of shooting (e.g., uploading to social media). However, the embodiment is not limited thereto. For example, the electronic device (100) can determine the camera angle and / or camera type (e.g., telephoto, wide angle, ultra-wide angle) for photographing the subject (e.g., user (700)) based on the position (or height) of the subject (e.g., user (700)) relative to the electronic device (100).

[0131] In one embodiment, the electronic device (100) can determine a camera angle and / or camera type (e.g., telephoto, wide angle, ultra-wide angle) for photographing a subject (e.g., user (700)) based on data related to the user (700). For example, the data related to the user (700) may indicate a camera angle and / or camera type for photographing a subject set by the user (700) during a previous shot. For example, the data related to the user (700) may include the movement of the user (700) during the current shot (e.g., moving into the camera angle, or only moving a specific body part of the user (700) (e.g., face and / or upper body) into the camera angle). For example, the electronic device (100) may suggest adjusting the camera angle (or adjusting the second angle) (or operating the third housing part (130)) through the user interaction area (620) so that the camera angle has a camera angle (710) according to the state (701) of FIG. 7a, based on identifying that the user (700) wants the camera angle to be directed toward the user (700)'s face and upper body. For example, the electronic device (100) may suggest adjusting the camera angle (or adjusting the second angle) (or operating the third housing part (130)) through the user interaction area (620) based on identifying that the user (700) wants the camera angle to face and upper body of the user (700). For example, in a state having the camera angle (730) of the state (703) of FIG. 7a, or the camera angle (750) of the state (705) of FIG. 7a, the electronic device (100) may suggest adjusting the camera angle through the user interaction area (620) so that the camera angle (710) of the state (701) of FIG. 7a is formed.For example, the electronic device (100) may suggest adjusting the camera angle by displaying the phrase “Set the angle to the guideline so that the face comes out better” in the user interaction area (620). However, the embodiment is not limited thereto. For example, the electronic device (100) may suggest adjusting the camera angle (or adjusting the second angle) (or operating the third housing part (130)) through the user interaction area (620) so that the camera angle has the camera angle (710) according to the state (701) of FIG. 7a, based on identifying that the subject (e.g., user (700)) has moved away from the camera angle (710).

[0132] According to an embodiment, the electronic device (100) may suggest movement of the subject (e.g., user (700)) through the user interaction area (620) based on identifying that the subject (e.g., user (700)) moves out of the camera angle (710). For example, in a state having the camera angle (750) of the state (705) of FIG. 7a, or in a state having the camera angle (710) of the state (707) of FIG. 7b, the electronic device (100) may suggest movement of the subject (e.g., user (700)) through the user interaction area (620) so that the subject (e.g., user (700)) is positioned within the camera angle (710). For example, the electronic device (100) can suggest moving the subject (e.g., user (700)) by displaying the phrase “Move upward so your face is better visible” in the user interaction area (620).

[0133] According to an embodiment, the electronic device (100) may guide the change of the type of camera (175) through the user interaction area (620) based on the distance between the subject (e.g., user (700)) and the electronic device (100). For example, in a state having the camera angle (710) of the state (709) of FIG. 7b, the electronic device (100) may guide the change of the type of camera (175) (e.g., to a telephoto camera). For example, the electronic device (100) may guide the change of the type of camera (175) (e.g., to a telephoto camera) by displaying the phrase “I will take a picture with a telephoto camera so that the face comes out better” in the user interaction area (620). However, the embodiment is not limited thereto. For example, the electronic device (100) can guide multimodal input (e.g., voice input and / or gesture input) to change the type of camera (175) through the user interaction area (620) based on the distance between the subject (e.g., user (700)) and the electronic device (100). For example, the electronic device (100) can display a message in the user interaction area (620) such as, “If you want to change to a telephoto camera so that your face looks better, try operating ‘Change to telephoto camera’ with voice or gesture.”

[0134] FIGS. 8A and 8B illustrate examples of UIs in which an electronic device guides a change in camera angle according to one embodiment.

[0135] FIGS. 8a and FIGS. 8b can be explained with reference to FIGS. 1a through FIGS. 7b.

[0136] In one embodiment, referring to FIG. 8a, the electronic device (100) can identify a location (810) where the third display area (140c) contacts the first display area (140a). For example, the electronic device (100) can identify a location (810) where the third display area (140c) contacts the first display area (140a) based on the orientations (or angles (e.g., angles (311, 321, 331)) of the housing parts (110, 120, 130) of the electronic device (100).

[0137] In one embodiment, the electronic device (100) can identify a user interaction area (820) in the first display area (140a) based on a position (810) in contact with the first display area (140a). For example, the electronic device (100) can identify a user interaction area (820) exposed from the first form based on a position (810) in contact with the first display area (140a). For example, the electronic device (100) can identify an area of ​​width (811) that is covered by the third housing part (130) and an area of ​​width (813) that is not covered by the third housing part (130) in the first display area (140a) based on a position (810) in contact with the first display area (140a). In one embodiment, the electronic device (100) can identify an area of ​​width (813) that is not obscured by the third housing part (130) as a user interaction area (820).

[0138] In one embodiment, the electronic device (100) may display a screen of a running application in a user interaction area (820). In one embodiment, the screen displayed in the user interaction area (820) may include an icon (831) of the running application and visual objects related to functions provided by the running application. For example, referring to FIG. 8a, if the running application is a camera application, the visual objects may include visual objects (833, 835) for controlling the camera application and / or visual objects (837) for interacting with the user.

[0139] In one embodiment, a visual object (837) for interacting with a user can guide the user on how to use the application currently running. In one embodiment, a visual object (837) for interacting with a user can guide multimodal input (e.g., voice input and / or gesture input). In one embodiment, a visual object (837) for interacting with a user can provide suggestions related to the functions of the application.

[0140] In one embodiment, the electronic device (100) may provide a suggestion related to the function of an application based on the current state of the electronic device (100). For example, if the application currently running is a camera application, the electronic device (100) may suggest adjusting settings related to the camera (175) (e.g., camera composition, camera angle) when the position (810) where the third display area (140c) contacts the first display area (140a) needs to be changed to position (850).

[0141] For example, if the running application is a camera application, the electronic device (100) may suggest adjusting settings related to the camera (175) (e.g., camera composition, camera angle) through a visual object (837). For example, in the states (703, 705) of FIG. 7a, the electronic device (100) may suggest adjusting settings related to the camera (175) (e.g., camera composition, camera angle) by displaying the phrase “fold further to the indicated part” on the visual object (837) for interacting with the user. Additionally, the electronic device (100) may activate a portion of the area (840) within the first display area (140a) outside the user interaction area (820) while suggesting adjusting settings related to the camera (175) (e.g., camera composition, camera angle) through the visual object (837). For example, the electronic device (100) may activate a display panel corresponding to a portion area (840) to display a visual object that guides a position (850) where a third display area (140c) should be in contact with a first display area (140a) in a portion area (840).

[0142] In one embodiment, the electronic device (100) can identify that a user operates the electronic device (100) after providing a suggestion related to the function of an application through a user interaction area (820). For example, the electronic device (100) can identify that a user operates the electronic device (100) according to the provided suggestion. In one embodiment, referring to FIG. 8b, the electronic device (100) can identify a user interaction area (820) exposed from a first form based on the orientations (or angles (e.g., angles (311, 321, 331)) of the housing parts (110, 120, 130). For example, the electronic device (100) can identify an area of ​​width (815) that is covered by the third housing part (130) and an area of ​​width (817) that is not covered by the third housing part (130) of the first display area (140a). In one embodiment, the electronic device (100) can identify an area of ​​width (817) that is not covered by the third housing part (130) as a user interaction area (820).

[0143] In one embodiment, the electronic device (100) may respond to the user's operation through a visual object (837) for interacting with the user based on identifying that the user is operating the electronic device (100). For example, referring to FIG. 8b, the electronic device (100) may indicate that the adjustment of settings related to the camera (175) (e.g., camera composition, camera angle) is completed (or successful) by displaying the phrase “Now the face is clearly visible, please say ‘Click’ to take a picture” on the visual object (837) for interacting with the user.

[0144] FIG. 9a illustrates an example of user voice input. FIG. 9b and FIG. 9c illustrate examples of a UI in which an electronic device guides a change in camera angle according to voice input, according to one embodiment.

[0145] FIGS. 9a to 9c can be explained with reference to FIGS. 1a to 8b.

[0146] In one embodiment, the electronic device (100) may receive user input from a user (700). For example, user input may include touch input to a display (170), voice input through a microphone (e.g., input module (1750) of FIG. 17), and / or gesture input through a camera (175). For example, referring to FIG. 9a, the electronic device (100) may receive voice input from the user (700) (e.g., “I want to record a video”).

[0147] In one embodiment, the electronic device (100) can execute an application and / or functions of the application based on user input. For example, referring to FIG. 9a, the electronic device (100) can execute a camera application based on voice input from a user (700) (e.g., “I want to record a video”). For example, referring to FIG. 9a, the electronic device (100) can change to a mode for recording a video within the camera application based on voice input from a user (700) (e.g., “I want to record a video”).

[0148] In one embodiment, the electronic device (100) can determine the camera angle and / or camera type (e.g., telephoto, wide-angle, ultra-wide-angle) desired by the user based on user input. For example, the electronic device (100) can identify the camera's shooting mode (e.g., portrait, normal shooting, video), shooting composition (e.g., portrait, landscape, animal, building), and / or shooting purpose (e.g., upload to social media) based on user input from the user (700). For example, the electronic device (100) can determine the camera angle and / or camera type (e.g., telephoto, wide-angle, ultra-wide-angle) desired by the user (700) based on the camera's shooting mode (e.g., portrait, normal shooting, video), shooting composition (e.g., portrait, landscape, animal, building), and / or shooting purpose (e.g., upload to social media).

[0149] For example, the electronic device (100) may suggest adjusting the camera angle (or adjusting the second angle) (or operating the third housing part (130)) through a user interaction area based on a camera angle (910) corresponding to a shooting mode (e.g., video recording) specified by user input. For example, the electronic device (100) may suggest adjusting the camera angle (or adjusting the second angle) (or operating the third housing part (130)) through a user interaction area so that the camera angle has a camera angle corresponding to the shooting mode (e.g., video recording) specified by user input, based on a shooting mode (e.g., video recording) specified by user input. In one embodiment, the camera angle corresponding to the shooting mode (e.g., video recording) specified by user input may be the camera angle that the user mainly set (or most recently set) during the specified shooting mode (e.g., video recording). However, the embodiment is not limited thereto. For example, the camera angle corresponding to the shooting mode (e.g., video recording) specified by user input may be a camera angle determined by the distance and / or height difference between the electronic device (100) and the user (700).

[0150] In one embodiment, referring to FIGS. 9b and 9c, the electronic device (100) may suggest adjusting the camera angle (or adjusting the second angle) (or operating the third housing part (130)) through an icon (931) of a running application displayed in a user interaction area (920) and a visual object (937) for interacting with the user within the screen, which includes visual objects related to functions provided by the running application. In one embodiment, if the running application is a camera application, the visual objects may include visual objects (933, 935) for controlling the camera application and / or a visual object (937) for interacting with the user.

[0151] In one embodiment, with reference to FIG. 9b, the electronic device (100) can suggest adjusting settings related to the camera (175) (e.g., camera composition, camera angle) by displaying the phrase “Please fold further to the dotted line shown above” in a user interaction area (920) determined based on a position (910) that contacts the first display area (140a). For example, referring to FIG. 9b, when the camera angle needs to be lowered (or when the width (911) of the first display area (140a) that is covered by the third housing part (130) needs to be reduced) (or when the width (913) that is not covered by the third housing part (130) needs to be increased), the electronic device (100) can suggest adjusting the settings related to the camera (175) (e.g., camera composition, camera angle) by displaying the phrase “Please fold further to the dotted line shown above” in the user interaction area (920). Additionally, the electronic device (100) may activate a portion of the area (940) within the first display area (140a) outside the user interaction area (920) while suggesting adjustments to settings related to the camera (175) (e.g., camera composition, camera angle) through a visual object (937) within the user interaction area (920). For example, the electronic device (100) may activate a display panel corresponding to the portion of the area (940) to display a visual object in the portion of the area (940) that guides the position (950) where the third display area (140c) should be in contact with the first display area (140a).

[0152] In one embodiment, with reference to FIG. 9c, the electronic device (100) can suggest adjusting settings related to the camera (175) (e.g., camera composition, camera angle) by displaying the phrase “Please extend further to the dotted line shown above” in a user interaction area (920) determined based on a position (910) that contacts the first display area (140a). For example, referring to FIG. 9c, if the camera angle needs to be raised (or if the width (915) of the first display area (140a) that is covered by the third housing part (130) needs to be increased) (or if the width (917) that is not covered by the third housing part (130) needs to be reduced), the electronic device (100) can suggest adjusting the settings related to the camera (175) (e.g., camera composition, camera angle) by displaying the phrase “Please extend further to the dotted line shown above” in the user interaction area (920). Additionally, the electronic device (100) may display a visual object that guides the position (955) where the third display area (140c) should be in contact with the first display area (140a) within a portion (945) of the area within the first display area (140a) outside the user interaction area (920), while suggesting the adjustment of settings related to the camera (175) (e.g., camera composition, camera angle) through a visual object (937) within the user interaction area (920).

[0153] In one embodiment, the electronic device (100) can identify that the user is operating the electronic device (100) after providing a suggestion related to the function of the application through the user interaction area (920). For example, the electronic device (100) can identify that the user is operating the electronic device (100) according to the provided suggestion. In one embodiment, the electronic device (100) can respond to the user's operation through a visual object (937) for interacting with the user based on identifying that the user is operating the electronic device (100). For example, the electronic device (100) can indicate that the adjustment of settings related to the camera (175) (e.g., camera composition, camera angle) is completed (or successful) by displaying the phrase “Now the face is clearly visible, please say ‘Click’ to take a picture” on the visual object for interacting with the user.

[0154] FIG. 10a illustrates an example of user voice input. FIG. 10b to FIG. 10e illustrate examples of a UI in which an electronic device changes according to the size of a user interaction area, according to one embodiment.

[0155] FIGS. 10a to 10e can be explained with reference to FIGS. 1a to 9c.

[0156] In one embodiment, the electronic device (100) can receive user input from a user (700). For example, user input may include touch input to a display (170), voice input through a microphone (e.g., input module (1750) of FIG. 17), and / or gesture input through a camera (175). For example, referring to FIG. 10a, the electronic device (100) can receive voice input from the user (700) (e.g., “Adjust the aspect ratio to 3:4”).

[0157] In one embodiment, the electronic device (100) can execute the functions of an application based on user input. For example, referring to FIG. 10a, the electronic device (100) can execute a function corresponding to voice input among the functions supported by the camera application based on voice input from the user (700) (e.g., “Adjust the aspect ratio to 3:4”). For example, referring to FIG. 10a, the electronic device (100) can change the aspect ratio of the camera (175) to 3:4 within the camera application based on voice input from the user (700) (e.g., “Adjust the aspect ratio to 3:4”).

[0158] In one embodiment, the electronic device (100) may display a user interface (UI) of a camera application in a user interaction area. For example, the UI of the camera application may display a response to a voice input from a user (700) (e.g., “Adjust the aspect ratio to 3:4”). In one embodiment, the electronic device (100) may display a UI that reflects a response to a voice input from a user (700) (e.g., “Adjust the aspect ratio to 3:4”) depending on the size of the user interaction area.

[0159] For example, referring to FIG. 10b, the user interaction area (1020) may include an icon (1031) of a running application and visual objects related to functions provided by the running application. For example, referring to FIG. 10b, if the running application is a camera application, it may include a preview image (1033) captured through the camera (175), a control element (1035) for controlling image capture, and / or a control element (1037) for setting a value of the camera (175) for image capture. For example, referring to FIG. 10b, the control element (1037) may include a visual object representing a 3:4 aspect ratio that reflects a response to voice input (e.g., “Adjust the aspect ratio to 3:4”).

[0160] In one embodiment, the electronic device (100) can identify that the position (1010) where the third display area (140c) contacts the first display area (140a) is changed. For example, the electronic device (100) can identify that the position (1010) where the third display area (140c) contacts the first display area (140a) changes based on the orientations (or angles (e.g., angles (311, 321, 331)) of the housing parts (110, 120, 130) of the electronic device (100). In one embodiment, the electronic device (100) can identify that the width (1011) of the first display area (140a) covered by the third housing part (130) increases, and the width (1012) not covered by the third housing part (130) decreases.

[0161] In one embodiment, the electronic device (100) can change the UI displayed in the reduced user interaction area (1020) as the position (1010) where the third display area (140c) contacts the first display area (140a) changes.

[0162] In one embodiment, the electronic device (100) may change the UI displayed in the user interaction area (1020) based on the width covered by the third housing part (130) and / or the width not covered by the third housing part (130). For example, the electronic device (100) may reduce the number of visual objects displayed in the user interaction area (1020) as the width not covered by the third housing part (130) decreases. For example, the electronic device (100) may reduce the number of columns in which visual objects displayed in the user interaction area (1020) are arranged as the width not covered by the third housing part (130) decreases.

[0163] For example, the electronic device (100) may stop displaying a visual object (e.g., a preview image) that requires more than a specified width among the visual objects displayed in the user interaction area (1020) as the width not covered by the third housing part (130) decreases.

[0164] For example, the electronic device (100) may display a visual object for the electronic device (100) to interact with a user in the user interaction area (1030) as the width not obscured by the third housing part (130) is reduced. For example, the electronic device (100) interacting with the user may include providing a guide to the user visually. For example, the electronic device (100) interacting with the user may include providing a guide to the user visually indicating that other types of input (e.g., voice input, and / or gesture input) distinct from touch input are available.

[0165] For example, referring to FIG. 10c, the electronic device (100) can identify that the width of the first display area (140a) that is covered by the third housing part (130) increases from width (1011) to width (1013), and the width not covered by the third housing part (130) decreases from width (1012) to width (1014). As the width not covered by the third housing part (130) (1014) decreases, the electronic device (100) can reduce the number of visual objects displayed in the user interaction area (1020) and / or the number of columns in which the visual objects are arranged. For example, referring to FIG. 10c, the electronic device (100) can stop displaying some visual objects in a control element (1037) for setting the setting value of the camera (175) for capturing an image when the application currently running is a camera application. For example, the electronic device (100) may stop displaying visual objects (e.g., “PORTRAIT”, “PHOTO”, “VIDEO”) for changing the shooting mode. For example, the electronic device (100) may stop displaying visual objects (e.g., “PORTRAIT”, “PHOTO”, “VIDEO”) for changing the shooting mode in a control element (1037) where the visual objects are arranged in two columns. However, the embodiments are not limited thereto. For example, the electronic device (100) may reduce the size (or width) of each of the visual objects displayed in the user interaction area (1020) as the width not obscured by the third housing part (130) is reduced. For example, the electronic device (100) can reduce the size (or width) of each visual object displayed in the user interaction area (1020) at a rate corresponding to the rate at which the width not covered by the third housing part (130) is reduced.

[0166] For example, referring to FIG. 10d, the electronic device (100) can identify that the width of the first display area (140a) covered by the third housing part (130) increases from width (1011) to width (1015), and the width not covered by the third housing part (130) decreases from width (1012) to width (1016). As the width not covered by the third housing part (130) (1016) decreases, the electronic device (100) can stop displaying a visual object (e.g., a preview image) that requires more than a specified width. For example, the specified width may be set differently for each visual object. For example, the specified width may be the minimum width required for user identification (or, distinction) and / or touch input identification (or, distinction) for each visual object. For example, referring to FIG. 10d, the electronic device (100) may stop displaying a preview image (1033) captured through a camera (175) when the application currently running is a camera application. For example, referring to FIG. 10b and FIG. 10c, the electronic device (100) may reduce the size of the preview image (1033) as the width not obscured by the third housing part (130) gradually decreases when the application currently running is a camera application. For example, referring to FIG. 10c and FIG. 10d, the electronic device (100) may stop displaying the preview image (1033) when the application currently running is a camera application as the width not obscured by the third housing part (130) decreases to a specified width or less.

[0167] For example, the electronic device (100) may display a visual object (1039) to provide a visual guide to the user as the width (1016) not obscured by the third housing part (130) decreases. For example, the electronic device (100) may display a visual object (1037) together with the visual object (1039) based on the fact that the width (1016) not obscured by the third housing part (130) is greater than or equal to the width at which the user can make a touch input.

[0168] For example, referring to FIG. 10e, the electronic device (100) can identify that the width of the first display area (140a) covered by the third housing part (130) increases from width (1011) to width (1017), and the width not covered by the third housing part (130) decreases from width (1012) to width (1018). As the width not covered by the third housing part (130) decreases, the electronic device (100) can display a visual object (1039) to provide a visual guide to the user. For example, the electronic device (100) can display only the visual object (1039) instead of the visual object (1037) based on the fact that the width not covered by the third housing part (130) (1018) is less than the width at which the user can make a touch input.

[0169] FIGS. 11a to 11c illustrate examples of UIs in which an electronic device changes according to the size of a user interaction area, according to one embodiment.

[0170] FIGS. 11a to 11c can be explained with reference to FIGS. 1a to 10e.

[0171] In one embodiment, the electronic device (100) can display a user interface (UI) of a gallery application in a user interaction area. In one embodiment, the electronic device (100) can display a UI in which visual objects are arranged according to the size of the user interaction area.

[0172] For example, referring to FIG. 11a, if the running application is a gallery application, the user interaction area (1120) may include one or more thumbnail images (1131, 1133, 1135) and a visual object (1137) for functions related to the selected thumbnail image (1135). In one embodiment, the thumbnail images (1131) may be previous thumbnail images of the selected thumbnail image (1135). In one embodiment, the thumbnail images (1133) may be next thumbnail images of the selected thumbnail image (1135). For example, the visual object (1137) may include icons mapped with functions for favorites, editing (or AI (artificial intelligence) editing), sharing, deleting, and / or playback of the original image of the selected thumbnail image (1135).

[0173] In one embodiment, the electronic device (100) can identify that the position (1110) where the third display area (140c) contacts the first display area (140a) is changed. For example, the electronic device (100) can identify that the position (1110) where the third display area (140c) contacts the first display area (140a) changes based on the orientations (or angles (e.g., angles (311, 321, 331)) of the housing parts (110, 120, 130) of the electronic device (100). In one embodiment, the electronic device (100) can identify that the width (1111) of the first display area (140a) covered by the third housing part (130) increases, and the width (1112) not covered by the third housing part (130) decreases.

[0174] In one embodiment, the electronic device (100) can change the UI displayed in the reduced user interaction area (1120) as the position (1110) where the third display area (140c) contacts the first display area (140a) changes.

[0175] In one embodiment, the electronic device (100) may change the UI displayed in the user interaction area (1120) based on the width covered by the third housing part (130) and / or the width not covered by the third housing part (130). For example, the electronic device (100) may stop displaying at least one of one or more thumbnail images (1131, 1133, 1135) or a visual object (1137) as the width not covered by the third housing part (130) decreases. For example, the electronic device (100) may display a control element (1139) for changing the selected thumbnail image as the width not covered by the third housing part (130) decreases.

[0176] For example, referring to FIG. 11b, the electronic device (100) can identify that the width of the first display area (140a) covered by the third housing part (130) increases from width (1111) to width (1113), and the width not covered by the third housing part (130) decreases from width (1112) to width (1114). As the width not covered by the third housing part (130) decreases, the electronic device (100) can stop displaying a visual object (1137) in the user interaction area (1120). The electronic device (100) can reduce the size of one or more thumbnail images (1131, 1133, 1135) displayed in the user interaction area (1120) as the width (1114) not covered by the third housing part (130) is reduced.

[0177] For example, referring to FIG. 11c, the electronic device (100) can identify that the width of the first display area (140a) that is covered by the third housing part (130) increases from width (1111) to width (1115), and the width that is not covered by the third housing part (130) decreases from width (1112) to width (1116). As the width (1116) that is not covered by the third housing part (130) decreases, the electronic device (100) can stop displaying visual objects (e.g., thumbnail images (1131, 1133, 1135)) that require more than a specified width. For example, referring to FIG. 11c, the electronic device (100) may display a control element (1139) for changing a selected thumbnail image in the user interaction area (1120) instead of thumbnail images (1131, 1133, 1135).

[0178] According to an embodiment, while the electronic device (100) is running a gallery application, an original image corresponding to a selected thumbnail image (1135) may be displayed on a display (170) placed in a second housing part (120). Accordingly, based on user input to a control element (1139) (e.g., user input for previous, or user input for next), an original image corresponding to a previous thumbnail image or a next thumbnail image of the selected thumbnail image (1135) may be displayed on the display (170).

[0179] FIGS. 12a to 12c illustrate examples of UIs in which an electronic device changes according to the size of a user interaction area, according to one embodiment.

[0180] FIGS. 12a to 12c can be explained with reference to FIGS. 1a to 11c.

[0181] In one embodiment, the electronic device (100) may display a user interface (UI) of a content playback application (e.g., a music player or a video player) in a user interaction area. In one embodiment, the electronic device (100) may display a UI in which visual objects are arranged according to the size of the user interaction area.

[0182] For example, referring to FIG. 12a, if the application running is a content playback application, the user interaction area (1220) may include a preview content (1231), a visual object (1233) for functions related to the playback of the preview content (1231), a visual object (1235) for functions related to the screen size on which the preview content (1231) is displayed, and / or a visual object (1237) representing a playback timeline.

[0183] In one embodiment, the electronic device (100) can identify that the position (1210) where the third display area (140c) contacts the first display area (140a) is changed. For example, the electronic device (100) can identify that the position (1210) where the third display area (140c) contacts the first display area (140a) changes based on the orientations (or angles (e.g., angles (311, 321, 331)) of the housing parts (110, 120, 130) of the electronic device (100). In one embodiment, the electronic device (100) can identify that the width (1211) of the first display area (140a) covered by the third housing part (130) increases, and the width (1212) not covered by the third housing part (130) decreases.

[0184] In one embodiment, the electronic device (100) can change the UI displayed in the reduced user interaction area (1220) as the position (1210) where the third display area (140c) contacts the first display area (140a) changes.

[0185] In one embodiment, the electronic device (100) may change the UI displayed in the user interaction area (1220) based on the width covered by the third housing part (130) and / or the width not covered by the third housing part (130). For example, as the width not covered by the third housing part (130) decreases, the electronic device (100) may stop displaying at least one of the preview content (1231), a visual object (1233) for a function related to the playback of the preview content (1231), a visual object (1235) for a function related to the screen size on which the preview content (1231) is displayed, and / or a visual object (1237) representing a playback timeline. For example, the electronic device (100) can display a visual object (1233) for a function related to the playback of preview content (1231) as the width not obscured by the third housing part (130) is reduced.

[0186] For example, referring to FIG. 12b, the electronic device (100) can identify that the width of the first display area (140a) covered by the third housing part (130) increases from width (1211) to width (1213), and the width not covered by the third housing part (130) decreases from width (1212) to width (1214). As the width not covered by the third housing part (130) (1214) decreases, the electronic device (100) can stop displaying preview content (1231) and / or visual objects (1235) in the user interaction area (1220). The electronic device (100) can display only visual objects (1233) and / or visual objects (1237) in the user interaction area (1220) as the width (1214) not covered by the third housing part (130) is reduced.

[0187] For example, referring to FIG. 12c, the electronic device (100) can identify that the width of the first display area (140a) that is covered by the third housing part (130) increases from width (1211) to width (1215), and the width not covered by the third housing part (130) decreases from width (1212) to width (1216). As the width not covered by the third housing part (130) (1216) decreases, the electronic device (100) can stop displaying a visual object (e.g., preview content (1231)) that requires more than a specified width. For example, referring to FIG. 12c, the electronic device (100) can display a visual object (1233) in a user interaction area (1220).

[0188] According to an embodiment, while the electronic device (100) is running a content playback application, the original content corresponding to the selected thumbnail image (1235) may be displayed on the display (170) placed in the second housing part (120). Accordingly, based on user input to the control element (1233) (e.g., user input for previous content playback, or user input for next content playback), the previous content or next content of the original content of the selected preview content (1231) may be displayed on the display (170).

[0189] FIGS. 13a to 13d illustrate examples of UIs in which an electronic device changes according to the size of a user interaction area, according to one embodiment.

[0190] FIGS. 13a to 13d can be explained with reference to FIGS. 1a to 12c.

[0191] In one embodiment, the electronic device (100) may display a screen of a running application on a display (170). For example, the running application may be a content playback application (e.g., a music player or a video player). In one embodiment, while the electronic device (100) displays a screen of a running application on the display (170), it may display a UI for controlling the application in a user interaction area.

[0192] Referring to FIG. 13a in comparison to FIG. 12a, the electronic device (100) may display a visual object (1335) for interacting with the user instead of a visual object (1235) for functions related to the screen size on which preview content (1331) is displayed, and / or a visual object (1237) representing a playback timeline. For example, referring to FIG. 13a, the visual object (1335) for interacting with the user may guide multimodal input (e.g., voice input and / or gesture input). For example, the visual object (1335) for interacting with the user may include an icon and text (e.g., “Help?”) indicating that voice input and / or gesture input is possible.

[0193] In one embodiment, the electronic device (100) can identify that the position (1310) where the third display area (140c) contacts the first display area (140a) is changed. For example, the electronic device (100) can identify that the position (1310) where the third display area (140c) contacts the first display area (140a) changes based on the orientations (or angles (e.g., angles (311, 321, 331)) of the housing parts (110, 120, 130) of the electronic device (100). In one embodiment, the electronic device (100) can identify that the width (1311) of the first display area (140a) covered by the third housing part (130) increases, and the width (1312) not covered by the third housing part (130) decreases.

[0194] In one embodiment, the electronic device (100) can change the UI displayed in the reduced user interaction area (1320) as the position (1310) where the third display area (140c) contacts the first display area (140a) changes.

[0195] For example, referring to FIG. 13b, the electronic device (100) can identify that the width of the first display area (140a) covered by the third housing part (130) increases from width (1311) to width (1313), and the width not covered by the third housing part (130) decreases from width (1312) to width (1314). As the width not covered by the third housing part (130) decreases, the electronic device (100) can stop displaying a visual object (1333) in the user interaction area (1320). The electronic device (100) can display preview content (1331) and / or visual objects (1335) in the user interaction area (1320) as the width (1314) not obscured by the third housing part (130) is reduced.

[0196] For example, referring to FIG. 13c, the electronic device (100) can identify that the width of the first display area (140a) covered by the third housing part (130) increases from width (1311) to width (1315), and the width not covered by the third housing part (130) decreases from width (1312) to width (1316). As the width not covered by the third housing part (130) decreases, the electronic device (100) can stop displaying preview content (1331) and / or visual objects (1335). For example, referring to FIG. 13c, the electronic device (100) can display visual objects (1333) in the user interaction area (1320).

[0197] For example, referring to FIG. 13d, the electronic device (100) can identify that the width of the first display area (140a) covered by the third housing part (130) increases from width (1311) to width (1317), and the width not covered by the third housing part (130) decreases from width (1312) to width (1318). As the width not covered by the third housing part (130) (1318) decreases, the electronic device (100) can stop displaying preview content (1331) and / or visual objects (1333). For example, referring to FIG. 13d, the electronic device (100) can display a visual object (1335) indicating that voice input and / or gesture input is possible in the user interaction area (1320).

[0198] FIGS. 14a to 14d illustrate examples of UIs in which an electronic device changes according to the size of a user interaction area, according to one embodiment.

[0199] FIGS. 14a to 14d can be explained with reference to FIGS. 1a to 13d.

[0200] In one embodiment, the electronic device (100) may display a user interface (UI) of a call application in a user interaction area. In one embodiment, the electronic device (100) may display a UI in which visual objects are arranged according to the size of the user interaction area. For example, referring to FIG. 14a, the electronic device (100) may display a UI for controlling a call in a user interaction area while performing a video call and / or voice call.

[0201] For example, referring to FIG. 14a, the electronic device (100) may display an image (1431) received from a counterpart electronic device, an image (14331) captured through a camera (175), a visual object (1435) for controlling a call, and / or a visual object (1437) for interacting with a user. For example, referring to FIG. 14a, the visual object (1437) for interacting with a user may guide multimodal input (e.g., voice input and / or gesture input). For example, the visual object (1437) for interacting with a user may include an icon and text (e.g., “Help?”) indicating that voice input and / or gesture input is possible.

[0202] In one embodiment, the electronic device (100) can identify that the position (1410) where the third display area (140c) contacts the first display area (140a) is changed. For example, the electronic device (100) can identify that the position (1410) where the third display area (140c) contacts the first display area (140a) changes based on the orientations (or angles (e.g., angles (311, 321, 331)) of the housing parts (110, 120, 130) of the electronic device (100). In one embodiment, the electronic device (100) can identify that the width (1411) of the first display area (140a) covered by the third housing part (140) increases, and the width (1412) not covered by the third housing part (140) decreases.

[0203] In one embodiment, the electronic device (100) can change the UI displayed in the reduced user interaction area (1420) as the position (1410) where the third display area (140c) contacts the first display area (140a) changes.

[0204] For example, referring to FIG. 14b, the electronic device (100) can identify that the width of the first display area (140a) covered by the third housing part (130) increases from width (1411) to width (1413), and the width not covered by the third housing part (130) decreases from width (1412) to width (1414). As the width not covered by the third housing part (130) decreases, the electronic device (100) can stop displaying a visual object (1437) in the user interaction area (1420). The electronic device (100) can reduce the size of the image (1431) received from the counterpart electronic device displayed in the user interaction area (1420) and / or the image (1433) captured through the camera (175) as the width (1414) not covered by the third housing part (130) is reduced.

[0205] For example, referring to FIG. 14c, the electronic device (100) can identify that the width of the first display area (140a) that is covered by the third housing part (140) increases from width (1411) to width (1415), and the width not covered by the third housing part (140) decreases from width (1412) to width (1416). As the width not covered by the third housing part (140) decreases, the electronic device (100) can stop displaying a visual object (1437) in the user interaction area (1420). For example, referring to FIG. 14c, the electronic device (100) can display identification information (1441) (e.g., name, phone number) for the other electronic device in the user interaction area (1420) instead of an image (1431) received from the other electronic device and / or an image (1431) captured through the camera (175) as the width (1416) not covered by the third housing part (140) is reduced.

[0206] For example, referring to FIG. 14d, the electronic device (100) can identify that the width of the first display area (140a) that is covered by the third housing part (140) increases from width (1411) to width (1417), and the width not covered by the third housing part (140) decreases from width (1412) to width (1418). As the width not covered by the third housing part (140) (1418) decreases, the electronic device (100) can stop displaying a visual object (1435) in the user interaction area (1420). For example, referring to FIG. 14d, the electronic device (100) may display identification information (e.g., name, phone number) for the other electronic device in the user interaction area (1420) instead of an image (1431) received from the other electronic device and / or an image (1433) captured through the camera (175) as the width (1418) not obscured by the third housing part (140) decreases. For example, referring to FIG. 14d, the electronic device (100) may display a visual object (1437) indicating that voice input and / or gesture input is possible as the width (1418) not obscured by the third housing part (140) decreases.

[0207] FIGS. 15a and 15b illustrate an example in which an electronic device, according to one embodiment, displays a UI through a user interaction area while having a U-shaped form.

[0208] FIGS. 15a and FIGS. 15b can be explained with reference to FIGS. 1a through FIGS. 14d.

[0209] In one embodiment, the electronic device (100) can identify the orientation of the electronic device (100) through a sensor (e.g., the sensor module (1776) of FIG. 17). For example, the electronic device (100) can identify the orientation of each of the first housing part (110), the second housing part (120), and the third housing part (130) through a sensor (e.g., the sensor module (1776) of FIG. 17). In one embodiment, the sensor (e.g., the sensor module (1776) of FIG. 17) can be placed in each of the first housing part (110), the second housing part (120), and the third housing part (130). In one embodiment, the sensor (e.g., the sensor module (1776) of FIG. 17) can be an inertial measurement unit (IMU) sensor, a gyroscope sensor, a geomagnetic sensor, and / or an accelerometer sensor.

[0210] For example, the electronic device (100) can identify angles between the first housing part (110), the second housing part (120), or the third housing part (130) based on the orientation of the first housing part (110), the second housing part (120), and / or the orientation of the third housing part (130). However, the embodiments are not limited thereto. For example, the electronic device (100) can identify angles between the first housing part (110) and the second housing part (120) based on the degree of rotation of the gears (g11, g12, g13, g14). For example, the electronic device (100) can identify angles between the second housing part (120) and the third housing part (130) based on the degree of rotation of the gears (g21, g22, g23, g24, g25, g26).

[0211] In one embodiment, the electronic device (100) can determine whether the electronic device (100) has a “U” shape based on the orientation of the electronic device (100). For example, the electronic device (100) can determine whether the electronic device (100) has a “U” shape based on the orientation of the first housing part (110), the second housing part (120), and / or the third housing part (130).

[0212] For example, the electronic device (100) can determine whether the electronic device (100) has a “U” shape based on angles between the first housing part (110), the second housing part (120), or the third housing part (130). For example, the electronic device (100) can determine whether the electronic device (100) has a “U” shape based on a first angle between the first housing part (110) and the second housing part (120), a second angle between the second housing part (120) and the third housing part (130), and a third angle between the third housing part (130) and the first housing part (110). For example, the electronic device (100) can determine whether the first angle is within a fourth angle range (e.g., an angle range that makes the distance between the second hinge structure (160) and the first housing part (110) greater than or equal to a reference distance) (e.g., 120 degrees or more) and whether the second angle is within a fifth angle range (e.g., greater than 0 and less than 60 degrees).

[0213] For example, referring to FIG. 15a, the electronic device (100) can be determined to have a “U” shape when the first housing part (110) is in contact with an object (or bottom surface), the first angle is within the range of the fourth angle, and the second angle is within the range of the fifth angle.

[0214] In one embodiment, the electronic device (100) can identify a user interaction area within the first display area (140a) based on a first angle and / or a second angle. For example, the electronic device (100) can identify a user interaction area within the first display area (140a) based on the position where the user looks at the electronic device (100) (or the first display area (140a) of the electronic device (100)) and the first angle and / or a second angle. For example, the electronic device (100) can identify a portion of the first display area (140a) visible to the user as a user interaction area depending on the position where the user looks at the electronic device (100) (or the first display area (140a) of the electronic device (100)). For example, when a user looks at the electronic device (100) in a configuration like Fig. 15b, the area (1560) visible to the user among the first display area (140a) can be identified as a user interaction area.

[0215] In one embodiment, the electronic device (100) may display a screen of an application running in a user interaction area. For example, referring to FIG. 15a, if the application running is a camera application, the electronic device (100) may display visual objects in the user interaction area, such as a preview image captured through the camera (175) and visual objects for interacting with the user. For example, referring to FIG. 15b, if the application running is a camera application, the electronic device (100) may display visual objects in the user interaction area, such as a preview image captured through the camera (175) and visual objects for controlling the camera application.

[0216] According to an embodiment, the electronic device (100) may display a visual object for interacting with the user in a user interaction area instead of a visual object for controlling a camera application, depending on the distance between the user and the electronic device (100).

[0217] FIG. 16 is a flowchart illustrating the operation of an electronic device according to one embodiment.

[0218] FIG. 16 can be explained with reference to FIGS. 1a through 15b.

[0219] Referring to FIG. 16, in operation 1610, the electronic device (100) can identify an attitude in which the electronic device (100) has a first form. In one embodiment, the electronic device (100) can identify the attitude of the electronic device (100) through a sensor (e.g., sensor module (1776) of FIG. 17). For example, the electronic device (100) can identify the attitude of each of the first housing part (110), the second housing part (120), and the third housing part (130) through a sensor (e.g., sensor module (1776) of FIG. 17).

[0220] For example, the electronic device (100) can identify angles between the first housing part (110), the second housing part (120), or the third housing part (130) based on the orientation of the first housing part (110), the second housing part (120), and / or the orientation of the third housing part (130). However, the embodiments are not limited thereto. For example, the electronic device (100) can identify angles between the first housing part (110) and the second housing part (120) based on the degree of rotation of the gears (g11, g12, g13, g14). In one embodiment, the electronic device (100) can identify the degree of rotation of the gears (g11, g12, g13, g14) and the degree of rotation of the gears (g21, g22, g23, g24, g25, g26) through a sensor (e.g., sensor module (1776) of FIG. 17). In one embodiment, the electronic device (100) can identify the angle between the first housing part (110) and the second housing part (120) based on the degree of rotation of the gears (g11, g12, g13, g14). In one embodiment, the electronic device (100) can identify the angle between the second housing part (120) and the third housing part (130) based on the degree of rotation of the gears (g21, g22, g23, g24, g25, g26). In one embodiment, the electronic device (100) can determine whether the electronic device (100) has a first shape based on angles between a first housing part (110), a second housing part (120), or a third housing part (130) identified according to the degree of rotation of gears (g11, g12, g13, g14) and the degree of rotation of gears (g21, g22, g23, g24, g25, g26).For example, the electronic device (100) can be determined to have a first shape as the first angle (311) is within a first angle range (e.g., an angle range that makes the distance between the second hinge structure (160) and the first housing part (110) greater than or equal to a reference distance) (e.g., 120 degrees or less) and the second angle (321) is within a second angle range (e.g., greater than 0 and less than 90 degrees).

[0221] In one embodiment, the electronic device (100) can determine whether the electronic device (100) has a first form based on the orientation of the electronic device (100). For example, the electronic device (100) can determine whether the electronic device (100) has a first form based on the orientation of the first housing part (110), the second housing part (120), and / or the orientation of the third housing part (130). For example, the electronic device (100) can determine whether the electronic device (100) has a first form based on the angles between the first housing part (110), the second housing part (120), or the third housing part (130). For example, the electronic device (100) can determine whether the first angle (311) is within the first angle range (e.g., an angle range that makes the distance between the second hinge structure (160) and the first housing part (110) greater than or equal to a reference distance) (e.g., 120 degrees or less) and whether the second angle (321) is within the second angle range (e.g., greater than 0 and less than 90 degrees).

[0222] For example, the electronic device (100) can determine whether the electronic device (100) has a first shape based on the position where the first housing part (110) contacts the third housing part (130) or the position where the third housing part (130) contacts the first housing part (110).

[0223] In one embodiment, the electronic device (100) can identify the width (w3) of the first display area (140a) of the first housing part (110) located within the first shape and / or the width (w4) of the first display area (140a) of the first housing part (110) located outside the first shape, based on the position where the third housing part (130) contacts the first housing part (110).

[0224] For example, the electronic device (100) may determine a user interaction area exposed (or protruding) from a first form of the first housing part (110) based on widths (w3, w4) identified according to the position where the third housing part (130) contacts the first housing part (110). For example, the size (or width) of the user interaction area may increase as the width (w3) decreases (or as the width (w4) increases). In one embodiment, the electronic device (100) may determine a portion of the flexible display (140) exposed or protruding out of a first form based on the widths (w3, w4). Hereinafter, the portion may be referred to as the exposed flexible display (140). In one embodiment, the electronic device (101) may display one or more user interfaces (UIs) arranged (or aligned) in a designated horizontal direction (e.g., the x-axis direction of FIG. 2a or FIG. 2b) on the exposed flexible display (140) during a landscape pose. In one embodiment, the electronic device (101) may display one or more UIs arranged (or aligned) in a designated vertical direction (e.g., the y-axis direction of FIG. 2a or FIG. 2b) on the exposed flexible display (140) during a portrait pose. Below, an electronic device (101) may be exemplified as displaying one or more UIs arranged (or aligned) in a designated horizontal direction (e.g., the x-axis direction of FIG. 2a or FIG. 2b) on the exposed flexible display (140).

[0225] In one embodiment, the electronic device (100) may determine to display one or more visual objects for obtaining touch inputs to control an application running in a portion of the area, based on the identification that the size of a portion of the area is greater than or equal to a reference size. In one embodiment, the reference size may be set based on the accuracy of the touch inputs for the visual objects. For example, the reference size may be a size such that each of the visual objects has a size in which touch inputs greater than or equal to the reference accuracy are obtained.

[0226] In one embodiment, the electronic device (100) may decide to display another visual object in the part area that guides that another type of input, distinct from the touch input for controlling the application, is possible, based on the identification that the size of the part area is less than the reference size. For example, the other type of input may include voice input and / or gesture input. For example, the electronic device (100) may decide to display another visual object in the part area that guides that another type of input is possible without displaying one or more visual objects for obtaining touch input, when the size of the part area is less than the reference size.

[0227] In one embodiment, the electronic device (100) may decide to output a voice signal through a speaker (e.g., the sound output module (1755) of FIG. 17) that guides that other types of input are possible without displaying visual objects when the size of a part of the area is less than a threshold size (e.g., a size that is not sufficient to display visual objects). In one embodiment, the electronic device (100) may decide to output a voice signal at a larger volume (or sound volume) as the distance between the user and the electronic device (100) increases.

[0228] In operation 1620, the electronic device (100) can display a UI through an exposed flexible display (140).

[0229] In one embodiment, the electronic device (100) can identify a location where the third display area (140c) contacts the first display area (140a). For example, the electronic device (100) can identify a location where the third display area (140c) contacts the first display area (140a) based on the orientations (or angles (e.g., angles (311, 321, 331)) of the housing parts (110, 120, 130) of the electronic device (100).

[0230] In one embodiment, the electronic device (100) can identify a user interaction area exposed from a first form in the first display area (140a) based on a position in contact with the first display area (140a). For example, the electronic device (100) can identify a width area covered by the third housing part (130) and a width area not covered by the third housing part (130) in the first display area (140a) based on a position in contact with the first display area (140a). In one embodiment, the electronic device (100) can identify a width area not covered by the third housing part (130) as a user interaction area exposed from the first form. However, it is not limited thereto. In one embodiment, the electronic device (100) can identify a user interaction area exposed from a first form of a first display area (140a) based on the degree of rotation of gears (g11, g12, g13, g14) and the degree of rotation of gears (g21, g22, g23, g24, g25, g26) (or angles between housing parts (110, 120, 130) identified according to these). For example, the electronic device (100) can identify a width area covered by the third housing part (130) and a width area not covered by the third housing part (130) in the first display area (140a) based on the degree of rotation of the gears (g11, g12, g13, g14) and the degree of rotation of the gears (g21, g22, g23, g24, g25, g26) (or angles between the housing parts (110, 120, 130) identified according to these). In one embodiment, the electronic device (100) can identify a width area not covered by the third housing part (130) as a user interaction area exposed from the first form.

[0231] In one embodiment, the electronic device (100) may display a screen of a running application in a user interaction area. In one embodiment, the screen displayed in the user interaction area may include an icon of the running application, visual objects related to functions provided by the running application, and / or visual objects for interacting with the user (or a UI (user interface) that guides multimodal input (e.g., voice input and / or gesture input)).

[0232] In operation 1630, the electronic device (100) can identify that the size of the exposed flexible display (140) changes to a reference size or smaller. For example, the electronic device (100) can identify that the size of the exposed flexible display (140) changes to a reference size or smaller based on first to third angles. For example, the electronic device (100) can identify that the size of the exposed flexible display (140) changes to a reference size or smaller based on the position where the third housing part (130) contacts the first housing part (110). For example, the reference size may be a size for each visual object to have a size at which a touch input greater than the reference accuracy is obtained.

[0233] In operation 1640, the electronic device (100) may display a UI that guides multimodal input through an exposed flexible display (140). For example, the UI that guides multimodal input (e.g., voice input and / or gesture input) may include one or more phrases for interacting with the user.

[0234] According to an embodiment, the electronic device (100) may display a UI that guides multimodal input based on the distance between the electronic device (100) and the user. For example, if the user is located at a reference distance (e.g., 1 meter) or more from the electronic device (100) where touch input is not easy, a UI that guides multimodal input may be displayed. For example, if the user is within a reference distance (e.g., 1 meter) from the electronic device (100), one or more visual objects for obtaining touch input may be displayed instead of a UI that guides multimodal input.

[0235] FIG. 17 is a block diagram of an electronic device (1701) in a network environment (1700) according to various embodiments.

[0236] Referring to FIG. 17, in a network environment (1700), an electronic device (1701) may communicate with an electronic device (1702) through a first network (1798) (e.g., a short-range wireless communication network) or with at least one of an electronic device (1704) or a server (1708) through a second network (1799) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1701) may communicate with the electronic device (1704) through a server (1708). According to one embodiment, the electronic device (1701) may include a processor (1720), memory (1730), input module (1750), sound output module (1755), display module (1760), audio module (1770), sensor module (1776), interface (1777), connection terminal (1778), haptic module (1779), camera module (1780), power management module (1788), battery (1789), communication module (1790), subscriber identification module (1796), or antenna module (1797). In some embodiments, at least one of these components (e.g., connection terminal (1778)) may be omitted from the electronic device (1701), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1776), camera module (1780), or antenna module (1797)) may be integrated into a single component (e.g., display module (1760)).

[0237] The processor (1720) can, for example, execute software (e.g., program (1740)) to control at least one other component (e.g., hardware or software component) of the electronic device (1701) connected to the processor (1720) and perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1720) can store commands or data received from other components (e.g., sensor module (1776) or communication module (1790)) in volatile memory (1732), process the commands or data stored in volatile memory (1732), and store the resulting data in non-volatile memory (1734). According to one embodiment, the processor (1720) may include a main processor (1721) (e.g., a central processing unit or an application processor) or an auxiliary processor (1723) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1701) includes a main processor (1721) and an auxiliary processor (1723), the auxiliary processor (1723) may be configured to use less power than the main processor (1721) or to be specialized for a designated function. The auxiliary processor (1723) may be implemented separately from the main processor (1721) or as part thereof.

[0238] The auxiliary processor (1723) may control at least some of the functions or states associated with at least one component of the electronic device (1701) (e.g., display module (1760), sensor module (1776), or communication module (1790)) on behalf of the main processor (1721) while the main processor (1721) is in an inactive (e.g., sleep) state, or together with the main processor (1721) while the main processor (1721) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1723) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1780) or communication module (1790)). According to one embodiment, the auxiliary processor (1723) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1701) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1708)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0239] The memory (1730) can store various data used by at least one component of the electronic device (1701) (e.g., processor (1720) or sensor module (1776)). The data may include, for example, software (e.g., program (1740)) and input or output data for related commands. The memory (1730) may include volatile memory (1732) or non-volatile memory (1734).

[0240] The program (1740) may be stored as software in memory (1730) and may include, for example, an operating system (1742), middleware (1744), or an application (1746).

[0241] The input module (1750) can receive commands or data to be used for a component of the electronic device (1701) (e.g., processor (1720)) from outside the electronic device (1701) (e.g., user). The input module (1750) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0242] The sound output module (1755) can output a sound signal to the outside of the electronic device (1701). The sound output module (1755) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0243] The display module (1760) can visually provide information to an external (e.g., user) of the electronic device (1701). The display module (1760) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1760) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0244] The audio module (1770) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1770) can acquire sound through the input module (1750) or output sound through the sound output module (1755) or an external electronic device (e.g., electronic device (1702)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (1701).

[0245] The sensor module (1776) can detect the operating state of the electronic device (1701) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1776) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0246] The interface (1777) may support one or more specified protocols that can be used for the electronic device (1701) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1702)). According to one embodiment, the interface (1777) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0247] The connection terminal (1778) may include a connector through which the electronic device (1701) can be physically connected to an external electronic device (e.g., electronic device (1702)). According to one embodiment, the connection terminal (1778) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0248] The haptic module (1779) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (1779) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0249] The camera module (1780) can capture still images and video. According to one embodiment, the camera module (1780) may include one or more lenses, image sensors, image signal processors, or flashes.

[0250] The power management module (1788) can manage the power supplied to the electronic device (1701). According to one embodiment, the power management module (1788) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0251] The battery (1789) can supply power to at least one component of the electronic device (1701). According to one embodiment, the battery (1789) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0252] The communication module (1790) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1701) and an external electronic device (e.g., electronic device (1702), electronic device (1704), or server (1708)), and the performance of communication through the established communication channel. The communication module (1790) may include one or more communication processors that operate independently of the processor (1720) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1790) may include a wireless communication module (1792) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1794) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1704) through a first network (1798) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1799) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1792) can identify or authenticate the electronic device (1701) within a communication network such as the first network (1798) or the second network (1799) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1796).

[0253] The wireless communication module (1792) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1792) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1792) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1792) can support various requirements specified in the electronic device (1701), external electronic device (e.g., electronic device (1704)), or network system (e.g., second network (1799)). According to one embodiment, the wireless communication module (1792) can support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 664 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 6 ms or less) for URLLC realization.

[0254] An antenna module (1797) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1797) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1797) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1798) or a second network (1799), may be selected from the plurality of antennas, for example, by a communication module (1790). A signal or power may be transmitted or received between the communication module (1790) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1797).

[0255] According to various embodiments, the antenna module (1797) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0256] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0257] According to one embodiment, commands or data may be transmitted or received between the electronic device (1701) and an external electronic device (1704) through a server (1708) connected to a second network (1799). Each of the external electronic devices (1702, or 1704) may be the same or a different type of device as the electronic device (1701). According to one embodiment, all or part of the operations performed on the electronic device (1701) may be performed on one or more of the external electronic devices (1702, 1704, or 1708). For example, if the electronic device (1701) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1701) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (1701). The electronic device (1701) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1701) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (1704) may include an Internet of Things (IoT) device. The server (1708) may be an intelligent server using machine learning and / or neural networks.According to one embodiment, an external electronic device (1704) or server (1708) may be included within the second network (1799). The electronic device (1701) may be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0258] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.

[0259] As described above, the electronic device (100) may include a housing comprising a first housing part (110), a second housing part (120) rotatably coupled to the first housing part (110), and a third housing part (130) rotatably coupled to the second housing part (120); a flexible display (140) disposed across the front of the first housing part (110), the front of the second housing part (120), and the front of the third housing part (130); at least one processor (1720) comprising a first sensor associated with the first housing part (110), a second sensor associated with the second housing part (120), a third sensor associated with the third housing part (130), and a processing circuit; and a memory (1730) comprising one or more storage media for storing instructions. The first housing part (110) may be configured to be positioned between the second housing part (120) and the third housing part (130) when the electronic device (100) is in a multi-folded state. When the instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to identify an angle between the first housing part (110) and the second housing part (120) based on a first value identified through the first sensor and a second value identified through the second sensor. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to identify a different angle between the second housing part (120) and the third housing part (130) based on the second value identified through the second sensor and the third value identified through the third sensor.When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to identify a location where the third housing part (130) contacts the first housing part (110) based on the angle and the other angle. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to identify a portion of the flexible display (140) that is exposed according to the identified location. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to display one or more visual objects to obtain touch input for controlling an application running in the portion of the area based on the identification that the size of the portion of the area is greater than or equal to a reference size. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to display another visual object guiding that a different type of input, distinct from the touch input for controlling the application, is possible in the part area based on the identification that the size of the part area is less than the reference size.

[0260] When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may cause the electronic device (100) to identify the distance between the electronic device (100) and the user. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may cause the one or more visual objects to be displayed in the partial area based on the identification that the distance is less than the reference distance while the size of the partial area is greater than or equal to the reference size. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may cause the one or more visual objects and the other visual object to be displayed in the partial area based on the identification that the distance is greater than or equal to the reference distance while the size of the partial area is greater than or equal to the reference size.

[0261] When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may cause the other visual object to be displayed in the part area without displaying the one or more visual objects, based on the identification that the size of the part area is less than the reference size.

[0262] When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to output a voice signal guiding the other type of input through a speaker based on the identification that the size of the part area is less than the reference size.

[0263] When the above instructions are executed individually or collectively by the at least one processor (1720), they may cause the electronic device (100) to identify the distance between the electronic device (100) and the user. When the above instructions are executed individually or collectively by the at least one processor (1720), they may cause the electronic device (100) to output a voice signal based on a volume that increases as the distance increases.

[0264] When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may cause the flexible display (140) to be disabled based on the identification that the size of the portion of the area is less than a threshold size smaller than the reference size.

[0265] When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to identify a subject within an image acquired through the camera. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to identify a camera angle that captures the subject. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to display a visual object that guides a change in the camera angle in the portion area.

[0266] The visual object guiding the change of the camera angle can guide the adjustment of the position where the third housing part (130) contacts the first housing part (110).

[0267] When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may cause the flexible display (140) to be deactivated based on the identification that the size of the portion of the area is less than a threshold size smaller than the reference size. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may cause the subject to be photographed through a light-emitting element placed on the rear of the third housing part (130).

[0268] The above other types of input may include voice input and / or gesture input.

[0269] The method described above may be performed by an electronic device (100) comprising a housing and a flexible display (140). The housing comprises a first housing part (110), a second housing part (120) rotatably coupled to the first housing part (110), and a third housing part (130) rotatably coupled to the second housing part (120), wherein the first housing part (110) is configured to be positioned between the second housing part (120) and the third housing part (130) when the electronic device (100) is in a multi-folded state, and the flexible display (140) may be positioned across the front of the first housing part (110), the front of the second housing part (120), and the front of the third housing part (130). The above method may include an operation of identifying an angle between the first housing part (110) and the second housing part (120) based on a first value identified through a first sensor and a second value identified through a second sensor. The above method may include an operation of identifying another angle between the second housing part (120) and the third housing part (130) based on the second value identified through a second sensor and a third value identified through a third sensor. The above method may include an operation of identifying a position where the third housing part (130) contacts the first housing part (110) based on the angle and the other angle. The above method may include an operation of identifying a portion of the flexible display (140) that is exposed according to the identified position. The above method may include an operation of displaying one or more visual objects to obtain touch input for controlling an application running in the portion of the portion, based on the identification that the size of the portion of the portion is greater than or equal to a reference size.The above method may include an action of displaying another visual object that guides that a different type of input, distinct from the touch input for controlling the application, is possible in the said portion area based on the identification that the size of said portion area is less than the reference size.

[0270] The above method may include an operation of identifying the distance between the electronic device (100) and the user. The above method may include an operation of displaying the one or more visual objects in the partial area based on identifying that the distance is less than the reference distance while the size of the partial area is greater than or equal to the reference size. The above method may include an operation of displaying the one or more visual objects and the other visual object in the partial area based on identifying that the distance is greater than or equal to the reference distance while the size of the partial area is greater than or equal to the reference size.

[0271] The above method may include an operation of displaying another visual object in the partial area without displaying one or more visual objects, based on the identification that the size of the partial area is less than the reference size.

[0272] The above method may include an operation of outputting a voice signal that guides the input of the other type of input through a speaker, based on the identification that the size of the portion of the above area is less than the reference size.

[0273] The above method may include an operation of identifying the distance between the electronic device (100) and the user. The above method may include an operation of outputting a voice signal at a volume identified based on the distance.

[0274] The above method may include an operation to disable the flexible display (140) based on identifying that the size of the portion of the area is less than a threshold size smaller than the reference size.

[0275] The above application may be a camera application for taking a photograph through a camera positioned on the rear of the third housing part (130). The method may include an operation of identifying a subject within an image obtained through the camera. The method may include an operation of identifying a camera angle for photographing the subject. The method may include an operation of displaying a visual object that guides a change in the camera angle in the partial area.

[0276] The above method may include an operation in which the visual object guiding the change of the camera angle guides the adjustment of the position where the third housing part (130) contacts the first housing part (110).

[0277] The above method may include an operation to disable the flexible display (140) based on identifying that the size of the portion of the area is less than a threshold size smaller than the reference size. The above method may include an operation to guide the subject to be photographed through a light-emitting element placed on the rear of the third housing part (130).

[0278] The above other types of input may include voice input and / or gesture input.

[0279] A non-transitory computer-readable storage medium as described above may store a program containing instructions. When the instructions are executed individually or collectively by at least one processor (1720), the electronic device (100) may cause the first housing part (110) and the second housing part (120) to identify an angle based on a first value identified through a first sensor and a second value identified through a second sensor. When the instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may cause the second housing part (120) and the third housing part (130) to identify another angle based on the second value identified through the second sensor and a third value identified through a third sensor. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to identify a location where the third housing part (130) contacts the first housing part (110) based on the angle and the other angle. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to identify a portion of the exposed flexible display (140) according to the identified location. When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to display one or more visual objects to obtain touch input for controlling an application running in the portion of the area based on the identification that the size of the portion of the area is greater than or equal to a reference size.When the above instructions are executed individually or collectively by the at least one processor (1720), the electronic device (100) may be caused to display another visual object guiding that a different type of input, distinct from the touch input for controlling the application, is possible in the part area based on the identification that the size of the part area is less than the reference size.

[0280] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.

[0281] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0282] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0283] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0284] Various embodiments of the present document may be implemented as software (e.g., program (1740)) comprising one or more instructions stored in a storage medium (e.g., internal memory (1736) or external memory (1738)) readable by a machine (e.g., electronic device (1701)). For example, a processor (e.g., processor (1720)) of the machine (e.g., electronic device (1701)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0285] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., CD-ROM (compact disc read-only memory)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0286] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

In electronic devices, Housing, the above housing is, 1st housing part, A second housing part rotatably coupled to the first housing part, and A third housing part rotatably coupled to the second housing part, wherein the first housing part is configured to be positioned between the second housing part and the third housing part when the electronic device is in a multi-folded state. A flexible display disposed across the front of the first housing part, the front of the second housing part, and the front of the third housing part, First sensor associated with the first housing part, A second sensor associated with a second housing part, Third sensor associated with the third housing part, At least one processor including a processing circuit, and The electronic device includes a memory that stores instructions and includes one or more storage media, wherein the instructions, when executed individually or collectively by the at least one processor, Based on a first value identified through the first sensor and a second value identified through the second sensor, an angle between the first housing part and the second housing part is identified, and Based on the second value identified through the second sensor and the third value identified through the third sensor, different angles between the second housing part and the third housing part are identified, and Based on the above angle and the other angle, identify the position where the third housing part contacts the first housing part, and Based on the identified location above, identify a portion of the exposed flexible display, and Based on the identification that the size of the above partial area is greater than or equal to a reference size, one or more visual objects are displayed to obtain touch input for controlling an application running in the said partial area, and Based on the identification that the size of the aforementioned partial area is less than the reference size, causing to display another visual object that guides that a different type of input, distinct from the touch input for controlling the application, is possible in the said partial area, Electronic device. In claim 1, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Identifying the distance between the above electronic device and the user, and Based on the identification that the distance is less than the reference distance while the size of the portion of the above area is greater than or equal to the reference size, the one or more visual objects are displayed in the portion of the above area, and Causing to display the one or more visual objects and the other visual object in the portion area based on the identification that the distance is greater than or equal to the reference distance while the size of the portion area is greater than or equal to the reference size, Electronic device. In claim 1 or claim 2, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on the identification that the size of the aforementioned portion area is less than the reference size, causing the other visual object to be displayed in the aforementioned portion area without displaying the one or more visual objects, Electronic device. In any one of claims 1 to 3, Includes speakers, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on the identification that the size of the above partial area is less than the reference size, causing to output a voice signal that guides the possibility of the other type of input through the speaker, Electronic device. In claim 4, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Identifying the distance between the above electronic device and the user, and Causing to output a voice signal based on the volume that increases as the above distance increases, Electronic device. In any one of claims 1 to 5, When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on the identification that the size of the aforementioned partial area is less than a threshold size smaller than the reference size, causing the flexible display to be disabled, Electronic device. In any one of claims 1 to 6, It includes a camera positioned on the rear of the third housing part, and The above application is a camera application for taking photos through the above camera, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Identifying a subject within an image acquired through the above camera, and Identify the camera angle capturing the above subject, and Causing a visual object that guides the change of the camera angle to be displayed in the said partial area, Electronic device. In claim 7, The visual object guiding the change of the camera angle guides the adjustment of the position where the third housing part contacts the first housing part. Electronic device. In claim 7, It includes a light-emitting element disposed on the rear surface of the third housing part, and When the above instructions are executed individually or collectively by the at least one processor, the electronic device, Based on the identification that the size of the aforementioned partial area is less than a threshold size smaller than the reference size, the flexible display is disabled, and Causing the subject to be photographed through the light-emitting element, Electronic device. In any one of claims 1 to 7, The above other types of input include voice input and / or gesture input, Electronic device. A method of an electronic device comprising a housing and a flexible display, wherein the housing comprises a first housing part, a second housing part rotatably coupled to the first housing part, and a third housing part rotatably coupled to the second housing part, the first housing part is configured to be positioned between the second housing part and the third housing part when the electronic device is in a multi-folded state, and the flexible display is disposed across the front of the first housing part, the front of the second housing part, and the front of the third housing part. An operation of identifying an angle between the first housing part and the second housing part based on a first value identified through a first sensor and a second value identified through a second sensor, An operation of identifying different angles between the second housing part and the third housing part based on the second value identified through the second sensor and the third value identified through the third sensor, An operation to identify a position where the third housing part contacts the first housing part based on the above angle and the other angle, An operation of identifying a portion of the exposed flexible display according to the above identified location, An operation of displaying one or more visual objects to obtain touch input for controlling an application running in said partial area, based on the identification that the size of said partial area is greater than or equal to a reference size, and Based on the identification that the size of the aforementioned portion of the area is less than the reference size, the operation includes displaying another visual object that guides that a different type of input, distinct from the touch input for controlling the application, is possible in the said portion of the area. method. In claim 11, An operation to identify the distance between the above electronic device and the user, An operation of displaying one or more visual objects in a partial area based on identifying that the distance is less than a reference distance while the size of the partial area is greater than or equal to the reference size, and The operation of displaying the one or more visual objects and the other visual object in the partial area based on identifying that the distance is greater than or equal to the reference distance while the size of the partial area is greater than or equal to the reference size. method. In claim 11 or claim 12, Based on the identification that the size of the portion area is less than the reference size, the operation of displaying the other visual object in the portion area without displaying the one or more visual objects method. In any one of claims 11 to 13, Based on the identification that the size of the aforementioned partial area is less than the reference size, the operation of outputting a voice signal that guides the input of the other type of input through a speaker is possible. method. In claim 14, An operation for identifying the distance between the above electronic device and the user, and Includes an operation of outputting a voice signal at a volume identified based on the above distance. method.

Images