Electronic device for controlling cameras having different aspect ratios, and method therefor

The electronic device with a multi-foldable housing and flexible display dynamically selects cameras based on posture and orientation, addressing the challenge of diverse aspect ratios to ensure optimal image display and quality across different configurations.

WO2025018576A1PCT designated stage expired Publication Date: 2025-01-23SAMSUNG ELECTRONICS CO LTD
View PDF 5 Cites 0 Cited by

Patent Information

Application Number
PCT/KR2024/007384
Authority / Receiving Office
WO · WO
Patent Type
Applications
Current Assignee / Owner
Priority Date
2023-08-14
Filing Date
2024-05-30
Publication Date
2025-01-23

AI Technical Summary

Technical Problem

As electronic devices become more diverse in shape and size to enhance mobility, there is a need for a system that can effectively manage and switch between multiple cameras with different aspect ratios to optimize image display and quality based on the device's posture and orientation.

Method used

An electronic device with a multi-foldable housing and flexible display, equipped with multiple cameras of varying aspect ratios, uses sensors to detect angles and postures, allowing the processor to dynamically select and switch between cameras to ensure optimal image display on the flexible display, regardless of the device's configuration.

Benefits of technology

This solution ensures seamless image display and quality adjustment based on the device's orientation, minimizing blank spaces and optimizing the aspect ratio for each display area, thereby enhancing user experience across various postures and configurations.

✦ Generated by Eureka AI based on patent content.

Smart Images

  • Figure KR2024007384_23012025_PF_FP_ABST
    Figure KR2024007384_23012025_PF_FP_ABST
Patent Text Reader

Abstract

An electronic device according to an embodiment may display a preview image on at least a portion of a flexible display by using a first camera. The electronic device may detect at least one of a changed first angle or a changed second angle by using at least one sensor while displaying the preview image on the at least a portion of the flexible display by using the first camera. The electronic device may determine a portion of the flexible display on which a preview image is to be displayed, on the basis of the detection. The electronic device may change from the first camera to a second camera so as to obtain the preview image to be displayed on the portion of the flexible display.
Need to check novelty before this filing date? Find Prior Art

Description

Electronic device and method for controlling cameras having different aspect ratios

[0001] The present disclosure relates to an electronic device and method for controlling cameras having different aspect ratios.

[0002] The shape and / or size of electronic devices are diversifying. To enhance mobility, electronic devices with reduced size and / or volume are being designed. Electronic devices may include a display for visualizing information. As the number of functions supported by electronic devices increases, the size of the display may increase to visualize more information to the user and / or to support the execution of the functions. For example, electronic devices may be designed to be reduced in size and / or volume while maintaining or increasing the size of the display.

[0003] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0004] In accordance with one embodiment, an electronic device may include a multi-foldable housing including a first housing, a second housing rotatably coupled to the first housing, and a third housing rotatably coupled to the second housing, a flexible display disposed on a first surface of the multi-foldable housing, a plurality of cameras disposed on the first surface on which the flexible display is disposed and having different aspect ratios, at least one sensor for sensing an angle between the first housing and the second housing or an angle between the second housing and the third housing, a memory for storing executable instructions, and at least one processor for accessing the memory to execute the instructions. The at least one processor may be configured to identify a first pose of the electronic device based on an angle sensed by the sensor while displaying an image on the flexible display using a first camera having a first aspect ratio among the plurality of cameras. The at least one processor may be configured to display an image on the identified portion using a second camera among the plurality of cameras, the second camera having a second aspect ratio different from the first aspect ratio, based on secondly identifying a posture of the electronic device changed by rotation of the first housing relative to the second housing, based on the sensor.

[0005] In one embodiment, a method of an electronic device may include an operation of identifying a first posture of the electronic device based on a sensor of the electronic device while displaying an image on a flexible display of the electronic device using a first camera having a first aspect ratio among a plurality of cameras of the electronic device. The plurality of cameras may be positioned on a first surface of a first housing of the electronic device in which the flexible display is positioned or a second surface of a second housing of the electronic device and may have different aspect ratios. The method may include an operation of displaying an image on the identified portion using a second camera having a second aspect ratio different from the first aspect ratio among the plurality of cameras based on identifying a second posture of the electronic device, the second posture being changed by a rotation of the second housing relative to the first housing, based on the sensor.

[0006] In one embodiment, an electronic device may include a housing including a first housing and a second housing rotatably coupled to the first housing, a flexible display disposed on a first surface of the first housing and a second surface of the second housing, a plurality of cameras positioned on the first surface or the second surface, and at least one processor. The at least one processor may be configured to, in response to an input for displaying an image using any one of the plurality of cameras, display the image based on a posture of the first housing and the second housing and an orientation of the electronic device. The at least one processor may be configured to identify an area of ​​the flexible display. The at least one processor may be configured to, based on identifying the area having a height greater than a width, display an image in the area using a first camera among the plurality of cameras, the first camera having a height greater than a width, the first camera being identified by widths and heights of the plurality of cameras distinguished by the orientation. The at least one processor may be configured to display an image in the area using a second camera among the plurality of cameras having a height shorter than a width, based on identifying the area having a height shorter than a width.

[0007] In one embodiment, a method of an electronic device may include an operation of identifying an area of ​​a flexible display of the electronic device on which the image is to be displayed, based on an input for displaying an image using one of a plurality of cameras of the electronic device, based on a posture of a first housing and a second housing of a housing of the electronic device and an orientation of the electronic device. The flexible display may be positioned on a first surface of the first housing and a second surface of the second housing, and the plurality of cameras may be positioned on the first surface or the second surface. The method may include an operation of displaying an image in the area using a first camera among the plurality of cameras, the first camera having a height greater than its width, the height being identified by widths and heights of the plurality of cameras distinguished by the orientation, based on identifying an area having a height greater than its width. The method may include an operation of displaying an image in the area using a second camera among the plurality of cameras, the second camera having a height less than its width, based on identifying an area having a height less than its width.

[0008] In one embodiment, an electronic device may include a first housing, a second housing rotatably coupled to the first housing, a flexible display disposed on a first surface of the first housing and a second surface of the second housing, a first camera disposed on the first surface, a second camera disposed on the second surface, at least one sensor for sensing an angle between the first housing and the second housing, a memory for storing executable instructions, and at least one processor for accessing the memory to execute the instructions. The at least one processor may be configured to identify a state of the electronic device based on the at least one sensor in response to an input for operating either the first camera or the second camera. The at least one processor may be configured to display an image on the entire active area of ​​the flexible display using the second camera having an aspect ratio of the entire active area of ​​the flexible display based on a state of the electronic device corresponding to an unfolded state. The at least one processor may be configured to display an image based on the first camera on one of the flat portions of the flexible display folded by the angle, based on a state of the electronic device corresponding to a sub-fold state between the unfolded state and the folded state.

[0009] In one embodiment, a method of an electronic device may include an operation of identifying a state of the electronic device based on at least one sensor of the electronic device in response to an input for operating either a first camera disposed on a first surface of a first housing or a camera disposed on a second surface of a second housing rotatably coupled to the first housing. The method may include an operation of displaying an image on the entire active area of ​​a flexible display disposed on the first surface and the second surface using the second camera, the second camera having an aspect ratio of the entire active area of ​​the flexible display, based on a state of the electronic device corresponding to an unfolded state. The method may include an operation of displaying an image based on the first camera on any one of flat portions of the flexible display folded by the angle, based on a state of the electronic device corresponding to a sub-fold state between the unfolded state and the folded state.

[0010] In one embodiment, an electronic device may include a foldable housing including a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part, a flexible display disposed on front surfaces of the first housing part, the second housing part, and the third housing part, a plurality of cameras including a first camera and a second camera disposed on the front surface corresponding to the flexible display, at least one sensor for sensing at least one of a first angle between the first housing part and the second housing part, or a second angle between the second housing part and the third housing part, at least one processor, and a memory for storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a preview image on at least a portion of the flexible display using the first camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to detect, using the at least one sensor, at least one of the changed first angle or the changed second angle while displaying a preview image on the at least a portion of the flexible display using the first camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the detection, a portion of the flexible display on which the preview image is to be displayed.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to change from the first camera to the second camera to obtain a preview image to be displayed on the portion of the flexible display.

[0011] In one embodiment, a method of an electronic device may be provided, comprising: a foldable housing including a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part; a flexible display disposed on front surfaces of the first housing part, the second housing part, and the third housing part; a plurality of cameras disposed on the front surface corresponding to the flexible display, the cameras including a first camera and a second camera; and at least one sensor for sensing at least one of a first angle between the first housing part and the second housing part or a second angle between the second housing part and the third housing part. The method may include an operation of displaying a preview image on at least a portion of the flexible display using the first camera. The method may include an operation of detecting, using the at least one sensor, at least one of a change in the first angle or the second angle while displaying the preview image on the at least portion of the flexible display using the first camera. The method may include an operation of determining a portion of the flexible display on which a preview image is to be displayed based on the detection. The method may include an operation of switching from the first camera to the second camera to obtain a preview image to be displayed on the portion of the flexible display.

[0012] In one embodiment, an electronic device may include a foldable housing including a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part, a flexible display disposed on front surfaces of the first housing part, the second housing part, and the third housing part, and a plurality of cameras including a first camera and a second camera disposed on the front surface corresponding to the flexible display. The plurality of cameras may include a first camera disposed on the second housing part and a second camera disposed on the first housing part. The electronic device may include a plurality of sensors including a first sensor for detecting a first angle between the first housing part and the second housing part and a second sensor for detecting a second angle between the second housing part and the third housing part, at least one processor, and a memory for storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to control the first camera to display a first preview image on the entire display area of ​​the flexible display while the foldable housing is in an unfolded state detected by the first angle and the second angle. An aspect ratio of the entire display area may correspond to an aspect ratio of an image sensor included in the first camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain sensor data from the plurality of sensors to detect whether the foldable housing within the unfolded state switches to another state while the preview image is displayed on the entire display area of ​​the flexible display.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to control the second camera to display a second preview image on the portion of the display area on the first housing part in response to the foldable housing switching from the unfolded state to a folded state in which the portion of the display area on the first housing part is visible. An aspect ratio of the portion may correspond to an aspect ratio of an image sensor included in the second camera.

[0013] In one embodiment, a method of an electronic device may be provided, comprising: a foldable housing including a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part; a flexible display disposed on front surfaces of the first housing part, the second housing part, and the third housing part; a plurality of cameras including a first camera and a second camera disposed on the front surface corresponding to the flexible display; the plurality of cameras including a first camera disposed on the second housing part and a second camera disposed on the first housing part; and a plurality of sensors including a first sensor for detecting a first angle between the first housing part and the second housing part and a second sensor for detecting a second angle between the second housing part and the third housing part. The method may include controlling the first camera to display a first preview image on the entire display area of ​​the flexible display while the foldable housing is in an unfolded state detected by the first angle and the second angle. An aspect ratio of the entire display area may correspond to an aspect ratio of an image sensor included in the first camera. The method may include acquiring sensor data from the plurality of sensors to detect whether the foldable housing within the unfolded state switches to another state while the preview image is displayed on the entire display area of ​​the flexible display. The method may include controlling the second camera to display a second preview image on a portion of the display area on the first housing part in response to the foldable housing switching from the unfolded state to a folded state in which the portion of the display area on the first housing part is visible.The aspect ratio of the above part may correspond to the aspect ratio of the image sensor included in the second camera.

[0014] In one embodiment, an electronic device may include a first housing, a second housing rotatably coupled to the first housing between a folded state and an unfolded state, a flexible display disposed on the first housing and the second housing, and a first camera disposed on one surface of the second housing corresponding to the flexible display. The first camera may include a first image sensor, and a first length of the first image sensor parallel to a folding axis between the first housing and the second housing may be shorter than a second length of the first image sensor perpendicular to the folding axis. The electronic device may include a second camera disposed on the one surface of the first housing. The second camera may include a second image sensor, and a third length of the second image sensor parallel to the folding axis may be longer than a fourth length perpendicular to the folding axis. The electronic device may include at least one processor, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a preview image on at least a portion of the flexible display using the first camera or the second camera. The camera used to display the preview image among the first camera or the second camera may be changed depending on the posture of the first housing and the second housing.

[0015] FIG. 1 illustrates one embodiment of an electronic device including a plurality of cameras.

[0016] FIG. 2 illustrates an example block diagram of an electronic device according to one embodiment.

[0017] Figures 3a and 3b illustrate one embodiment of a deformable electronic device.

[0018] FIG. 4 illustrates exemplary locations of cameras included in an electronic device according to one embodiment.

[0019] FIG. 5 illustrates an exemplary flowchart for an electronic device according to one embodiment.

[0020] FIG. 6 illustrates an example of a user interface (UI) displayed by an electronic device that displays an image using one of a plurality of cameras.

[0021] FIG. 7 illustrates different states of an electronic device according to one embodiment.

[0022] FIG. 8 illustrates different states of an electronic device according to one embodiment.

[0023] FIG. 9 illustrates different states of an electronic device according to one embodiment.

[0024] FIG. 10 illustrates an exemplary flowchart for an electronic device according to one embodiment.

[0025] FIG. 11 is a block diagram of an electronic device within a network environment according to various embodiments.

[0026] Hereinafter, various embodiments of this document are described with reference to the attached drawings.

[0027] The various embodiments of this document and the terminology used therein are not intended to limit the technology described in this document to a specific embodiment, but should be understood to include various modifications, equivalents, and / or substitutes of the embodiment. In connection with the description of the drawings, similar reference numerals may be used for similar components. The singular expression may include plural expressions unless the context clearly indicates otherwise. In this document, expressions such as "A or B", "at least one of A and / or B", "A, B, or C", or "at least one of A, B, and / or C" may include all possible combinations of the items listed together. Expressions such as "first", "second", "first", or "second" may modify the corresponding components regardless of order or importance, and are only used to distinguish one component from another, but do not limit the corresponding components. When it is said that a component (e.g., a first component) is “(functionally or communicatively) connected” or “connected” to another component (e.g., a second component), said component may be directly connected to said other component, or may be connected via another component (e.g., a third component).

[0028] The term "module" as used in this document includes a unit composed of hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimal unit or portion thereof that performs one or more functions. For example, a module may be composed of an application-specific integrated circuit (ASIC).

[0029] FIG. 1 illustrates an embodiment of an electronic device (101) including a plurality of cameras (170). In one embodiment, the electronic device (101) may be referred to as a terminal (or user terminal) in terms of being owned by a user. The terminal may include, for example, a personal computer (PC) such as a laptop or desktop. The terminal may include, for example, a smartphone, a smartpad, and / or a tablet PC. The terminal may include a smart accessory such as a smartwatch and / or a head-mounted device (HMD).

[0030] Referring to FIG. 1, according to one embodiment, an electronic device (101) may include a deformable housing. Based on the deformability, the housing of the electronic device (101) may be divided into a plurality of assemblies (or assemblies). The assemblies of the housing may be referred to as portions and / or parts of the housing. For example, the housing of the electronic device (101) of FIG. 1 may include a first housing assembly (111), a second housing assembly (112), and a first hinge assembly (121) for rotatably coupling the first housing assembly (111) and the second housing assembly (112). The relative position, angle, shape, and / or distance of the first housing assembly (111) and the second housing assembly (112), which are rigid bodies, may be changed by an external force with respect to the first hinge assembly (121). The housing of the electronic device (101) may include a second housing assembly (112), a third housing assembly (113), and a second hinge assembly (122) for rotatably coupling the second housing assembly (112) and the third housing assembly (113). Based on the second hinge assembly (122), the relative position, angle, shape, posture, and / or distance of the second housing assembly (112) and the third housing assembly (113) may be changed by an external force. Based on the first hinge assembly (121) and the second hinge assembly (122), the electronic device (101) may have a structure that can be folded one or more times. In one embodiment, the housing assembly including the first housing assembly (111), the second housing assembly (112), and the third housing assembly (113) may be referred to as a housing part, a sub-housing, a flat housing, and / or a rigid housing.In one embodiment, a hinge assembly comprising a first hinge assembly (121) and a second hinge assembly (122) may be referred to as a hinge housing, a joint housing, and / or a flexible housing.

[0031] Referring to FIG. 1, a first folding axis (131) and / or a second folding axis (132) formed along the y-axis direction are illustrated. The first folding axis (131) may be a rotation axis of the first housing assembly (111) and the second housing assembly (112) connected via the first hinge assembly (121), and may be formed within the first hinge assembly (121). As the first housing assembly (111) and / or the second housing assembly (112) rotates around the first folding axis (131), a first angle (141) between the first housing assembly (111), the first hinge assembly (121), and the second housing assembly (112) may change. The second folding axis (132) is a rotation axis of the second housing assembly (112) and the third housing assembly (113) connected through the second hinge assembly (122), and may be formed within the second hinge assembly (122). As the second housing assembly (112) and / or the third housing assembly (113) rotate around the second folding axis (132), the second angle (142) between the second housing assembly (112), the second hinge assembly (122), and the third housing assembly (113) may change. In terms of including a plurality of deformable folding axes, such as the first folding axis (131) and the second folding axis (132), the electronic device (101) may be referred to as a multi-foldable electronic device.

[0032] Referring to FIG. 1, according to one embodiment, an electronic device (101) may include a flexible display (150) disposed on one surface (e.g., a front surface of the electronic device (101)) of a first housing assembly (111), a second housing assembly (112), and a third housing assembly (113). For example, the flexible display (150) may extend from the first housing assembly (111) across the second housing assembly (112) to the third housing assembly (113). The flexible display (150) may be positioned to form the front surfaces of the first housing assembly (111), the second housing assembly (112), and the third housing assembly (113). For example, the flexible display (150) may be arranged from the first housing assembly (111) across the first hinge assembly (121), the second housing assembly (112), and the second hinge assembly (122) to the third housing assembly (113). Hereinafter, the first angle (141) may correspond to an angle between one side of the first housing assembly (111) on which the flexible display (150) is arranged and one side of the second housing assembly (112), which can be folded by the first folding axis (131) of the first hinge assembly (121). Hereinafter, the second angle (142) may correspond to an angle between one side of the second housing assembly (112) and one side of the third housing assembly (113) on which the flexible display (150) is arranged, which can be folded by the second folding axis (132) of the second hinge assembly (122). In one embodiment, the flexible display (150) may be referred to as a display, a deformable display, and / or a deformable panel.

[0033] Referring to FIG. 1, an electronic device (101) may include a plurality of cameras (170) arranged on a first side (e.g., a front side) of a housing in which a flexible display (150) is arranged. For example, lenses of the plurality of cameras (170) may be exposed to the outside through the first side. Through the lenses visible through the first side, each of the plurality of cameras (170) may receive ambient light directed toward the first side. Although an embodiment of an electronic device (101) including a plurality of cameras (170) arranged on the first side is described through FIG. 1 and the drawings described below, the positions of the plurality of cameras (170) are not limited to the embodiment. For example, the plurality of cameras (170) may be arranged on a second side (e.g., a rear side) of the electronic device (101) opposite the first side.

[0034] Hardware included in an electronic device (101) for controlling a flexible display (150) and a plurality of cameras (170) is described with reference to FIG. 2. Referring to FIG. 1, exemplary positions of a flexible display (150) and a plurality of cameras (170) arranged on a first surface of a housing are illustrated. The positions of the plurality of cameras (170) on the first surface are not limited to the embodiment of FIG. 1. Different cases in which a plurality of cameras (170) are arranged are described with reference to FIG. 4.

[0035] Referring to FIG. 1, an exemplary appearance of an electronic device (101) is illustrated with reference to three mutually perpendicular axes (x-axis, y-axis, and z-axis). An exemplary appearance of a flexible display (150) is illustrated in which a length (lx) in the x-axis direction is longer than a length (ly) in the y-axis direction, but the embodiment is not limited thereto. On a first surface of the housing, a plurality of cameras (170) may be arranged along different orientations. For example, a length (c) in the x-axis direction of an image sensor of a first camera (170-1) and / or an image output from the image sensor may be longer than a length (d) in the y-axis direction. A length (a) in the x-axis direction of an image sensor of a second camera (170-2) and / or an image output from the image sensor may be shorter than a length (b) in the y-axis direction.

[0036] In the present disclosure, the width and height may correspond to the lengths of two sides that are perpendicular to each other in an object having a rectangular shape. The rectangle may include a rectangle having a round-shaped shape, such as the flexible display (150) of FIG. 1. The mapping between the width, height, and the two sides may change depending on the relationship between the object and a reference direction (e.g., a direction toward the ground and / or a direction of gravitational acceleration). Hereinafter, the aspect ratio may represent the ratio of the width and height of a rectangular object.

[0037] In the present disclosure, the direction of an object having a rectangular shape may correspond to the direction of a relatively longer side among two mutually perpendicular sides of the rectangle. For example, the direction of the flexible display (150) of FIG. 1 may be parallel to the direction of the x-axis. The direction of the camera (170-1) of FIG. 1 may be parallel to the direction of the x-axis because the length (c) in the x-axis direction is longer than the length (d) in the y-axis direction. The direction of the camera (170-2) of FIG. 1 may be parallel to the y-axis.

[0038] For example, as in the exemplary state (191) of FIG. 1, when the direction of the y-axis of the electronic device (101) is perpendicular to the ground (or parallel to the direction of gravitational acceleration), the length (lx) of the flexible display (150) in the x-axis direction may correspond to the width of the flexible display (150), and the length (ly) of the flexible display (150) in the y-axis direction may correspond to the height of the flexible display (150). In the above example, the aspect ratio of the flexible display (150) may be lx:ly. In the above example, the width of the image output from the camera (170-1) may have a length (c) in the x-axis direction, and the height of the image may have a length (d) in the y-axis direction. In the above example, the width of the image output from the camera (170-2) may have a length (a) in the x-axis direction, and the height of the image may have a length (b) in the y-axis direction.

[0039] For example, when a user holds the electronic device (101) such that the +x-axis direction of the electronic device (101) faces the ground, the width of the flexible display (150) may correspond to the length (ly) in the y-axis direction, and the height of the flexible display (150) may correspond to the length (lx) in the x-axis direction. In the above example, the aspect ratio of the flexible display (150) may be ly:lx. In the above example, the width of the image output from the camera (170-1) may have a length (d) in the y-axis direction, and the height of the image may have a length (c) in the x-axis direction. In the above example, the width of the image output from the camera (170-2) may have a length (b) in the y-axis direction, and the height of the image may have a length (a) in the x-axis direction.

[0040] Referring to FIG. 1, independently of the orientation of the electronic device (101), the plurality of cameras (170) may have different aspect ratios. In one embodiment, the electronic device (101) may, while displaying an image using one of the plurality of cameras (170), select, determine, and / or identify an activated camera for displaying the image based on an aspect ratio of at least a portion of the flexible display (150) on which the image is to be displayed and / or an orientation related to the aspect ratio. The image displayed on the flexible display (150) may be at least a portion of an image and / or video acquired from a camera, and may be displayed on the flexible display (150) to guide an image and / or video to be acquired (or captured) through the camera based on a shooting input.

[0041] Referring to FIG. 1, at least a portion of the flexible display (150) on which an image is to be displayed may be related to the posture and / or orientation of the electronic device (101). Referring to the state (191) of FIG. 1, the electronic device (101) may display an image on the entire active area of ​​the flexible display (150). Within the state (191) in which the width of the flexible display (150) corresponds to the x-axis direction, the electronic device (101) may identify a camera to be activated for displaying an image among the cameras (170) based on an aspect ratio between the length (lx) in the x-axis direction and the length (ly) in the y-axis direction. In a state (191) in which the width (e.g., length in the x-axis direction (lx)) of the flexible display (150) is longer than the height (e.g., length in the y-axis direction (ly)), the electronic device (101) can identify a camera capable of outputting an image having a width longer than the height among a plurality of cameras (170). In the state (191), since the width (e.g., length in the x-axis direction (c)) of the camera (170-1) is longer than the height (e.g., length in the y-axis direction (d)) and the width (e.g., length in the x-axis direction (a)) of the camera (170-2) is shorter than the height (e.g., length in the y-axis direction (b)), the electronic device (101) can display an image on the entire active area of ​​the flexible display (150) using the camera (170-1).

[0042] In one embodiment of an electronic device (101) including a deformable housing, an area of ​​a flexible display (150) on which an image is displayed can be changed by the shape of the housing. Referring to an exemplary state (192) of FIG. 1, when a first angle (141) corresponds to a substantially right angle due to the rotation of the first folding axis (131), the flexible display (150) can have two flat portions relative to the first folding axis (131). Within the state (192), the electronic device (101) can display an image on a portion of the flexible display (150) positioned on the first housing assembly (111), among the flat portions of the flexible display (150). Within the state (192), the electronic device (101) can select one of a plurality of cameras (170) based on an aspect ratio of the portion of the flexible display (150). The electronic device (101) can display an image on at least a portion of the flexible display (150) using a selected camera.

[0043] Within the exemplary state (192) of FIG. 1, a portion of the flexible display (150) used for displaying an image may have a width that is longer than a height. Within the state (192), the width (e.g., length (b) in the y-axis direction) of the camera (170-2) may be longer than the height (e.g., length (a) in the x-axis direction). The electronic device (101) may display an image on the portion of the flexible display (150) by using the camera (170-2) having a width (e.g., length (b) in the y-axis direction) that is longer than the height (e.g., length (a) in the x-axis direction).

[0044] As described above, according to one embodiment, the electronic device (101) can optimize the image quality and / or magnification of an image to be displayed on a portion of the flexible display (150) based on selective driving of the plurality of cameras (170). For example, in a state (191) of displaying an image on the entire active area of ​​the flexible display (150) having a width greater than its height, since the electronic device (101) displays the image using the camera (170-1) that outputs an image having a width greater than its height, margins such as letter boxes on the flexible display (150) can be minimized or reduced. The electronic device (101) can identify a camera to be activated for displaying an image among a plurality of cameras (170) based on the posture of the electronic device (101), including the orientation of the electronic device (101) (e.g., the y-axis is perpendicular to the ground, as in state (191)) and / or the shape of the electronic device (101) (e.g., the shape bent around the first folding axis (131), as in state (192)). Different shapes of the electronic device (101) distinguished by a deformable housing are described with reference to FIGS. 3A to 3B. An operation of selecting a camera based on the posture of the electronic device (101) is described with reference to FIGS. 5 to 10.

[0045] Hereinafter, with reference to FIG. 2, an exemplary hardware configuration included in the electronic device (101) described with reference to FIG. 1 is described.

[0046] FIG. 2 illustrates an example of a block diagram of an electronic device (101), according to one embodiment. The electronic device (101) of FIG. 1 may include hardware of the electronic device (101) described with reference to FIG. 2 . Referring to FIG. 2 , the electronic device (101) according to one embodiment may include at least one of a processor (210), a memory (220), a flexible display (150), a plurality of cameras (170), or a sensor (230). The processor (210), the memory (220), the flexible display (150), the plurality of cameras (170), and the sensor (230) may be electronically and / or operably coupled with each other by an electronic component, such as a communication bus (202).

[0047] In one embodiment, the operative coupling of the hardware components of the electronic device (101) may mean that a direct connection or an indirect connection is established, either wired or wireless, between the hardware components such that a second hardware component is controlled by a first hardware component among the hardware components. Although illustrated based on different blocks, the embodiment is not limited thereto, and a portion of the hardware of FIG. 2 (e.g., at least a portion of the processor (210) and the memory (220)) may be included in a single integrated circuit such as a system on a chip (SoC). The hardware components of the electronic device (101), which are divided into blocks, may be located in or included in at least one of the first housing assembly (111), the second housing assembly (112), or the third housing assembly (113) described with reference to FIG. 1. The type and / or number of hardware components included in the electronic device (101) is not limited to that illustrated in FIG. 2. For example, the electronic device (101) may include only some of the hardware components illustrated based on the blocks of FIG. 2.

[0048] According to one embodiment, the processor (210) of the electronic device (101) may include hardware and / or circuitry for processing data based on one or more instructions. The hardware and / or circuitry for processing data may include, for example, an arithmetic and logic unit (ALU), a floating point unit (FPU), a field programmable gate array (FPGA), a central processing unit (CPU), and / or an application processor (AP). The number of processors (210) may be one or more. For example, the processor (210) may have a multi-core processor structure such as a dual core, a quad core, or a hexa core.

[0049] According to one embodiment, the memory (220) of the electronic device (101) may include hardware components for storing data and / or instructions input and / or output to the processor (210). The memory (220) may include, for example, volatile memory such as random-access memory (RAM) and / or non-volatile memory such as read-only memory (ROM). The volatile memory may include, for example, at least one of dynamic RAM (DRAM), static RAM (SRAM), cache RAM, and pseudo SRAM (PSRAM). The non-volatile memory may include, for example, at least one of programmable ROM (PROM), erasable PROM (EPROM), electrically erasable PROM (EEPROM), flash memory, hard disk, compact disc, solid state drive (SSD), and embedded multi-media card (eMMC).

[0050] According to one embodiment, a flexible display (150) of an electronic device (101) can output visualized information (e.g., screens of FIGS. 1, 6 to 9) to a user. For example, the flexible display (150) can be controlled by a controller, such as a graphic processing unit (GPU) and / or a processor (210), to output visualized information to the user. The flexible display (150) can include a liquid crystal display (LCD), a plasma display panel (PDP), and / or one or more light emitting diodes (LEDs). The LEDs can include organic LEDs (OLEDs). The flexible display (150) can include electronic paper. As described above with reference to FIG. 1, the flexible display (150) can have an at least partially curved shape and / or a deformable shape. Hereinafter, the active area and / or display area of ​​the flexible display (150) may correspond to at least a portion of the flexible display (150) that includes one or more enabled or activated pixels.

[0051] According to one embodiment, the flexible display (150) of the electronic device (101) may include a sensor (e.g., a touch sensor panel (TSP)) for detecting an external object (e.g., a user's finger) on the flexible display (150). For example, based on the TSP, the electronic device (101) may detect an external object that is in contact with the flexible display (150) or floating on the flexible display (150). In response to detecting the external object, the electronic device (101) may execute a function associated with a specific visual object corresponding to a location of the external object on the flexible display (150) among visual objects displayed within the flexible display (150).

[0052] According to one embodiment, the sensor (230) of the electronic device (101) may generate electrical information from non-electronic information related to the electronic device (101), which may be processed by the processor (210) and / or stored in the memory (220). For example, the sensor (230) may include a global positioning system (GPS) sensor for detecting a geographic location of the electronic device (101). In addition to the GPS method, the sensor (230) may generate information indicating the geographic location of the electronic device (101) based on a global navigation satellite system (GNSS), such as, for example, Galileo or Beidou (compass). The information may be stored in the memory (220), processed by the processor (210), and / or transmitted to another electronic device distinct from the electronic device (101) via the communication circuit (240). The sensor (230) is not limited to those described above, and may include an image sensor, a light sensor, a proximity sensor, a grip sensor, and / or a ToF sensor for detecting electromagnetic waves including light.

[0053] In one embodiment, the processor (210) of the electronic device (101) can sense or identify the attitude, shape, and / or orientation of the electronic device (101) using a sensor (230). The sensor (230) may include an inertial measurement unit (IMU) (232) and / or a Hall sensor (234) for identifying the attitude, shape, and / or orientation of the electronic device (101). The Hall sensor (234) may include a magnet and a magnetic field sensor that measures a change in a magnetic field formed by the magnet. The magnet and the magnetic field sensor may be disposed in different assemblies of a housing of the electronic device (101) (e.g., the first housing assembly (111), the second housing assembly (112), and / or the third housing assembly (113) of FIG. 1). Based on the change in the magnetic field measured by the magnetic field sensor, the Hall sensor (234) can output sensor data indicating the distance between the parts.

[0054] For example, in one embodiment where the electronic device (101) includes a deformable housing, the processor (210) of the electronic device (101) can use the magnets and the magnetic field sensors disposed in different parts of the housing (e.g., the first housing assembly (111), the second housing assembly (112), and / or the third housing assembly (113) of FIG. 1) to identify a shape of the housing or a parameter associated with the shape (e.g., the first angle (141) and / or the second angle (142) of FIG. 1). For example, the Hall sensor (234) can output sensor data indicative of the distance and / or the shape of the housing.

[0055] According to one embodiment, the IMU (232) may include an acceleration sensor, a gyro sensor, a geomagnetic sensor, or any combination thereof. The acceleration sensor may output an electrical signal representing gravitational acceleration and / or acceleration along each of a plurality of axes (e.g., an x-axis, a y-axis, and a z-axis) that are perpendicular to each other. The gyro sensor may output an electrical signal representing an angular velocity (e.g., an angular velocity based on roll, pitch, and / or yaw) along each of the plurality of axes. The geomagnetic sensor may output an electrical signal representing a magnitude of a magnetic field formed in the electronic device (101) along each of the plurality of axes (e.g., an x-axis, a y-axis, and / or a z-axis). The processor (210) may repeatedly acquire data representing acceleration, angular velocity, and / or magnitude of a magnetic field from the IMU based on a specified period (e.g., 1 millisecond). Using a Hall sensor and / or an IMU, the processor (210) can identify parameters related to the shape of the electronic device (101) (e.g., the first angle (141) and / or the second angle (142) of FIG. 1). Based on the parameters, the processor (210) can identify the current shape of the electronic device (101) among designated shapes for distinguishing the shape of the electronic device (101) (e.g., the unfolded state, the folded state, and / or the sub-folded state as described with reference to FIGS. 3A and 3B). For example, the processor (210) of the electronic device (101) can identify the first angle (141) between the first housing assembly (111) and the second housing assembly (112) of FIG. 1 and / or the second angle (142) between the second housing assembly (112) and the third housing assembly (113) of FIG. 1 using the sensor (230).

[0056] According to one embodiment, using the IMU (232), the processor (210) can identify parameters related to the shape of the electronic device (101) (e.g., directions (g1, g2) of gravitational acceleration applied to the electronic device (101) of FIG. 7). Based on the parameters, the processor (210) can identify the current shape of the electronic device (101) among designated shapes for distinguishing the shape of the electronic device (101) (e.g., landscape mode, portrait mode, as described with reference to FIG. 7). For example, the processor (210) can compare an angle between the direction of the gravitational acceleration identified using the IMU (232) and a reference direction to determine the current shape of the electronic device (101) among designated modes such as portrait mode or landscape mode.

[0057] Although not shown, according to one embodiment, the electronic device (101) may include an output means for outputting information in a form other than a visualized form. For example, the electronic device (101) may include a motor for providing haptic feedback based on vibration. For example, the electronic device (101) may include one or more speakers for outputting an audio signal, such as the first speaker (161), the second speaker (162), the third speaker (163), and the fourth speaker (164) of FIGS. 3A and 3B .

[0058] According to one embodiment, one or more instructions (or commands) representing operations and / or actions to be performed on data by the processor (210) may be stored within the memory (220) of the electronic device (101). A set of one or more instructions may be referred to as firmware, an operating system, a process, a routine, a sub-routine, and / or an application. For example, the electronic device (101) and / or the processor (210) may perform at least one of the operations of FIG. 5 and / or FIG. 10 when a set of a plurality of instructions distributed in the form of an operating system, firmware, a driver, and / or an application is executed. Hereinafter, the fact that an application is installed in an electronic device (101) may mean that one or more instructions provided in the form of an application are stored in the memory (220) of the electronic device (101), and that the one or more applications are stored in a format executable by the processor (210) of the electronic device (101) (e.g., a file having an extension specified by the operating system of the electronic device (101)).

[0059] In one embodiment, each of the plurality of cameras (170) included in the electronic device (101) may include one or more optical sensors (e.g., a charged coupled device (CCD) sensor, a complementary metal oxide semiconductor (CMOS) sensor) that generate an electrical signal representing the color and / or brightness of light. The plurality of optical sensors included in each of the cameras (170) may be arranged in the form of a two-dimensional grid. Each of the cameras (170) may acquire the electrical signals of each of the plurality of optical sensors substantially simultaneously, and generate an image corresponding to light reaching the optical sensors of the two-dimensional grid and including a plurality of pixels arranged two-dimensionally. For example, photographic data may mean one image acquired from one of the cameras (170) at a specific timing. For example, video data may mean a sequence of a plurality of images acquired from one of the cameras (170) according to a specified frame rate.

[0060] In one embodiment, the electronic device (101) may include a plurality of cameras (170). Referring to FIG. 1, an embodiment of the electronic device (101) including two cameras (170-1, 170-2) is illustrated, but the embodiment is not limited thereto. The fields-of-view (FOV) of the plurality of cameras (170) may be different from each other. The FOV is an area formed based on a view angle through which each lens of the cameras (170) can receive light, and may correspond to an area corresponding to an image generated by each of the cameras (170). The FoV may be divided into a horizontal angle of view and / or a vertical angle of view. Lengths (c, d) of FIG. 1 may be related to the horizontal angle of view and / or the vertical angle of view of the camera (170-1).

[0061] According to one embodiment, the processor (210) of the electronic device (101) may display an image on the flexible display (150) using a first camera having a first aspect ratio among a plurality of cameras (170). While displaying the image, the processor (210) may identify a posture of the electronic device (101) based on the sensor (230). The processor (210) may identify whether the posture of the electronic device (101) changes based on the sensor (230). For example, the posture of the electronic device (101) may change based on a rotation of the housing assembly (e.g., a rotation of the first housing assembly (111) with respect to the second housing assembly (112) of FIG. 1). Based on identifying the changed posture of the electronic device (101), the processor (210) may identify a portion on which an image is to be displayed, among flat portions of the flexible display (150) distinguished by the posture. The processor (210) can display an image on the identified portion by using a second camera having a second aspect ratio different from the first aspect ratio among the plurality of cameras (170) based on identifying the portion having an aspect ratio different from the first aspect ratio.

[0062] As described above, the processor (210) can select or change a camera among the plurality of cameras (170) based on the posture of the electronic device (101) identified using the sensor (230). The processor (210) can display an image based on the selected or changed camera. The posture of the electronic device (101) can be changed by rotation between the housing assemblies. The processor (210) can display a visual object (or indicator, visual affordance) on the flexible display (150) to emphasize the camera selected for displaying the image. Hereinafter, different postures of the electronic device (101) changed by rotation between the housing assemblies will be exemplarily described with reference to FIG. 3A and / or FIG. 3B.

[0063] Figures 3a and 3b illustrate one embodiment of a deformable electronic device. The electronic device (101) of Figures 1 and / or 2 may include the electronic device (101) of Figures 3a and 3b.

[0064] Referring to FIGS. 3A and / or 3B , different configurations of an electronic device (101) supporting deformability based on multiple folding axes (e.g., a first folding axis (131) and / or a second folding axis (132)) are illustrated. Referring to FIG. 3A , a first electronic device (101-1) is illustrated including a flexible display (150) that is visually completely covered by a first housing assembly (111) to a third housing assembly (113) folded along a first folding axis (131) and a second folding axis (132). Referring to FIGS. 3A and 3B , according to one embodiment, the electronic device (101) may include a first speaker (161) and / or a third speaker (163) disposed in the first housing assembly (111). The electronic device (101) may include a second speaker (162) and / or a fourth speaker (164) disposed in a third housing assembly (113). The third speaker (163) may be disposed at a second edge of the first housing assembly (111) opposite a first edge of the first housing assembly (111) where the first speaker (161) is disposed. The fourth speaker (164) may be disposed at a second edge of the third housing assembly (113) opposite a first edge of the third housing assembly (113) where the second speaker (162) is disposed. Although the second speaker (162) disposed on one side of the third housing assembly (113) on which the flexible display (150) is disposed and the first speaker (161), the third speaker (163) and the fourth speaker (164) disposed on the side connected to the front side of the electronic device (101) are exemplarily illustrated, the positions of the speakers (e.g., the first speaker (161) to the fourth speaker (164)) included in the electronic device (101) are not limited to the positions illustrated in FIG. 3A and / or FIG. 3B.

[0065] Referring to FIG. 3A, different states (e.g., a first state (301), a second state (302), and / or a third state (303)) of a first electronic device (101-1) are illustrated, distinguished by a first angle (141) and a second angle (142). The first state (301) of the first electronic device (101-1), in which the first angle (141) and the second angle (142) are substantially straight angles (e.g., about 180°), may be referred to as a fully unfolded state, an outspread state, an opened state, an unfolded state, a flat state, and / or a planar state. Within the first state (301), the flexible display (150) disposed from the first housing assembly (111) across the second housing assembly (112) to the third housing assembly (113) may have a substantially flat shape. Within the first state (301), a single plane may be formed on the front surface of the electronic device (101) on which the flexible display (150) is disposed. Within the first state (301), the directions of the front surfaces of the first housing assembly (111), the second housing assembly (112), and the third housing assembly (113) may be parallel to and / or the same as each other. The state (191) of FIG. 1 may correspond to or be included in the first state (301) and / or the unfolded state of FIG. 3A.

[0066] Referring to FIG. 3A, a second state (302) of the first electronic device (101-1) is illustrated, wherein the first angle (141) is substantially parallel and the second angle (142) is less than parallel. The state of the first electronic device (101-1) in which the first angle (141) and / or the second angle (142) are less than parallel, including the second state (302), may be referred to as an in-fold state, a sub-unfolded state (or sub-folded state), an intermediate state, and / or a concave state. Although only the second hinge assembly (122) among the first hinge assembly (121) and the second hinge assembly (122) is shown as being folded, the embodiment is not limited thereto, and the sub-fold state may include a state in which both the first angle (141) and the second angle (142) are less than a flat angle and exceed 0°. Within the sub-fold state, a plurality of planes may be formed by the flexible display (150) folded by at least one hinge assembly. Referring to the second state (302), the flexible display (150) bent by the second hinge assembly (122) may include two flat portions separated by the second hinge assembly (122). For example, a flexible display (150) disposed across a second hinge assembly (122) can be divided into a portion of the flexible display (150) corresponding to the third housing assembly (113) and a portion of the flexible display (150) corresponding to the first housing assembly (111) and the second housing assembly (112) by the rotation of the second hinge assembly (122). For example, flat portions of the flexible display (150) divided by the second hinge assembly (122) can face different, non-parallel directions. The state (192) of FIG. 1 may correspond to or be included in the second state (302) of FIG. 3A and / or the in-fold state.

[0067] Referring to FIG. 3A, the third state (303) of the first electronic device (101-1), in which the first angle (141) and the second angle (142) are substantially all 0°, may be referred to as a fully folded state, a folded state, and / or a closed state. Within the third state (303), the flexible display (150) may be visually completely covered by the first housing assembly (111) to the third housing assembly (113). For example, within the folded state, the size of the flexible display (150) of the first electronic device (101-1) exposed to the outside may be substantially 0. Referring to FIG. 3A, an exemplary third state (303) is illustrated in which the front and rear surfaces of the third housing assembly (113) on which a portion of the flexible display (150) (e.g., the first display) is disposed are covered by the first housing assembly (111) and the second housing assembly (112), but the embodiment is not limited thereto. A first electronic device (101-1) including a flexible display (150) that is visually completely covered in a folded state may include a cover display (152) (e.g., the second display) disposed on a rear surface opposite to the front surface on which the flexible display (150) is disposed. Referring to FIG. 3A, according to one embodiment, a first electronic device (101-1) may include a cover display (152) disposed on a second surface (e.g., a rear surface of the first housing assembly (111)) of the first housing assembly (111) opposite to a first surface (e.g., a front surface of the first housing assembly (111)) of the first housing assembly (111) on which a portion of the flexible display (150) is disposed.

[0068] Referring to FIG. 3a, a first electronic device (101-1) including a flexible display (150) configured to be folded at an angle less than a parallel angle along a first folding axis (131) and a second folding axis (132) may be referred to as a G-shaped foldable electronic device. Referring to FIG. 3b, different forms of a second electronic device (101-2) including a flexible display (150) configured to be folded at an angle greater than a parallel angle along at least one of the first folding axis (131) and the second folding axis (132) are illustrated. The second electronic device (101-2) may be referred to as an S-shaped foldable electronic device.

[0069] Referring to FIG. 3B, different states (e.g., the fourth state (304) to the sixth state (306)) of the second electronic device (101-2) are illustrated, distinguished by the first angle (141) and the second angle (142). The fourth state (304) of the second electronic device (101-2) may correspond to the first state (301) of the first electronic device (101-1) of FIG. 3A. Within the fourth state (304), which corresponds to the unfolded state, a flat plane may be formed by the flexible display (150).

[0070] Referring to FIG. 3B, a fifth state (305) of the second electronic device (101-2) is illustrated, in which the first angle (141) exceeds a parallel angle and the second angle (142) is substantially parallel. The state of the second electronic device (101-2) in which the first angle (141) and / or the second angle (142) exceed a parallel angle and are less than 360° may be referred to as an out-fold state, a sub-fold state, and / or a convex state. Although only the first angle (141) among the first angle (141) and the second angle (142) is illustrated as exceeding a parallel angle, the embodiment is not limited thereto. Within the convex state including the fifth state (305), a plurality of planes formed by the flexible display (150) folded by the first hinge assembly (121) may face different directions.

[0071] Referring to FIG. 3B, the sixth state (306) of the second electronic device (101-2) in which the first angle (141) is substantially 360° and the second angle (142) is substantially 0° may be referred to as a fully folded state, a folded state, and / or a closed state. Within the sixth state (306), among the portions of the flexible display (150) disposed in each of the first housing assembly (111) to the third housing assembly (113), only the portion of the flexible display (150) disposed on the first housing assembly (111) may be exposed to the outside.

[0072] According to one embodiment, the electronic device (101) can identify a state of the electronic device (101) (e.g., any one of an unfolded state, a folded state, an in-fold state, and / or an out-fold state) indicated by the first angle (141) and the second angle (142) based on a sensor (e.g., the sensor (230) of FIG. 2). Based on the state, the electronic device (101) can identify a portion of the flexible display (150) on which an image is to be displayed and / or a camera (e.g., any one of the plurality of cameras (170) of FIGS. 1 and / or 2) for displaying the image. Depending on the state of the electronic device (101), an aspect ratio and / or an orientation of a portion of the flexible display (150) on which an image is to be displayed may be changed. The electronic device (101) may include a plurality of cameras (170) having different aspect ratios and / or orientations to display an image suitable for the aspect ratio and / or orientation of the part.

[0073] Hereinafter, with reference to FIG. 4, exemplary locations of a plurality of cameras (170) arranged on the front of an electronic device (101) for displaying an image are described.

[0074] FIG. 4 illustrates exemplary locations of cameras (170) included in an electronic device (101), according to one embodiment. The electronic device (101) of FIG. 1 and / or FIG. 2 may include the electronic device (101) of FIG. 4. The cameras (170) of FIG. 1 and / or FIG. 2 may include the cameras (170) of FIG. 4.

[0075] Referring to FIG. 4, a front surface of an electronic device (101) as viewed in the direction of the +z axis is illustrated. According to an embodiment, the electronic device (101) may include a plurality of cameras (170) arranged on the front surface where the flexible display (150) is arranged. Referring to FIG. 4, a plurality of cameras (170) at least partially overlapping the flexible display (150) on the front surface are illustrated. For example, at least one of the plurality of cameras (170) may correspond to an under display camera (UDC) (or under panel camera, UPC) arranged under the flexible display (150). The embodiment is not limited thereto. For example, a notch region and / or a hole region may be formed on a portion of an edge of the flexible display (150) in order to arrange at least one of the plurality of cameras (170). Referring to FIG. 4, a plurality of cameras (170) are shown positioned adjacent to the periphery of the flexible display (150), but the positions of the plurality of cameras (170) are not limited to the embodiment of FIG. 4.

[0076] Referring to FIG. 4, the camera (170-1) disposed on the front surface of the second housing assembly (112) may include an image sensor having an x-axis length (c) that is longer than a y-axis length (d). On the second housing assembly (112), the camera (170-1) may be disposed adjacent to an edge (112-2) of the second housing assembly (112) that is parallel to the x-axis direction. The camera (170-2) disposed on the first housing assembly (111) may include an image sensor having an x-axis length (a) that is shorter than a y-axis length (b). On the front surface of the first housing assembly (111), the camera (170-1) may be disposed adjacent to an edge (111-1) of the first housing assembly (111) that is parallel to the y-axis direction. The camera (170-3) disposed on the first housing assembly (111) may include an image sensor having an x-axis length (e) that is longer than a y-axis length (f). The camera (170-4) disposed on the first housing assembly (111) may include an image sensor having an x-axis length (g) that is longer than a y-axis length (h). On the front surface of the first housing assembly (111), the camera (170-4) may be disposed adjacent to an edge (111-1) of the first housing assembly (111) that is parallel to the y-axis direction.

[0077] According to one embodiment, the electronic device (101) may include at least two cameras among the plurality of cameras (170) illustrated in FIG. 4. The cameras included in the electronic device (101) may have different width and height relationships. The cameras included in the electronic device (101) may have directions that are perpendicular to each other. For example, the electronic device (101) may include a first combination of cameras (170-1, 170-2) having directions that are perpendicular to each other. The electronic device (101) including the cameras (170-1, 170-2) of the first combination may display an image through the entire active area of ​​the flexible display (150) in a fully unfolded state of the flexible display (150) using the camera (170-1) positioned on the second housing assembly (112). For example, the camera (170-1) may be positioned at the center of the x-axis of the front surface of the electronic device (101) in the unfolded state. The electronic device (101) including the cameras (170-1, 170-2) of the first combination may, in the sub-folded state, obtain an image to be displayed on any one of the flat portions of the flexible display (150) using the camera (170-2) positioned on the first housing assembly (111). The embodiment is not limited thereto.

[0078] The electronic device (101) may include a different combination of the first combination of the cameras (170-1, 170-2) than the first combination of the cameras (170-1, 170-2) exemplified above. For example, the electronic device (101) may include a second combination of cameras (170-2, 170-4) having mutually perpendicular directions, or a third combination of cameras (170-2, 170-3) having mutually perpendicular directions. Because the electronic device (101) includes a combination of cameras having mutually perpendicular directions (e.g., the first to third combinations described above), the electronic device (101) may obtain an image having a height shorter than a width from one of the cameras, and may obtain an image having a height longer than a width using another of the cameras.

[0079] An electronic device (101) including cameras of any one of the combinations described above may select one camera (e.g., a camera used to display an image) among the cameras included in the combination based on the orientation of at least a portion of a flexible display (150) on which an image is to be displayed. A mode in which the electronic device (101) displays an image may be set to either a portrait mode or a landscape mode based on the orientation of an area of ​​the flexible display (150) on which the image is to be displayed. The portrait mode may be a mode for displaying an image in an area having a height that is greater than its width. The landscape mode may be a mode for displaying an image in an area having a width that is greater than its height. While displaying an image based on the portrait mode, the electronic device (101) can acquire the image by activating a camera among the cameras included in the combination that has a direction corresponding to the portrait mode (e.g., a direction perpendicular to the ground and / or a direction parallel to gravitational acceleration). While displaying an image based on the landscape mode, the electronic device (101) can acquire the image by activating a camera among the cameras included in the combination that has a direction corresponding to the landscape mode (e.g., a direction parallel to the ground and / or a direction perpendicular to gravitational acceleration).

[0080] As described above, according to one embodiment, the electronic device (101) can determine one of the cameras (170) by comparing the directions of the cameras (170) included in the electronic device (101) with the direction of the electronic device (101) identified among portrait mode or landscape mode. Using the determined camera, the electronic device (101) can display an image having an aspect ratio suitable for the layout of the flexible display (150) visible to the user.

[0081] Below, with reference to FIG. 5, the operation of an electronic device (101) that determines one camera among a plurality of cameras is described.

[0082] FIG. 5 illustrates an exemplary flowchart for an electronic device according to one embodiment. The electronic device (101) of FIG. 1 and / or FIG. 2 may perform the operations of the electronic device described with reference to FIG. 5. For example, the electronic device (101) and / or the processor (210) of FIG. 2 may perform at least one of the operations of FIG. 5.

[0083] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0084] Referring to FIG. 5, in operation (510), according to one embodiment, a processor of an electronic device may identify an input for displaying an image. The input may include an input for executing a software application related to a camera (e.g., cameras 170 of FIGS. 1 and / or 2 ) among software applications installed on the electronic device, such as a camera application. The input may include an input for switching to a camera disposed on the front of the electronic device on which a flexible display is disposed, among cameras included in the electronic device. The input may include an input for establishing a call connection based on a video call. For example, the input of operation (510) may include an input for executing a software application installed on the electronic device for a video call. The input of the operation (510) may include a touch input on a flexible display of the electronic device (e.g., the flexible display (150) of FIGS. 1 and / or 2) and / or an input to a button exposed externally through the housing of the electronic device. A processor that identifies the input of the operation (510) may perform the operation (520).

[0085] Referring to FIG. 5 , within operation (520), a processor of an electronic device according to one embodiment may identify whether an angle between housing assemblies corresponds to a specified angle (e.g., approximately 180º) of an unfolded state. The processor may use one or more sensors (e.g., sensor (230) of FIG. 2 ) to identify angles (e.g., first angle (141) and / or second angle (142) of FIGS. 1 and 2 ) between housing assemblies (e.g., first housing assembly (111), second housing assembly (112), and / or third housing assembly (113) of FIGS. 1 and 2 ). If the angle of operation (520) does not correspond to the specified angle and / or the state of the electronic device is different from the unfolded state (520-No), the processor may perform operation (550). If the angle of the operation (520) corresponds to a specified angle, and / or the state of the electronic device corresponds to an unfolded state (520-Yes), the processor may perform the operation (530).

[0086] Referring to FIG. 5, in operation (530), according to one embodiment, a processor of an electronic device may activate a first camera among a plurality of cameras. For example, the processor may perform operation (530) in an unfolded state. The first camera may have a direction identical to the direction of the entire active area of ​​the flexible display among the cameras arranged on the front surface of the electronic device on which the flexible display is arranged. The first camera may have an aspect ratio identical to the aspect ratio of the entire active area of ​​the flexible display.

[0087] Referring to FIG. 5 , in operation (550), a processor of an electronic device according to an embodiment may identify a portion of a flexible display, which portion is to be displayed with an image, among portions of the flexible display, which portions are distinguished by an angle between housing assemblies. In a different state (e.g., a sub-fold state, an intermediate state, an in-fold state, and / or an out-fold state) distinct from an unfolded state, the processor may perform operation (550). In a state distinct from the unfolded state, the flexible display may be at least partially bendable by rotation of a folding axis (e.g., the first folding axis (131) and / or the second folding axis (132) of FIG. 1 ) transverse to the flexible display. The processor may determine a portion of the flat portions of the flexible display, which portion is to be displayed with an image, among the flat portions of the flexible display, which are distinguished by the folding axis.

[0088] For example, the processor may select and / or identify, based on a sensor (e.g., sensor (230) of FIG. 2), a portion of the flat portions of the flexible display on which an image is to be displayed. For example, based on the directions of normals of the portions, the processor may determine the portion on which the image is to be displayed. For example, a processor that identifies, among the flat portions of the flexible display, a portion having a normal that is parallel to a reference direction (e.g., a direction toward the ground and / or a direction of gravitational acceleration) or differs by less than a specified angle from the reference direction may determine a portion different from the portion as the portion on which the image is to be displayed. Based on operation (550), the processor may determine, among the flat portions of the flexible display, a portion having a normal similar to a direction of the user's eyes (typically a direction perpendicular to the reference direction) as the portion for displaying an image.

[0089] Referring to FIG. 5 , in operation (560), according to one embodiment, a processor of an electronic device may activate a camera corresponding to an identified portion among a plurality of cameras. The processor may activate a camera having an orientation corresponding to an orientation of the portion identified based on operation (550). The processor may activate a camera having an aspect ratio (or a relationship between width and height) similar to an aspect ratio (or a relationship between width and height) of the portion identified based on operation (550). In one embodiment, to identify a camera to be activated based on operation (560), the processor may identify an angle and / or orientation of the electronic device with respect to a reference direction identified by a sensor of the electronic device.

[0090] In one embodiment, the processor can obtain information (or parameters) about the orientation of the camera from information (or parameters) related to the camera. The information can relate to an angle and / or orientation of the electronic device measured by a sensor. The processor can use the information to select a camera for operation (560). For example, the information can include constants and / or text indicating an angle of the camera with respect to a reference direction (e.g., 0º, 90º, 180º, and / or 270º). For example, if the angle of the camera with respect to the reference direction is in a range from -45º to 45º, the information can include a constant indicating that the angle of the camera with respect to the reference direction is 0º. For example, if the angle of the camera with respect to the reference direction is in a range from 45º to 135º, the information can include a constant indicating that the angle of the camera with respect to the reference direction is 90º. For example, if the angle of the camera with respect to the reference direction is in a range from 135º to 225º, the information may include a constant indicating that the angle of the camera with respect to the reference direction is 180º. For example, if the angle of the camera with respect to the reference direction is in a range from 225º to 315º, the information may include a constant indicating that the angle of the camera with respect to the reference direction is 270º.

[0091] Referring to FIG. 5, in operation (540), a processor of an electronic device according to an embodiment may display an image on a flexible display based on an activated camera among a plurality of cameras. The processor that has activated a first camera based on operation (530) may display at least a portion of an image and / or video acquired through the first camera on the flexible display in operation (540). The processor that has activated any one of the plurality of cameras based on operation (560) may display at least a portion of an image and / or video acquired through the activated camera on the flexible display in operation (540).

[0092] As described above, according to one embodiment, the processor of the electronic device can compare the direction of at least a portion of the flexible display on which an image is to be displayed with the directions of each of the cameras disposed on the front surface of the housing in which the flexible display is disposed, and activate one of the cameras. The processor can display an image on at least a portion of the flexible display using the activated camera.

[0093] Below, with reference to FIGS. 6 to 9, exemplary operations of a processor selecting one camera among a plurality of cameras are described.

[0094] FIG. 6 illustrates an example of a user interface (UI) displayed by an electronic device (101) that displays an image using one of a plurality of cameras (170). The electronic device (101) of FIG. 1 and / or FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 6. For example, the electronic device (101) and / or the processor (210) of FIG. 2 may perform the operation of the electronic device (101) described with reference to FIG. 6.

[0095] Referring to FIG. 6, different states (601, 602) of an electronic device (101) distinguished by a posture are illustrated. The electronic device (101) may determine, based on an input for executing a camera application, which camera among a plurality of cameras (170) is to be activated to display an image on at least a portion of the flexible display (150). The electronic device (101) may identify and / or determine, based on a posture of the electronic device (101) indicated by one or more sensors (e.g., sensor (230) of FIG. 2), at least a portion of the flexible display (150) on which an image is to be displayed. The electronic device (101) may display a visual object (612) having a form of a button (e.g., a circular image and / or icon) for receiving a photographing input, together with the image displayed on at least a portion of the flexible display (150). From the perspective of capturing images and / or videos based on touch input, the visual object (612) may be referred to as a shutter.

[0096] According to one embodiment, the electronic device (101) may identify an area of ​​the flexible display (150) on which the image is to be displayed, based on an input for displaying an image using one of a plurality of cameras (170), a posture of housing assemblies included in the electronic device (e.g., a first housing assembly (111), a second housing assembly (112), and / or a third housing assembly (113)) and an orientation of the electronic device (101). The input may include an input for executing a camera application. Referring to FIG. 6, within an exemplary state (601) of the electronic device (101) having an unfolded posture, the electronic device (101) may display an image based on the entire active area of ​​the flexible display (150).

[0097] Referring to FIG. 6, within the state (601), the width of the flexible display (150) may be longer than the height. Within the state (601) of displaying an image in an area having a height longer than the width, the electronic device (101) may acquire an image by activating a camera (170-1) among the cameras (170) having a width longer than the height. While the camera (710-1) is activated, the electronic device (101) may deactivate another camera (170-2). Within the state (601), the electronic device (101) may compare the direction of the area where the image is to be displayed and the directions of the cameras (170) to select or identify a camera to be activated for the image. In the state (601) of FIG. 6, the direction of the camera (170-1) whose width in the x-axis direction is longer than the height in the y-axis direction may be parallel to the x-axis, and the direction of the camera (170-2) whose width in the y-axis direction is longer than the height in the x-axis direction may be parallel to the y-axis. In the state (601) where the direction of the area (e.g., the entire active area) of the flexible display (150) on which the image is to be displayed corresponds to the direction of the x-axis, the electronic device (101) may acquire an image through the camera (170-1) having a direction that matches the direction of the x-axis of the entire active area. For example, the electronic device (101) may selectively activate a camera having a direction that matches the direction of the flexible display (150) on which the image is to be displayed, among a plurality of cameras (170), to acquire an image.

[0098] According to one embodiment, the electronic device (101) may select a camera to be activated for displaying an image using parameters representing the orientations of each of the cameras (170) with respect to a reference direction (e.g., a direction perpendicular to the ground and / or a direction of gravitational acceleration). As in state (601), when the reference direction is parallel to the y-axis, the parameter for camera (170-1) may correspond to 90º and / or 270º because the orientation of camera (170-1) is parallel to the x-axis. Within state (601), the parameter for camera (170-2) may correspond to 0º and / or 180º because the orientation of camera (170-2) is parallel to the y-axis. Within the state (601), the electronic device (101) that displays an image on the entire active area of ​​the flexible display (150) having a direction parallel to the x-axis can acquire an image from the camera (170-1) among the cameras (170) since the direction of the entire active area is perpendicular to the reference direction (e.g., 90º and / or 270º).

[0099] Referring to FIG. 6, a state (602) of an electronic device (101) including a folded flexible display (150) by rotation of a first housing assembly (111) relative to a second housing assembly (112) based on a first hinge assembly (121) is illustrated. The state (602) may be included in an in-fold state and / or a sub-fold state of the electronic device (101). The electronic device (101) may identify the state (602) of the electronic device (101) included in the sub-fold state using one or more sensors (e.g., the Hall sensor (234) and / or the IMU (232) of FIG. 2). For example, the electronic device (101) can identify that the state (602) of the electronic device (101) corresponds to a subfold state based on identifying a first angle (141) corresponding to 90º, which is identified based on data from one or more of the sensors.

[0100] Within a state (602) included in a sub-fold state, the flexible display (150) may have two flat portions (621, 622) by the first folding axis (131). The electronic device (101) may select, identify, and / or determine which portion among the portions (621, 622) is to be displayed with an image based on a posture and / or orientation of the electronic device (101). Within the state (602), normals of the portions (621, 622) may be oriented in different directions. Within the state (602), the electronic device (101) may select the portion on which the image is to be displayed based on a direction of gravitational acceleration applied to at least one of the portions (621, 622). For example, if the direction of the gravitational acceleration applied to the portion (622) is parallel to the direction of the normal of the portion (622), the electronic device (101) can determine a portion (621) different from the portion (622) as the portion on which the image is to be displayed.

[0101] In a state (602) of displaying an image through a portion (621), the electronic device (101) can execute a camera application for displaying the image and another software application different from the portion (622) of the flexible display (150) that is different from the portion (621). By executing the camera application and the other software application using each of the flat portions (621, 622) of the flexible display (150), the electronic device (101) can provide a user experience based on multi-tasking. For example, the electronic device (101) can execute a software application (e.g., a note application) for generating media content (e.g., a document and / or note) including text, handwriting, images, videos, audios, or a combination thereof received from a user, and display a screen provided from the software application on the portion (622) of the flexible display (150).

[0102] Referring to FIG. 6, in a state (602) of displaying an image through a portion (621) of a flexible display (150), the electronic device (101) can identify a camera to be activated for displaying an image based on the directions of each of the cameras (170) in the state (602). Since the length of the y-axis of the portion (621) is longer than the length of the z-axis, the direction of the portion (621) where the image is to be displayed can be parallel to the y-axis. The electronic device (101) can acquire an image by activating a camera (170-2) among the cameras (170) that has a direction parallel to the y-axis.

[0103] In one embodiment, while displaying an image using one of the cameras (170), the electronic device (101) may display a visual object (e.g., visual objects (614, 624)) on the flexible display (150) to guide the position of the camera used for displaying the image. Referring to FIG. 6, in a state (601) of displaying an image using the camera (170-1), the electronic device (101) may display a visual object (614) to emphasize a portion of the flexible display (150) that overlaps the camera (170-1). In order to emphasize the portion of the flexible display (150) that overlaps the camera (170-1), the position of the visual object (614) on the flexible display (150) may be adjacent to a portion of the flexible display (150) that is punched to transmit external light toward the camera (170-1). The embodiment is not limited thereto, and the location of the visual object (614) on the flexible display (150) may be adjacent to a portion of the flexible display (150) that includes pixels arranged at a relatively low density to increase the amount of external light transmitted toward the camera (170-1).

[0104] In one embodiment, the visual object (614) displayed by the electronic device (101) may have a shape of a line (e.g., a circular line) surrounding a portion of the flexible display (150) that overlaps the camera (170-1). Similarly, in a state (602) of displaying an image using the camera (170-2), the electronic device (101) may display a visual object (624) to emphasize a portion of the flexible display (150) that overlaps the camera (170-2). The visual object (624) may have a position and / or shape relative to the portion of the flexible display (150) that overlaps the camera (170-2). Although the visual objects (614, 624) having a circular shape are illustrated as an example, the shapes of the visual objects (614, 624) are not limited to the embodiment of FIG. 6. For example, the electronic device (101) may display a visual object (and / or indicator) in the form of a dot on a flexible display (150) adjacent to the camera to guide the position of the camera used for displaying an image.

[0105] According to one embodiment, the electronic device (101) may determine the color of a visual object (e.g., visual objects (614, 624)) for indicating the position of the camera as a complementary color of at least one color of pixels of the flexible display (150) in order to improve the visibility of the visual object. For example, in the state (601) of FIG. 6, the electronic device (101) may display a visual object (614) having a complementary color of a representative color of pixels represented by a color distribution of pixels included in the flexible display (150). The representative color may be an average value of the colors of the pixels, and may be determined by average values ​​of brightness values ​​of each of the three primary colors of red, green, and blue. The electronic device (101) may determine the color of the visual object (614) based on the color distribution of the entire active area of ​​the flexible display (150) and / or a portion of the flexible display (150) where the visual object (614) is to be displayed. The embodiment is not limited thereto, and the electronic device (101) may display a visual object having a form of a specified color (e.g., red) at a location on the flexible display (150) associated with the camera.

[0106] Referring to states (601, 602) of FIG. 6, since an image is acquired using a camera having a direction and / or aspect ratio corresponding to the direction and / or aspect ratio of at least a portion of the flexible display (150) on which the image is to be displayed, the electronic device (101) can display an image having a shape similar to that of at least a portion of the flexible display (150). Since an image having a shape similar to that of at least a portion of the flexible display (150) is displayed, an area of ​​a portion where the image is not displayed can be minimized or reduced within the at least portion.

[0107] FIG. 7 illustrates different states (601, 701) of an electronic device according to one embodiment. The electronic device (101) of FIG. 1 and / or FIG. 2 may perform the operations of the electronic device (101) described with reference to FIG. 7. For example, the electronic device (101) and / or the processor (210) of FIG. 2 may perform the operations of the electronic device (101) described with reference to FIG. 7.

[0108] Referring to FIG. 7, different states (601, 701) of an electronic device (101) are illustrated, distinguished by a reference direction (e.g., a direction perpendicular to the ground and / or a direction of gravitational acceleration). The electronic device (101) can identify a direction of gravitational acceleration applied to the electronic device (101) using a sensor (e.g., sensor (230) of FIG. 2). Within state (601), the electronic device (101) can identify a direction (g1) of gravitational acceleration applied in the direction of the -y axis. Within state (701), the electronic device (101) can identify a direction (g2) of gravitational acceleration applied in the direction of the +x axis.

[0109] According to one embodiment, the electronic device (101) can change the direction of an image displayed over the entire active area of ​​the flexible display (150) depending on the directions (g1, g2) of gravitational acceleration applied to the electronic device (101), such as states (601, 701). Within the state (601) that identifies the direction (g1) of gravitational acceleration parallel to the y-axis, the electronic device (101) can display an image based on a landscape mode. Based on the landscape mode, the electronic device (101) can determine the x-axis of the flexible display (150) as the width of the image and the y-axis of the flexible display (150) as the height of the image.

[0110] According to one embodiment, the electronic device (101) can determine which camera among the cameras (170) based on the relationship between the width and height of the image. As described above with reference to the state (601) of FIG. 6, the electronic device (101) can acquire an image using the camera (170-1) having a direction parallel to the x-axis within the state (601) among the cameras (170). While acquiring an image using the camera (170-1), the electronic device (101) can display a visual object (614) at a location adjacent to the camera (170-1) on the flexible display (150).

[0111] Referring to FIG. 7, in a state (601) of displaying an image acquired through a camera (170-1) in the entire active area of ​​a flexible display (150), an electronic device (101) that identifies rotation of the electronic device (101) based on a sensor (e.g., an IMU (232) of FIG. 2) may switch to a state (701) based on the rotation. For example, a user holding the electronic device (101) may rotate the electronic device (101) by 90º in a clockwise direction with respect to the z-axis. In the state (701) switched by the rotation, the electronic device (101) may identify a direction (g2) of gravitational acceleration parallel to the x-axis. The electronic device (101) that identifies the direction (g2) of gravitational acceleration may display an image based on a portrait mode. Based on the portrait mode, the electronic device (101) can determine the y-axis of the flexible display (150) as the width of the image and the x-axis of the flexible display (150) as the height of the image. For example, during the transition from state (601) to state (701), the width and height of the image can be changed. The electronic device (101) that identifies the change in the width and / or height of the image can reselect one of the cameras (170) based on the directions of the cameras (170).

[0112] Referring to FIG. 7, within a state (701), parameters indicating the orientations of the cameras (170) with respect to a reference direction (e.g., the direction of gravitational acceleration (g2)) may be changed by the rotation of the electronic device (101). For example, a parameter of a camera (170-1) having an x-axis as a width may correspond to 0º and / or 180º because the x-axis is parallel to the reference direction. For example, a parameter of a camera (170-2) having a y-axis as a width may correspond to 90º and / or 270º because the y-axis is perpendicular to the reference direction. Within a state (701) that displays an image based on a portrait mode, the electronic device (101) may select and / or identify one of the cameras (170) based on the orientations of the cameras (170) indicated by the parameters.

[0113] For example, within a portrait mode displaying an image having a height greater than its width, the electronic device (101) may determine a camera (170-1) having a height greater than its width as the camera corresponding to the image. The electronic device (101) may display an image acquired using the camera (170-1) on the entire active area of ​​the flexible display (150). Within a state (701) of displaying an image acquired using the camera (170-1), the electronic device (101) may display a visual object (614) on the flexible display (150) at a location adjacent to the camera (170-1).

[0114] As described above, according to one embodiment, the electronic device (101) may select or identify one of the plurality of cameras (170) based on the relationship between the width and the height of the area where an image is to be displayed. For example, based on identifying the area having a height greater than the width (e.g., state (701) of FIG. 7), the electronic device (101) may display an image in the area using a camera (e.g., camera (170-1) in state (701)) among the plurality of cameras (170). For example, based on identifying the area having a height less than the width (e.g., state (601) of FIG. 7), the electronic device (101) may display an image in the area using a camera (e.g., camera (170-1) in state (601)) among the plurality of cameras.

[0115] Hereinafter, with reference to FIGS. 8 and / or 9, an exemplary operation is described in which an electronic device (101) identifies rotation between housing assemblies by a first folding axis (131) and / or a second folding axis (132), determines a portion of a flexible display (150) on which an image is to be displayed, and activates one of the cameras (170) based on the determined portion.

[0116] FIG. 8 illustrates different states (801, 602) of an electronic device according to one embodiment. The electronic device (101) of FIG. 1 and / or FIG. 2 may perform the operations of the electronic device (101) described with reference to FIG. 8. For example, the electronic device (101) and / or the processor (210) of FIG. 2 may perform the operations of the electronic device (101) described with reference to FIG. 8.

[0117] Referring to FIG. 8, different states (801, 802) of the electronic device (101) are illustrated, distinguished by the rotation of at least one of the first folding axis (131) or the second folding axis (132). The electronic device (101) can identify the rotation of at least one of the first folding axis (131) or the second folding axis (132) based on sensor data obtained from one or more sensors (e.g., sensor (230) of FIG. 2) and changed by the rotation of the first folding axis (131) and / or the second folding axis (132). For example, the sensor data may relate to a first angle (141) between the first housing assembly (111) and the second housing assembly (112) at the first folding axis (131) and / or a second angle (142) between the second housing assembly (112) and the third housing assembly (113) at the second folding axis (132). States (801, 802) of FIG. 8 may be included in sub-fold states of the electronic device (101), such as state (302) of FIG. 3A and / or state (305) of FIG. 3B.

[0118] Referring to FIG. 8, within states (801, 602) in which the flexible display (150) includes at least two flat portions, the electronic device (101) can select one of the portions on which an image is to be displayed. For example, within a state (801) in which the flat portions (811, 812) of the flexible display (150) are distinguished based on the second folding axis (132), the electronic device (101) can select one of the portions on which an image is to be displayed based on the directions of the normals of the portions (811, 812). With respect to the x-axis, y-axis, and z-axis illustrated based on the second housing assembly (112), the portion (811) can be oriented in the direction of the +z-axis, and the portion (812) can be oriented in the direction of the -x-axis. Within the state (801), when gravitational acceleration is applied in the direction of the +x axis, the electronic device (101) can display an image on a portion (811) facing a different direction from the gravitational acceleration.

[0119] In a state (801) of displaying an image on a portion (811) of a flexible display (150), the electronic device (101) may select or identify one of the cameras (170) based on an aspect ratio and / or direction of the portion (811). In the state (801) of FIG. 8, based on the directions of the cameras (170) determined based on the posture of the electronic device (101), the electronic device (101) may determine a camera to be activated to display an image on an area (911) from among a plurality of cameras (170). The electronic device (101) displaying an image on a portion (811) having a height greater than a width may selectively activate a camera (170-1) among the cameras (170) that outputs an image having a height greater than a width. The electronic device (101) can display an image obtained from a camera (170-1) on a portion (811) of a flexible display (150).

[0120] Referring to FIG. 8, in a state (801) of displaying an image acquired from a camera (170-1) on a portion (811) of a flexible display (150), the electronic device (101) can display a visual object (813) corresponding to the camera (170-1). The visual object (813) can have a shape that surrounds a portion of the flexible display (150) that overlaps the camera (170-1). The color of the visual object (813) having a shape of a line that surrounds the portion can correspond to a specified color or a complementary color of a representative color of an image and / or screen displayed through the portion (811).

[0121] In one embodiment, the electronic device (101) can change at least a portion of the flexible display (150) on which an image is to be displayed based on identifying that the posture of the electronic device (101) has changed. Based on changing at least a portion of the flexible display (150) on which an image is to be displayed, the electronic device (101) can reselect and / or reidentify a camera among the cameras (170) to be activated for displaying the image. For example, within state (801), if a user rotates the first housing assembly (111) relative to the second housing assembly (112) about the first folding axis (131) and rotates the second housing assembly (112) about the second folding axis (132), the electronic device (101) can have the shape illustrated in state (602) of FIG. 8. The electronic device (101) can switch from state (801) to state (602) based on identifying a changed shape using a sensor.

[0122] The electronic device (101), which has switched from a state (801) in which an image is displayed on a portion (811) of the flexible display (150) to a state (602), can reselect a portion on which an image is to be displayed among the flat portions (621, 622) of the flexible display (150) distinguished by the rotation of the first folding axis (131). As described above with reference to FIG. 6, the electronic device (101) can determine the portion (621) perpendicular to the ground as the portion on which an image is to be displayed. The electronic device (101) can select a camera (170-2) to be activated for displaying an image among the cameras (170) based on the direction and / or aspect ratio of the portion (621). In a state (602) of displaying an image using a camera (170-2), the electronic device (101) can display a visual object (624) for visualizing the position of the camera (170-2) on the flexible display (150).

[0123] While the operation of the electronic device (101) switching between two different states has been described with reference to FIGS. 6 through 8, the embodiment is not limited thereto. For example, the electronic device (101) can be switched from the state (601) of FIG. 6 to the state (602) of FIG. 6 and / or FIG. 8 and / or the state (701) of FIG. 7, as well as the state (801) of FIG. 8. For example, the electronic device (101) can be switched from the state (602) of FIG. 6 to the state (801) of FIG. 8 and / or the state (601) of FIG. 6 and / or FIG. 7, as well as the state (701) of FIG. 7. For example, the electronic device (101) can be switched from the state (701) of FIG. 7 to the state (601) of FIG. 7, as well as the states (602, 801) of FIG. 8. For example, the electronic device (101) can be switched from the state (801) of FIG. 8 to the state (701) of FIG. 7 and / or the state (601) of FIG. 6, as well as the state (602) of FIG. 6 and / or FIG. 8.

[0124] FIG. 9 illustrates different states of an electronic device (101-2) according to one embodiment. The electronic device (101) of FIG. 1 and / or FIG. 2 may perform the operations of the electronic device (101-2) described with reference to FIG. 9. For example, the electronic device (101) and / or the processor (210) of FIG. 2 may perform the operations of the electronic device (101-2) described with reference to FIG. 9.

[0125] Referring to FIG. 9, different states (901, 902, 903) of an electronic device (101-2) that can be folded at an angle exceeding a horizontal angle with respect to a first folding axis (131) are illustrated. The states (901, 902, 903) may be included in an unfolded state, a sub-folded state (or an out-folded state), and a folded state of the electronic device (101-2), respectively. The electronic device (101-2) may be switched between the exemplary states (901, 902, 903) based on a posture of the electronic device (101-2) identified using one or more sensors (e.g., sensor (230) of FIG. 2).

[0126] Referring to FIG. 9, the electronic device (101-2) may activate at least one of the cameras (170) based on a video call application. In states (901, 902, 903) in which a video call connection is established, the electronic device (101-2) may display a video transmitted (or streamed) from a counterpart (or an external electronic device connected via a network) in an area (911) and display a video being acquired from an activated camera in an area (912). The video displayed through the area (912) may be referred to as an image from the perspective of a video to be transmitted (or streamed) to the counterpart.

[0127] In one embodiment providing a screen based on a video call application, the electronic device (101-2) may display visual objects (913, 914, 915) for controlling a video call established by the video call application on the flexible display (150). For example, the electronic device (101-2) may display a visual object (913) corresponding to a function for changing an activated camera. For example, in response to an input indicating selection of a visual object (913), the electronic device (101-2) may activate a camera different from the currently activated camera among the cameras (170) and display an image in the area (912) using the activated camera. The embodiment is not limited thereto, and in response to the input, the electronic device (101-2) may activate another camera located on the rear side opposite to the front side of the electronic device (101-2) where the cameras (170) are arranged, and display an image in the area (912) using the activated camera. The electronic device (101-2) may display a visual object (914) corresponding to a function for stopping (or terminating) an established video call. In response to an input indicating selection of the visual object (914), the electronic device (101-2) may terminate the video call. The electronic device (101-2) may display a visual object (915) corresponding to a function for at least temporarily stopping transmitting audio to the other party (or external electronic device). In response to an input indicating selection of the visual object (915), the electronic device (101-2) may stop transmitting audio to the other party (or external electronic device) or may reduce the volume of audio transmitted to the other party (or external electronic device) to substantially 0.

[0128] Referring to FIG. 9, within a state (901) included in an unfolded state, the electronic device (101-2) can display a screen on the flexible display (150) based on the landscape mode. Within the screen displayed on the flexible display (150), the electronic device (101-2) can display an image acquired from the camera (170-1) in an area (912) related to the landscape mode. Within the state (901) of displaying an image acquired from the camera (170-1), the electronic device (101-2) can display a visual object (919) indicating that the camera (170-1) is activated. The visual object (919), similar to the visual objects (614, 624) of FIG. 6, may have a position relative to a portion of the flexible display (150) that overlaps the camera (170-1) and may have a complementary color of a representative color of the colors of the pixels of the flexible display (150). The embodiment is not limited thereto.

[0129] The camera that the electronic device (101-2) activates to display an image in the area (912) may be changed among a plurality of cameras (170) depending on the posture of the electronic device (101-2). Referring to FIG. 9, in a state (902) in which the rotation of the first housing assembly (111) with respect to the second housing assembly (112) is identified based on the first folding axis (131), the electronic device (101-2) may display areas (911, 912) on a portion of the flexible display (150) positioned on the second housing assembly (112) and the third housing assembly (113) based on the rotation. In the state (902), the electronic device (101-2) may display an image acquired from the camera (170-1) in the area (912). While switching from state (901) to state (902), the electronic device (101-2) can move the areas (911, 912) and visual objects (913, 914, 915) to the above part of the flexible display (150).

[0130] Referring to FIG. 9, as the first folding axis (131) and the second folding axis (132) are all rotated, the state of the electronic device (101-2) can be switched to a state (903) included in the folded state. Within the state (903), a portion of the flexible display (150) and the camera (170-2) positioned on the first housing assembly (111) can be exposed to the outside. Other portions of the flexible display (150) and the camera (170-1) can be covered by the housing of the electronic device (101-2) (e.g., the second housing assembly (112) and / or the third housing assembly (113)). In a state where the camera (170-1) is covered (903), the electronic device (101-2) can activate the camera (170-2) to display an image on a portion of an area (932) of the flexible display (150).

[0131] For example, while switching from one of states (901, 902) to state (903), the electronic device (101-2) can display regions (931, 932) and visual objects (913, 914, 915) having a layout based on a portion of a flexible display (150) positioned on the first housing assembly (111). Within region (931), the electronic device (101-2) can display a video transmitted from a counterpart (or an external electronic device), similar to the regions of states (901, 902). Within region (932), the electronic device (101-2) can display an image acquired from one of the plurality of cameras (170) of the electronic device (101-2), similar to region (912) of states (901, 902).

[0132] Referring to FIG. 9, in a state (903) of displaying a screen on a portion of a flexible display (150) having a height greater than the width, the electronic device (101-2) can activate a camera (170-2) arranged to output an image and / or video having a height greater than the width, to obtain an image to be displayed in an area (932). In a state (903) in which the camera (170-2) is activated, the electronic device (101-2) can display a visual object (939) to emphasize the camera (170-2). The electronic device (101-2) can display a visual object (939) in the form of a line that surrounds a portion of the flexible display (150) overlapping with the camera (170-2). The color of the visual object (939) may be determined as one of the complementary colors of the representative color of the screen positioned on the first housing assembly (111), the complementary colors of the representative color of the image and / or video displayed through at least one of the areas (931, 932), and / or a specified color.

[0133] Hereinafter, with reference to FIG. 10, an exemplary operation of the electronic device (101) described with reference to FIGS. 1 to 9 is described.

[0134] FIG. 10 illustrates an exemplary flowchart for an electronic device according to one embodiment. The electronic device (101) of FIG. 1 and / or FIG. 2 may perform the operations of the electronic device described with reference to FIG. 10 . For example, the electronic device (101) and / or the processor (210) of FIG. 2 may perform at least one of the operations of FIG. 10 . At least one of the operations of FIG. 10 may be related to, or performed similarly to, the operations described with reference to FIG. 5 .

[0135] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0136] Referring to FIG. 10 , in operation (1010), a processor of an electronic device according to an embodiment may identify a posture of the electronic device while displaying an image on a flexible display (e.g., the flexible display (150) of FIGS. 1 to 9 ) using a first camera having a first aspect ratio among a plurality of cameras (e.g., cameras 170 of FIGS. 1 to 9 ). The processor may perform operation (1010) in response to an input indicating execution of a camera-related function and / or software application (e.g., a camera application and / or a video call application). The processor performing operation (1010) in an unfolded state may identify a first camera used for displaying an image based on the first aspect ratio of the entire active area of ​​the flexible display. The first camera may be selected from or identified among a plurality of cameras arranged on one surface of the electronic device to have different orientations. Based on the operation (1010) of FIG. 10, the processor may monitor the posture of the electronic device using one or more sensors (e.g., sensor (230) of FIG. 2). For example, the processor may identify whether the posture of the electronic device has changed based on the operation (1010).

[0137] As described above with reference to FIG. 1, the plurality of cameras included in the electronic device may have different aspect ratios. The different aspect ratios of the cameras may mean that the relationship between the width and height represented by the aspect ratios is different. For example, the electronic device may include a first camera with a first aspect ratio having a width greater than its height and a second camera with a second aspect ratio having a height greater than its width. In the above example, since the image is displayed using the first camera with the first aspect ratio, the height of the image displayed by operation (1010) may be shorter than the width of the image.

[0138] Referring to FIG. 10, in operation (1020), a processor of an electronic device according to one embodiment may identify a position of the electronic device changed by rotation of housing assemblies (e.g., the first housing assembly (111), the second housing assembly (112), and / or the third housing assembly (113) of FIGS. 1 to 9), and may identify a portion of the flexible display, which is to display an image, among portions of the flexible display distinguished by the rotation. By the rotation of the housing assemblies, the flexible display of the electronic device (e.g., the flexible display (150) of FIG. 2) may be bent about a folding axis between the housing assemblies (e.g., the first folding axis (131) and / or the second folding axis (132) of FIGS. 1 to 9). The electronic device (101-2) can select or determine which part of the flat parts of the flexible display (e.g., parts (811, 812) of FIG. 8 and / or parts (621, 622) of FIG. 6) separated by the folding axis is to display an image.

[0139] For example, the processor may identify the portion on which the image is to be displayed based on the orientation of the electronic device, as identified by the gravitational acceleration applied to the electronic device. For example, the processor may display the image on a portion of the flat portions of the flexible display that is different from the portion parallel to the direction of the gravitational acceleration and / or the direction perpendicular to the ground, as described above with reference to state (602) of FIG. 6. For example, the processor may identify the portion on which the image is to be displayed based on the directions in which each of the flat portions of the flexible display faces. The processor may identify the portion on which the image is to be displayed based on the sizes of each of the flat portions of the flexible display.

[0140] Referring to FIG. 10 , in operation (1030), a processor of an electronic device according to an embodiment may identify whether an aspect ratio of a portion identified based on operation (1020) corresponds to a first aspect ratio of operation (1010). For example, the processor may identify whether a relationship between a width and a height of the identified portion matches a relationship between a width and a height represented by the first aspect ratio of operation (1010). If the aspect ratio of the portion identified based on operation (1020) corresponds to the first aspect ratio (1030—Yes), the processor may perform operation (1040). If the aspect ratio of the portion identified based on operation (1020) is different from the first aspect ratio (1030—No), the processor may perform operation (1050).

[0141] Referring to FIG. 10, in operation (1040), the processor of the electronic device according to one embodiment may display an image on a portion identified using the first camera. For example, while displaying an image using the first camera of the first aspect ratio having a width greater than height, if the portion identified based on operation (1020) has a width greater than height, the processor may continue displaying the image using the first camera based on operation (1040).

[0142] Referring to FIG. 10, in operation (1050), according to an embodiment, the processor of the electronic device may display an image on the identified portion using a second camera having a second aspect ratio different from the first aspect ratio among the plurality of cameras. For example, while displaying an image using a first camera having a first aspect ratio having a width greater than height, if the portion identified based on operation (1020) has a height greater than width, the processor may acquire an image using a second camera having a second aspect ratio indicating a height greater than width based on operation (1050).

[0143] As described above, according to one embodiment, the electronic device can display an image suitable for the shape of a flexible, deformable display using cameras disposed on one side of the housing and having different aspect ratios. When the width, height, size, and / or aspect ratio of an area capable of displaying an image changes due to folding and / or rotation of the flexible display, the electronic device can selectively activate one of the cameras related to the aspect ratio of the area. The electronic device can display an image acquired from the activated camera on the area.

[0144] FIG. 11 is a block diagram of an electronic device (1301) within a network environment (1100) according to various embodiments. Referring to FIG. 11, in the network environment (1100), the electronic device (1101) may communicate with the electronic device (1102) via a first network (1198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (1104) or the server (1108) via a second network (1199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (1101) may communicate with the electronic device (1104) via the server (1108). According to one embodiment, the electronic device (1101) may include a processor (1120), a memory (1130), an input module (1150), an audio output module (1155), a display module (1160), an audio module (1170), a sensor module (1176), an interface (1177), a connection terminal (1178), a haptic module (1179), a camera module (1180), a power management module (1188), a battery (1189), a communication module (1190), a subscriber identification module (1196), or an antenna module (1197). In some embodiments, the electronic device (1101) may omit at least one of these components (e.g., the connection terminal (1178)), or may have one or more other components added. In some embodiments, some of these components (e.g., sensor module (1176), camera module (1180), or antenna module (1197)) may be integrated into a single component (e.g., display module (1160)).

[0145] The processor (1120) may, for example, execute software (e.g., a program (1140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (1101) connected to the processor (1120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (1120) may store commands or data received from other components (e.g., a sensor module (1176) or a communication module (1190)) in a volatile memory (1132), process the commands or data stored in the volatile memory (1132), and store result data in a non-volatile memory (1134). According to one embodiment, the processor (1120) may include a main processor (1121) (e.g., a central processing unit or an application processor) or an auxiliary processor (1123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (1121). For example, when the electronic device (1101) includes the main processor (1121) and the auxiliary processor (1123), the auxiliary processor (1123) may be configured to use less power than the main processor (1121) or to be specialized for a given function. The auxiliary processor (1123) may be implemented separately from the main processor (1121) or as a part thereof.

[0146] The auxiliary processor (1123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (1160), a sensor module (1176), or a communication module (1190)) of the electronic device (1101), for example, on behalf of the main processor (1121) while the main processor (1121) is in an inactive (e.g., sleep) state, or together with the main processor (1121) while the main processor (1121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (1123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (1180) or a communication module (1190)). In one embodiment, the auxiliary processor (1123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (1101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (1108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0147] The memory (1130) can store various data used by at least one component (e.g., the processor (1120) or the sensor module (1176)) of the electronic device (1101). The data can include, for example, software (e.g., the program (1140)) and input data or output data for commands related thereto. The memory (1130) can include a volatile memory (1132) or a non-volatile memory (1134).

[0148] The program (1140) may be stored as software in memory (1130) and may include, for example, an operating system (1142), middleware (1144), or an application (1146).

[0149] The input module (1150) can receive commands or data to be used in a component of the electronic device (1101) (e.g., a processor (1120)) from an external source (e.g., a user) of the electronic device (1101). The input module (1150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0150] The audio output module (1155) can output audio signals to the outside of the electronic device (1101). The audio output module (1155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0151] The display module (1160) can visually provide information to an external party (e.g., a user) of the electronic device (1101). The display module (1160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. In one embodiment, the display module (1160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0152] The audio module (1170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (1170) can acquire sound through the input module (1150), output sound through the sound output module (1155), or an external electronic device (e.g., electronic device (1102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (1101).

[0153] The sensor module (1176) can detect the operating status (e.g., power or temperature) of the electronic device (1101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (1176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0154] The interface (1177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (1101) with an external electronic device (e.g., the electronic device (1102)). In one embodiment, the interface (1177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0155] The connection terminal (1178) may include a connector through which the electronic device (1101) may be physically connected to an external electronic device (e.g., the electronic device (1102)). In one embodiment, the connection terminal (1178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0156] The haptic module (1179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. In one embodiment, the haptic module (1179) may include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0157] The camera module (1180) can capture still images and videos. In one embodiment, the camera module (1180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0158] The power management module (1188) can manage the power supplied to the electronic device (1101). According to one embodiment, the power management module (1188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0159] A battery (1189) may power at least one component of the electronic device (1101). In one embodiment, the battery (1189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0160] The communication module (1190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (1101) and an external electronic device (e.g., electronic device (1102), electronic device (1104), or server (1108)), and the performance of communication through the established communication channel. The communication module (1190) may operate independently from the processor (1120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1190) may include a wireless communication module (1192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (1194) (e.g., a local area network (LAN) communication module, or a power line communication module). Any of these communication modules may communicate with an external electronic device (1104) via a first network (1198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (1199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1192) may use subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (1196) to verify or authenticate the electronic device (1101) within a communication network such as the first network (1198) or the second network (1199).

[0161] The wireless communication module (1192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (1192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (1192) may support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (1192) may support various requirements specified in the electronic device (1101), an external electronic device (e.g., the electronic device (1104)), or a network system (e.g., the second network (1199)). According to one embodiment, the wireless communication module (1192) may support a peak data rate (e.g., 20 Gbps or more) for eMBB implementation, a loss coverage (e.g., 164 dB or less) for mMTC implementation, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC implementation.

[0162] The antenna module (1197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (1197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (1197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (1198) or the second network (1199), may be selected from the plurality of antennas by, for example, the communication module (1190). A signal or power may be transmitted or received between the communication module (1190) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (1197).

[0163] According to various embodiments, the antenna module (1197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high frequency band.

[0164] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0165] According to one embodiment, commands or data may be transmitted or received between the electronic device (1101) and an external electronic device (1104) via a server (1108) connected to a second network (1199). Each of the external electronic devices (1102 or 1504) may be the same or a different type of device as the electronic device (1101). According to one embodiment, all or part of the operations executed in the electronic device (1101) may be executed in one or more of the external electronic devices (1102, 1504, or 1508). For example, when the electronic device (1101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (1101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (1101). The electronic device (1101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (1101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (1104) may include an Internet of Things (IoT) device. The server (1108) may be an intelligent server utilizing machine learning and / or a neural network.According to one embodiment, an external electronic device (1104) or server (1108) may be included within the second network (1199). The electronic device (1101) may be applied to intelligent services (e.g., smart homes, smart cities, smart cars, or healthcare) based on 5G communication technology and IoT-related technology.

[0166] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0167] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0168] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0169] Various embodiments of the present document may be implemented as software (e.g., a program (1140)) including one or more instructions stored in a storage medium (e.g., an internal memory (1136) or an external memory (1138)) readable by a machine (e.g., an electronic device (1101)). For example, a processor (e.g., a processor (1120)) of the machine (e.g., an electronic device (1101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0170] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a commodity between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) via an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0171] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and arranged in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added. The electronic device (1101) of FIG. 11 may be an example of the electronic device (101) described with reference to FIGS. 1 to 10.

[0172] In one embodiment, a method for displaying an image suitable for the shape of a flexible display may be required. According to one embodiment of the present invention, an electronic device (e.g., the electronic device (101) of FIGS. 1 to 10 and / or the electronic device (1101) of FIG. 11) as described above comprises a multi-foldable housing including a first housing (e.g., the first housing assembly (111) of FIG. 1) and a second housing (e.g., the second housing assembly (112) of FIG. 1) rotatably coupled to the first housing and a third housing rotatably coupled to the second housing, a flexible display (e.g., the flexible display (150) of FIG. 1) disposed on a first surface of the multi-foldable housing, a plurality of cameras (e.g., the cameras (170) of FIG. 1) positioned on the first surface and having different aspect ratios, at least one sensor (e.g., the first housing assembly (111) of FIG. 1) for sensing an angle between the first housing and the second housing or an angle between the second housing and the third housing) The electronic device may include a sensor (230), a memory (e.g., memory (220) of FIG. 2) for storing executable instructions, and at least one processor (e.g., processor (210) of FIG. 2) for accessing the memory and executing the instructions. The at least one processor may be configured to identify a first pose of the electronic device based on an angle sensed by the sensor while displaying an image on the flexible display using a first camera having a first aspect ratio among the plurality of cameras.The at least one processor may be configured to display an image on the flexible display using a second camera, among the plurality of cameras, having a second aspect ratio different from the first aspect ratio, based on identifying a second posture of the electronic device, which is changed by a rotation of the first housing relative to the second housing, based on the sensor. In one embodiment, the electronic device may acquire the image using one camera, among the plurality of cameras, corresponding to an aspect ratio of at least a portion of the flexible display on which the image is to be displayed.

[0173] For example, the at least one processor may be configured to display a visual object to highlight a portion of the flexible display that overlaps the first camera while displaying the image using the first camera.

[0174] For example, the at least one processor may be configured to display the visual object (e.g., visual objects (614, 624) of FIG. 6, visual object (813) of FIG. 8, visual objects (919, 939) of FIG. 9) having a complementary color of a representative color of the pixels represented by the color distribution of the pixels included in the flexible display.

[0175] For example, the at least one processor may be configured to display the visual object in the form of a line surrounding the portion of the flexible display that overlaps the first camera.

[0176] For example, the at least one processor may be configured to determine which camera among the plurality of cameras is to be activated to display the image based on orientations of the first camera and the second camera determined based on a pose of the electronic device identified among the first pose or the second pose.

[0177] For example, the at least one processor may be configured to compare the orientations of the first camera and the second camera with the orientation of the electronic device identified as being in portrait mode or landscape mode, to determine a camera among the plurality of cameras to be used for displaying the image.

[0178] For example, the at least one processor may be configured to obtain parameters representing the directions of the first camera and the second camera, the directions being distinguished according to angles of the first camera and the second camera with respect to a reference direction.

[0179] For example, the plurality of cameras may include the first camera configured to display an image having a height shorter than a width. The plurality of cameras may include the second camera configured to display an image having a height longer than a width.

[0180] According to one embodiment of the present invention, a method of an electronic device as described above may include an operation (e.g., operation 1010 of FIG. 10 ) of identifying a first pose of the electronic device based on a sensor of the electronic device while displaying an image on the flexible display of the electronic device using a first camera having a first aspect ratio among a plurality of cameras of the electronic device, the first camera having a first aspect ratio being disposed on a first surface of a first housing or a second surface of a second housing on which a flexible display of the electronic device is disposed and having different aspect ratios. The method may include an operation (e.g., operation 1050 of FIG. 10 ) of displaying an image on the flexible display using a second camera having a second aspect ratio different from the first aspect ratio among the plurality of cameras, based on identifying a second pose of the electronic device changed by a rotation of the second housing relative to the first housing, based on the sensor.

[0181] For example, the act of displaying the image using the first camera may include the act of displaying a visual object to highlight a portion of the flexible display overlapping the first camera.

[0182] For example, the act of displaying the visual object may include an act of displaying the visual object having a complementary color of a representative color of the pixels represented by the color distribution of the pixels included in the flexible display.

[0183] For example, the act of displaying the visual object may include an act of displaying the visual object in the form of a line surrounding the portion of the flexible display overlapping the first camera.

[0184] For example, the identifying action may include an action of determining, from among the plurality of cameras, a camera to be activated to display the image in the identified portion based on the directions of the first camera and the second camera determined based on the pose of the electronic device identified among the first pose or the second pose.

[0185] For example, the determining operation may include an operation of comparing the directions of the first camera and the second camera with the direction of the electronic device corresponding to a portrait mode or a landscape mode, and determining a camera for displaying the image from among the plurality of cameras.

[0186] For example, the determining operation may include an operation of obtaining parameters representing the directions of the first camera and the second camera, which are distinguished according to angles of the first camera and the second camera with respect to a reference direction.

[0187] For example, the plurality of cameras may include the first camera configured to display an image having a height shorter than its width. The plurality of cameras may include the second camera configured to display an image having a height longer than its width.

[0188] According to one embodiment of the present invention, an electronic device as described above may include a first housing, a second housing rotatably coupled to the first housing, a flexible display disposed on a first surface of the first housing and a second surface of the second housing, a plurality of cameras positioned on the first surface or the second surface, and at least one processor. The at least one processor may be configured to, in response to an input for displaying an image using any one of the plurality of cameras, identify an area of ​​the flexible display on which the image is to be displayed based on a posture of the first housing and the second housing and an orientation of the electronic device. The at least one processor may be configured to, based on identifying the area having a height greater than a width, display an image in the area using a first camera among the plurality of cameras, the first camera having a height greater than a width, the first camera being identified by widths and heights of the plurality of cameras distinguished by the orientation. The at least one processor may be configured to display an image in the area using a second camera among the plurality of cameras having a height shorter than a width, based on identifying the area having a height shorter than a width.

[0189] For example, the at least one processor may be configured to display a visual object on the flexible display to guide the position of a camera used for displaying the image while displaying the image using either the first camera or the second camera.

[0190] For example, the at least one processor may be configured to display the visual object having a complementary color of a representative color of pixels displayed on the flexible display.

[0191] For example, the at least one processor may be configured to identify an area on which the image is to be displayed, among flat portions of the flexible display, which are distinguished by an angle between the first housing and the second housing.

[0192] According to one embodiment of the present invention, a method of an electronic device as described above may include an operation of identifying an area of ​​a flexible display of the electronic device on which an image is to be displayed, based on an input for displaying an image using one of a plurality of cameras of the electronic device, based on a posture of a first housing and a second housing of a housing of the electronic device and an orientation of the electronic device. The flexible display may be positioned on a first surface of the first housing and a second surface of the second housing, and the plurality of cameras may be positioned on the first surface or the second surface. The method may include an operation of displaying an image in the area using a first camera among the plurality of cameras, the first camera having a height greater than its width, the height being identified by widths and heights of the plurality of cameras distinguished by the orientation, based on identifying the area having a height less than its width. The method may include an operation of displaying an image in the area using a second camera among the plurality of cameras, the second camera having a height less than its width, based on identifying the area having a height less than its width.

[0193] For example, the act of displaying the image may include an act of displaying a visual object on the flexible display to guide the position of a camera used for displaying the image while displaying the image using either the first camera or the second camera.

[0194] For example, the act of displaying the visual object may include an act of displaying the visual object having a complementary color of the representative color of pixels displayed on the flexible display.

[0195] For example, the identifying action may include an action of identifying an area on which the image is to be displayed, among flat portions of the flexible display, distinguished by an angle between the first housing and the second housing.

[0196] In one embodiment, an electronic device may include a first housing, a second housing rotatably coupled to the first housing, a flexible display disposed on a first surface of the first housing and a second surface of the second housing, a first camera disposed on the first surface, a second camera disposed on the second surface, at least one sensor for sensing an angle between the first housing and the second housing, a memory for storing executable instructions, and at least one processor for accessing the memory to execute the instructions. The at least one processor may be configured to identify a state of the electronic device based on the at least one sensor in response to an input for operating either the first camera or the second camera. The at least one processor may be configured to display an image on the entire active area of ​​the flexible display using the second camera having an aspect ratio of the entire active area of ​​the flexible display based on a state of the electronic device corresponding to an unfolded state. The at least one processor may be configured to display an image based on the first camera on one of the flat portions of the flexible display folded by the angle, based on a state of the electronic device corresponding to a sub-fold state between the unfolded state and the folded state.

[0197] For example, the at least one processor may be configured to display a visual object having a shape that wraps around a portion of the flexible display overlapping the first camera while displaying the image based on the first camera.

[0198] For example, the at least one processor may be configured to display the visual object having a complementary color of a representative color of pixels included in the flexible display.

[0199] For example, the at least one processor may be configured to determine, within the state of the electronic device corresponding to the sub-fold state, the portion of the flexible display on which the image based on the first camera is to be displayed based on the orientations of each of the first housing and the second housing.

[0200] In one embodiment, a method of an electronic device may include an operation of identifying a state of the electronic device based on at least one sensor of the electronic device in response to an input for operating either a first camera disposed on a first surface of a first housing or a camera disposed on a second surface of a second housing rotatably coupled to the first housing. The method may include an operation of displaying an image on the entire active area of ​​a flexible display disposed on the first surface and the second surface using the second camera, the second camera having an aspect ratio of the entire active area of ​​the flexible display, based on a state of the electronic device corresponding to an unfolded state. The method may include an operation of displaying an image based on the first camera on any one of flat portions of the flexible display folded by the angle, based on a state of the electronic device corresponding to a sub-fold state between the unfolded state and the folded state.

[0201] For example, the action of displaying the image based on the first camera may include the action of displaying a visual object having a shape that wraps around a portion of the flexible display overlapping the first camera.

[0202] For example, the act of displaying the visual object may include an act of displaying the visual object having a complementary color of the representative color of pixels included in the flexible display.

[0203] For example, the act of displaying the image based on the first camera may include an act of determining, within the state of the electronic device corresponding to the sub-fold state, the portion of the flexible display on which the image based on the first camera is to be displayed, based on the directions of each of the first housing and the second housing.

[0204] According to one embodiment of the present invention, an electronic device as described above may include a foldable housing including a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part, a flexible display disposed on front surfaces of the first housing part, the second housing part, and the third housing part, a plurality of cameras including a first camera and a second camera disposed on the front surface corresponding to the flexible display, at least one sensor for sensing at least one of a first angle between the first housing part and the second housing part, or a second angle between the second housing part and the third housing part, at least one processor, and a memory for storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a preview image on at least a portion of the flexible display using the first camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to detect, using the at least one sensor, at least one of the changed first angle or the changed second angle while displaying a preview image on the at least a portion of the flexible display using the first camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the detection, a portion of the flexible display on which the preview image is to be displayed.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to change from the first camera to the second camera to obtain a preview image to be displayed on the portion of the flexible display.

[0205] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to change from the first camera to the second camera to obtain a preview image to be displayed on the portion of the flexible display, based at least on a property of the portion of the flexible display.

[0206] For example, the property of the portion of the flexible display may include at least one of position information of the portion of the flexible display within the flexible display, size information of the portion of the flexible display, or aspect ratio information of the portion of the flexible display.

[0207] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the preview image on the at least a portion of the flexible display using the first camera disposed on the second housing part while the foldable housing is in an unfolded state. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the acquired preview image on the determined portion disposed on the first housing part on which the second camera is disposed, in response to the foldable housing switching from the unfolded state to the folded state based on the detection.

[0208] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine that the foldable housing is in the unfolded state based on detecting the first angle and the second angle, both of which are entirely within a first angular range. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine that the foldable housing is in the folded state based on detecting the first angle within a second angular range greater than the first angular range and the second angle within a third angular range less than the first angular range.

[0209] For example, a first length of a first image sensor included in the first camera, which is parallel to the folding axis between the first housing part and the second housing part, may be shorter than a second length of the first image sensor, which is perpendicular to the folding axis. A third length of a second image sensor included in the second camera, which is parallel to the folding axis, may be longer than a fourth length of the image sensor, which is perpendicular to the folding axis.

[0210] For example, at least a portion of the flexible display on which the preview image is displayed using the first camera may have a fifth length parallel to the folding axis that is less than a sixth length perpendicular to the folding axis. The determined portion on which the preview image is displayed using the second camera may have a seventh length parallel to the folding axis that is longer than an eighth length perpendicular to the folding axis.

[0211] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object in the form of a line surrounding a portion of the flexible display that overlaps the first camera, so as to emphasize the portion of the flexible display that overlaps the first camera while displaying the preview image using the first camera.

[0212] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the visual object having a complementary color of a representative color represented by a color distribution of pixels included in the flexible display.

[0213] In one embodiment, a method of an electronic device may be provided, comprising: a foldable housing including a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part; a flexible display disposed on front surfaces of the first housing part, the second housing part, and the third housing part; a plurality of cameras disposed on the front surface corresponding to the flexible display, the cameras including a first camera and a second camera; and at least one sensor for sensing at least one of a first angle between the first housing part and the second housing part or a second angle between the second housing part and the third housing part. The method may include an operation of displaying a preview image on at least a portion of the flexible display using the first camera. The method may include an operation of detecting, using the at least one sensor, at least one of a change in the first angle or the second angle while displaying the preview image on the at least portion of the flexible display using the first camera. The method may include an operation of determining a portion of the flexible display on which a preview image is to be displayed based on the detection. The method may include an operation of switching from the first camera to the second camera to obtain a preview image to be displayed on the portion of the flexible display.

[0214] For example, the changing operation may include changing from the first camera to the second camera to obtain a preview image to be displayed on the portion of the flexible display, based at least on a property of the portion of the flexible display. The property of the portion of the flexible display may include at least one of position information of the portion of the flexible display within the flexible display, size information of the portion of the flexible display, or aspect ratio information of the portion of the flexible display.

[0215] For example, the method may include an operation of displaying the preview image on at least a portion of the flexible display using the first camera disposed on the second housing part while the foldable housing is in an unfolded state. The method may include an operation of displaying the acquired preview image on the determined portion disposed on the first housing part on which the second camera is disposed, in response to the foldable housing switching from the unfolded state to the folded state based on the detection.

[0216] For example, the determining operation may include an operation of determining that the foldable housing is in the unfolded state based on detecting all of the first angle and the second angle included in a first angle range. The determining operation may include an operation of determining that the foldable housing is in the folded state based on detecting the first angle included in a second angle range greater than the first angle range and the second angle included in a third angle range less than the first angle range.

[0217] For example, a first length of a first image sensor included in the first camera, which is parallel to the folding axis between the first housing part and the second housing part, may be shorter than a second length of the first image sensor, which is perpendicular to the folding axis. A third length of a second image sensor included in the second camera, which is parallel to the folding axis, may be longer than a fourth length of the image sensor, which is perpendicular to the folding axis.

[0218] For example, at least a portion of the flexible display on which the preview image is displayed using the first camera may have a fifth length parallel to the folding axis that is less than a sixth length perpendicular to the folding axis. The determined portion on which the preview image is displayed using the second camera may have a seventh length parallel to the folding axis that is longer than an eighth length perpendicular to the folding axis.

[0219] For example, the act of displaying the preview may include an act of displaying the visual object in the form of a line surrounding the portion of the flexible display overlapping the first camera, so as to emphasize the portion of the flexible display overlapping the first camera.

[0220] For example, the act of displaying the visual object may include an act of displaying the visual object having a complementary color of a representative color represented by a color distribution of pixels included in the flexible display.

[0221] In one embodiment, an electronic device may include a foldable housing including a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part, a flexible display disposed on front surfaces of the first housing part, the second housing part, and the third housing part, and a plurality of cameras including a first camera and a second camera disposed on the front surface corresponding to the flexible display. The plurality of cameras may include a first camera disposed on the second housing part and a second camera disposed on the first housing part. The electronic device may include a plurality of sensors including a first sensor for detecting a first angle between the first housing part and the second housing part and a second sensor for detecting a second angle between the second housing part and the third housing part, at least one processor, and a memory for storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to control the first camera to display a first preview image on the entire display area of ​​the flexible display while the foldable housing is in an unfolded state detected by the first angle and the second angle. An aspect ratio of the entire display area may correspond to an aspect ratio of an image sensor included in the first camera. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to obtain sensor data from the plurality of sensors to detect whether the foldable housing within the unfolded state switches to another state while the preview image is displayed on the entire display area of ​​the flexible display.The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to control the second camera to display a second preview image on the portion of the display area on the first housing part in response to the foldable housing switching from the unfolded state to a folded state in which the portion of the display area on the first housing part is visible. An aspect ratio of the portion may correspond to an aspect ratio of an image sensor included in the second camera.

[0222] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to control the first camera to display a third preview image on the entire display area of ​​the flexible display and to stop displaying the second preview image on the portion, in response to the foldable housing switching from the folded state to the unfolded state.

[0223] For example, a first length of the image sensor included in the first camera, which is parallel to the folding axis between the first housing part and the second housing part, may be shorter than a second length of the image sensor included in the first camera, which is perpendicular to the folding axis. A third length of the image sensor included in the second camera, which is parallel to the folding axis, may be longer than a fourth length of the image sensor included in the second camera, which is perpendicular to the folding axis.

[0224] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine that the foldable housing is in the unfolded state based on detecting the first angle and the second angle that are entirely within a specified angular range that includes a flat angle. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine that the foldable housing is in the folded state based on detecting the first angle that is greater than the specified angular range and the second angle that is less than the specified angular range.

[0225] For example, the height of the first preview image may be shorter than the width of the first preview image. The height of the second preview image may be longer than the width of the second preview image.

[0226] In one embodiment, a method of an electronic device may be provided, comprising: a foldable housing including a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part; a flexible display disposed on front surfaces of the first housing part, the second housing part, and the third housing part; a plurality of cameras including a first camera and a second camera disposed on the front surface corresponding to the flexible display; the plurality of cameras including a first camera disposed on the second housing part and a second camera disposed on the first housing part; and a plurality of sensors including a first sensor for detecting a first angle between the first housing part and the second housing part and a second sensor for detecting a second angle between the second housing part and the third housing part. The method may include controlling the first camera to display a first preview image on the entire display area of ​​the flexible display while the foldable housing is in an unfolded state detected by the first angle and the second angle. An aspect ratio of the entire display area may correspond to an aspect ratio of an image sensor included in the first camera. The method may include acquiring sensor data from the plurality of sensors to detect whether the foldable housing within the unfolded state switches to another state while the preview image is displayed on the entire display area of ​​the flexible display. The method may include controlling the second camera to display a second preview image on a portion of the display area on the first housing part in response to the foldable housing switching from the unfolded state to a folded state in which the portion of the display area on the first housing part is visible.The aspect ratio of the above part may correspond to the aspect ratio of the image sensor included in the second camera.

[0227] For example, the method may include, in response to the foldable housing switching from the folded state to the unfolded state, controlling the first camera to display a third preview image on the entire display area of ​​the flexible display and stopping displaying the second preview image on the portion.

[0228] For example, a first length of the image sensor included in the first camera, which is parallel to the folding axis between the first housing part and the second housing part, may be shorter than a second length of the image sensor included in the first camera, which is perpendicular to the folding axis. A third length of the image sensor included in the second camera, which is parallel to the folding axis, may be longer than a fourth length of the image sensor included in the second camera, which is perpendicular to the folding axis.

[0229] For example, the acquiring operation may include an operation of determining that the foldable housing is in the unfolded state based on detecting the first angle and the second angle that are entirely within a specified angular range including a flat angle. The acquiring operation may include an operation of determining that the foldable housing is in the folded state based on detecting the first angle that is greater than the specified angular range and the second angle that is less than the specified angular range.

[0230] For example, the height of the first preview image may be shorter than the width of the first preview image. The height of the second preview image may be longer than the width of the second preview image.

[0231] In one embodiment, an electronic device may include a first housing, a second housing rotatably coupled to the first housing between a folded state and an unfolded state, a flexible display disposed on the first housing and the second housing, and a first camera disposed on one surface of the second housing corresponding to the flexible display. The first camera may include a first image sensor, and a first length of the first image sensor parallel to a folding axis between the first housing and the second housing may be shorter than a second length of the first image sensor perpendicular to the folding axis. The electronic device may include a second camera disposed on the one surface of the first housing. The second camera may include a second image sensor, and a third length of the second image sensor parallel to the folding axis may be longer than a fourth length perpendicular to the folding axis. The electronic device may include at least one processor, and a memory storing instructions. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display a preview image on at least a portion of the flexible display using the first camera or the second camera. The camera used to display the preview image among the first camera or the second camera may be changed depending on the posture of the first housing and the second housing.

[0232] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the preview image using the first camera while the first housing and the second housing are in an unfolded state.

[0233] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the preview image using the second camera while the first housing and the second housing are in a folded state.

[0234] For example, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to display the preview image on a portion of the flexible display disposed on the first housing while the first housing and the second housing are in the folded state.

[0235] For example, the electronic device may include a sensor configured to detect an angle between the first housing and the second housing. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on the data from the sensor, at least a portion of the flexible display corresponding to the preview image. The instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to determine, based on an aspect ratio of the determined at least portion, which of the first camera or the second camera is to be used to display the preview image.

[0236] The devices described above may be implemented as hardware components, software components, and / or a combination of hardware components and software components. For example, the devices and components described in the embodiments may be implemented using one or more general-purpose computers or special-purpose computers, such as a processor, a controller, an arithmetic logic unit (ALU), a digital signal processor, a microcomputer, a field programmable gate array (FPGA), a programmable logic unit (PLU), a microprocessor, or any other device capable of executing instructions and responding to them. The processing device may execute an operating system (OS) and one or more software applications running on the operating system. The processing device may also access, store, manipulate, process, and generate data in response to the execution of the software. For ease of understanding, the processing device is sometimes described as being used alone; however, one of ordinary skill in the art will recognize that the processing device may include multiple processing elements and / or multiple types of processing elements. For example, a processing unit may include multiple processors, or a processor and a controller. Other processing configurations, such as parallel processors, are also possible.

[0237] Software may include a computer program, code, instructions, or a combination of one or more of these, which may configure a processing device to perform a desired operation or may independently or collectively command the processing device. The software and / or data may be embodied in any type of machine, component, physical device, computer storage medium, or device for interpretation by the processing device or for providing instructions or data to the processing device. The software may also be distributed over networked computer systems and stored or executed in a distributed manner. The software and data may be stored on one or more computer-readable recording media.

[0238] The method according to the embodiment may be implemented in the form of program commands that can be executed through various computer means and recorded on a computer-readable medium. In this case, the medium may be one that continuously stores a computer-executable program or one that temporarily stores it for execution or download. In addition, the medium may be various recording means or storage means in the form of a single or multiple hardware combinations, and is not limited to a medium directly connected to a computer system, but may also be distributed over a network. Examples of the medium may include magnetic media such as hard disks, floppy disks, and magnetic tapes, optical recording media such as CD-ROMs and DVDs, magneto-optical media such as floptical disks, and those configured to store program commands, including ROM, RAM, and flash memory. In addition, examples of other media may include recording media or storage media managed by app stores that distribute applications, sites that supply or distribute various software, servers, etc.

[0239] Although the embodiments described above have been described by way of limited examples and drawings, those skilled in the art will appreciate that various modifications and variations can be made based on the above teachings. For example, appropriate results can still be achieved even if the described techniques are performed in a different order than described, and / or components of the described systems, structures, devices, circuits, etc. are combined or combined in a different manner than described, or are replaced or substituted with other components or equivalents.

[0240] Therefore, other implementations, other embodiments, and equivalents to the claims also fall within the scope of the claims described below.

Claims

1. In electronic devices, A foldable housing comprising a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part; A flexible display disposed on the front surfaces of the first housing part, the second housing part, and the third housing part; A plurality of cameras including a first camera and a second camera, arranged on the front surface corresponding to the flexible display; At least one sensor for sensing at least one of a first angle between the first housing part and the second housing part, or a second angle between the second housing part and the third housing part; at least one processor; and A memory for storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Displaying a preview image on at least a portion of the flexible display using the first camera; and While displaying a preview image on at least a portion of the flexible display using the first camera, detecting at least one of the changed first angle or the second angle using the at least one sensor, Based on the above detection, a portion of the flexible display on which the preview image is to be displayed is determined, and causing a change from the first camera to the second camera to obtain a preview image to be displayed on the part of the flexible display; Electronic devices.

2. In claim 1, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based at least on the properties of said part of said flexible display, changing from said first camera to said second camera to obtain a preview image to be displayed on said part of said flexible display, The property of the part of the flexible display includes at least one of position information of the part of the flexible display within the flexible display, size information of the part of the flexible display, or aspect ratio information of the part of the flexible display. Electronic devices.

3. In claim 1, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While the foldable housing is in an unfolded state, the preview image is displayed on at least a portion of the flexible display using the first camera disposed on the second housing part, In response to the foldable housing switching from the unfolded state to the folded state based on the detection, causing the acquired preview image to be displayed on the determined portion disposed on the first housing part on which the second camera is disposed. Electronic devices.

4. In claim 3, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on detecting the first angle and the second angle, which are entirely included in the first angle range, determining that the foldable housing is in the unfolded state; Causing the foldable housing to be determined to be in a folded state based on detecting the first angle included in a second angle range greater than the first angle range and the second angle included in a third angle range smaller than the first angle range. Electronic devices.

5. In claim 1, a first length of the first image sensor included in the first camera, which is parallel to the folding axis between the first housing part and the second housing part, is smaller than a second length of the first image sensor, which is perpendicular to the folding axis; and The third length of the second image sensor included in the second camera, which is parallel to the folding axis, is longer than the fourth length of the image sensor, which is perpendicular to the folding axis. Electronic devices.

6. In claim 1, at least a portion of the flexible display on which the preview image is displayed using the first camera has a fifth length parallel to the folding axis, which is less than a sixth length perpendicular to the folding axis, and The determined portion on which the preview image is displayed using the second camera has a seventh length parallel to the folding axis and longer than the eighth length perpendicular to the folding axis. Electronic devices.

7. In claim 1, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: While displaying the preview image using the first camera, causing the visual object to be displayed in the form of a line surrounding the portion of the flexible display overlapped with the first camera, in order to emphasize the portion of the flexible display overlapped with the first camera. Electronic devices.

8. In claim 7, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Causing the visual object to be displayed having a complementary color of a representative color represented by the color distribution of pixels included in the flexible display. Electronic devices.

9. A method of an electronic device comprising a foldable housing including a first housing part, a second housing part rotatably coupled with the first housing part, and a third housing part rotatably coupled with the second housing part, a flexible display disposed on the front surfaces of the first housing part, the second housing part, and the third housing part, a plurality of cameras including a first camera and a second camera disposed on the front surface corresponding to the flexible display, and at least one sensor for sensing at least one of a first angle between the first housing part and the second housing part, or a second angle between the second housing part and the third housing part, An operation of displaying a preview image on at least a portion of the flexible display using the first camera; and An action of detecting at least one of the changed first angle or the second angle using the at least one sensor while displaying a preview image on at least a portion of the flexible display using the first camera; An operation of determining a portion of the flexible display on which a preview image is to be displayed based on the above detection, and Including an operation of changing from the first camera to the second camera to obtain a preview image to be displayed on the part of the flexible display. method.

10. In claim 9, the changing operation is: Further comprising an action of changing from the first camera to the second camera to obtain a preview image to be displayed on the part of the flexible display, based at least on a property of the part of the flexible display; The property of the part of the flexible display includes at least one of position information of the part of the flexible display within the flexible display, size information of the part of the flexible display, or aspect ratio information of the part of the flexible display. method.

11. In claim 9, An operation of displaying the preview image on at least a portion of the flexible display using the first camera disposed on the second housing part while the foldable housing is in an unfolded state; Further comprising an operation of displaying the acquired preview image on the determined portion disposed on the first housing part on which the second camera is disposed, in response to the foldable housing switching from the unfolded state to the folded state based on the detection. method.

12. In claim 11, the determining action is: An action of determining that the foldable housing is in the unfolded state based on detecting all of the first angle and the second angle included in the first angle range; An operation of determining that the foldable housing is in a folded state based on detecting the first angle included in a second angle range greater than the first angle range and the second angle included in a third angle range less than the first angle range, method.

13. In claim 9, a first length of the first image sensor included in the first camera, which is parallel to the folding axis between the first housing part and the second housing part, is smaller than a second length of the first image sensor, which is perpendicular to the folding axis; and The third length of the second image sensor included in the second camera, which is parallel to the folding axis, is longer than the fourth length of the image sensor, which is perpendicular to the folding axis. method.

14. In claim 9, at least a portion of the flexible display on which the preview image is displayed using the first camera has a fifth length parallel to the folding axis, which is less than a sixth length perpendicular to the folding axis, and The determined portion on which the preview image is displayed using the second camera has a seventh length parallel to the folding axis and longer than the eighth length perpendicular to the folding axis. method.

15. In claim 9, the action of displaying the preview is: An operation of displaying the visual object, which has the form of a line surrounding the portion of the flexible display overlapping the first camera, to emphasize the portion of the flexible display overlapping the first camera. method.

Citation Information

Patent Citations

  • Mobile terminal and control method thereof

    KR1020160033507A

  • The Apparatus and Method for Portable Device

    KR102171450B1

  • Portable device and method for controlling same

    US20170293383A1

  • Electronic device controlling screen based on folding event and method for controlling the same

    WO2020235885A1

  • KR20230038290A