Electronic device for executing application software by using camera
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- Filing Date
- 2025-12-15
- Publication Date
- 2026-08-13
Smart Images

Figure KR2025021760_13082026_PF_FP_ABST
Abstract
Description
An electronic device that runs application software using a camera
[0001] The following descriptions relate to an electronic device that runs application software using a camera.
[0002] An electronic device can identify an event for acquiring an image through a camera using application software. For example, the electronic device can identify candidate cameras for the application software among a plurality of cameras based on the event.
[0003] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.
[0004] According to one embodiment, a multi-foldable electronic device is provided. The multi-foldable electronic device may include a housing, a flexible display, a display, a plurality of cameras, at least one processor including a processing circuit, and a memory including one or more storage media for storing instructions. The housing may include a first housing part, a second housing part rotatably coupled to the first housing part, and a third housing part rotatably coupled to the second housing part. The flexible display may define at least a portion of the front side of the first housing part, at least a portion of the front side of the second housing part, and at least a portion of the front side of the third housing part. The display may define at least a portion of the rear side of the second housing part. The plurality of cameras may include at least one first camera visible through a portion of the flexible display disposed within the third housing part, second cameras disposed within the third housing part and visible from the rear side of the third housing part, and at least one third camera visible through the display. The instructions may cause a multi-foldable electronic device to acquire a first image through at least one of the second cameras using the first application software, when executed individually or collectively by at least one processor. The instructions may cause a multi-foldable electronic device to identify an event for acquiring a second image using the second application software, when executed individually or collectively by at least one processor.The instructions may cause the multi-foldable electronic device to identify each of at least one first camera, at least one second camera excluding at least one second camera, or at least one third camera as a candidate camera to be used for the second application software, based on an event being identified while the multi-foldable electronic device is in an unfolded state in which the first housing part and the second housing part are unfolded and the second housing part and the third housing part are unfolded, or in a single-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are unfolded. The instructions may cause the multi-foldable electronic device to identify each of the second cameras or at least one of the third cameras, excluding at least one second camera, as a candidate camera to be used for the second application software, based on the identification of an event while the multi-foldable electronic device is in a multi-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are folded, when executed individually or collectively by at least one processor.
[0005] According to one embodiment, a multi-foldable electronic device is provided. The multi-foldable electronic device may include a housing, a flexible display, a display, a plurality of cameras, at least one processor including a processing circuit, and a memory including one or more storage media for storing instructions. The housing may include a first housing part, a second housing part rotatably coupled to the first housing part, and a third housing part rotatably coupled to the second housing part. The flexible display may define at least a portion of the front side of the first housing part, at least a portion of the front side of the second housing part, and at least a portion of the front side of the third housing part. The display may define at least a portion of the rear side of the third housing part. The plurality of cameras may include at least one first camera visible through a portion of the flexible display disposed within the second housing part, second cameras disposed within the second housing part and visible from the rear side of the second housing part, and at least one third camera visible through the display. The instructions may cause a multi-foldable electronic device to acquire a first image through at least one of the second cameras using the first application software, when executed individually or collectively by at least one processor. The instructions may cause a multi-foldable electronic device to identify an event for acquiring a second image using the second application software, when executed individually or collectively by at least one processor.The instructions may cause the multi-foldable electronic device to identify each of at least one camera among at least one first camera, at least one second camera excluding at least one second camera, or at least one third camera as a candidate camera to be used for the second application software, based on an event being identified while the multi-foldable electronic device is in an unfolded state in which the first housing part and the second housing part are unfolded and the second housing part and the third housing part are unfolded when executed individually or collectively by at least one processor. The instructions may cause the multi-foldable electronic device to identify each of the second cameras or at least one of the third cameras, excluding at least one second camera, as a candidate camera to be used for the second application software, based on an event being identified while the multi-foldable electronic device is in a single-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are unfolded, or in a multi-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are folded.
[0006] According to one embodiment, an electronic device is provided. It may include a camera, at least one processor including a processing circuit, and a memory including one or more storage media for storing instructions. The instructions may cause the electronic device to acquire a first image through the camera using first application software when executed individually or collectively by at least one processor. The instructions may cause the electronic device to identify an event to acquire a second image through the camera using second application software while acquiring the first image using first application software when executed individually or collectively by at least one processor. The instructions may cause the electronic device to identify a buffer used to acquire the first image to maintain the acquisition of the first image through the camera using first application software based on the event when executed individually or collectively by at least one processor. When the instructions are executed individually or collectively by at least one processor, they may cause an electronic device to acquire a second image corresponding to a first image by accessing an identified buffer using second application software.
[0007] Figure 1 is a schematic view of an exemplary electronic device.
[0008] FIGS. 2a, FIGS. 2b, and FIGS. 2c are drawings according to one embodiment of an electronic device.
[0009] FIG. 3a illustrates an example of an environment for identifying the state of an electronic device.
[0010] FIG. 3b illustrates an example of an operating system environment for using multiple cameras through different applications.
[0011] FIGS. 4a, FIGS. 4b, and FIGS. 4c are flowcharts illustrating a method for identifying candidate cameras for different applications based on the state of an electronic device while an image is acquired through a camera using an application.
[0012] FIG. 4d is a flowchart illustrating a method for identifying cameras for each of the different applications running on an electronic device.
[0013] FIG. 4e is a flowchart illustrating a method for identifying a camera for a different application based on the state of the electronic device while an image is acquired through the camera using an application.
[0014] FIGS. 5a and 5b are examples of environments in which candidate cameras for other applications are identified while an image is acquired through a camera using an application in an unfolded state.
[0015] FIGS. 6a and 6b are examples of environments in which candidate cameras for other applications are identified while an image is acquired through a camera using an application in a multi-folding state.
[0016] Figure 7 is an example of an environment in which candidate cameras for other applications are identified while an image is acquired through a camera using an application while the electronic device is partially folded.
[0017] FIG. 8 is a flowchart illustrating a method for identifying candidate cameras for different applications based on the scene of the image while an image is acquired through a camera using an application.
[0018] Figure 9 is an example of an environment in which different applications within an electronic device share the same camera.
[0019] FIGS. 10a and FIGS. 10b are examples of environments in which different applications share a camera based on the scene of the image acquired while the image is acquired through the camera using an application.
[0020] FIG. 11 is a flowchart illustrating a method of capturing an image by changing the camera settings while two applications share the same camera.
[0021] FIG. 12 is a flowchart illustrating a method of capturing an image by maintaining camera settings while two applications share the same camera.
[0022] FIGS. 13a, FIGS. 13b, and FIGS. 13c are drawings according to one embodiment of an electronic device.
[0023] FIGS. 14a and FIGS. 14b are flowcharts illustrating a method for identifying candidate cameras for an application among a plurality of cameras based on the state of an electronic device.
[0024] FIG. 15 is a block diagram of an electronic device in a network environment according to various embodiments.
[0025] Figure 1 is a schematic view of an exemplary electronic device.
[0026] According to one embodiment, referring to FIG. 1, the electronic device (100) may include at least one processor (10), a memory (20), a plurality of cameras (30), at least one sensor (40), a flexible display (140), and / or a display (170). For example, the electronic device (100) may be described as a multi-foldable electronic device having a tri-fold housing structure. For example, the tri-fold housing structure may include a first housing part, a second housing part rotatably coupled to the first housing part, and a third housing part rotatably coupled to the second housing part. For example, the electronic device (100) may include at least a part of the electronic device (1501) of FIG. 15 or correspond to at least a part of the electronic device (1501) of FIG. 15.
[0027] According to one embodiment, at least one processor (10) may include a processing circuit. At least one processor (10) may include a single processor or multiple processors. At least one processor (10) may control the memory (20) and / or one or more components (e.g., a plurality of cameras (30), at least one sensor (40), a flexible display (140), and / or a display (170)) of the electronic device (100). For example, at least one processor (10) may include at least a part of the processor (1520) of FIG. 15 or correspond to at least a part of the processor (1520) of FIG. 15.
[0028] According to one embodiment, the memory (20) may store one or more programs configured to be executed individually and / or collectively by at least one processor (10). One or more programs may include instructions. The instructions may cause the electronic device (100) to perform operations described with reference to FIGS. 2a through 14b. The memory (20) may include one or more storage media. At least some of the one or more programs may be available to manage, control, and / or execute a software application using a camera, as described below. For example, the memory (20) may include at least some of the memory (1530) of FIG. 15 or correspond to at least some of the memory (1530) of FIG. 15.
[0029] According to one embodiment, each of the plurality of cameras (30) can capture (or shoot) an image (e.g., a still image) and / or video. For example, each of the plurality of cameras (30) may include one or more lenses, image sensors, and / or flashes. For example, the plurality of cameras (30) may include at least a part of the camera module (1580) of FIG. 15 or correspond to at least a part of the camera module (1580) of FIG. 15.
[0030] According to one embodiment, at least one sensor (40) may be used to identify the state of the electronic device (100). For example, the state of the electronic device (100) may correspond to an unfolded state, a single-folded state, or a multi-folded state. For example, the state of the electronic device (100) may be identified according to the folding state between the first housing part of the electronic device (100), the second housing part of the electronic device (100) rotatably coupled to the first housing part, and the third housing part of the electronic device (100) rotatably coupled to the second housing part. For example, the unfolded state may be a state in which the first housing part and the second housing part are unfolded, and the second housing part and the third housing part are unfolded. For example, a single-folding state may be a state in which the first housing part and the second housing part are folded, and the second housing part and the third housing part are unfolded. For example, a multi-folding state may be a state in which the first housing part and the second housing part are folded, and the second housing part and the third housing part are folded. For example, at least one sensor (40) may include one or more sensors for identifying the state of the electronic device (100). For example, one or more sensors may include Hall sensors for identifying the state of the electronic device (100). For example, each Hall sensor may be included in another housing part of the electronic device (100) to form a pair with a magnet in the housing part of the electronic device (100). For example, one or more sensors may include accelerometer sensors and / or gyroscope sensors for identifying the state of the electronic device (100).For example, among the acceleration sensors, the first acceleration sensor may be included in the first housing part, the second acceleration sensor may be included in the second housing part, and the third acceleration sensor may be included in the third housing part. For example, among the gyro sensors, the first gyro sensor may be included in the first housing part, the second gyro sensor may be included in the second housing part, and the third gyro sensor may be included in the third housing part.
[0031] According to one embodiment, at least one sensor (40) may be used to identify the orientation (or rotational state) of an electronic device (100). For example, the orientation of the electronic device (100) may be represented by a rotation angle along an axis (e.g., x-axis, y-axis, and / or z-axis). For example, at least one sensor (40) may include one or more sensors for identifying the orientation of the electronic device (100). For example, one or more sensors may include a gyroscope sensor. For example, at least one sensor (40) may include at least a part of the sensor module (1576) of FIG. 15 or correspond to at least a part of the sensor module (1576) of FIG. 15.
[0032] According to one embodiment, the flexible display (140) can visually provide information to the outside of the electronic device (100) (e.g., a user). For example, the flexible display (140) can define the front sides of the housing parts included in the electronic device (100). For example, the flexible display (140) can define at least a portion of the front side of the first housing part, at least a portion of the front side of the second housing part, and / or at least a portion of the front side of the third housing part. For example, the flexible display (140) may include a display panel, a touch sensor, and / or a processing circuit. For example, the display panel may be used to display visual information (e.g., an image, a screen, an object, a UI (user interface), a GUI (graphic user interface), and / or a visual object). For example, the display panel may have a display area capable of receiving touch input. For example, the display area may include three or more display areas corresponding to each of the housing parts. For example, a touch sensor may be used to acquire data about an external object located on a display panel. For example, the touch sensor may be located within or on the display panel to provide an area of the display panel capable of receiving touch input. For example, the touch sensor may be configured to acquire data about contact points on at least a portion of the area. For example, a processing circuit may control the touch sensor. For example, the processing circuit may process signals or data acquired (or received) through the touch sensor. The flexible display (140) may include at least a portion of the display module (1560) of FIG. 15 or correspond to at least a portion of the display module (1560) of FIG. 15.
[0033] According to one embodiment, the display (170) can visually provide information to an external (e.g., user) outside the electronic device (100). The display (170) may define at least a portion of the rear side of one of the housing parts (e.g., a first housing part, a second housing part, or a third housing part) included in the electronic device (100). For example, the display (170) may include a display panel, a touch sensor, and / or a processing circuit. For example, the display panel may be used to display visual information (e.g., an image, a screen, an object, a UI (user interface), a GUI (graphic user interface), and / or a visual object). For example, the display panel may have a display area capable of receiving touch input. For example, the touch sensor may be used to obtain data about an external object located on the display panel. For example, the touch sensor may be located within or on the display panel to provide an area of the display panel capable of receiving touch input. For example, a touch sensor may be configured to acquire data for contact points on at least a portion of an area. For example, a processing circuit may control the touch sensor. For example, a processing circuit may process signals or data acquired (or received) through the touch sensor. For example, a display (170) may include at least a portion of the display module (1560) of FIG. 15 or correspond to at least a portion of the display module (1560) of FIG. 15.
[0034] FIGS. 2a, FIGS. 2b, and FIGS. 2c are drawings according to one embodiment of an electronic device.
[0035] According to one embodiment, FIG. 2a illustrates an example of an unfolded state (200a) of an electronic device (100). FIG. 2b illustrates an example of a single-folded state (200b) of an electronic device (100). FIG. 2c illustrates an example of a multi-folded state (200c) of an electronic device (100).
[0036] According to one embodiment, with reference to FIGS. 2a, 2b, and 2c, an electronic device (100) may include a plurality of cameras (30), a housing structure (101), a flexible display (140), a first hinge structure (150), a second hinge structure (160), and / or a display (170). The plurality of cameras (30) may include a camera (31), a camera (32), a camera (33), a camera (34), and / or a camera (35). The housing structure (101) may include a first housing part (110), a second housing part (120), and / or a third housing part (130).
[0037] According to one embodiment, the camera (31) is positioned within the third housing part (130) and can be seen through a portion of the flexible display (140) positioned within the third housing part (130). The camera (31) may be referred to as an internal front camera (or selfie camera) in terms of being seen through the flexible display (140) defining the front side of the first housing part (110), the front side of the second housing part (120), and / or the front side of the third housing part (130).
[0038] According to one embodiment, each of the camera (32), camera (33), and / or camera (34) is disposed within the third housing part (130) and may be visible from the rear side of the third housing part (130). Each of the camera (32), camera (33), and / or camera (34) may be referred to as a rear camera in terms of being visible from the rear side of the third housing part (130). The camera (32), camera (33), and / or camera (34) may have different field of view (FOV) ranges. For example, the camera (32) may be described as an ultra-wide angle camera having a first field of view range. For example, the camera (33) may be described as a wide angle camera having a second field of view range lower than the first field of view range. For example, the camera (34) may be described as a telephoto camera having a third field of view range lower than the second field of view range.
[0039] According to one embodiment, the camera (31), camera (32), camera (33), and / or camera (34) are placed within a housing part (e.g., a third housing part (130)), so that at least one processor (10) of the electronic device (100) can increase the speed of processing images obtained from the camera.
[0040] According to one embodiment, the camera (35) is positioned within the second housing part (120) and can be seen through a display (170) positioned within the second housing part (120). The camera (35) may be referred to as an external front camera (or selfie camera) in terms of being seen through a display (170) that defines the rear side of the second housing part (120).
[0041] According to one embodiment, the first housing part (110) may be rotatably coupled to the second housing part (120) by a first hinge structure (150). The second housing part (120) and the first housing part (110) may be rotated with respect to the first hinge structure (150). While the first housing part (110) is rotated with respect to the first hinge structure (150), the second housing part (120) may be rotated with respect to the first hinge structure (150). For example, when the second housing part (120) and the first housing part (110) are rotated with respect to the first hinge structure (150), the angular displacement of the second housing part (120) may be substantially the same as the angular displacement of the first housing part (110).
[0042] According to one embodiment, the third housing part (130) may be rotatably coupled to the second housing part (120) by a second hinge structure (160). The second housing part (120) and the third housing part (130) may be rotated about the second hinge structure (160). While the second housing part (120) is rotated about the second hinge structure (160), the third housing part (130) may be rotated about the second hinge structure (160). For example, when the second housing part (120) and the third housing part (130) are rotated about the second hinge structure (160), the angular displacement (or angular change) of the second housing part (120) may be substantially the same as the angular displacement of the third housing part (130).
[0043] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can change the state of the electronic device (100). The first hinge structure (150) and the second hinge structure (160) can provide (or enable) an unfolded state (200a) of the electronic device (100). The unfolded state (200a) of the electronic device (100) can be described as a state in which the first housing part (110) and the second housing part (120) are unfolded, and the second housing part (120) and the third housing part (130) are unfolded. Within the unfolded state (200a), the front side of the first housing part (110), the front side of the second housing part (120), and / or the front side of the third housing part (130) can define the front side of the electronic device (100). In the unfolded state (200a), the front side of the first housing part (110), the front side of the second housing part (120), and / or the front side of the third housing part (130) may face in the same direction. In the unfolded state (200a), the electronic device (100) may provide the user with a large display area of the flexible display (140).
[0044] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can provide a single-folding state (200b) of the electronic device (100). The single-folding state (200b) of the electronic device (100) can be described as a state in which the first housing part (110) and the second housing part (120) are folded, and the second housing part (120) and the third housing part (130) are unfolded. For example, within the single-folding state (200b), the front side of the second housing part (120) and the front side of the third housing part (130) may face in the same direction, and the front side of the first housing part (110) and the front side of the second housing part (120) may face in opposite directions. In a single-fold state (200b), the electronic device (100) can provide visual information through a part of the flexible display (140) (e.g., a third display area (140c)).
[0045] According to one embodiment, the electronic device (100) can change from an unfolded state (200a) to a multi-folded state (200c) through a single-folded state (200b). For example, the state of the electronic device (100) can change from an unfolded state (200a) to a single-folded state (200b). The state of the electronic device (100) can change from a single-folded state (200b) to a multi-folded state (200c). For example, when the state of the electronic device (100) changes from a single-folded state (200b) to a multi-folded state (200c), the folded first housing part (110) and the second housing part (120) can be placed on a third housing part (130).
[0046] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can provide a multi-folding state (200c) of the electronic device (100). The multi-folding state (200c) of the electronic device (100) can be described as a state in which the first housing part (110) and the second housing part (120) are folded, and the second housing part (120) and the third housing part (130) are folded. In the multi-folding state (200c), the front side of the first housing part (110) and the front side of the second housing part (120) may face in opposite directions, and the front side of the second housing part (120) and the front side of the third housing part (130) may face in opposite directions. In the multi-folding state (200c), the front side of the first housing part (110) and the front side of the third housing part (130) may face each other in the same direction. For example, in the multi-folding state (200c), the front side of the second housing part (120) may face the front side of the first housing part (110), and the front side of the third housing part (130) may face the rear side of the first housing part (110). In the multi-folding state (200c), the rear side of the second housing part (120) may be exposed to the outside. A display (170) may be placed on the rear side of the second housing part (120). In the multi-folding state (200c), the rear side of the third housing part (130) may be exposed to the outside. In a multi-folding state (200c), the electronic device (100) can be folded to improve portability and can provide visual information through a display (170) placed in a second housing part (120).
[0047] According to one embodiment, the electronic device (100) may further include a key button (139). The key button (139) may be exposed from a structure (e.g., an opening) formed on the side of the third housing part (130) and may partially protrude outside the electronic device (100). The key button (139) may provide physical input to a processing circuit inside the electronic device (100) by pressure transmitted from the outside. The key button (139) may be implemented in other forms, such as a soft key that is not included in the electronic device (100) but is displayed on a flexible display (140) or a display (170).
[0048] According to one embodiment, the key button (139) may be positioned on the side of the third housing part (130) so as to be exposed to the outside in the multi-folding state (200c). As the key button (139) is positioned on the side of the third housing part (130), it may be positioned in the direction in which the side of the third housing part (130) faces. Even if the display (170) in the multi-folding state (200c) is changed to the unfolded state (200a) by a user, the position of the key button (139) positioned on the side of the third housing part (130) may not be moved. For example, referring to FIG. 2a, in the unfolded state (200a), when the flexible display (140) is viewed from above, the key button (139) may be positioned on the right side. Referring to FIG. 2c, in the multi-folding state (200c), when viewing the display (170) from above, the key button (139) can be positioned on the right side.
[0049] According to one embodiment, the flexible display (140) may define the appearance of the electronic device (100) at least partially. The flexible display (140) may be partially disposed within the housing structure (101). The flexible display (140) may define the front side of the electronic device (100). The flexible display (140) may include a first unbendable portion (141), a second unbendable portion (142), a third unbendable portion (143), a first bendable portion (144), and / or a second bendable portion (145). The first unbendable portion (141) of the flexible display (140) may be disposed on the front side of the first housing part (110). A second unbendable portion (142) of the flexible display (140) may be placed on the front side of the second housing part (120). A third unbendable portion (143) of the flexible display (140) may be placed on the front side of the third housing part (130). A first bendable portion (144) of the flexible display (140) may be placed between the first unbendable portion (141) and the second unbendable portion (142) of the flexible display (140). For example, the first bendable portion (144) of the flexible display (140) may be placed on a first hinge structure (150) connecting the first housing part (110) and the second housing part (120). The second bendable portion (145) of the flexible display (140) may be positioned between the second unbendable portion (142) and the third unbendable portion (143) of the flexible display (140). For example, the second bendable portion (145) of the flexible display (140) may be positioned on a second hinge structure (160) connecting the second housing part (120) and the third housing part (130).
[0050] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) may have the first unbendable portion (141) of the flexible display (140), the second unbendable portion (142) of the flexible display (140), and / or the third unbendable portion (143) of the flexible display (140) oriented substantially in the same direction. In the unfolded state (200a), the first bendable portion (144) and the second bendable portion (145) may be positioned in a horizontal plane substantially in the same direction as the first unbendable portion (141), the second unbendable portion (142), and / or the third unbendable portion (143).
[0051] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can provide a single-folding state (200b) of the electronic device (100). In the single-folding state (200b), the first unbendable portion (141) of the flexible display (140) may face the second unbendable portion (142) of the flexible display (140), and the third unbendable portion (143) of the flexible display (140) may face the same direction as the second unbendable portion (142) of the flexible display (140). For example, the second unbendable portion (142) and the third unbendable portion (143) may be positioned substantially on the same horizontal plane.
[0052] According to one embodiment, in a single-folding state (200b), the first bendable portion (144) of the flexible display (140) is bent by the first hinge structure (150), so that the first bendable portion (144) of the flexible display (140) can be folded such that the first unbendable portion (141) of the flexible display (140) and the second unbendable portion (142) of the flexible display (140) face in different directions.
[0053] According to one embodiment, in a single-folding state (200b), the second bendable portion (145) of the flexible display (140) is maintained in an unfolded state by the second hinge structure (160), so that the second bendable portion (145) of the flexible display (140) can be unfolded such that the second unbendable portion (142) of the flexible display (140) and the third unbendable portion (143) of the flexible display (140) face in the same direction.
[0054] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can provide a multi-folding state (200c) of the electronic device (100). In the multi-folding state (200c), the second unbendable portion (142) of the flexible display (140) may face the first unbendable portion (141) of the flexible display (140), and the third unbendable portion (143) of the flexible display (140) may face the rear side of the first housing part (110).
[0055] According to one embodiment, in a multi-folding state (200c), the first bendable portion (144) of the flexible display (140) is bent by the first hinge structure (150), so that the first bendable portion (144) of the flexible display (140) can be folded such that the first unbendable portion (141) of the flexible display (140) and the second unbendable portion (142) of the flexible display (140) face in different directions.
[0056] According to one embodiment, in a multi-folding state (200c), the second bendable portion (145) of the flexible display (140) is bent by the second hinge structure (160), so that the second bendable portion (145) of the flexible display (140) can be folded such that the second unbendable portion (142) of the flexible display (140) and the third unbendable portion (143) of the flexible display (140) face in different directions. The second bendable portion (145) may further include a first deformation portion (145a), a second deformation portion (145b), and / or a flat portion (145c). The first deformation portion (145a) may be positioned between the planar portion (145c) and the second unbendable portion (142), and the second deformation portion (145b) may be positioned between the planar portion (145c) and the third unbendable portion (143). The planar portion (145c) may be positioned between the first deformation portion (145a) and the second deformation portion (145b). The planar portion (145c) may be supported by a support plate that is distinct from the hinge plates of the second hinge structure (160). Regardless of the state of the electronic device (100), the planar portion (145c) may remain flat. The first deformation part (145a) and the second deformation part (145b) are unfolded in the unfolded state (200a) and / or the single-folding state (200b), and in the multi-folding state (200c), the first deformation part (145a) and the second deformation part (145b) can be bent so that the second unbendable part (142) and the third unbendable part (143) face different directions. In the multi-folding state (200c), the first housing part (110) can be positioned between the second housing part (120) and the third housing part (130). In the multi-folding state (200c), the second bendable portion (145) of the flexible display (140) placed on the second hinge structure (160) may partially face the side (110c) of the first housing part (110).
[0057] According to one embodiment, the display area of the flexible display (140) may include a first display area (140a), a second display area (140b), and / or a third display area (140c). The display area represents an area capable of providing visual information from the flexible display (140). In the unfolded state (200a), the entire display area of the flexible display (140) may be visible from the front side of the housing structure (101). For example, in the unfolded state (200a), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may be visually exposed. The electronic device (100) may provide a large display area to the user that includes the first display area (140a), the second display area (140b), and / or the third display area (140c).
[0058] According to one embodiment, in a single-folding state (200b), the display area of the flexible display (140) may be partially visible from the front side of the third housing part (130). For example, the third display area (140c) may be visually exposed, while the first display area (140a) and the second display area (140b) may not be visually exposed.
[0059] According to one embodiment, within the multi-folding state (200c), the display area of the flexible display (140) may not be visible. For example, within the multi-folding state (200c), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may not be visually exposed.
[0060] According to one embodiment, as a non-limiting example, when the flexible display (140) is used to display a screen within the unfolded state (200a) of the electronic device (100), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may be activated. As a non-limiting example, within the multi-folding state (200c), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may be deactivated. In a non-limiting example, within a single-folding state (200b) of the electronic device (100), when the flexible display (140) is used to display a screen, the third display area (140c) may be activated, and the first display area (140a) and the second display area (140b) of the flexible display (140) may be deactivated.
[0061] According to one embodiment, as a non-limiting example, when the flexible display (140) is used to display a screen within the unfolded state (200a) of the electronic device (100), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may display visual information. As a non-limiting example, within the multi-folding state (200c), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may provide a black image. As a non-limiting example, within a single-folding state (200b) of the electronic device (100), when the flexible display (140) is used to display a screen, the third display area (140c) may provide visual information, and the first display area (140a) and the second display area (140b) of the flexible display (140) may provide a black image.
[0062] FIG. 3a illustrates an example of an environment for identifying the state of an electronic device.
[0063] According to one embodiment, with reference to FIG. 3a, an environment (300a) for identifying a change in the state of an electronic device (100 of FIG. 1) is illustrated. The environment (300a) may include one or more sensors (310) used to identify the state of the electronic device (100 of FIG. 1) and a folding state management system (320) for managing the operation of the electronic device (100 of FIG. 1) according to the state of the electronic device (100 of FIG. 1). In one embodiment, the one or more sensors (310) may include a strain sensor (311), a distance sensor (312), and / or a gyroscope sensor (313). For example, the strain sensor (311) may be described as a sensor for measuring pressure applied to the surface of the electronic device (100 of FIG. 1) according to a resistance value. For example, the distance sensor (312) may be described as a sensor for measuring the distance between an electronic device (100 of FIG. 1) and an external object. For example, the gyroscope sensor (313) may be described as a sensor for detecting the attitude of the electronic device (100 of FIG. 1). For example, one or more sensors (310) may include at least a part of at least one sensor (40 of FIG. 1) or correspond to at least a part of at least one sensor (40 of FIG. 1).
[0064] In one embodiment, the folding state management system (320) may include a folding event converter (321), a folding state management unit (322), a system event receiver (323), an input handler (324), a context management unit (325), a state memory module (326), and / or a folding event handler (237). For example, the folding event converter (321) may determine whether the state of the electronic device (100 of FIG. 1) has been switched based on sensing data obtained through one or more sensors (310). For example, the folding state management unit (322) may manage the state of the electronic device (100 of FIG. 1) according to whether the state of the electronic device (100 of FIG. 1) has been switched. For example, the system event receiver (323) may receive an event generated by a system (e.g., an operating system). For example, an input handler (324) may receive user input, including user key input, mouse click, and / or touch input. For example, a context management unit (325) may manage context regarding events that have been performed or will be performed within a system (e.g., an operating system). For example, a state memory module (326) may be described as a module for storing historical information about the state of an electronic device (100 in FIG. 1). For example, a folding event handler (327) may control, manage, and / or execute actions performed within the electronic device (100 in FIG. 1) based on identifying that the state of the electronic device (100 in FIG. 1) has been switched.
[0065] FIG. 3b illustrates an example of an operating system environment for using multiple cameras through different applications.
[0066] According to one embodiment, with reference to FIG. 3b, an operating system environment (300) for using a plurality of cameras through different applications is illustrated. The environment (300) may include a camera application (330), an OS camera framework (340), and / or a camera HAL (hardware abstraction layer) (350). The camera application (330) may include a camera framework (331), an application engine (332), an application activity (333), a folding state determination unit (334), an external device connection management unit (337), and / or a candidate camera determination unit (338). The folding state determination unit (334) may include a device state management unit (335) and / or a layout state management unit (336). For example, the OS camera framework (340) may be described as software for managing the interaction between the camera application (330) and the camera HAL (350) in the operating system. For example, the camera HAL (350) can provide an intermediary function between the hardware layer of the camera and the upper software layer of the camera.
[0067] According to one embodiment, the camera framework (331) can be described as an upper layer of software for creating the functions of a camera application (330).
[0068] According to one embodiment, an electronic device (100 of FIG. 1) can perform operations to process data within a camera application (330) through a system (e.g., an operating system (OS)) using an application engine (332).
[0069] According to one embodiment, an electronic device (100 of FIG. 1) can display the UI (user interface) of a camera application (330) through a flexible display (140 of FIG. 1) or a display (170 of FIG. 1) using an application activity (333).
[0070] According to one embodiment, an electronic device (100 of FIG. 1) can identify the state of the electronic device (100 of FIG. 1) detected through at least one sensor (40 of FIG. 1) using a folding state determination unit (334). The state of the electronic device (100 of FIG. 1) may correspond to an unfolded state, a single-folded state, or a multi-folded state. An unfolded state may be described as a state in which the first housing part (110 of FIG. 2a) and the second housing part (120 of FIG. 2a) are unfolded, and the second housing part (120 of FIG. 2a) and the third housing part (130 of FIG. 2a) are unfolded. A single-folding state can be described as a state in which the first housing part (110 in FIG. 2a) and the second housing part (120 in FIG. 2a) are folded, and the second housing part (120 in FIG. 2a) and the third housing part (130 in FIG. 2a) are unfolded. A multi-folding state can be described as a state in which the first housing part (110 in FIG. 2a) and the second housing part (120 in FIG. 2a) are folded, and the second housing part (120 in FIG. 2a) and the third housing part (130 in FIG. 2a) are folded. For example, an electronic device (100 in FIG. 1) can manage operations performed on the electronic device (100 in FIG. 1) associated with the state of the electronic device (100 in FIG. 1) using a device state management unit (335). For example, an electronic device (100 of FIG. 1) can manage the layout state of an execution screen of a camera application (330) displayed through a flexible display (140 of FIG. 1) and / or a display (170 of FIG. 1) by using a layout state management unit (336).
[0071] According to one embodiment, an electronic device (100 of FIG. 1) can obtain data for identifying a candidate camera among a plurality of cameras (30 of FIG. 1) by using an external device connection management unit (337). In one embodiment, the data may include information indicating whether the electronic device (100 of FIG. 1) and an external electronic device (e.g., a keyboard) are connected.
[0072] According to one embodiment, an electronic device (100 of FIG. 1) can transmit information regarding the state of the electronic device (100 of FIG. 1) from a folding state determination unit (334) to a candidate camera determination unit (338). The electronic device (100 of FIG. 1) can acquire data identified according to an external device connection management unit (337) using the candidate camera determination unit (338). The electronic device (100 of FIG. 1) can identify a candidate camera for application software among a plurality of cameras (30 of FIG. 1) based on the state of the electronic device (100 of FIG. 1) and / or acquired data using the candidate camera determination unit (338). An operation method for identifying candidate cameras for other applications while an image is acquired through a camera using an application within the electronic device (100 of FIG. 1) is described below with reference to FIG. 4a, 4b, and 4c.
[0073] FIGS. 4a, FIGS. 4b, and FIGS. 4c are flowcharts illustrating a method for identifying candidate cameras for different applications based on the state of an electronic device while an image is acquired through a camera using an application.
[0074] According to one embodiment, referring to FIGS. 4a and 4b, in operation 401, at least one processor (10 of FIG. 1) may acquire a first image using first application software through at least one second camera among a plurality of cameras (30 of FIG. 1) (or rear cameras (e.g., camera (32 of FIG. 2a), camera (33 of FIG. 2a), and / or camera (34 of FIG. 2a))). For example, the second cameras may be positioned within a third housing part (130 of FIG. 2a) of an electronic device (100 of FIG. 2a) and may be visible from the rear side of the third housing part (130 of FIG. 2a) of the electronic device (100 of FIG. 2a). By example, without limitation, the first application software may be described as camera application software.
[0075] According to one embodiment, in operation 402, at least one processor (10 in FIG. 1) can identify an event for acquiring a second image using a second application software while maintaining the acquisition of the first image using the first application software while the first image is being acquired. The second application software may be application software distinct from the first application software. For example, the event may be an event in which input for a UI object for acquiring an image through a camera is received in the second application software, which is message application software, while the first image is being acquired using the first application software, which is camera application software. As another example, the event may be an event in which the second application software, which is different camera application software, is executed while the first image is being acquired using the first application software, which is camera application software.
[0076] According to one embodiment, in operation 403, at least one processor (10 in FIG. 1) can identify whether the state of the electronic device (100 in FIG. 1) corresponds to a multi-folded state through at least one sensor (40 in FIG. 1). The state of the electronic device (100 in FIG. 1) may correspond to an unfolded state, a single-folded state, or a multi-folded state. An unfolded state may be described as a state in which the first housing part (110 in FIG. 2a) and the second housing part (120 in FIG. 2a) are unfolded, and the second housing part (120 in FIG. 2a) and the third housing part (130 in FIG. 2a) are unfolded. A single-folding state can be described as a state in which the first housing part (110 in FIG. 2a) and the second housing part (120 in FIG. 2a) are folded, and the second housing part (120 in FIG. 2a) and the third housing part (130 in FIG. 2a) are unfolded. A multi-folding state can be described as a state in which the first housing part (110 in FIG. 2a) and the second housing part (120 in FIG. 2a) are folded, and the second housing part (120 in FIG. 2a) and the third housing part (130 in FIG. 2a) are folded.
[0077] According to one embodiment, in operation 404, at least one processor (10 in FIG. 1) may identify each of at least one camera among a plurality of cameras (30 in FIG. 1), excluding at least one second camera for the first application software, as a candidate camera to be used for the second application software, based on the identification of an event while the electronic device (100 in FIG. 1) is in an unfolded state or a single-folded state (e.g., in the case of the example of operation 403). For example, the candidate cameras may include at least one first camera (or an internal front camera (e.g., camera (31 in FIG. 2a))), second cameras excluding at least one second camera used for the first application software (or rear cameras (e.g., camera (32 in FIG. 2a), camera (33 in FIG. 2a), and / or camera (34 in FIG. 2a))), and / or at least one third camera (or an external front camera (e.g., camera (35 in FIG. 2c))). For example, at least one first camera may be visible through a portion of a flexible display (140 in FIG. 2a) disposed within a third housing part (130 in FIG. 2a) of an electronic device (100 in FIG. 2a). For example, at least one third camera may be visible through a display (170 in FIG. 2c) defining at least a portion of the rear side of a second housing part (120 in FIG. 2c) of an electronic device (100 in FIG. 2c).
[0078] According to one embodiment, in operation 405, at least one processor (10 in FIG. 1) may determine whether a second image to be acquired using the second application software corresponds to a first image being acquired using the first application software, based on the identification of an event while the electronic device (100 in FIG. 1) is in an unfolded state or a single-folded state. For example, at least one processor (10 in FIG. 1) may determine that the second image corresponds to the first image if at least a portion of the first image and at least a portion of the second image are substantially identical. For example, at least one processor (10 in FIG. 1) may determine that the first image and the second image correspond to each other if the first image is determined to be an image acquired by one of the second cameras (e.g., a wide-angle camera) and the second image is determined to be an image acquired by another of the second cameras (e.g., a telephoto camera).
[0079] According to one embodiment, in operation 406, at least one processor (10 in FIG. 1) may acquire the second image using the second application software through at least one camera among the second cameras (or rear cameras (e.g., camera (32 in FIG. 2a), camera (33 in FIG. 2a), and / or camera (34 in FIG. 2a)) excluding at least one second camera for the first application software, based on a determination that the second image corresponds to the first image (e.g., in the case of the example of operation 405).
[0080] According to one embodiment, in operation 407, at least one processor (10 in FIG. 1) may identify each of at least one camera among at least one first camera (or internal front camera (e.g., camera (31 in FIG. 2a))) or at least one third camera (or external front camera (e.g., camera (35 in FIG. 2c))) as a candidate camera to be used for the second application software based on a determination that the second image does not correspond to the first image (e.g., in the case of No in operation 405).
[0081] According to one embodiment, at least one processor (10 in FIG. 1) can identify, using the second application software, information about a camera among a plurality of cameras (30 in FIG. 1) that was used for the second application software, based on a determination that the second image does not correspond to the first image while the electronic device (100 in FIG. 1) is in an unfolded state or a single-folded state (e.g., in the case of No in operation 403 and No in operation 405). At least one processor (10 in FIG. 1) can identify a camera to be used for the second application software according to the orientation of the camera (e.g., inside or outside) indicated by the information. For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one first camera (or internal front camera (e.g., camera (31 in FIG. 2a))) using second application software based on identifying that at least one first camera (or internal front camera (e.g., camera (31 in FIG. 2a))) is indicated by information. For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one third camera (or external front camera (e.g., camera (35 in FIG. 2c))) using second application software, based on identifying by information that one of the second cameras (or rear cameras (e.g., camera (32 in FIG. 2a), camera (33 in FIG. 2a), and / or camera (34 in FIG. 2a))) and / or at least one third camera (or external front camera (e.g., camera (35 in FIG. 2c)))) is indicated.
[0082] According to one embodiment, at least one processor (10 in FIG. 1) can identify the orientation (or rotational state) of the electronic device (100 in FIG. 1) through at least one sensor (40 in FIG. 1) based on a determination that the second image does not correspond to the first image while the electronic device (100 in FIG. 1) is in an unfolded state or a single-folded state (e.g., in the case of No in operation 403 and No in operation 405). For example, the orientation of the electronic device (100 in FIG. 1) may be represented by a rotation angle along an axis (e.g., x-axis, y-axis, and / or z-axis). For example, at least one sensor (40 in FIG. 1) may include one or more sensors (e.g., a gyroscope sensor) for identifying the orientation of the electronic device (100 in FIG. 1). For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one first camera (or internal front camera (e.g., camera (31 in FIG. 2a))) using second application software based on identifying the posture of an electronic device (100 in FIG. 1) corresponding to a first range. For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one third camera (or external front camera (e.g., camera (35 in FIG. 2a))) using second application software based on identifying the posture of an electronic device (100 in FIG. 1) corresponding to a second range.
[0083] According to one embodiment, at least one processor (10 in FIG. 1) can identify whether an external electronic device (e.g., keyboard) is connected to the electronic device (100 in FIG. 1) based on a determination that the second image does not correspond to the first image while the electronic device (100 in FIG. 1) is in an unfolded state or a single-folded state (e.g., in the case of No in operation 403 and No in operation 405). For example, at least one processor (10 in FIG. 1) can acquire the second image through at least one first camera (or internal front camera (e.g., camera (31 in FIG. 2a))) using second application software based on the determination that no external electronic device is connected to the electronic device (100 in FIG. 1). For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one third camera (or external front camera (e.g., camera (35 in FIG. 2c))) using second application software based on identifying that an external electronic device is connected to an electronic device (100 in FIG. 1).
[0084] According to one embodiment, in operation 408, at least one processor (10 in FIG. 1) may identify at least one camera among a plurality of cameras (30 in FIG. 1), excluding at least one first camera (or an internal front camera (e.g., camera (31 in FIG. 2a))), as a candidate camera to be used for the second application software, based on the identification of an event while the electronic device (100 in FIG. 1) is in a multi-folding state (e.g., in the case of the example of operation 403). For example, the candidate cameras may be at least one camera among the second cameras (or rear cameras (e.g., camera (32 in FIG. 2a), camera (33 in FIG. 2a), or camera (34 in FIG. 2a))) or at least one third camera (or an external front camera (e.g., camera (35 in FIG. 2c)))), excluding at least one second camera used for the first application software. For example, candidate cameras may be described as a plurality of cameras (30 in FIG. 1), excluding at least one second camera for the first application software. For example, since at least one first camera (or internal front camera (e.g., camera (31 in FIG. 2a))) is covered by the rear side of the first housing part (110 in FIG. 2a) of the electronic device (100 in FIG. 1) while the electronic device (100 in FIG. 1) is in a multi-folding state, at least one processor (10 in FIG. 1) may exclude at least one first camera (or internal front camera (e.g., camera (31 in FIG. 2a))) from the candidate cameras.
[0085] According to one embodiment, in operation 409, at least one processor (10 in FIG. 1) can determine whether a second image to be acquired using second application software corresponds to a first image being acquired using first application software, based on the identification of an event while the electronic device (100 in FIG. 1) is in a multi-folding state. For example, at least one processor (10 in FIG. 1) can determine that the second image corresponds to the first image if at least a portion of the first image and at least a portion of the second image are substantially identical. For example, at least one processor (10 in FIG. 1) can determine that the first image and the second image correspond to each other if the first image is determined to be an image acquired by one of the second cameras (e.g., a wide-angle camera) and the second image is determined to be an image acquired by another of the second cameras (e.g., a telephoto camera).
[0086] According to one embodiment, in operation 410, at least one processor (10 of FIG. 1) may acquire the second image using the second application software through at least one camera among the second cameras (or rear cameras (e.g., camera (32 of FIG. 2a), camera (33 of FIG. 2a), and / or camera (34 of FIG. 2a))) based on a determination that the second image corresponds to the first image (e.g., in the case of the example of operation 409).
[0087] According to one embodiment, in operation 411, at least one processor (10 in FIG. 1) may acquire the second image using the second application software through at least one third camera (or external front camera (e.g., camera (35 in FIG. 2c))) based on a determination that the second image does not correspond to the first image (e.g., in the case of No in operation 409).
[0088] According to one embodiment, at least one processor (10 in FIG. 1) can identify the location of an execution screen of a first application software and / or the location of an execution screen of a second application software displayed as a split view. For example, at least one processor (10 in FIG. 1) can identify a candidate camera for the second application software based on the relationship between the locations of the execution screens and the locations of each of the plurality of cameras (30 in FIG. 1).
[0089] According to one embodiment, referring to FIG. 4c, in operation 421, at least one processor (10 of FIG. 1) can acquire a first image through at least one second camera among the second cameras (e.g., 32, 33, 34 of FIG. 2a) using the first application software.
[0090] According to one embodiment, in operation 422, at least one processor (10 of FIG. 1) can identify an event for acquiring a second image using second application software.
[0091] According to one embodiment, in operation 423, at least one processor (10 in FIG. 1) may identify each of at least one camera among at least one first camera (31 in FIG. 2a), at least one second camera excluding at least one second camera used through the first application software (32, 33, 34 in FIG. 2a), or at least one third camera (35 in FIG. 2c) as a candidate camera to be used for the second application software, based on the identification of an event while the electronic device (100 in FIG. 1) is in an unfolded state or a single-folded state. For example, the unfolded state may be a state in which the first housing part (110 in FIG. 2a) and the second housing part (120 in FIG. 2a) are unfolded, and the second housing part (120 in FIG. 2a) and the third housing part (130 in FIG. 2a) are unfolded. For example, the single-folding state may be a state in which the first housing part (110 in FIG. 2a) and the second housing part (120 in FIG. 2a) are folded, and the second housing part (120 in FIG. 2a) and the third housing part (130 in FIG. 2a) are unfolded.
[0092] According to one embodiment, in operation 424, at least one processor (10 in FIG. 1) may identify each of at least one camera among the second cameras (32, 33, 34 in FIG. 2a) or at least one third camera (35 in FIG. 2c), excluding at least one second camera used through the first application software, based on the identification of an event while the electronic device (100 in FIG. 1) is in a multi-folded state.
[0093] FIG. 4d is a flowchart illustrating a method for identifying cameras for each of the different applications running on an electronic device.
[0094] According to one embodiment, with reference to FIG. 4d, in operation 431, at least one processor (10 of FIG. 1) can identify an event for executing the first application software.
[0095] According to one embodiment, in operation 432, at least one processor (10 in FIG. 1) can determine whether a target camera to be used for the first application software among a plurality of cameras (30 in FIG. 1) is available based on an event for executing the first application software. For example, at least one processor (10 in FIG. 1) can determine whether the target camera is available by determining whether there is access rights to the camera and / or whether the camera is operating normally.
[0096] According to one embodiment, in operation 433, at least one processor (10 of FIG. 1) may terminate the execution of the first application software based on the determination that the target camera to be used for the first application software is not available.
[0097] According to one embodiment, in operation 434, at least one processor (10 of FIG. 1) can execute the first application software using the target camera based on determining that the target camera to be used for the first application software is available.
[0098] According to one embodiment, in operation 435, at least one processor (10 of FIG. 1) can identify an event for executing a second application software while using the first application software.
[0099] According to one embodiment, in operation 436, at least one processor (10 of FIG. 1) can obtain list information for cameras available for the second application software based on an event for executing the second application software.
[0100] According to one embodiment, in operation 437, at least one processor (10 of FIG. 1) can determine whether there is an available camera among at least one camera indicated by list information.
[0101] According to one embodiment, in operation 438, at least one processor (10 of FIG. 1) may execute the second application software using the camera used for the first application software based on the determination that there is no available camera according to the list information.
[0102] According to one embodiment, in operation 439, at least one processor (10 in FIG. 1) can identify the state of an electronic device (100 in FIG. 1) to identify a candidate camera to be used for the second application software based on a determination that there is a camera available according to list information.
[0103] According to one embodiment, in operation 440, at least one processor (10 in FIG. 1) can identify the connection status between an electronic device (100 in FIG. 1) and an external electronic device (e.g., a keyboard) to identify a candidate camera to be used for the second application software based on a determination that there is a camera available according to list information.
[0104] According to one embodiment, in operation 441, at least one processor (10 in FIG. 1) can identify a candidate camera to be used for the second application software based on the state of the electronic device (100 in FIG. 1) and / or the connection state between the electronic device (100 in FIG. 1) and an external electronic device, and can execute the second application software using the candidate camera.
[0105] FIG. 4e is a flowchart illustrating a method for identifying a camera for a different application based on the state of the electronic device while an image is acquired through the camera using an application.
[0106] According to one embodiment, referring to FIG. 4e, in operation 451, at least one processor (10 of FIG. 1) can identify an event for executing a second application software while using the first application software.
[0107] According to one embodiment, in operation 452, at least one processor (10 of FIG. 1) can obtain list information for cameras available for the second application software based on an event for executing the second application software.
[0108] According to one embodiment, in operation 453, at least one processor (10 of FIG. 1) can determine whether there is an available camera among at least one camera indicated by list information.
[0109] According to one embodiment, in operation 454, at least one processor (10 in FIG. 1) may execute the second application software using the camera used for the first application software based on the determination that there is no available camera according to the list information.
[0110] According to one embodiment, in operation 455, at least one processor (10) can identify the state of an electronic device (100 of FIG. 1) to identify a candidate camera to be used for the second application software based on a determination that there is a camera available according to list information.
[0111] According to one embodiment, in operation 456, at least one processor (10 in FIG. 1) can determine whether the state of the electronic device (100 in FIG. 1) is a multi-folding state.
[0112] According to one embodiment, in operation 457, at least one processor (10 in FIG. 1) may exclude at least one first camera (31 in FIG. 2a) (or internal front camera) from the available cameras indicated by the list information based on identifying that the state of the electronic device (100 in FIG. 1) corresponds to a multi-folding state.
[0113] According to one embodiment, in operation 458, at least one processor (10) can identify the connection state between the electronic device (100 in FIG. 1) and an external device based on identifying that the state of the electronic device (100) corresponds to an unfolded state or a single-folding state, or excluding at least one first camera (31 in FIG. 2a) from the available cameras indicated by the list information.
[0114] According to one embodiment, in operation 459, at least one processor (10 in FIG. 1) can execute a second application software using a candidate camera depending on the connection status between the electronic device (100 in FIG. 1) and an external device.
[0115] According to one embodiment, an electronic device (100 of FIG. 1) can enhance the user experience for application software using a camera by identifying a candidate camera for another application software based on the state of the electronic device (100 of FIG. 1) while an image is acquired through the camera using application software.
[0116] FIGS. 5a and 5b are examples of environments in which candidate cameras for other applications are identified while an image is acquired through a camera using an application in an unfolded state.
[0117] According to one embodiment, with reference to FIG. 5a, an environment (500a) is illustrated in which an image is acquired through a rear camera using camera application software while an image is acquired through another rear camera using message application software in an unfolded state.
[0118] According to one embodiment, an electronic device (100 of FIG. 1) can substantially concurrently display a screen of camera application software and a screen of message application in a split view through a flexible display (140). The screen of camera application software can be displayed through a second display area (140b) and a third display area (140c) of the flexible display (140). The screen of message application software can be displayed through a first display area (140a) of the flexible display (140).
[0119] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (510) through a second camera (or a rear camera (e.g., camera (33 of FIG. 2a))) using camera application software. While the image (510) is being acquired, the electronic device (100 of FIG. 1) can identify an event for acquiring an image using message application software based on an input (e.g., touch input) to a UI object (520) included in the execution screen of message application software while the image (510) is being acquired.
[0120] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (530) through a second camera (or rear camera (e.g., camera (32 of FIG. 2a))) using message application software based on the identification of an event in the unfolded state.
[0121] According to one embodiment, with reference to FIG. 5b, an environment (500b) is shown in which an image is acquired through an external front camera or an internal front camera using message application software while an image is acquired through a rear camera using camera application software in an unfolded state.
[0122] According to one embodiment, an electronic device (100 of FIG. 1) can substantially concurrently display a screen of camera application software and a screen of message application in a split view through a flexible display (140). The screen of camera application software can be displayed through a second display area (140b) and a third display area (140c) of the flexible display (140). The screen of message application software can be displayed through a first display area (140a) of the flexible display (140).
[0123] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (510) through a second camera (or a rear camera (e.g., camera (33 of FIG. 2a))) using camera application software. While the image (510) is being acquired, the electronic device (100 of FIG. 1) can identify an event for acquiring an image using message application software based on an input (e.g., touch input) to a UI object (520) included in the execution screen of message application software while the image (510) is being acquired.
[0124] According to one embodiment, an electronic device (100 of FIG. 1) may acquire an image (540) using message application software through a third camera (or an external front camera (e.g., camera (35 in FIG. 2c))) or acquire an image (550) using message application software through a first camera (or an internal front camera (e.g., camera (31 in FIG. 2a)))) based on an event being identified in the unfolded state.
[0125] FIGS. 6a and 6b are examples of environments in which candidate cameras for other applications are identified while an image is acquired through a camera using an application in a multi-folding state.
[0126] According to one embodiment, with reference to FIG. 6a, an environment (600a) is illustrated in which an image is acquired through a rear camera using camera application software while an image is acquired through another rear camera using message application software in a multi-folded state.
[0127] According to one embodiment, an electronic device (100 of FIG. 1) can display a message application execution screen (620) that is partially superimposed on a camera application software execution screen as a pop-up view through a display (170).
[0128] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (610) through a second camera (or a rear camera (e.g., camera (33 of FIG. 2a)))) using camera application software. While the image (610) is being acquired, the electronic device (100) can identify an event for acquiring an image using the message application software based on an input (e.g., touch input) to a UI object (621) included in the execution screen (620) of the message application software.
[0129] The electronic device (100) can acquire an image (630) through a second camera (or rear camera (e.g., camera (32 in FIG. 2a))) using message application software based on the identification of an event in a multi-folding state.
[0130] According to one embodiment, with reference to FIG. 6b, an environment (600b) is shown in which an image is acquired through an external front camera using message application software while an image is acquired through a rear camera using camera application software in a multi-folded state.
[0131] According to one embodiment, an electronic device (100 of FIG. 1) can display a message application execution screen (620) that is partially superimposed on a camera application software execution screen as a pop-up view through a display (170).
[0132] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (610) through a second camera (or a rear camera (e.g., camera (33 of FIG. 2a))) using camera application software. While the image (610) is being acquired, the electronic device (100 of FIG. 1) can identify an event for acquiring an image using message application software based on an input (e.g., touch input) to a UI object (621) included in the execution screen (620) of message application software while maintaining the acquisition of the image (610) using the camera application software.
[0133] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (640) through a third camera (or an external front camera (e.g., camera (35 of FIG. 2c))) using message application software based on the identification of an event in a multi-folding state.
[0134] Figure 7 is an example of an environment in which candidate cameras for other applications are identified while an image is acquired through a camera using an application while the electronic device is partially folded.
[0135] According to one embodiment, with reference to FIG. 7, an environment (700) is shown in which a portion of the surface of the electronic device (100 of FIG. 1) is placed on an outer surface (710) while the electronic device (100 of FIG. 1) is partially folded.
[0136] According to one embodiment, within the environment (700), at least one processor (10 in FIG. 1) may maintain acquiring a first image through at least one second camera among the second cameras (or rear cameras (e.g., camera (32 in FIG. 2a), camera (33 in FIG. 2a), and / or camera (34 in FIG. 2a))) using the first application software. At least one processor (10 in FIG. 1) may identify, through at least one sensor (40 in FIG. 1), that the first housing part (110 in FIG. 2a) and the second housing part (120 in FIG. 2a) are placed on an outer surface (710), and that the state of the electronic device (100 in FIG. 1) corresponds to a state in which the second housing part (120 in FIG. 2a) and the third housing part (130 in FIG. 2a) are partially folded. At least one processor (10 in FIG. 1) can identify an event for acquiring a second image using second application software while the first housing part (110 in FIG. 2a) and the second housing part (120 in FIG. 2a) are placed on an outer surface (710), and the state of the electronic device (100 in FIG. 1) is such that the second housing part (120 in FIG. 2a) and the third housing part (130 in FIG. 2a) are partially folded. Based on the identification of the event while the electronic device (100 in FIG. 1) is in a state, at least one processor (10 in FIG. 1) can identify each of at least one camera among a plurality of cameras (30 in FIG. 1), excluding at least one third camera (or an external front camera (e.g., camera (35 in FIG. 2c))), as a candidate camera to be used for the second application software.For example, the candidate cameras may be at least one of the second cameras (or rear cameras (e.g., camera (32 in FIG. 2a), camera (33 in FIG. 2a), and / or camera (34 in FIG. 2a))) or at least one first camera (or at least one internal front camera (e.g., camera (31 in FIG. 2a))) excluding at least one second camera for the first application software from a plurality of cameras (30 in FIG. 1). For example, the candidate cameras may be described as cameras excluding at least one second camera for the first application software from a plurality of cameras (30 in FIG. 1). For example, since at least one third camera (or external front camera (e.g., camera (35 in FIG. 2c))) is covered by an external surface (710) while the electronic device (100 in FIG. 1) is in a state, the candidate cameras may be described as cameras excluding at least one third camera (or external front camera (e.g., camera (35 in FIG. 2c))).
[0137] According to one embodiment, an electronic device (100 of FIG. 1) can identify candidate cameras to be used for other application software from idle cameras while an image is acquired through a camera using application software. However, the present disclosure is not limited thereto. For example, the electronic device (100 of FIG. 1) can identify a camera as a candidate camera for other application software based on the fact that the scene of an image acquired through a camera for application software satisfies a reference condition. An operation method for identifying a candidate camera based on the scene of an image is described below with reference to FIG. 8.
[0138] FIG. 8 is a flowchart illustrating a method for identifying candidate cameras for different applications based on the scene of the image while an image is acquired through a camera using an application.
[0139] According to one embodiment, referring to FIG. 8, in operation 801, at least one processor (10 of FIG. 1) can acquire a first image through at least one camera among a plurality of cameras (30 of FIG. 1) using first application software. For example, the plurality of cameras (30 of FIG. 1) may include at least one first camera (or an internal front camera (e.g., camera (31 of FIG. 2a))), a second camera (or rear cameras (e.g., camera (32 of FIG. 2a), camera (33 of FIG. 2a), and / or camera (34 of FIG. 2a))), and / or at least one third camera (or an external front camera (e.g., camera (35 of FIG. 2c))). For example, at least one first camera may be visible through a portion of a flexible display (140 in FIG. 2a) disposed within a third housing part (130 in FIG. 2a) of an electronic device (100 in FIG. 2a). For example, second cameras may be disposed within the third housing part (130 in FIG. 2a) of an electronic device (100 in FIG. 2a) and may be visible from the rear side of the third housing part (130 in FIG. 2a) of the electronic device (100 in FIG. 2a). For example, at least one third camera may be visible through a display (170 in FIG. 2c) defining at least a portion of the rear side of a second housing part (120 in FIG. 2c) of an electronic device (100 in FIG. 2c). By example, without limitation, the first application software may be described as camera application software.
[0140] According to one embodiment, in operation 802, at least one processor (10 in FIG. 1) can identify an event for acquiring a second image using a second application software while maintaining the acquisition of the first image using the first application software while the first image is acquired. The second application software may be application software distinct from the first application software. For example, the event may be an event in which input for a UI object for executing a video call through a camera is received in the second application software, which is a call application software, while the first image is acquired using the first application software, which is a camera application software. For another example, the event may be an event in which input for a UI object for acquiring an image through a camera is received in the second application software, which is a message application software, while the first image is acquired using the first application software, which is a camera application software.
[0141] According to one embodiment, in operation 803, at least one processor (10 in FIG. 1) can identify a scene of a first image acquired through at least one camera among a plurality of cameras (30 in FIG. 1) based on an event.
[0142] According to one embodiment, in operation 804, at least one processor (10 in FIG. 1) can determine whether the identified scene satisfies a reference condition. The reference condition may be set in various ways depending on the embodiment. For example, the reference condition may correspond to a type defined to allow scene sharing with other users (e.g., natural landscape, festival, landmark, person, or animal) for the type of scene identified for the first image. For example, if the type of scene identified for the first image is a defined type, at least one processor (10 in FIG. 1) can execute second application software to provide the first image as a preview image through operations 805 and 806 below. For example, if the type of scene identified for the first image is not a defined type, at least one processor (10 in FIG. 1) can execute second application software using a second image distinguished from the first image through operation 807 below.
[0143] According to one embodiment, in operation 805, at least one processor (10 in FIG. 1) may identify at least one camera among a plurality of cameras (30 in FIG. 1) as a camera to be used for the second application software based on identifying an identified scene satisfying a reference condition (e.g., in the case of the example of operation 804). At least one processor (10 in FIG. 1) may identify a buffer used to acquire the first image to maintain the acquisition of the first image using the first application software through at least one camera used for the first application software based on identifying at least one camera among the plurality of cameras (30 in FIG. 1) as a camera to be used for the second application software. For example, the buffer may be described as a memory area where image data acquired through the camera is stored.
[0144] According to one embodiment, in operation 806, at least one processor (10 in FIG. 1) can obtain a second image corresponding to a first image by accessing an identified buffer using second application software.
[0145] According to one embodiment, in operation 807, at least one processor (10 in FIG. 1) can identify candidate cameras to be used for the second application software among a plurality of cameras (30 in FIG. 1), excluding at least one camera used for the first application software, based on the identification of an identified scene that does not satisfy a reference condition (e.g., in the case of No in operation 804), according to the state of the electronic device (100 in FIG. 1). For example, at least one processor (10 in FIG. 1) can perform the aforementioned operations 403 to 411 based on the identification of an identified scene that does not satisfy a reference condition.
[0146] Figure 9 is an example of an environment in which different applications within an electronic device share the same camera.
[0147] According to one embodiment, with reference to FIG. 9, an environment (900) is illustrated in which a first application (or first application software) (921) and a second application (or second application software) (922) share the same camera through a camera HAL (hardware abstraction layer) (910) within an electronic device (100 of FIG. 1).
[0148] According to one embodiment, an electronic device (100 of FIG. 1) can use a camera HAL (910) to transmit a first camera stream data (camera stream1) and / or a second camera stream data (camera stream2) to the first application (921) from a camera among a plurality of cameras (30 of FIG. 1) that is used for the first application (921). For example, the first camera stream data (camera stream1) may be described as image data to be displayed as a preview image on the execution screen of the first application (921). For example, the second camera stream data (camera stream2) may be described as image data to be processed in the first application (921).
[0149] According to one embodiment, since the first camera stream data (camera stream1) is image data to be displayed as a preview image on the execution screen of the first application (921), the electronic device (100 of FIG. 1) can cause the first application (921) and the second application (922) to share the same camera by using the second camera stream data (camera stream2). For example, the electronic device (100 of FIG. 1) can identify a buffer for the second camera stream data (camera stream2) by using the second application (922). For example, the electronic device (100 of FIG. 1) can obtain the second camera stream data (camera stream2) by using the second application (922) by accessing the identified buffer.
[0150] According to one embodiment, within the environment (900), the first application (921) and the second application (922) may be operated through a single camera when accessing the same camera by choice of the user after using different cameras. For example, the second application (922) may share a preview with the first application (921) to use the camera occupied by the first application (921), and may request the first application (921) to allow remote control to execute a command for taking a photo. The first application (921) may share a preview and allow remote control in response to the request of the second application (922). For example, the second application (922) may receive the preview image from the first application (921), transmit a command for taking a photo to the first application (921) by executing a remote command, and then receive the result of the photo taking. The second application (922) can take a photo using the camera occupied by the first application (921) by storing data about the result of the photo taking.
[0151] FIGS. 10a and FIGS. 10b are examples of environments in which different applications share a camera based on the scene of the image acquired while the image is acquired through the camera using an application.
[0152] According to one embodiment, with reference to FIG. 10a, an environment (1000a) is shown in which an image is acquired through a rear camera using a call application software while an image is acquired through a rear camera using camera application software in an unfolded state.
[0153] According to one embodiment, an electronic device (100 of FIG. 1) can substantially concurrently display a screen of camera application software and a screen of a call application in a split view through a flexible display (140). The screen of camera application software may be displayed through a second display area (140b) and / or a third display area (140c) of the flexible display (140). The screen of call application software may be displayed through a first display area (140a) of the flexible display (140).
[0154] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (1010) through a second camera (or a rear camera (e.g., camera (33 of FIG. 2a))) using camera application software. While the image (1010) is being acquired, the electronic device (100 of FIG. 1) can identify an event for acquiring an image using the call application software while maintaining the acquisition of the image (1010) using the camera application software, based on input (e.g., touch input) to a UI object (1020) included in the execution screen of the call application software. The UI object (1020) can execute a video call through the camera in the call application software.
[0155] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (1021) from an external electronic device that performs a video call with the electronic device (100 of FIG. 1) based on an event.
[0156] According to one embodiment, an electronic device (100 of FIG. 1) can identify a scene of an image (1010) based on an event. The electronic device (100 of FIG. 1) can identify that a scene of an image (1010) satisfies a reference condition based on identifying a type of scene of an image (1010) corresponding to a natural landscape. Based on identifying a scene of an image (1010) that satisfies a reference condition, the electronic device (100 of FIG. 1) can acquire an image (1022) through a second camera (or a rear camera (e.g., camera (33 of FIG. 2a))) using call application software.
[0157] According to one embodiment, with reference to FIG. 10b, an environment (1000b) is shown in which an image is acquired through an internal front camera using a call application software while an image is acquired through an internal front camera using camera application software in an unfolded state.
[0158] According to one embodiment, an electronic device (100 of FIG. 1) can substantially concurrently display a screen of camera application software and a screen of a call application in a split view through a flexible display (140). The screen of camera application software may be displayed through a second display area (140b) and / or a third display area (140c) of the flexible display (140). The screen of call application software may be displayed through a first display area (140a) of the flexible display (140).
[0159] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (1030) through a first camera (or an internal front camera (e.g., camera (31 of FIG. 2a))) using camera application software. While the image (1030) is being acquired, the electronic device (100 of FIG. 1) can identify an event to acquire an image using the call application software while maintaining the acquisition of the image (1030) using the camera application software, based on an input (e.g., touch input) to a UI object (1040) included in the execution screen of the call application software. The UI object (1040) can execute a video call through the camera in the call application software.
[0160] According to one embodiment, an electronic device (100 of FIG. 1) can acquire an image (1041) from an external electronic device that performs a video call with the electronic device (100 of FIG. 1) based on an event.
[0161] According to one embodiment, the electronic device (100) can identify a scene of an image (1030) based on an event. The electronic device (100 of FIG. 1) can identify that a scene of an image (1030) satisfies a reference condition based on identifying a type of scene of an image (1030) corresponding to a person. Based on identifying a scene of an image (1030) that satisfies a reference condition, the electronic device (100 of FIG. 1) can acquire an image (1042) through a first camera (or an internal front camera (e.g., camera (31 of FIG. 2a))) using call application software.
[0162] FIG. 11 is a flowchart illustrating a method of capturing an image by changing the camera settings while two applications share the same camera.
[0163] According to one embodiment, referring to FIG. 11, in operation 1101, at least one processor (10 of FIG. 1) can acquire a first image through a camera included in a plurality of cameras (30 of FIG. 1) using first application software. For example, a plurality of cameras (30 in FIG. 1) may include at least one first camera (or an internal front camera (e.g., camera (31 in FIG. 2a))), second cameras (or rear cameras (e.g., camera (32 in FIG. 2a), camera (33 in FIG. 2a), and / or camera (34 in FIG. 2a)), and / or at least one third camera (or an external front camera (e.g., camera (35 in FIG. 2c))). For example, at least one first camera may be visible through a portion of a flexible display (140 in FIG. 2a) disposed within a third housing part (130 in FIG. 2a) of the electronic device (100 in FIG. 2a). For example, the second cameras are disposed within the third housing part (130 in FIG. 2a) of the electronic device (100 in FIG. 2a), and the electronic device (100 in FIG. 2a) It may be visible from the rear side of the third housing part (130 in FIG. 2a). For example, at least one third camera may be visible through a display (170 in FIG. 2c) defining at least a portion of the rear side of the second housing part (120 in FIG. 2c) of the electronic device (100 in FIG. 2c). By example, without limitation, the first application software may be described as camera application software.
[0164] According to one embodiment, in operation 1102, at least one processor (10 of FIG. 1) can identify an event for acquiring a second image using a second application software through a camera while maintaining the acquisition of a first image using a first application software while the first image is being acquired. The second application software may be application software distinct from the first application software. For example, the event may be an event in which input for a UI object for executing a video call through a camera is received in the second application software, which is a call application software, while the first image is being acquired using the first application software, which is a camera application software. For another example, the event may be an event in which input for a UI object for acquiring an image through a camera is received in the second application software, which is a message application software, while the first image is being acquired using the first application software, which is a camera application software.
[0165] According to one embodiment, in operation 1103, at least one processor (10 in FIG. 1) can identify a buffer used to acquire a first image to maintain the acquisition of a first image using the first application software through a camera based on an event. For example, the buffer can be described as a memory area where image data acquired through the camera is stored. For example, at least one processor (10 in FIG. 1) can identify a buffer used to acquire a first image based on transmitting a request for buffer sharing from the second application software to the first application software.
[0166] According to one embodiment, in operation 1104, at least one processor (10 in FIG. 1) can obtain a second image corresponding to a first image by accessing an identified buffer using second application software. For example, at least one processor (10 in FIG. 1) can display the second image as a preview image within the execution screen of the second application software based on transmitting a request to share a preview image from the second application software to the first application software.
[0167] According to one embodiment, in operation 1105, at least one processor (10 of FIG. 1) can identify an input for capturing the second image using second application software while the first image and the second image are acquired.
[0168] According to one embodiment, in operation 1106, at least one processor (10 of FIG. 1) can change a camera setting (e.g., field of view (FOV) or tone) based on input using the first application software from a first setting set according to the first application software to a second setting set according to the second application software.
[0169] According to one embodiment, in operation 1107, at least one processor (10 of FIG. 1) can acquire a second image captured according to the changed settings of the camera using second application software.
[0170] According to one embodiment, in operation 1108, at least one processor (10 of FIG. 1) can restore the camera settings from the second settings to the first settings using the first application software based on acquiring a second image captured using the second application software.
[0171] FIG. 12 is a flowchart illustrating a method of capturing an image by maintaining camera settings while two applications share the same camera.
[0172] According to one embodiment, referring to FIG. 12, in operation 1201, at least one processor (10 of FIG. 1) can acquire a first image through a camera included in a plurality of cameras (30 of FIG. 1) using first application software. For example, the plurality of cameras (30 of FIG. 1) may include at least one first camera (or an internal front camera (e.g., camera (31 of FIG. 2a))), second cameras (or rear cameras (e.g., camera (32 of FIG. 2a), camera (33 of FIG. 2a), and / or camera (34 of FIG. 2a))), and / or at least one third camera (or an external front camera (e.g., camera (35 of FIG. 2c))). For example, at least one first camera may be visible through a portion of a flexible display (140 in FIG. 2a) disposed within a third housing part (130 in FIG. 2a) of an electronic device (100 in FIG. 1). For example, second cameras may be disposed within the third housing part (130 in FIG. 2a) of an electronic device (100 in FIG. 2a) and may be visible from the rear side of the third housing part (130 in FIG. 2a) of the electronic device (100 in FIG. 2a). For example, at least one third camera may be visible through a display (170 in FIG. 2c) defining at least a portion of the rear side of a second housing part (120 in FIG. 2c) of an electronic device (100 in FIG. 1). By example, without limitation, the first application software may be described as camera application software.
[0173] According to one embodiment, in operation 1202, at least one processor (10 of FIG. 1) can identify an event for acquiring a second image using a second application software through a camera while maintaining the acquisition of a first image using a first application software while the first image is being acquired. The second application software may be application software distinct from the first application software. For example, the event may be an event in which input for a UI object for executing a video call through a camera is received in the second application software, which is a call application software, while the first image is being acquired using the first application software, which is a camera application software. For another example, the event may be an event in which input for a UI object for acquiring an image through a camera is received in the second application software, which is a message application software, while the first image is being acquired using the first application software, which is a camera application software.
[0174] According to one embodiment, in operation 1203, at least one processor (10 in FIG. 1) may identify a buffer used to acquire a first image to maintain the acquisition of a first image using the first application software through the camera based on an event. For example, the buffer may be described as a memory area where image data acquired through the camera is stored. For example, the buffer may store the original image acquired through the camera regardless of the camera settings according to the first application software. For example, at least one processor (10 in FIG. 1) may identify a buffer used to acquire a first image based on transmitting a request for buffer sharing from the second application software to the first application software.
[0175] According to one embodiment, in operation 1204, at least one processor (10 in FIG. 1) can obtain a second image corresponding to a first image by accessing an identified buffer using second application software. For example, at least one processor (10 in FIG. 1) can display the second image as a preview image within the execution screen of the second application software based on transmitting a request to share a preview image from the second application software to the first application software.
[0176] According to one embodiment, in operation 1205, at least one processor (10 of FIG. 1) can identify an input for capturing the second image using second application software while the first image and the second image are acquired.
[0177] According to one embodiment, in operation 1206, at least one processor (10 of FIG. 1) can acquire a second image captured through a camera based on input using second application software. For example, the captured second image may be described as an original image stored in an identified buffer.
[0178] According to one embodiment, in operation 1207, at least one processor (10 of FIG. 1) can modify (or edit) (or correct) the captured second image according to the settings of the second application software using the second application software.
[0179] FIGS. 13a, FIGS. 13b, and FIGS. 13c are drawings according to one embodiment of an electronic device.
[0180] According to one embodiment, FIG. 13a illustrates an example of an unfolded state (1300a) of an electronic device (100). FIG. 13b illustrates an example of a single-folded state (1300b) of an electronic device (100). FIG. 13c illustrates an example of a multi-folded state (1300c) of an electronic device (100).
[0181] According to one embodiment, with reference to FIGS. 13a, 13b, and 13c, the electronic device (100) may include a plurality of cameras (30), a housing structure (101), a flexible display (140), a first hinge structure (150), a second hinge structure (160), and / or a display (170). The plurality of cameras (30) may include a camera (31), a camera (32), a camera (33), a camera (34), and / or a camera (35). The housing structure (101) may include a first housing part (110), a second housing part (120), and a third housing part (130).
[0182] According to one embodiment, the camera (31) is positioned within the second housing part (120) and can be seen through a portion of the flexible display (140) positioned within the second housing part (120). The camera (31) may be referred to as an internal front camera (or selfie camera) in terms of being seen through the flexible display (140) defining the front side of the first housing part (110), the front side of the second housing part (120), and / or the front side of the third housing part (130).
[0183] According to one embodiment, each of the camera (32), camera (33), and / or camera (34) is disposed within the second housing part (120) and may be visible from the rear side of the second housing part (120). Each of the camera (32), camera (33), and / or camera (34) may be referred to as a rear camera in terms of being visible from the rear side of the second housing part (120). The camera (32), camera (33), and / or camera (34) may have different field of view (FOV) ranges. For example, the camera (32) may be described as an ultra-wide angle camera having a first field of view range. For example, the camera (33) may be described as a wide angle camera having a second field of view range lower than the first field of view range. For example, the camera (34) may be described as a telephoto camera having a third field of view range lower than the second field of view range.
[0184] According to one embodiment, the camera (31), camera (32), camera (33), and / or camera (34) are placed within one housing part (e.g., a second housing part (120)), so that at least one processor (10) of the electronic device (100) can increase the speed of processing images obtained from the camera.
[0185] According to one embodiment, the camera (35) is positioned within the third housing part (130) and can be seen through a display (170) positioned within the third housing part (130). The camera (35) may be referred to as an external front camera (or selfie camera) in terms of being seen through a display (170) that defines the rear side of the third housing part (130).
[0186] According to one embodiment, the first housing part (110) may be rotatably coupled to the second housing part (120) by a first hinge structure (150). The second housing part (120) and the first housing part (110) may be rotated with respect to the first hinge structure (150). While the first housing part (110) is rotated with respect to the first hinge structure (150), the second housing part (120) may be rotated with respect to the first hinge structure (150). For example, when the second housing part (120) and the first housing part (110) are rotated with respect to the first hinge structure (150), the angular displacement of the second housing part (120) may be substantially the same as the angular displacement of the first housing part (110).
[0187] According to one embodiment, the third housing part (130) may be rotatably coupled to the second housing part (120) by a second hinge structure (160). The second housing part (120) and the third housing part (130) may be rotated about the second hinge structure (160). While the second housing part (120) is rotated about the second hinge structure (160), the third housing part (130) may be rotated about the second hinge structure (160). For example, when the second housing part (120) and the third housing part (130) are rotated about the second hinge structure (160), the angular displacement (or angular change) of the second housing part (120) may be substantially the same as the angular displacement of the third housing part (130).
[0188] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can change the state of the electronic device (100). The first hinge structure (150) and the second hinge structure (160) can provide (or enable) an unfolded state (1300a) of the electronic device (100). The unfolded state (1300a) of the electronic device (100) can be described as a state in which the first housing part (110) and the second housing part (120) are unfolded, and the second housing part (120) and the third housing part (130) are unfolded. Within the unfolded state (1300a), the front side of the first housing part (110), the front side of the second housing part (120), and / or the front side of the third housing part (130) can define the front side of the electronic device (100). In the unfolded state (1300a), the front side of the first housing part (110), the front side of the second housing part (120), and / or the front side of the third housing part (130) may face in the same direction. In the unfolded state (1300a), the electronic device (100) may provide the user with a large display area of the flexible display (140).
[0189] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can provide a single-folding state (1300b) of the electronic device (100). The single-folding state (1300b) of the electronic device (100) can be described as a state in which the first housing part (110) and the second housing part (120) are folded, and the second housing part (120) and the third housing part (130) are unfolded. For example, within the single-folding state (1300b), the front side of the second housing part (120) and the front side of the third housing part (130) may face in the same direction, and the front side of the first housing part (110) and the front side of the second housing part (120) may face in opposite directions. In a single-fold state (1300b), the electronic device (100) can provide visual information through a part of the flexible display (140) (e.g., a third display area (140c)).
[0190] According to one embodiment, the electronic device (100) can change from an unfolded state (1300a) to a multi-folded state (1300c) through a single-folded state (1300b). For example, the state of the electronic device (100) can change from an unfolded state (1300a) to a single-folded state (1300b). The state of the electronic device (100) can change from a single-folded state (1300b) to a multi-folded state (1300c). For example, when the state of the electronic device (100) changes from a single-folded state (1300b) to a multi-folded state (1300c), the folded first housing part (110) and second housing part (120) can be placed on a third housing part (130).
[0191] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can provide a multi-folding state (1300c) of the electronic device (100). The multi-folding state (1300c) of the electronic device (100) can be described as a state in which the first housing part (110) and the second housing part (120) are folded, and the second housing part (120) and the third housing part (130) are folded. In the multi-folding state (1300c), the front side of the first housing part (110) and the front side of the second housing part (120) may face in opposite directions, and the front side of the second housing part (120) and the front side of the third housing part (130) may face in opposite directions. In the multi-folding state (1300c), the front side of the first housing part (110) and the front side of the third housing part (130) may face each other in the same direction. For example, in the multi-folding state (1300c), the front side of the second housing part (120) may face the front side of the first housing part (110), and the front side of the third housing part (130) may face the rear side of the first housing part (110). In the multi-folding state (1300c), the rear side of the second housing part (120) may be exposed to the outside. A display (170) may be placed on the rear side of the third housing part (130). In the multi-folding state (1300c), the rear side of the third housing part (130) may be exposed to the outside. In a multi-folding state (1300c), the electronic device (100) can be folded to improve portability and can provide visual information through a display (170) placed in a third housing part (130).
[0192] According to one embodiment, the electronic device (100) may further include a key button (139). The key button (139) may be exposed from a structure (e.g., an opening) formed on the side of the third housing part (130) and may partially protrude outside the electronic device (100). The key button (139) may provide physical input to a processing circuit inside the electronic device (100) by pressure transmitted from the outside. The key button (139) may be implemented in other forms, such as a soft key that is not included in the electronic device (100) but is displayed on a flexible display (140) or a display (170).
[0193] According to one embodiment, a key button (139) may be positioned on the side of a third housing part (130) so as to be exposed to the outside in a multi-folding state (1300c). The key button positioned in the third housing part (130) may be moved from the left side of the electronic device (100) to the right side of the electronic device (100) as the state of the electronic device (100) changes from a multi-folding state (1300c) to an unfolded state (1300a) by a user looking at the display. For example, referring to FIG. 13a, in the unfolded state (1300a), when looking up at the flexible display (140), the key button (139) may be positioned on the right side. Referring to FIG. 13b, in the multi-folding state (1300c), when looking up at the display (170), the key button (139) may be positioned on the left side.
[0194] According to one embodiment, the flexible display (140) may define the appearance of the electronic device (100) at least partially. The flexible display (140) may be partially disposed within the housing structure (101). The flexible display (140) may define the front side of the electronic device (100). The flexible display (140) may include a first unbendable portion (141), a second unbendable portion (142), a third unbendable portion (143), a first bendable portion (144), and / or a second bendable portion (145). The first unbendable portion (141) of the flexible display (140) may be disposed on the front side of the first housing part (110). A second unbendable portion (142) of the flexible display (140) may be placed on the front side of the second housing part (120). A third unbendable portion (143) of the flexible display (140) may be placed on the front side of the third housing part (130). A first bendable portion (144) of the flexible display (140) may be placed between the first unbendable portion (141) and the second unbendable portion (142) of the flexible display (140). For example, the first bendable portion (144) of the flexible display (140) may be placed on a first hinge structure (150) connecting the first housing part (110) and the second housing part (120). The second bendable portion (145) of the flexible display (140) may be positioned between the second unbendable portion (142) and the third unbendable portion (143) of the flexible display (140). For example, the second bendable portion (145) of the flexible display (140) may be positioned on a second hinge structure (160) connecting the second housing part (120) and the third housing part (130).
[0195] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) may have the first unbendable portion (141) of the flexible display (140), the second unbendable portion (142) of the flexible display (140), and / or the third unbendable portion (143) of the flexible display (140) oriented substantially in the same direction. In the unfolded state (1300a), the first bendable portion (144) and the second bendable portion (145) may be positioned in a horizontal plane substantially in the same direction as the first unbendable portion (141), the second unbendable portion (142), and / or the third unbendable portion (143).
[0196] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can provide a single-folding state (1300b) of the electronic device (100). In the single-folding state (1300b), the first unbendable portion (141) of the flexible display (140) may face the second unbendable portion (142) of the flexible display (140), and the third unbendable portion (143) of the flexible display (140) may face the same direction as the second unbendable portion (142) of the flexible display (140). For example, the second unbendable portion (142) and the third unbendable portion (143) may be positioned substantially on the same horizontal plane.
[0197] According to one embodiment, in a single-folding state (1300b), the first bendable portion (144) of the flexible display (140) is bent by the first hinge structure (150), so that the first bendable portion (144) of the flexible display (140) can be folded such that the first unbendable portion (141) of the flexible display (140) and the second unbendable portion (142) of the flexible display (140) face in different directions.
[0198] According to one embodiment, in a single-folding state (1300b), the second bendable portion (145) of the flexible display (140) is maintained in an unfolded state by the second hinge structure (160), so that the second bendable portion (145) of the flexible display (140) can be unfolded such that the second unbendable portion (142) of the flexible display (140) and the third unbendable portion (143) of the flexible display (140) face in the same direction.
[0199] According to one embodiment, the first hinge structure (150) and the second hinge structure (160) can provide a multi-folding state (1300c) of the electronic device (100). In the multi-folding state (1300c), the second unbendable portion (142) of the flexible display (140) may face the first unbendable portion (141) of the flexible display (140), and the third unbendable portion (143) of the flexible display (140) may face the rear side of the first housing part (110).
[0200] According to one embodiment, in a multi-folding state (1300c), the first bendable portion (144) of the flexible display (140) is bent by the first hinge structure (150), so that the first bendable portion (144) of the flexible display (140) can be folded such that the first unbendable portion (141) of the flexible display (140) and the second unbendable portion (142) of the flexible display (140) face in different directions.
[0201] According to one embodiment, in a multi-folding state (1300c), the second bendable portion (145) of the flexible display (140) is bent by the second hinge structure (160), so that the second bendable portion (145) of the flexible display (140) can be folded such that the second unbendable portion (142) of the flexible display (140) and the third unbendable portion (143) of the flexible display (140) face in different directions. The second bendable portion (145) may further include a first deformation portion (145a), a second deformation portion (145b), and / or a flat portion (145c). The first deformation portion (145a) may be positioned between the planar portion (145c) and the second unbendable portion (142), and the second deformation portion (145b) may be positioned between the planar portion (145c) and the third unbendable portion (143). The planar portion (145c) may be positioned between the first deformation portion (145a) and the second deformation portion (145b). The planar portion (145c) may be supported by a support plate that is distinct from the hinge plates of the second hinge structure (160). Regardless of the state of the electronic device (100), the planar portion (145c) may remain flat. The first deformation part (145a) and the second deformation part (145b) are unfolded in the unfolded state (1300a) and / or the single-folding state (1300b), and in the multi-folding state (1300c), the first deformation part (145a) and the second deformation part (145b) can be folded so that the second unbendable part (142) and the third unbendable part (143) face in different directions. In the multi-folding state (1300c), the first housing part (110) can be positioned between the second housing part (120) and the third housing part (130). In the multi-folding state (1300c), the second bendable portion (145) of the flexible display (140) placed on the second hinge structure (160) may partially face the side (110c) of the first housing part (110).
[0202] According to one embodiment, the display area of the flexible display (140) may include a first display area (140a), a second display area (140b), and / or a third display area (140c). The display area represents an area capable of providing visual information from the flexible display (140). In the unfolded state (1300a), the entire display area of the flexible display (140) may be visible from the front side of the housing structure (101). For example, in the unfolded state (1300a), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may be visually exposed. The electronic device (100) may provide a large display area to the user that includes the first display area (140a), the second display area (140b), and / or the third display area (140c).
[0203] According to one embodiment, in a single-folding state (1300b), the display area of the flexible display (140) may be partially visible from the front side of the third housing part (130). For example, the third unbendable part (143) may be visually exposed, while the first display area (140a) and the second display area (140b) may not be visually exposed.
[0204] According to one embodiment, within the multi-folding state (1300c), the display area of the flexible display (140) may not be visible. For example, within the multi-folding state (1300c), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may not be visually exposed.
[0205] According to one embodiment, as a non-limiting example, when the flexible display (140) is used to display a screen within the unfolded state (1300a) of the electronic device (100), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may be activated. As a non-limiting example, when the flexible display (140) is used to display a screen within the single-folded state (1300b) of the electronic device (100), the third display area (140c) may be activated, and the first display area (140a) and the second display area (140b) of the flexible display (140) may be deactivated. As an example not limited to, within the multi-folding state (1300c) of the electronic device (100), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may be disabled.
[0206] According to one embodiment, as a non-limiting example, when the flexible display (140) is used to display a screen within the unfolded state (1300a) of the electronic device (100), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may display visual information. As a non-limiting example, when the flexible display (140) is used to display a screen within the single-folded state (1300b) of the electronic device (100), the third display area (140c) may provide visual information, and the first display area (140a) and the second display area (140b) of the flexible display (140) may provide a black image. As an example not limited to, within a multi-folding state (1300c), the first display area (140a), the second display area (140b), and / or the third display area (140c) of the flexible display (140) may provide a black image.
[0207] FIGS. 14a and FIGS. 14b are flowcharts illustrating a method for identifying candidate cameras for an application among a plurality of cameras based on the state of an electronic device.
[0208] According to one embodiment, referring to FIG. 14a and FIG. 14b, in operation 1401, at least one processor (10 of FIG. 1) may acquire a first image using first application software through at least one second camera among a plurality of cameras (30 of FIG. 1) (or rear cameras (e.g., camera (32 of FIG. 13a), camera (33 of FIG. 13a), and / or camera (34 of FIG. 13a)). For example, the second cameras may be positioned within a second housing part (120 of FIG. 13a) of an electronic device (100 of FIG. 13a) and may be visible from the rear side of the second housing part (120 of FIG. 13a) of the electronic device (100 of FIG. 13a). By example, without limitation, the first application software may be described as camera application software.
[0209] According to one embodiment, in operation 1402, at least one processor (10 in FIG. 1) can identify an event for acquiring a second image using a second application software while maintaining the acquisition of the first image using the first application software while the first image is acquired. The second application software may be application software distinct from the first application software. For example, the event may be an event in which input for a UI object for acquiring an image through a camera is received in the second application software, which is message application software, while the first image is acquired using the first application software, which is camera application software. As another example, the event may be an event in which the second application software, which is different camera application software, is executed while the first image is acquired using the first application software, which is camera application software.
[0210] According to one embodiment, in operation 1403, at least one processor (10 in FIG. 1) can identify whether the state of the electronic device (100 in FIG. 1) corresponds to an unfolded state through at least one sensor (40 in FIG. 1). The state of the electronic device (100 in FIG. 1) may correspond to an unfolded state, a single-folded state, or a multi-folded state. An unfolded state may be described as a state in which the first housing part (110 in FIG. 13a) and the second housing part (120 in FIG. 13a) are unfolded, and the second housing part (120 in FIG. 13a) and the third housing part (130 in FIG. 13a) are unfolded. A single-folding state can be described as a state in which the first housing part (110 in FIG. 13a) and the second housing part (120 in FIG. 13a) are folded, and the second housing part (120 in FIG. 13a) and the third housing part (130 in FIG. 13a) are unfolded. A multi-folding state can be described as a state in which the first housing part (110 in FIG. 13a) and the second housing part (120 in FIG. 13a) are folded, and the second housing part (120 in FIG. 13a) and the third housing part (130 in FIG. 13a) are folded.
[0211] According to one embodiment, in operation 1404, at least one processor (10 in FIG. 1) may identify each of at least one camera among a plurality of cameras (30 in FIG. 1), excluding at least one second camera for the first application software, as a candidate camera to be used for the second application software, based on the identification of an event while the electronic device (100 in FIG. 1) is in an unfolded state (e.g., in the case of the example of operation 1403). For example, the candidate camera may include at least one first camera (or an internal front camera (e.g., Camera (31 in FIG. 13a))), second cameras excluding at least one second camera used for the first application software (or rear cameras (e.g., Camera (32 in FIG. 13a), Camera (33 in FIG. 13a), and / or Camera (34 in FIG. 13a)), and / or at least one third camera (or an external front camera (e.g., Camera (35 in FIG. 13c))). For example, at least one first camera may be visible through a portion of a flexible display (140 in FIG. 13a) disposed within a second housing part (120 in FIG. 13a) of the electronic device (100 in FIG. 13a). For example, at least one third camera may be visible through a rear of a third housing part (130 in FIG. 13c) of the electronic device (100 in FIG. 13c). It can be seen through a display (170 in FIG. 13c) that defines at least a part of the side.
[0212] According to one embodiment, in operation 1405, at least one processor (10 in FIG. 1) can determine whether a second image to be acquired using the second application software corresponds to a first image being acquired using the first application software, based on the identification of an event while the electronic device (100 in FIG. 1) is in an unfolded state. For example, at least one processor (10 in FIG. 1) can determine that the second image corresponds to the first image if at least a portion of the first image and at least a portion of the second image are substantially identical. For example, at least one processor (10 in FIG. 1) can determine that the first image and the second image correspond to each other if the first image is an image acquired by one of the second cameras (e.g., a wide-angle camera) and the second image is an image to be acquired by another of the second cameras (e.g., a telephoto camera).
[0213] According to one embodiment, in operation 1406, at least one processor (10 of FIG. 1) may acquire the second image using the second application software through at least one camera among the second cameras (or rear cameras (e.g., camera (32 of FIG. 13a), camera (33 of FIG. 13a), and / or camera (34 of FIG. 13a)) excluding at least one second camera for the first application software, based on a determination that the second image corresponds to the first image (e.g., in the case of the example of operation 1405).
[0214] According to one embodiment, in operation 1407, at least one processor (10 in FIG. 1) may identify each of at least one camera among at least one first camera (or internal front camera (e.g., camera (31 in FIG. 13a))) or at least one third camera (or external front camera (e.g., camera (35 in FIG. 13c))) as a candidate camera to be used for the second application software based on a determination that the second image does not correspond to the first image (e.g., in the case of No in operation 1405).
[0215] According to one embodiment, at least one processor (10 in FIG. 1) can identify, using the second application software, information about a camera among a plurality of cameras (30 in FIG. 1) that was used for the second application software, based on a determination that the second image does not correspond to the first image while the electronic device (100 in FIG. 1) is in an unfolded state (e.g., the case of yes in operation 1403 and no in operation 1405). At least one processor (10 in FIG. 1) can identify a camera to be used for the second application software according to the orientation of the camera (e.g., inside or outside) indicated by the information. For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one first camera (or internal front camera (e.g., camera (31 in FIG. 13a))) using second application software based on identifying that at least one first camera (or internal front camera (e.g., camera (31 in FIG. 13a))) is indicated by information. For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one third camera (or external front camera (e.g., camera (35 in FIG. 13c))) using second application software, based on identifying by information that one of the second cameras (or rear cameras (e.g., camera (32 in FIG. 13a), camera (33 in FIG. 13a), and / or camera (34 in FIG. 13a))) and / or at least one third camera (or external front camera (e.g., camera (35 in FIG. 13c))) is indicated.
[0216] According to one embodiment, at least one processor (10 in FIG. 1) can identify the orientation (or rotational state) of the electronic device (100 in FIG. 1) through at least one sensor (40 in FIG. 1) based on a determination that the second image does not correspond to the first image while the electronic device (100 in FIG. 1) is in an unfolded state (e.g., Yes in operation 1403 and No in operation 1405). For example, the orientation of the electronic device (100 in FIG. 1) may be represented by a rotation angle along an axis (e.g., x-axis, y-axis, and / or z-axis). For example, at least one sensor (40 in FIG. 1) may include one or more sensors (e.g., a gyroscope sensor) for identifying the orientation of the electronic device (100 in FIG. 1). For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one first camera (or internal front camera (e.g., camera (31 in FIG. 13a))) using second application software based on identifying the posture of an electronic device (100 in FIG. 1) corresponding to a first range. For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one third camera (or external front camera (e.g., camera (35 in FIG. 13c))) using second application software based on identifying the posture of an electronic device (100 in FIG. 1) corresponding to a second range.
[0217] According to one embodiment, at least one processor (10 in FIG. 1) can identify whether an external electronic device (e.g., keyboard) is connected to the electronic device (100 in FIG. 1) based on a determination that the second image does not correspond to the first image while the electronic device (100 in FIG. 1) is in an unfolded state (e.g., Yes in operation 1403 and No in operation 1405). For example, at least one processor (10 in FIG. 1) can acquire the second image through at least one first camera (or internal front camera (e.g., Camera (31 in FIG. 13a))) using second application software based on the determination that no external electronic device is connected to the electronic device (100 in FIG. 1). For example, at least one processor (10 in FIG. 1) can acquire a second image through at least one third camera (or external front camera (e.g., camera (35 in FIG. 13c))) using second application software based on identifying that an external electronic device is connected to the electronic device (100 in FIG. 1).
[0218] According to one embodiment, in operation 1408, at least one processor (10 in FIG. 1) may identify at least one camera among a plurality of cameras (30 in FIG. 1), excluding at least one first camera (or an internal front camera (e.g., camera (31 in FIG. 13a))), as a candidate camera to be used for the second application software, based on whether an event is identified while the electronic device (100 in FIG. 1) is in a single-folding state or a multi-folding state (e.g., in the case of No in operation 1403). For example, the candidate cameras may be at least one of the second cameras (or rear cameras (e.g., camera (32 in FIG. 13a), camera (33 in FIG. 13a), and / or camera (34 in FIG. 13a)) or at least one third camera (or external front camera (e.g., camera (35 in FIG. 13c))), excluding at least one second camera used for the first application software. For example, the candidate cameras may be described as a plurality of cameras (30 in FIG. 1) excluding at least one second camera for the first application software. For example, since at least one first camera (or internal front camera (e.g., camera (31 in FIG. 13a))) is covered by the front side of the first housing part (110 in FIG. 13a) of the electronic device (100 in FIG. 1) while the electronic device (100 in FIG. 1) is in a single-folding state or a multi-folding state, at least one processor (of FIG. 1 10) may exclude at least one first camera (or internal front camera (e.g., camera (31 in FIG. 13a))) from the candidate cameras.
[0219] According to one embodiment, in operation 1409, at least one processor (10 in FIG. 1) may determine whether a second image to be acquired using the second application software corresponds to a first image being acquired using the first application software, based on the identification of an event while the electronic device (100 in FIG. 1) is in a single-folding state or a multi-folding state. For example, at least one processor (10 in FIG. 1) may determine that the second image corresponds to the first image if at least a portion of the first image and at least a portion of the second image are substantially identical. For example, at least one processor (10 in FIG. 1) may determine that the first image and the second image correspond to each other if the first image is an image acquired by one of the second cameras (e.g., a wide-angle camera) and the second image is an image to be acquired by another of the second cameras (e.g., a telephoto camera).
[0220] According to one embodiment, in operation 1410, at least one processor (10 of FIG. 1) may acquire the second image using the second application software through at least one camera among the second cameras (or rear cameras (e.g., camera (32 of FIG. 13a), camera (33 of FIG. 13a), and / or camera (34 of FIG. 13a))) based on a determination that the second image corresponds to the first image (e.g., in the case of the example of operation 1409).
[0221] According to one embodiment, in operation 1411, at least one processor (10 in FIG. 1) can acquire the second image using second application software through at least one third camera (or external front camera (e.g., camera (35 in FIG. 13c))) included in a plurality of cameras (30) based on a determination that the second image does not correspond to the first image (e.g., in the case of No in operation 1409).
[0222] According to one embodiment, at least one processor (10 in FIG. 1) can identify the location of an execution screen of a first application software and / or the location of an execution screen of a second application software displayed as a split view. For example, at least one processor (10 in FIG. 1) can identify a candidate camera for the second application software based on the relationship between the locations of the execution screens and the locations of each of the plurality of cameras (30 in FIG. 1).
[0223] According to one embodiment, an electronic device (100 of FIG. 1) can enhance the user experience for application software using a camera by identifying a candidate camera for another application software based on the state of the electronic device (100 of FIG. 1) while an image is acquired through the camera using application software.
[0224] According to one embodiment, the electronic device (100 of FIG. 1) may correspond to the electronic device (1501) described with reference to FIG. 15 below.
[0225] FIG. 15 is a block diagram of an electronic device in a network environment according to various embodiments.
[0226] According to one embodiment, with reference to FIG. 15, in a network environment (1500), an electronic device (1501) may communicate with an electronic device (1502) through a first network (1598) (e.g., a short-range wireless communication network) or with at least one of an electronic device (1504) or a server (1508) through a second network (1599) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (1501) may communicate with the electronic device (1504) through a server (1508). According to one embodiment, the electronic device (1501) may include a processor (1520), memory (1530), input module (1550), sound output module (1555), display module (1560), audio module (1570), sensor module (1576), interface (1577), connection terminal (1578), haptic module (1579), camera module (1580), power management module (1588), battery (1589), communication module (1590), subscriber identification module (1596), or antenna module (1597). In some embodiments, at least one of these components (e.g., connection terminal (1578)) may be omitted from the electronic device (1501), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (1576), camera module (1580), or antenna module (1597)) may be integrated into a single component (e.g., display module (1560)).
[0227] According to one embodiment, the processor (1520) can control at least one other component (e.g., a hardware or software component) of the electronic device (1501) connected to the processor (1520) by executing software (e.g., a program (1540)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (1520) can store commands or data received from other components (e.g., a sensor module (1576) or a communication module (1590)) in a volatile memory (1532), process the commands or data stored in the volatile memory (1532), and store the resulting data in a non-volatile memory (1534). According to one embodiment, the processor (1520) may include a main processor (1521) (e.g., a central processing unit or an application processor) or an auxiliary processor (1523) that can operate independently or together with it (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor). For example, if the electronic device (1501) includes a main processor (1521) and an auxiliary processor (1523), the auxiliary processor (1523) may be configured to use less power than the main processor (1521) or to be specialized for a designated function. The auxiliary processor (1523) may be implemented separately from the main processor (1521) or as part thereof.
[0228] According to one embodiment, the auxiliary processor (1523) may control at least some of the functions or states associated with at least one component of the electronic device (1501) (e.g., display module (1560), sensor module (1576), or communication module (1590)) on behalf of the main processor (1521) while the main processor (1521) is in an inactive (e.g., sleep) state, or together with the main processor (1521) while the main processor (1521) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (1523) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (1580) or communication module (1590)). According to one embodiment, the auxiliary processor (1523) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (1501) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (1508)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of these, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0229] According to one embodiment, the memory (1530) may store various data used by at least one component of the electronic device (1501) (e.g., a processor (1520) or a sensor module (1576)). The data may include, for example, input data or output data for software (e.g., a program (1540)) and related commands. The memory (1530) may include volatile memory (1532) or non-volatile memory (1534).
[0230] According to one embodiment, the program (1540) may be stored as software in memory (1530) and may include, for example, an operating system (1542), middleware (1544), or an application (1546).
[0231] According to one embodiment, the input module (1550) may receive commands or data to be used by a component of the electronic device (1501) (e.g., processor (1520)) from outside the electronic device (1501) (e.g., user). The input module (1550) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0232] According to one embodiment, the sound output module (1555) can output an audio signal to the outside of the electronic device (1501). The sound output module (1555) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0233] According to one embodiment, the display module (1560) can visually provide information to an external (e.g., user) of the electronic device (1501). The display module (1560) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (1560) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by a touch.
[0234] According to one embodiment, the audio module (1570) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (1570) can acquire sound through an input module (1550) or output sound through an audio output module (1555) or an external electronic device (e.g., electronic device (1502)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (1501).
[0235] According to one embodiment, the sensor module (1576) can detect the operating state of the electronic device (1501) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (1576) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0236] According to one embodiment, the interface (1577) may support one or more specified protocols that can be used for the electronic device (1501) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (1502)). According to one embodiment, the interface (1577) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0237] According to one embodiment, the connection terminal (1578) may include a connector through which the electronic device (1501) can be physically connected to an external electronic device (e.g., electronic device (1502)). According to one embodiment, the connection terminal (1578) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0238] According to one embodiment, the haptic module (1579) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (1579) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0239] According to one embodiment, the camera module (1580) can capture still images and video. According to one embodiment, the camera module (1580) may include one or more lenses, image sensors, image signal processors, or flashes.
[0240] According to one embodiment, the power management module (1588) can manage power supplied to the electronic device (1501). According to one embodiment, the power management module (1588) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0241] According to one embodiment, the battery (1589) can supply power to at least one component of the electronic device (1501). According to one embodiment, the battery (1589) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0242] According to one embodiment, the communication module (1590) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (1501) and an external electronic device (e.g., electronic device (1502), electronic device (1504), or server (1508)), and the performance of communication through the established communication channel. The communication module (1590) may include one or more communication processors that operate independently of the processor (1520) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (1590) may include a wireless communication module (1592) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (1594) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (1504) through a first network (1598) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (1599) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (1592) can identify or authenticate the electronic device (1501) within a communication network such as the first network (1598) or the second network (1599) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (1596).
[0243] According to one embodiment, the wireless communication module (1592) can support a 5G network following a 4G network and next-generation communication technology, for example, new radio access technology. The NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (1592) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (1592) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (1592) can support various requirements specified in the electronic device (1501), external electronic device (e.g., electronic device (1504)), or network system (e.g., second network (1599)). According to one embodiment, the wireless communication module (1592) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0244] According to one embodiment, the antenna module (1597) may transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (1597) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (1597) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (1598) or a second network (1599), may be selected from the plurality of antennas, for example, by a communication module (1590). The signal or power may be transmitted or received between the communication module (1590) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (1597).
[0245] According to various embodiments, the antenna module (1597) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0246] According to one embodiment, at least some of the components are connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and can exchange signals (e.g., commands or data) with each other.
[0247] According to one embodiment, commands or data may be transmitted or received between an electronic device (1501) and an external electronic device (1504) through a server (1508) connected to a second network (1599). Each of the external electronic devices (1502, or 1504) may be the same or a different type of device as the electronic device (1501). According to one embodiment, all or part of the operations performed on the electronic device (1501) may be performed on one or more of the external electronic devices (1502, 1504, or 1508). For example, if the electronic device (1501) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (1501) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive a request may execute at least part of the requested function or service, or additional functions or services related to the request, and transmit the result of the execution to the electronic device (1501). The electronic device (1501) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (1501) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (1504) may include an Internet of Things (IoT) device. The server (1508) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (1504) or the server (1508) may be included within a second network (1599).The electronic device (1501) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0248] The technical problems to be solved in this disclosure are not limited to those mentioned above, and other technical problems not mentioned will be clearly understood by those skilled in the art to which this disclosure pertains.
[0249] According to one embodiment, a multi-foldable electronic device (e.g., electronic device (100)) comprises: a housing (e.g., housing structure (101)) comprising a first housing part (e.g., first housing part (110)), a second housing part (e.g., second housing part (120)) rotatably coupled to the first housing part, and a third housing part (e.g., third housing part (130)) rotatably coupled to the second housing part; a flexible display (e.g., flexible display (170)) defining at least a portion of the front side of the first housing part, at least a portion of the front side of the second housing part, and at least a portion of the front side of the third housing part; and a display (e.g., display (170)) defining at least a portion of the rear side of the second housing part. It may include a plurality of cameras (e.g., a plurality of cameras (30)) comprising at least one first camera (e.g., camera (31)) visible through a portion of a flexible display disposed within a third housing part, second cameras (e.g., camera (32), camera (33), and camera (34)) disposed within the third housing part and visible from the rear side of the third housing part, and at least one third camera (e.g., camera (35)) visible through a display; at least one processor (e.g., at least one processor (10)) comprising a processing circuit; and a memory (e.g., memory (20)) that stores instructions and includes one or more storage media.When the instructions are executed individually or collectively by at least one processor: acquiring a first image through at least one second camera among the second cameras using the first application software; identifying an event for acquiring the second image using the second application software; and identifying each of at least one first camera, the second cameras excluding at least one second camera, or at least one third camera as candidate cameras to be used for the second application software, based on the identification of an event while the multi-foldable electronic device is in an unfolded state in which the first housing part and the second housing part are unfolded and the second housing part and the third housing part are unfolded, or in a single-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are unfolded; And, based on the identification of an event while the multi-foldable electronic device is in a multi-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are folded, the multi-foldable electronic device may be able to identify each of the second cameras excluding at least one second camera or at least one third camera as a candidate camera to be used for the second application software.
[0250] According to one embodiment, the event may be identified while the first image is being acquired. The event may be for acquiring the second image using the second application software while maintaining the acquisition of the first image using the first application software. Instructions, when executed individually or collectively by at least one processor, may cause the multi-foldable electronic device to: determine whether the second image to be acquired using the second application software corresponds to the first image being acquired using the first application software, based on the event being identified while the multi-foldable electronic device is in an unfolded state or a single-folded state; acquire the second image using the second application software through at least one camera among the second cameras excluding at least one second camera, based on the determination that the second image corresponds to the first image; and identify each of at least one first camera or at least one third camera as a candidate camera to be used for the second application software, based on the determination that the second image does not correspond to the first image.
[0251] According to one embodiment, instructions, when executed individually or collectively by at least one processor, may cause a multi-foldable electronic device to: identify, using the second application software, information about a camera used for the second application software among a plurality of cameras based on a determination that the second image does not correspond to the first image; acquire a second image through at least one first camera using the second application software based on identifying that the camera indicated by the information corresponds to at least one first camera; and acquire a second image through at least one third camera using the second application software based on identifying that the camera indicated by the information corresponds to one of the second cameras and at least one third camera.
[0252] According to one embodiment, the multi-foldable electronic device may further include at least one sensor (e.g., at least one sensor (40)). Instructions, when executed individually or collectively by at least one processor, may cause the multi-foldable electronic device to: identify the orientation of the multi-foldable electronic device through at least one sensor based on a determination that the second image does not correspond to the first image; acquire the second image through at least one first camera using second application software based on the identification of the orientation of the multi-foldable electronic device corresponding to the first range; and acquire the second image through at least one third camera using second application software based on the identification of the orientation of the multi-foldable electronic device corresponding to the second range.
[0253] According to one embodiment, instructions can cause the multi-foldable electronic device to be executed individually or collectively by at least one processor to: determine whether a second image to be acquired using the second application software corresponds to a first image being acquired using the first application software, based on an event being identified while the multi-foldable electronic device is in a multi-folding state; acquire the second image through the second application software via at least one camera among the second cameras excluding at least one second camera, based on the determination that the second image corresponds to the first image; and acquire the second image through the second application software via at least one third camera, based on the determination that the second image does not correspond to the first image.
[0254] According to one embodiment, instructions, when executed individually or collectively by at least one processor, may cause the multi-foldable electronic device to identify each of at least one camera among the second cameras, excluding at least one first camera or at least one second camera, as a candidate camera to be used for the second application software, based on the identification of an event while the multi-foldable electronic device is in a state where the second housing part is placed on an outer surface and the second housing part and the third housing part are partially folded.
[0255] According to one embodiment, instructions can cause a multi-foldable electronic device to be executed individually or collectively by at least one processor to: identify a scene of a first image acquired through at least one camera among the second cameras excluding at least one second camera based on an event; and identify at least one second camera as a camera to be used for the second application software based on the identification of an identified scene satisfying a reference condition.
[0256] According to one embodiment, instructions, when executed individually or collectively by at least one processor: based on identifying at least one second camera as a camera to be used for second application software; identifying a buffer used to acquire a first image to maintain the acquisition of a first image using first application software through at least one second camera; and by accessing the identified buffer, a multi-foldable electronic device may be provided to acquire a second image corresponding to the first image using second application software.
[0257] According to one embodiment, a multi-foldable electronic device (e.g., electronic device (100)) comprises: a housing (e.g., housing structure (101)) comprising a first housing part (e.g., first housing part (110)), a second housing part (e.g., second housing part (120)) rotatably coupled to the first housing part, and a third housing part (e.g., third housing part (130)) rotatably coupled to the second housing part; a flexible display (e.g., flexible display (170)) defining at least a portion of the front side of the first housing part, at least a portion of the front side of the second housing part, and at least a portion of the front side of the third housing part; and a display (e.g., display (170)) defining at least a portion of the rear side of the third housing part. It may include a plurality of cameras (e.g., a plurality of cameras (30)) comprising at least one first camera (e.g., camera (31)) visible through a portion of a flexible display disposed within a second housing part, second cameras (e.g., camera (32), camera (33), and camera (34)) disposed within the second housing part and visible from the rear side of the second housing part, and at least one third camera (e.g., camera (35)) visible through a display; at least one processor (e.g., at least one processor (10)) comprising a processing circuit; and a memory (e.g., memory (20)) that stores instructions and includes one or more storage media.When the instructions are executed individually or collectively by at least one processor: acquiring a first image through at least one second camera among the second cameras using the first application software; identifying an event for acquiring a second image using the second application software; and identifying each of at least one camera among at least one first camera, the second cameras excluding at least one second camera, or at least one third camera as a candidate camera to be used for the second application software, based on the identification of an event while the multi-foldable electronic device is in an unfolded state in which the first housing part and the second housing part are unfolded and the second housing part and the third housing part are unfolded; and the multi-foldable electronic device may be able to identify each of the second camera, excluding at least one second camera, or at least one third camera as candidate cameras to be used for the second application software, based on an event being identified while the multi-foldable electronic device is in a single-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are unfolded, or in a multi-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are folded.
[0258] According to one embodiment, the event may be identified while the first image is being acquired. The event may be for acquiring the second image using the second application software while maintaining the acquisition of the first image using the first application software. Instructions, when executed individually or collectively by at least one processor, may cause the multi-foldable electronic device to: determine whether the second image to be acquired using the second application software corresponds to the first image being acquired using the first application software based on the identification of the event while the multi-foldable electronic device is in an unfolded state; acquire the second image through the second application software via at least one camera among the second cameras excluding at least one second camera based on the determination that the second image corresponds to the first image; and identify each of at least one first camera or at least one third camera as a candidate camera to be used for the second application software based on the determination that the second image does not correspond to the first image.
[0259] According to one embodiment, instructions, when executed individually or collectively by at least one processor, may cause a multi-foldable electronic device to: identify, using the second application software, information about a camera used for the second application software among a plurality of cameras based on a determination that the second image does not correspond to the first image; acquire a second image through at least one first camera using the second application software based on identifying that the camera indicated by the information corresponds to at least one first camera; and acquire a second image through at least one third camera using the second application software based on identifying that the camera indicated by the information corresponds to one of the second cameras and at least one third camera.
[0260] According to one embodiment, the multi-foldable electronic device may further include at least one sensor (e.g., at least one sensor (40)). Instructions, when executed individually or collectively by at least one processor, may cause the multi-foldable electronic device to: identify the orientation of the multi-foldable electronic device through at least one sensor based on a determination that the second image does not correspond to the first image; acquire the second image through at least one first camera using second application software based on the identification of the orientation of the multi-foldable electronic device corresponding to the first range; and acquire the second image through at least one third camera using second application software based on the identification of the orientation of the multi-foldable electronic device corresponding to the second range.
[0261] According to one embodiment, instructions may cause the multi-foldable electronic device to be executed individually or collectively by at least one processor to: determine whether a second image to be acquired using the second application software corresponds to a first image being acquired using the first application software, based on an event being identified while the multi-foldable electronic device is in a single-folding state or a multi-folding state; acquire the second image through the second application software via at least one camera among the second cameras excluding at least one second camera, based on the determination that the second image corresponds to the first image; and acquire the second image through the second application software via at least one third camera, based on the determination that the second image does not correspond to the first image.
[0262] According to one embodiment, instructions can cause a multi-foldable electronic device to be executed individually or collectively by at least one processor: based on an event, to identify a scene of a first image acquired through at least one second camera among the second cameras; and based on the identification of an identified scene satisfying a reference condition, to identify at least one second camera as a camera to be used for the second application software.
[0263] According to one embodiment, instructions, when executed individually or collectively by at least one processor: based on identifying at least one second camera as a camera to be used for second application software; identifying a buffer used to acquire a first image to maintain the acquisition of a first image using first application software through at least one second camera; and by accessing the identified buffer, a multi-foldable electronic device may be provided to acquire a second image corresponding to the first image using second application software.
[0264] According to one embodiment, an electronic device (e.g., electronic device (100)) may include a camera (e.g., a plurality of cameras (30)); at least one processor (e.g., at least one processor (10)) comprising a processing circuit; and a memory (e.g., memory (20)) that stores instructions and includes one or more storage media. The instructions may cause the electronic device to acquire a first image through a camera using a first application software when executed individually or collectively by at least one processor: to acquire a first image through a camera using a first application software while acquiring the first image using the first application software; to identify an event to acquire a second image through a camera using a second application software while acquiring the first image using the first application software; to identify a buffer used to acquire the first image to maintain the acquisition of the first image through the camera using the first application software based on the event; and to acquire a second image corresponding to the first image using the second application software by accessing the identified buffer.
[0265] According to one embodiment, the instructions, when executed individually or collectively by at least one processor, may cause an electronic device to: identify, using second application software, an input for capturing a second image while a first image and a second image are being acquired; change, using first application software, a camera setting based on the input from a first setting set according to first application software to a second setting set according to second application software; and acquire a second image captured according to the changed setting of the camera using second application software.
[0266] According to one embodiment, when the instructions are executed individually or collectively by at least one processor: the electronic device may be caused to restore the camera settings from the second settings to the first settings using the first application software based on acquiring a second image captured using the second application software.
[0267] According to one embodiment, the instructions, when executed individually or collectively by at least one processor, may cause an electronic device to: identify, using second application software, an input for capturing a second image while a first image and a second image are being acquired; acquire, using second application software, a second image captured through a camera based on the input; and modify, using second application software, the captured second image according to the settings of the second application software.
[0268] According to one embodiment, instructions, when executed individually or collectively by at least one processor: identify a scene of a first image through a camera using first application software based on an event; and cause an electronic device to identify the camera as a camera to be used for second camera application software based on the identification of an identified scene satisfying a reference condition.
[0269] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs.
[0270] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0271] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of such embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or multiple items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or any possible combination thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish a component from another corresponding component and do not limit the components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that the component may be connected to the other component directly (e.g., via a wire), wirelessly, or through a third component.
[0272] As used in the various embodiments of this document, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of a component or part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0273] Various embodiments of the present document may be implemented as software (e.g., program (1540)) comprising one or more instructions stored in a storage medium (e.g., internal memory (1536) or external memory (1538)) readable by a machine (e.g., electronic device (1501)). For example, a processor (e.g., processor (1520)) of the machine (e.g., electronic device (1501)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to at least one called instruction. One or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0274] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0275] According to various embodiments, each component (e.g., module or program) of the described components may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as they were performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In a multi-foldable electronic device, A housing comprising a first housing part, a second housing part rotatably coupled to the first housing part, and a third housing part rotatably coupled to the second housing part; A flexible display defining at least a portion of the front side of the first housing part, at least a portion of the front side of the second housing part, and at least a portion of the front side of the third housing part; A display defining at least a portion of the rear side of the second housing part; A plurality of cameras including at least one first camera visible through a portion of the flexible display disposed within the third housing part, second cameras disposed within the third housing part and visible from the rear side of the third housing part, and at least one third camera visible through the display; At least one processor including a processing circuit; and Memory that stores instructions and includes one or more storage media, When the above instructions are executed individually or collectively by the at least one processor: Acquiring a first image using a first application software through at least one of the second cameras; Identifying an event for acquiring a second image using the above-mentioned second application software; Based on the identification of the event while the multi-foldable electronic device is in an unfolded state in which the first housing part and the second housing part are unfolded and the second housing part and the third housing part are unfolded, or in a single-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are unfolded, each of the at least one first camera, the second cameras excluding the at least one second camera, or the at least one third camera is identified as a candidate camera to be used for the second application software; and Based on the identification of the event while the multi-foldable electronic device is in a multi-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are folded, each of the second cameras excluding the at least one second camera or at least one of the at least one third camera is identified as a candidate camera to be used for the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
2. In Claim 1, The above event is identified while the first image is acquired, and The above event is for acquiring the second image using the second application software while maintaining the acquisition of the first image using the first application software, and When the above instructions are executed individually or collectively by the at least one processor: Based on the identification of the event while the multi-foldable electronic device is in the unfolded state or the single-folded state, determining whether the second image to be acquired using the second application software corresponds to the first image being acquired using the first application software; Based on the determination that the second image corresponds to the first image, the second image is acquired using the second application software through at least one of the second cameras excluding the at least one second camera; and Based on the determination that the second image does not correspond to the first image, each of the at least one first camera or the at least one third camera is identified as a candidate camera to be used for the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
3. In Claim 2, When the above instructions are executed individually or collectively by the at least one processor: Based on the determination that the second image does not correspond to the first image, information regarding the camera among the plurality of cameras that was used for the second application software is identified using the second application software; Based on identifying that the camera represented by the above information corresponds to the at least one first camera, the second image is acquired through the at least one first camera using the second application software; and Based on identifying that the camera represented by the above information corresponds to one of the second cameras and the at least one third camera, the second image is acquired through the at least one third camera using the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
4. In Claim 2, The above multi-foldable electronic device further includes at least one sensor, and When the above instructions are executed individually or collectively by the at least one processor: Based on the determination that the second image does not correspond to the first image, the orientation of the multi-foldable electronic device is identified through the at least one sensor; Based on identifying the attitude of the multi-foldable electronic device corresponding to the first range, the second image is acquired through the at least one first camera using the second application software; and Based on identifying the attitude of the multi-foldable electronic device corresponding to the second range, the second image is acquired through the at least one third camera using the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
5. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor: Based on the identification of the event while the multi-foldable electronic device is in the multi-folding state, determining whether the second image to be acquired using the second application software corresponds to the first image being acquired using the first application software; Based on the determination that the second image corresponds to the first image, the second image is acquired through at least one of the second cameras, excluding the at least one second camera, via the second application software; and Based on the determination that the second image does not correspond to the first image, the second image is acquired through the at least one third camera via the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
6. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor: Based on the fact that the event is identified while the second housing part is placed on an outer surface and the second housing part and the third housing part are in a partially folded state, the multi-foldable electronic device identifies each of at least one camera among the second cameras, excluding at least one first camera or at least one second camera, as a candidate camera to be used for the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
7. In Claim 1, When the above instructions are executed individually or collectively by the at least one processor: Based on the above event, identify the scene of the first image acquired through at least one of the second cameras; and Based on the identification of the above-mentioned identified scene satisfying the standard conditions, the at least one second camera is identified as a camera to be used for the second application software, The above multi-foldable electronic device, causing, Multi-foldable electronic device.
8. In Claim 7, When the above instructions are executed individually or collectively by the at least one processor: Based on identifying the above at least one second camera as the camera to be used for the above second application software: Identifying a buffer used to acquire the first image so as to maintain the acquisition of the first image using the first application software through the at least one second camera; and By accessing the identified buffer, the second image corresponding to the first image is obtained using the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
9. In a multi-foldable electronic device, A housing comprising a first housing part, a second housing part rotatably coupled to the first housing part, and a third housing part rotatably coupled to the second housing part; A flexible display defining at least a portion of the front side of the first housing part, at least a portion of the front side of the second housing part, and at least a portion of the front side of the third housing part; A display defining at least a portion of the rear side of the third housing part; A plurality of cameras including at least one first camera visible through a portion of the flexible display disposed within the second housing part, second cameras disposed within the second housing part and visible from the rear side of the second housing part, and at least one third camera visible through the display; At least one processor including a processing circuit; and Memory that stores instructions and includes one or more storage media, When the above instructions are executed individually or collectively by the at least one processor: Acquiring a first image using a first application software through at least one of the second cameras; Identifying an event for acquiring a second image using the above-mentioned second application software; Based on the identification of the event while the multi-foldable electronic device is in an unfolded state in which the first housing part and the second housing part are unfolded and the second housing part and the third housing part are unfolded, each of the at least one first camera, the second cameras excluding the at least one second camera, or the at least one third camera is identified as a candidate camera to be used for the second application software; and Based on the identification of the event while the multi-foldable electronic device is in a single-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are unfolded, or in a multi-folded state in which the first housing part and the second housing part are folded and the second housing part and the third housing part are folded, each of the second cameras excluding the at least one second camera or at least one of the at least one third camera is identified as a candidate camera to be used for the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
10. In Claim 9, The above event is identified while the first image is acquired, and The above event is for acquiring the second image using the second application software while maintaining the acquisition of the first image using the first application software, and When the above instructions are executed individually or collectively by the at least one processor: Based on the identification of the event while the multi-foldable electronic device is in the unfolded state, determining whether the second image to be acquired using the second application software corresponds to the first image being acquired using the first application software; Based on the determination that the second image corresponds to the first image, the second image is acquired through at least one of the second cameras, excluding the at least one second camera, via the second application software; and Based on the determination that the second image does not correspond to the first image, each of the at least one first camera or the at least one third camera is identified as a candidate camera to be used for the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
11. In Claim 10, When the above instructions are executed individually or collectively by the at least one processor: Based on the determination that the second image does not correspond to the first image, information regarding the camera among the plurality of cameras that was used for the second application software is identified using the second application software; Based on identifying that the camera represented by the above information corresponds to the at least one first camera, the second image is acquired through the at least one first camera using the second application software; and Based on identifying that the camera represented by the above information corresponds to one of the second cameras and the at least one third camera, the second image is acquired through the at least one third camera using the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
12. In Claim 10, The above multi-foldable electronic device further includes at least one sensor, and When the above instructions are executed individually or collectively by the at least one processor: Based on the determination that the second image does not correspond to the first image, the orientation of the multi-foldable electronic device is identified through the at least one sensor; Based on identifying the attitude of the multi-foldable electronic device corresponding to the first range, the second image is acquired through the at least one first camera using the second application software; and Based on identifying the attitude of the multi-foldable electronic device corresponding to the second range, the second image is acquired through the at least one third camera using the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
13. In Claim 9, When the above instructions are executed individually or collectively by the at least one processor: Based on the identification of the event while the multi-foldable electronic device is in the single-folding state or the multi-folding state, determining whether the second image to be acquired using the second application software corresponds to the first image being acquired using the first application software; Based on the determination that the second image corresponds to the first image, the second image is acquired through at least one of the second cameras, excluding the at least one second camera, via the second application software; and Based on the determination that the second image does not correspond to the first image, the second image is acquired through the at least one third camera via the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.
14. In Claim 9, When the above instructions are executed individually or collectively by the at least one processor: Based on the above event, identify the scene of the first image acquired through at least one of the second cameras; and Based on the identification of the above-mentioned identified scene satisfying the standard conditions, the at least one second camera is identified as a camera to be used for the second application software, The above multi-foldable electronic device, causing, Multi-foldable electronic device.
15. In Claim 14, When the above instructions are executed individually or collectively by the at least one processor: Based on identifying the above at least one second camera as the camera to be used for the above second application software: Identifying a buffer used to acquire the first image so as to maintain the acquisition of the first image using the first application software through the at least one second camera; and By accessing the identified buffer, the second image corresponding to the first image is obtained using the second application software. The above multi-foldable electronic device, causing, Multi-foldable electronic device.