Electronic device comprising plurality of cameras, and control method therefor

Abstract

A method for controlling an electronic device comprising a first housing including a first surface and a second surface, a second housing including a third surface and a fourth surface, and a flexible display disposed on the first surface and the third surface may comprise the operations of: identifying that a user input for capturing a stereoscopic image has been received; acquiring a first image, through a rear camera disposed on the second surface, and a second image, through a front camera disposed on the fourth surface, on the basis of receiving the user input for capturing the stereoscopic image; and displaying an image, rotated by a first set value from an image related to the first image or the second image, as a preview image through the flexible display.

Description

Electronic device including multiple cameras and method for controlling the same

[0001] Various embodiments of the present invention relate to an electronic device including a plurality of cameras and a method for controlling the same.

[0002] The variety of services and additional features offered through electronic devices, such as smartphones, is steadily increasing. To enhance the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices to offer a variety of features and differentiate themselves from competitors. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.

[0003] Recently, technologies have been developed that allow electronic devices to capture images in various ways, including using multiple cameras. Electronic devices can capture stereoscopic images using multiple cameras. Stereoscopic images capture a pair of 2D images that utilize the visual differences between the two eyes to create a three-dimensional sense of depth. Stereoscopic images are fundamentally based on the principle that the images shown to each human eye differ due to parallax (e.g., binocular parallax) based on the distance between the two eyes, and that this difference is recognized to create a sense of depth. Thus, two images, a left image (left-eye image) and a right image (right-eye image), are expressed as a pair.

[0004] The above information may be provided as background information to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0005] According to one embodiment, an electronic device includes a first housing including a first side and a second side opposite the first side, a second housing including a third side and a fourth side opposite the third side, a hinge structure rotatably connecting the first housing and the second housing, a flexible display disposed on the first side and the third side, a rear camera disposed on the second side, a front camera disposed on the fourth side, at least one processor including a processing circuit, and a memory storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: acquire a first image through the rear camera, acquire a second image through the front camera, and display an image rotated by a first set value from an image related to the first image or the second image as a preview image through the flexible display based on a user input for capturing a stereo image being received.

[0006] In one embodiment, a method for controlling an electronic device includes a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a flexible display disposed on the first side and the third side, a rear camera disposed on the second side, a front camera disposed on the fourth side, and at least one processor including a processing circuit, the method comprising: an operation of confirming that a user input for capturing a stereo image is received; an operation of acquiring a first image through the rear camera and a second image through the front camera based on the reception of the user input for capturing the stereo image; and an operation of displaying an image rotated by a first set value from an image related to the first image or the second image as a preview image through the flexible display.

[0007] According to one embodiment, an electronic device includes a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a flexible display disposed on the first side and the third side, a rear camera disposed on the second side, a front camera disposed on the fourth side, at least one processor including a processing circuit, and a memory storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: acquire a first image through the rear camera, acquire a second image through the front camera, display the first image as a preview image through the display, and store an image obtained by rotating each of the first image and the second image by a first setting value in the memory as an image for a stereo image.

[0008] According to one embodiment, an electronic device includes a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a flexible display disposed on the first side and the third side, a rear camera disposed on the second side, a front camera disposed on the fourth side, at least one processor including a processing circuit, and a memory storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: determine a folding angle sensed by the sensor based on a user input for capturing a stereo image being received, and display a guide through the flexible display to guide unfolding of the electronic device based on determining that the folding angle sensed by the sensor is less than a set first threshold value.

[0009] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0010] FIG. 2A is a diagram illustrating an unfolded state of an electronic device according to an embodiment of the present disclosure.

[0011] FIG. 2b is a diagram illustrating a folded state of an electronic device according to an embodiment of the present disclosure.

[0012] FIG. 3 is a diagram illustrating a state in which multiple cameras are arranged in an electronic device according to one embodiment of the present disclosure.

[0013] FIG. 4 is a block diagram of an electronic device including a plurality of cameras according to an embodiment of the present disclosure.

[0014] FIG. 5 is a diagram illustrating the concept of height correction according to one embodiment of the present disclosure.

[0015] FIG. 6A is a diagram showing an original image and a viewed image of a stereo image according to an embodiment of the present disclosure.

[0016] FIG. 6b is a diagram showing an original image and a view image of a stereo image according to an embodiment of the present disclosure.

[0017] FIG. 7 is a diagram illustrating a method for rotating a preview image according to an embodiment of the present disclosure.

[0018] FIG. 8 is a diagram illustrating a method for rotating a preview image according to an embodiment of the present disclosure.

[0019] FIG. 9 is a drawing showing a method of rotating a horizontal bar guide according to one embodiment of the present disclosure.

[0020] FIG. 10 is a diagram illustrating a method for horizontally correcting an image from a captured image according to an embodiment of the present disclosure.

[0021] FIG. 11 is a diagram illustrating a method for correcting horizontality during stereo adjustment according to an embodiment of the present disclosure.

[0022] FIG. 12 is a diagram showing a height difference during stereo adjustment according to one embodiment of the present disclosure.

[0023] FIG. 13 is a drawing illustrating a method for correcting a hinge angle guide and an image according to an embodiment of the present disclosure.

[0024] FIG. 14 is a flowchart illustrating a method for correcting horizontality when capturing stereo images in an electronic device according to an embodiment of the present disclosure.

[0025] FIG. 15 is a flowchart illustrating a method for correcting horizontality when capturing stereo images in an electronic device according to an embodiment of the present disclosure.

[0026] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0027] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0028] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0029] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0030] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0031] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0032] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0033] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0034] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0035] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0036] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0037] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0038] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0039] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0040] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0041] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0042] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0043] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0044] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0045] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimizing terminal power and connecting multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0046] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the selected at least one antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0047] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0048] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0049] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0050] The artificial intelligence-related functions according to the present disclosure are operated through a processor and memory. The processor may be composed of one or more processors. In this case, one or more processors may be a general-purpose processor such as a central processing unit (CPU), an application processor (AP), or a digital signal processor (DSP); a graphics-only processor such as a graphics processing unit (GPU) or a vision processing unit (VPU); or an artificial intelligence-only processor such as an NPU. One or more processors control the processing of input data according to predefined operating rules or artificial intelligence models stored in memory. Alternatively, if one or more processors are artificial intelligence-only processors, the artificial intelligence-only processor may be designed with a hardware structure specialized for processing a specific artificial intelligence model.

[0051] The predefined operation rules or artificial intelligence models are characterized by being created through learning. Here, being created through learning means that the basic artificial intelligence model is trained using a learning algorithm using a plurality of learning data, thereby creating a predefined operation rules or artificial intelligence model set to perform a desired characteristic (or purpose). This learning may be performed on the device itself on which the artificial intelligence according to the present disclosure is performed, or may be performed through a separate server and / or system. Examples of the learning algorithm include, but are not limited to, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning.

[0052] An artificial intelligence model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values, and performs neural network operations through operations between the operation results of the previous layer and the multiple weights. The multiple weights of the multiple neural network layers may be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights may be updated so that the loss value or cost value obtained from the artificial intelligence model is reduced or minimized during the learning process. The artificial neural network may include a deep neural network (DNN), and examples thereof include, but are not limited to, a convolutional neural network (CNN), a deep neural network (DNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or deep Q-networks.

[0053] FIG. 2a is a drawing illustrating a structure of an electronic device in an unfolded state according to one embodiment, and FIG. 2b is a drawing illustrating a structure of an electronic device in a folded state according to one embodiment.

[0054] Referring to FIGS. 2A and 2B, an electronic device (101) according to an embodiment is a foldable electronic device, and may include a hinge structure (e.g., a hinge structure (230) of FIG. 2B) (e.g., a hinge cover) covering a foldable portion of a housing (200), and a first display (161) (e.g., a display module (160) of FIG. 1) in a flexible or foldable form disposed within a space formed by the housing (200). According to an embodiment, the electronic device (101) may include a second display (163) disposed on a part of the housing (200) on an opposite side to which the first display (161) is disposed. According to an embodiment, the side on which the first display (161) is disposed is defined as a first side (e.g., a front side) of the electronic device (101). And, the side opposite the first side is defined as the second side (e.g., the back) of the electronic device (101). In addition, the side surrounding the space between the first side and the second side is defined as the third side (e.g., the side) of the electronic device (101). The second display (163) may be smaller in size than the first display (161).

[0055] According to one embodiment, the housing (200) may include a first housing structure (210), a second housing structure (220) including a sensor area (224), a first rear cover (280), a second rear cover (290), and a hinge structure (230). The housing (200) of the electronic device (101) is not limited to the shape and combination shown in FIGS. 2A and 2B, and may be implemented by other shapes or combinations and / or combinations of parts. For example, in another embodiment, the first housing structure (210) and the first rear cover (280) may be formed integrally, and the second housing structure (220) and the second rear cover (290) may be formed integrally.

[0056] According to one embodiment, the first housing structure (210) and the second housing structure (220) may be arranged on both sides with respect to a folding axis (e.g., the folding axis (A) of FIG. 2A) as the center, and may have a shape that is overall symmetrical with respect to the folding axis (A). As described below, the angle or distance between the first housing structure (210) and the second housing structure (220) may vary depending on whether the state of the electronic device (101) is in an unfolded state, a folded state, or a partially unfolded intermediate state. According to one embodiment, unlike the first housing structure (210), the second housing structure (220) additionally includes a sensor area (224) in which various sensors are arranged, but may have a shape that is symmetrical with respect to the other areas.

[0057] According to one embodiment, the first housing structure (210) and the second housing structure (220) are connected to a hinge structure (230) and can be folded or unfolded by rotating about the hinge structure (230). Accordingly, the electronic device (101) can be changed into a folded state or an unfolded state. The electronic device (101) can be changed from an unfolded state as shown in FIG. 2A to a folded state (e.g., an in-folded state as shown in FIG. 2B) in which the first surface of the first housing structure (210) and the first surface of the second housing structure (220) come closer to each other and face each other. The electronic device (101) can be converted from an unfolded state as shown in FIG. 2A to a folded state (e.g., an out folded state) in which the second surface of the first housing structure (210) approaches and faces the second surface of the second housing structure (220).

[0058] In one embodiment, as illustrated in FIG. 2A, the first housing structure (210) and the second housing structure (220) may together form a recess that accommodates the first display (161). In one embodiment, due to the sensor area (224), the recess may have two or more different widths in a direction perpendicular to the folding axis (A). According to one embodiment, the recess may have a first width (w1) between a first portion (210a) of the first housing structure (210) that is parallel to the folding axis (A) and a first portion (220a) formed at an edge of the sensor area (224) of the second housing structure (220), and the recess may have a second width (w2) formed by a second portion (210b) of the first housing structure (210) and a second portion (220b) of the second housing structure (220) that is parallel to the folding axis (A) and does not correspond to the sensor area (224). In this case, the second width (w2) may be formed to be longer than the first width (w1). As another example, the first part (210a) of the first housing structure (210) and the first part (220a) of the second housing structure (220) having mutually asymmetrical shapes may form a first width (w1) of the recess, and the second part (210b) of the first housing structure (210) and the second part (220b) of the second housing structure (220) having mutually symmetrical shapes may form a second width (w2) of the recess. In one embodiment, the first part (220a) and the second part (220b) of the second housing structure (220) may have different distances from the folding axis (A). The width of the recess is not limited to the illustrated example. In another embodiment, the recess may have a plurality of widths due to the shape of the sensor area (224) or the asymmetrical shapes of the first housing structure (210) and the second housing structure (220).

[0059] According to one embodiment, at least a portion of the first housing structure (210) and the second housing structure (220) may be formed of a metallic or non-metallic material having a rigidity of a selected size to support the first display (161). At least a portion formed of the metallic material may provide a ground plane of the electronic device (101) and may be electrically connected to a ground line formed on a printed circuit board.

[0060] According to one embodiment, the sensor area (224) may be formed to have a predetermined area adjacent to one corner of the second housing structure (220). However, the arrangement, shape, and size of the sensor area (224) are not limited to the illustrated example. For example, in another embodiment, the sensor area (224) may be provided in another corner of the second housing structure (220) or in any area between the upper corner and the lower corner. In one embodiment, components for performing various functions built into the electronic device (101) may be visually exposed to the front of the electronic device (101) through the sensor area (224) or through one or more openings provided in the sensor area (224). In various embodiments, the components may include various types of sensors. The sensor may include, for example, at least one of a front camera, a receiver, or a proximity sensor.

[0061] According to one embodiment, the first rear cover (280) is disposed on one side of the folding axis on the rear of the electronic device (101) and may have, for example, a substantially rectangular periphery, the periphery of which may be wrapped by the first housing structure (210). Similarly, the second rear cover (290) is disposed on the other side of the folding axis on the rear of the electronic device (101) and the periphery of which may be wrapped by the second housing structure (220).

[0062] According to one embodiment, the first rear cover (280) and the second rear cover (290) may have substantially symmetrical shapes with respect to the folding axis (A axis). However, the first rear cover (280) and the second rear cover (290) do not necessarily have mutually symmetrical shapes, and in another embodiment, the electronic device (101) may include the first rear cover (280) and the second rear cover (290) of various shapes. In another embodiment, the first rear cover (280) may be formed integrally with the first housing structure (210), and the second rear cover (290) may be formed integrally with the second housing structure (220).

[0063] According to one embodiment, the first rear cover (280), the second rear cover (290), the first housing structure (210), and the second housing structure (220) may form a space in which various components of the electronic device (101) (e.g., a printed circuit board or a battery) may be placed. According to one embodiment, one or more components may be placed or visually exposed on the rear surface of the electronic device (101). For example, at least a portion of the sub-display may be visually exposed through the first rear area (282) of the first rear cover (280). In another embodiment, one or more components or sensors may be visually exposed through the second rear area (392) of the second rear cover (290). In one embodiment, the sensors may include a proximity sensor and / or a rear camera.

[0064] According to one embodiment, a front camera visually exposed to the front of the electronic device (101) through one or more openings provided in the sensor area (224) or a rear camera (393) exposed through the second rear area (392) of the second rear cover (290) may include one or more lenses, an image sensor, and / or an image signal processor. A flash may include, for example, a light emitting diode or a xenon lamp. In some embodiments, two or more lenses (infrared camera, wide-angle and telephoto lenses) and image sensors may be arranged on one side of the electronic device (101).

[0065] Referring to FIG. 2b, the hinge structure (230) may be configured to be positioned between the first housing structure (210) and the second housing structure (220) so as to cover internal components. According to one embodiment, the hinge structure (230) may be covered by a part of the first housing structure (210) and the second housing structure (220) or exposed to the outside, depending on the folding state (unfolded state, intermediate state, or folded state) of the electronic device (101). According to one embodiment, as shown in FIG. 2A, when the electronic device (101) is in an unfolded state, the hinge structure (230) may be covered by the first housing structure (210) and the second housing structure (220) and not exposed. As another example, as shown in FIG. 2B, when the electronic device (101) is in a folded state (e.g., a fully folded state), the hinge structure (230) may be exposed to the outside between the first housing structure (210) and the second housing structure (220). As another example, the first When the housing structure (210) and the second housing structure (220) are in an intermediate state where they are folded at a certain angle, the hinge structure (230) may be partially exposed to the outside between the first housing structure (210) and the second housing structure (220). However, in this case, the exposed area may be less than that in the completely folded state. In one embodiment, the hinge structure (230) may include a curved surface.

[0066] According to one embodiment, the first display (161) may be disposed on a space formed on a first surface of the first housing structure (210) and a first surface of the second housing (220). According to one embodiment, the second display (163) may be disposed on a space formed on a second surface of the first housing structure (210) or a second surface of the second housing structure (220). For example, the first display (161) may be mounted on a recess formed by the housing (200) and may constitute most of the front surface of the electronic device (101). According to one embodiment, the first display (161) may mean a display in which at least a portion of the display can be transformed into a flat or curved surface. According to one embodiment, the first display (161) may include a folding area (203), a first display area (201) disposed in a first housing structure (210) on one side (e.g., the left side of the folding area (203) illustrated in FIG. 2A) with respect to the folding area (203), and a second display area (202) disposed in a second housing structure (220) on the other side (e.g., the right side of the folding area (203) illustrated in FIG. 2A).

[0067] However, the division of the regions of the first display (161) illustrated in FIG. 2A is exemplary, and the first display (161) may be divided into a plurality of regions (for example, four or more or two) depending on the structure or function. For example, in the embodiment illustrated in FIG. 2A, the regions of the first display (161) may be divided by a folding region (203) extending parallel to the y-axis or a folding axis (A-axis), but in other embodiments, the first display (161) may be divided into regions based on another folding region (for example, a folding region parallel to the x-axis) or another folding axis (for example, a folding axis parallel to the x-axis). According to one embodiment, the first display (161) and the second display (163) may be combined with or disposed adjacent to a touch detection circuit, a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer that detects a magnetic field-type stylus pen.

[0068] According to one embodiment, the first display area (201) and the second display area (202) may have an overall symmetrical shape centered on the folding area (203). However, unlike the first display area (201), the second display area (202) may include a cut notch depending on the presence of the sensor area (224), but may have a shape symmetrical with respect to the first display area (201) in other areas. In other words, the first display area (201) and the second display area (202) may include a portion having a symmetrical shape and a portion having an asymmetrical shape.

[0069] Hereinafter, the operation of the first housing structure (210) and the second housing structure (220) according to the state of the electronic device (101) (e.g., folded state, unfolded state, or intermediate state) and each area of ​​the first display (161) will be described.

[0070] According to one embodiment, when the electronic device (101) is in an unfolded state (e.g., the unfolded state of FIG. 2A), the first housing structure (210) and the second housing structure (220) may be arranged to form an angle of 180 degrees and face the same direction. The surface of the first display area (201) of the first display (161) and the surface of the second display area (202) may form an angle of 180 degrees with each other and face the same direction (e.g., toward the front of the electronic device). The folding area (203) may form the same plane as the first display area (201) and the second display area (202).

[0071] According to one embodiment, when the electronic device (101) is in a folded state (e.g., the folded state of FIG. 2B), the first housing structure (210) and the second housing structure (220) may be arranged to face each other. The surface of the first display area (201) of the first display (161) and the surface of the second display area (202) may form a narrow angle (e.g., between 0 and 10 degrees) with each other and may face each other. The folding area (203) may be formed as a curved surface having at least a portion of a predetermined curvature.

[0072] According to one embodiment, when the electronic device (101) is in a half-folding state, the first housing structure (210) and the second housing structure (220) may be arranged at a certain angle with respect to each other. The surface of the first display area (201) of the first display (161) and the surface of the second display area (202) may form an angle that is larger than the angle in the folded state and smaller than the angle in the unfolded state. The folding area (203) may be formed as a curved surface having at least a certain curvature, and the curvature at this time may be smaller than that in the folded state.

[0073] According to one embodiment, the electronic device (101) may include an in-folding type or an out-folding type. The in-folding type may refer to a state in which the flexible first display (161) is not exposed to the outside in a fully folded state. As another example, the first display (161) may refer to a state in which the first display (161) is folded in a front direction. The out-folding type may refer to a state in which the first display (161) is visually exposed to the outside in a fully folded state. As another example, the first display (161) may refer to a state in which the first display (161) is folded in a rear direction. For example, the electronic device (101) may display a multi-window in an unfolded state (e.g., the unfolded state of FIG. 2A).

[0074] Although the above FIGS. 2A and 2B illustrate an example in which the display area is expanded through a flexible display, that is, the display area is enlarged, the electronic device may have a display area that is expanded using a rollable display, or may have a display area of ​​a size that allows multi-window display without being flexible or rollable.

[0075] FIG. 3 is a diagram illustrating a state in which multiple cameras are arranged in an electronic device according to one embodiment of the present disclosure.

[0076] Referring to FIG. 3, an electronic device according to one embodiment (e.g., electronic device (101) of FIG. 1) may include a plurality of cameras (e.g., camera module (190) of FIG. 1). However, the electronic device (101) according to one embodiment may further include other components described in FIG. 1.

[0077] According to one embodiment, an electronic device can capture a stereo image using at least two cameras among a plurality of rear cameras (393) and a front camera (383) positioned in a vertical direction as illustrated in FIG. 3. According to one embodiment, a "stereo image" is an image obtained through two or more cameras, and can be used to mean a pair of 2D images that enable the perception of a three-dimensional sense of depth by utilizing the difference in visual acuity of both eyes. For example, the stereo image may include a left-eye image corresponding to the left eye and a right-eye image corresponding to the right eye. According to one embodiment, the stereo image may be played back through an electronic device developed to be wearable by a user (e.g., a wearable electronic device such as an augmented reality glass (AR glass), a video see-through (VST) device, or a head-mounted display (HMD) device) and displayed to the user in the form of a 3D image. The stereo image may also be replaced with the term "spatial video," but is not limited to a specific term.

[0078] According to one embodiment, the camera may include a plurality of cameras, and among the plurality of cameras, the front camera (383) (or front cover camera) may be disposed on the fourth side (e.g., front) of the second housing, and among the plurality of cameras, the rear camera (393) (or rear cover camera) may be disposed on the second side (e.g., rear) of the first housing. For example, when the electronic device is placed in a vertical direction (the direction shown in FIG. 2A), a stereo image may be captured using any one of the rear cameras (393) and the front camera (383). According to one embodiment, the rear cameras (392) may include a first rear camera (393) and a second rear camera (394) of different or the same kind. The first rear camera (393) and the second rear camera (394) of different or the same kind may be rear cameras disposed on the rear of the electronic device. For example, if the first rear camera (393) and the second rear camera (394) are different types of cameras, the first rear camera (393) may be a wide-angle camera, and the second rear camera (394) may be an ultra-wide-angle camera. The first rear camera (393) configured as the wide-angle camera may be referred to as a main camera, but is not limited to the above term.

[0079] According to one embodiment, when the electronic device is foldable, as illustrated in FIGS. 2A and 3 , when the electronic device is fully unfolded, the front camera (383) and the rear camera (393) may face the same direction. Accordingly, a stereo image may be acquired using the front camera (383) positioned at the front and the rear camera (393) positioned at the rear.

[0080] According to one embodiment, in the embodiments described below, for convenience of explanation, among the multiple cameras used for stereoscopic image capture, the rear camera (393) may be set as a camera corresponding to the right eye, and the front camera (383) may be set as a camera corresponding to the left eye. According to various embodiments, the rear camera (393) may be set as a camera corresponding to the left eye, and the front camera (383) may be set as a camera corresponding to the left eye.

[0081] According to one embodiment, the electronic device may acquire a first image through the rear camera (393) and a second image through the front camera (383) based on a user input for capturing a stereo image. According to one embodiment, the electronic device may acquire a left-eye image and a right-eye image of the stereo image based on the first image and the second image.

[0082] The electronic device may display an image set for a preview image among the first image and the second image (e.g., the first image or the second image) as a preview image through a display (e.g., a flexible display). According to various embodiments, as illustrated in FIG. 5, when a stereo image is captured using one of a plurality of rear cameras (593, 594) and a front camera (583), and the stored stereo image is viewed, an image rotated by a certain angle may be displayed due to a height difference between the cameras. For example, as illustrated in FIG. 5, the rear camera (594) and the front camera (583) may not be positioned in consideration of capturing a stereo image. Accordingly, when the electronic device is held vertically, the front camera (583) may be positioned higher than the rear camera (594). In this way, due to the height difference between the front camera (583) and the rear camera (594), even if the user positions the electronic device exactly horizontally to capture the original image (611), when viewing the stored stereo image, as shown in FIG. 6A, the viewing image (612) may be viewed as an image rotated by a certain angle due to the height difference between the cameras.

[0083] In the various embodiments described below, when shooting a stereo image using a front camera (583) and a rear camera (594), various methods for correcting rotation are described so that the user can obtain a stereo image in a desired direction. For example, referring to FIGS. 5 and 6B, when the user shoots an original image (621) on an electronic device, the user can obtain a stereo image (e.g., a viewing image (622)) in a desired direction by tilting the image by a set angle. To this end, the electronic device can guide the user to naturally align the horizontal of the original image (621) by displaying a preview image rotated by a set angle. A detailed description thereof will be described later in the description of FIGS. 7 and 8.

[0084] According to various embodiments, the electronic device may guide the user to naturally align the level by displaying a horizontal bar guide with a corrected direction along with a preview image. This will be described in detail later in the description of FIG. 9. In another embodiment, the electronic device may align the level by correcting a rotated stereo image caused by a height difference between cameras during stereo image capture through image correction. This will be described in detail later in the description of FIG. 10.

[0085] According to various embodiments, the electronic device may display an image, which is rotated by a first setting value among the first image and the second image, as a preview image through a display (e.g., a flexible display). According to various embodiments, the electronic device may obtain tilt information of the electronic device from a sensor and determine an inclination in the direction of gravity adjusted by a second setting value from the inclination information. Based on the adjusted inclination in the direction of gravity, the electronic device may display a horizontal bar guide indicating a horizontal level together with the preview image through the display.

[0086] According to various embodiments, the electronic device may store data of the stereo image acquired based on the first image and the second image in a memory.

[0087] FIG. 4 is a block diagram of an electronic device including a plurality of cameras according to an embodiment of the present disclosure.

[0088] Referring to FIG. 4, an electronic device (101) including a plurality of cameras may include a processor (320) (e.g., the processor (120) of FIG. 1), a memory (330) (e.g., the memory (130) of FIG. 1), a flexible display (360) (e.g., the display module (160) of FIG. 1), a sensor (340) (e.g., the sensor module (176) of FIG. 1), and a plurality of cameras (e.g., the camera module (180) of FIG. 1). The plurality of cameras may include a front camera (383) (e.g., a front cover camera) and a rear camera (393) (e.g., a rear cover camera). Although FIG. 4 illustrates one rear camera (393) for convenience of explanation, the electronic device may include two or more rear cameras.

[0089] According to one embodiment, when a user inputs execution of an application related to taking pictures or videos on an electronic device (101), the processor (320) may execute a program corresponding to the application related to taking pictures or videos stored in the memory (330) (e.g., program (140) of FIG. 1).

[0090] According to one embodiment, the processor (320) may display a preview image through the flexible display (360) according to the execution of an application related to the photo or video recording. The preview image displayed through the flexible display (360) may correspond to a first image (e.g., a right-eye image) acquired (or captured) through the rear camera (393) or a second image (e.g., a left-eye image) acquired (or captured) through the front camera (383).

[0091] According to one embodiment, when a user input for starting shooting of a stereo image is received through the application, and a user input for ending shooting is received after a certain period of time, the processor (320) may store a first image acquired through the rear camera (393) and a second image acquired through the front camera (383) from the start of shooting to the end of shooting as a stereo image in the memory (330). According to one embodiment, the stereo image stored in the memory (330) may be stored in the form of a compressed file based on a set coding method (e.g., HV-HEVC (multi-view high efficiency video coding)). According to one embodiment, the user input for starting shooting of the stereo image may be set or confirmed by an input of a video shooting start button when the shooting mode in the application is set to a stereo image shooting mode, or may be set or confirmed by an input of a stereo image shooting start button that is set separately.

[0092] According to various embodiments, the processor (320) may display an image rotated by a first set value among the first image and the second image as a preview image through the flexible display.

[0093] According to various embodiments, when the electronic device is held vertically, as illustrated in FIGS. 2A and 3 , the front camera may be positioned higher than the rear camera. Thus, due to the height difference between the front and rear cameras, even if the user positions the electronic device exactly horizontally to take a picture, when viewing a stored stereo image, as illustrated in FIG. 6A , the image may be rotated by a certain angle due to the height difference between the cameras.

[0094] According to various embodiments, when capturing stereo images using a front camera and a rear camera, the electronic device (101) may provide a guide for correcting rotation so that the user can acquire a stereo image in a desired direction. For example, the electronic device may guide the user to naturally align the horizontal by displaying the preview image on the flexible display (360) after rotating it by a set angle. A detailed description thereof will be provided later in the description of FIGS. 7 and 8.

[0095] According to various embodiments, the electronic device (101) may guide the user to naturally align the horizontal line by displaying a horizontal bar guide with a direction-corrected view along with a preview image on the flexible display (360). A detailed description thereof will be described later in the description of FIG. 9. In another embodiment, the electronic device (101) may align the horizontal line by correcting a rotated stereo image generated by a height difference between cameras during stereo image capture through image correction. A detailed description thereof will be described later in the description of FIG. 10.

[0096] According to various embodiments, the electronic device (101) may display an image rotated by a first setting value among the first image and the second image set for the preview image as a preview image through a display (e.g., a flexible display (360)). According to various embodiments, the electronic device (101) may obtain tilt information of the electronic device (101) from the sensor (340) and determine an inclination in the direction of gravity adjusted by a second setting value from the inclination information. Based on the adjusted inclination in the direction of gravity, the electronic device (101) may display a horizontal bar guide indicating a horizontal level together with the preview image through a display (e.g., a flexible display (360)).

[0097] According to various embodiments, the electronic device (101) may store data of the stereo image acquired based on the first image and the second image in the memory (330).

[0098] FIG. 7 is a diagram illustrating a method for rotating a preview image according to an embodiment of the present disclosure.

[0099] Referring to FIG. 7, according to one embodiment, when a user inputs execution of an application related to taking pictures or videos on an electronic device (101), the processor (320) may execute a program corresponding to the application related to taking pictures or videos stored in a memory (330) (e.g., program (140) of FIG. 1).

[0100] According to one embodiment, the processor (320) may display a preview image through the flexible display (360) according to the execution of an application related to taking a photo or video. The preview image displayed through the flexible display (360) may correspond to a first image (e.g., a right-eye image) acquired (or captured) through the rear camera (393) or a second image (e.g., a left-eye image) acquired (or captured) through the front camera (383). For convenience of explanation, the first image will be referred to as a rear original image (702), and the second image will be referred to as a front original image (701).

[0101] According to various embodiments, the processor (320) may generate (710) an image as a preview image by rotating the image set for the preview image among the front original image (701) and the rear original image (702) by a first setting value based on preset tilt information. The processor (320) may display the image generated by rotating the image set for the preview image among the front original image (701) and the rear original image (702) as a preview image through the flexible display. According to various embodiments, the cropped area (710) may be displayed as a preview image so as to be in a rotation state in order to rotate the image (703) set for the preview image among the front original image (701) or the rear original image (702) by the first setting value.

[0102] FIG. 8 is a diagram illustrating a method for rotating a preview image according to an embodiment of the present disclosure.

[0103] Referring to FIG. 8, according to one embodiment, when a user inputs execution of an application related to taking pictures or videos on an electronic device (101), the processor (320) may execute a program corresponding to the application related to taking pictures or videos stored in a memory (330) (e.g., program (140) of FIG. 1).

[0104] According to one embodiment, the processor (320) may display a preview image through the flexible display (360) according to the execution of an application related to taking a photo or video. The preview image displayed through the flexible display (360) may correspond to a first image (e.g., a right-eye image) acquired (or captured) through the rear camera (393) or a second image (e.g., a left-eye image) acquired (or captured) through the front camera (383). For convenience of explanation, the first image will be referred to as a rear original image (702), and the second image will be referred to as a front original image (701).

[0105] According to various embodiments, the processor (320) may perform stereo rectification (800) from the front original image (701) and the rear original image (702). For example, the processor (320) may perform stereo rectification (800) to generate an image rotated by a first set value based on a preset calibration value. When performing stereo rectification on the front original image (701) and the rear original image (702), the processor (320) may generate a rotated front image (812) and a rotated rear image (813) by rotating them by the first set value. The processor (320) may display a set image among the rotated front image (812) and the rotated rear image (813) as a preview image (811) through the flexible display.

[0106] FIG. 9 is a drawing showing a method of rotating a horizontal bar guide according to one embodiment of the present disclosure.

[0107] Referring to FIG. 9, the horizontal adjustment unit (920) of the processor (320) may receive information about the direction of gravity from a sensor (e.g., an inertial measurement unit (IMU) (910)) to adjust the horizontal bar guide. The horizontal adjustment unit (920) of the processor (320) may rotate a vector of the direction of gravity by the inclination of the z-axis based on the z-axis of the IMU (910). According to various embodiments, the horizontal adjustment unit (920) of the processor (320) may generate a rotated preview image based on the method described above in FIG. 7 or FIG. 8. According to various embodiments, the horizontal adjustment unit (920) of the processor (320) may correct the horizontal direction of the horizontal bar guide displayed on the screen by reflecting the inclination of the adjusted direction of gravity.

[0108] FIG. 10 is a diagram illustrating a method for horizontally correcting an image from a captured image according to an embodiment of the present disclosure.

[0109] Referring to FIG. 10, according to various embodiments, when a user captures a stereo image without a rotation guide (e.g., a rotated preview image or a rotated horizontal bar guide), the image adjustment unit (1010) of the processor (320) may horizontally correct the left-eye image and the right-eye image captured through the front camera (383) and the rear camera (393) and store them in the memory as data of a stereo image. For example, the image adjustment unit (1010) of the processor (320) may receive information about the direction of gravity from the IMU (910). Based on the information about the direction of gravity, the image adjustment unit (1010) of the processor (320) may horizontally correct the left-eye image and the right-eye image captured through the front camera (383) and the rear camera (393) and store them in the memory as data of a stereo image. For example, the image adjustment unit (1010) of the processor (320) can adjust the rotated image to a horizontal state by performing image warping on the left-eye image and the right-eye image using the vector of the gravity direction received from the IMU (910) and the relative rotation value in the current z-axis direction.

[0110] According to various embodiments, the processor (320) may correct the left-eye image or the right-eye image using an artificial intelligence model. For example, the processor (320) may correct the left-eye image to match the height of the right-eye image. To this end, the processor (320) may obtain 3D geometry and color information at the corresponding location. For example, the processor (320) may perform stereo correction from the left-eye image and the right-eye image to obtain geometry at the transformed location. After the stereo correction, the processor (320) may estimate the disparity between the images through a depth estimation unit. The processor (320) may convert the depth image at the location corresponding to the left-eye image and generate geometry at the height of the right-eye image. According to various embodiments, the processor (320) may generate an image at the transformed location. For example, color information of the left-eye image and the right-eye image may be obtained through image warping based on the converted geometry. At this time, the occlusion / disocclusion area of ​​the camera caused by the height difference between the left and right eye images can be filled by a generative artificial intelligence model.

[0111] FIG. 11 is a diagram illustrating a method for correcting horizontality during stereo adjustment according to an embodiment of the present disclosure. FIG. 12 is a diagram illustrating a height difference during stereo adjustment according to an embodiment of the present disclosure.

[0112] Referring to FIGS. 11 and 12 , as described above, the epipolar lines between the left-eye image and the right-eye image may not match due to the height difference between the front camera (383) and the rear camera (393). According to various embodiments, as illustrated in FIG. 11 , when performing stereo adjustment of the left-eye image and the right-eye image, the processor (320) may perform correction (e.g., rectification) so that the epipolar lines between the left-eye image and the right-eye image match.

[0113] FIG. 13 is a drawing illustrating a method for correcting a hinge angle guide and an image according to an embodiment of the present disclosure.

[0114] Referring to FIG. 13, the processor (320) of the electronic device (101) may output information to guide the user to unfold the screen through the display (1300) when the hinge unfolding angle (θ) of the electronic device (101) is smaller than the threshold value (θ1) during stereoscopic image capturing. For example, the processor (320) may induce the user to unfold the screen further by displaying the message “Please open more for capturing” in the form of text or an image on the screen. The processor (320) may induce the user to unfold the screen further by outputting the message or warning sound through a speaker.

[0115] According to various embodiments, when the hinge unfolding angle (θ) of the electronic device (101) is equal to or greater than a threshold value (θ1), the processor (320) may display an overlapping area of ​​the stereo image as a preview image (1310a, 1310b). For example, based on receiving a user input for capturing the stereo image, a first image may be acquired through the rear camera, and a second image may be acquired through the front camera. The capturing areas may be different from each other due to differences in positions or performances of the rear camera and the front camera. Accordingly, the processor (320) may display an overlapping area between a screen area of ​​the first image and a screen area of ​​the second image as a preview image (1310a, 1310b). The user may confirm an area where a stereo image is captured by checking information about the overlapping area displayed in the preview image (1310a, 1310b) when capturing a stereo image. For example, when shooting a stereo image, the user can expand the screen further by checking the overlapping area in the area where the stereo image is shot. According to various embodiments, the processor (320) can guide the user to expandable peripheral image information by overlaying and displaying the maximum angle images (1320a, 1320b) of the front camera (383) and the rear camera (393) through image stitching. For example, when shooting a stereo image, the user can check the maximum angle images (1320a, 1320b) and expand the overlapping area by maximizing the screen (e.g., by expanding the hinge opening angle to 180 degrees).

[0116] Hereinafter, with reference to FIGS. 14 and 15, operations of an electronic device for matching a shooting point and a playback point according to various embodiments will be described.

[0117] In the following examples, the operations may be performed sequentially, but are not necessarily sequential. For example, the order of the operations may be changed, and at least two operations may be performed in parallel.

[0118] FIG. 14 is a flowchart illustrating a method for correcting horizontality when capturing stereo images in an electronic device according to an embodiment of the present disclosure.

[0119] Referring to FIG. 14, an electronic device (101) including a plurality of cameras (e.g., an electronic device (201) of FIG. 2) may include a processor (320) (e.g., a processor (120) of FIG. 1), a memory (330) (e.g., a memory (130) of FIG. 1), a flexible display (360) (e.g., a display module (160) of FIG. 1), and a plurality of cameras (e.g., a camera module (180) of FIG. 1). The plurality of cameras may include a front camera (383) and a rear camera (393). The rear camera (393) may include a plurality of cameras (e.g., a first rear camera and a second rear camera).

[0120] According to one embodiment, the processor (320) may, at operation 1402, receive user input for capturing a stereo image.

[0121] According to one embodiment, the processor (320) may, at operation 1404, acquire a first image through the rear camera and acquire a second image through the front camera based on a user input for capturing a stereo image.

[0122] According to one embodiment, the processor (320) may display an image, which is rotated by a first setting value, from an image related to the first image or the second image, as a preview image through the flexible display. For example, in operation 1406, the processor (320) may display an image, which is rotated by a first setting value from an image set for a preview image among the first image and the second image, as a preview image through the flexible display. Alternatively, the processor (320) may display an image, which is rotated by a first setting value from an image shifted in a first direction (e.g., left or right) among either the first image or the second image, as a preview image through the flexible display. Alternatively, the processor (320) may display an image, which is rotated by a first setting value from an image synthesized from the first image and the second image, as a preview image through the flexible display. According to various embodiments, the first setting value may be set based on a height difference between the rear camera and the front camera. According to various embodiments, the processor (320) may check the first set value based on preset tilt information, and display an image rotated by the first set value among the first image and the second image set for the preview image as a preview image through the flexible display.

[0123] According to various embodiments, the processor (320) may perform stereo rectification on an image set for a preview image among the first image and the second image based on the first setting value, and display the stereo rectified image as a preview image through the flexible display.

[0124] According to various embodiments, when the processor (320) stores the first image and the second image as images corresponding to a stereo image, the processor (320) may further correct the first image or the second image based on a difference in performance between the rear camera (e.g., the first rear camera or the second rear camera) and the front camera. For example, the performance of the rear camera (e.g., the first rear camera or the second rear camera) and the front camera may include at least one of an angle of view, a resolution, brightness, a tone, or FPS (frame per second). According to various embodiments, the performance of each of the plurality of cameras included in the electronic device (101) may be different as shown in Table 1 below.

[0125] 1st rear camera 2nd rear camera Front camera Wide angle Ultra wide angle Wide angle Sensor resolution 50MP 12MP 10MP Shooting resolution 8K, UHD, FHD HD UHD, FHD, HD UHD, FHD, HD FPS 60, 30 30 60, 30

[0126] Referring to the above , the sensor resolution may refer to the number of pixels that the actual sensor is physically composed of. The shooting resolution may refer to the resolution of a video stored after grouping a plurality of physical pixels and merging them into a single logical pixel. According to various embodiments, the angle of view may include a wide angle or an ultra-wide angle. For example, when the angle of view of a second rear camera among a plurality of rear cameras is an ultra-wide angle and the angle of view of a front camera is a wide angle, the angle of view of an image captured through the second rear camera may be corrected to match the angle of view of the front camera.

[0127] According to various embodiments, the brightness and tone of a first image captured by a rear camera and a second image captured by a front camera may differ from each other. The processor (320) may adjust a digital gain based on an auto exposure value performed by each camera to uniformly match the brightness and tone of the first and second images. By adjusting the digital gain, the brightness and tone of the first and second images may be uniformly adjusted.

[0128] According to various embodiments, the resolutions of the first image captured through the rear camera and the second image captured through the front camera may be different from each other as shown in Table 1 above. For example, an actually captured image can be used in a common resolution (e.g., UHD, FHD, HD) of the first rear camera and the front camera. On the other hand, the resolution of the image of the front camera that does not support 8K resolution can be matched by performing super resolution on the image captured by the front camera using the information acquired through the first rear camera as guide information.

[0129] According to various embodiments, the FPS of the first image captured through the rear camera and the second image captured through the front camera may be different from each other as shown in Table 1. For example, if it is impossible to capture at the same FPS through the two cameras, the processor (320) may sample frames for the image captured at a relatively higher FPS according to the time stamp of the image captured at a relatively lower FPS. Alternatively, the processor (320) may use the video captured at a relatively high FPS as guide information to up-convert the frame rate of the video captured at a relatively low FPS.

[0130] FIG. 15 is a flowchart illustrating a method for correcting horizontality when capturing stereo images in an electronic device according to an embodiment of the present disclosure.

[0131] Referring to FIG. 15, an electronic device (101) including a plurality of cameras (e.g., an electronic device (201) of FIG. 2) may include a processor (320) (e.g., a processor (120) of FIG. 1), a memory (330) (e.g., a memory (130) of FIG. 1), a flexible display (360) (e.g., a display module (160) of FIG. 1), and a plurality of cameras (e.g., a camera module (180) of FIG. 1). The plurality of cameras may include a front camera (383) and a rear camera (393).

[0132] According to one embodiment, the processor (320) may, at operation 1502, receive user input for capturing a stereo image.

[0133] In one embodiment, the processor (320) may acquire a first image through the rear camera and a second image through the front camera based on a user input for capturing a stereo image. In one embodiment, the processor (320) may display an image selected from among the first image and the second image as a preview image.

[0134] According to one embodiment, the processor (320) may determine a folding angle (e.g., a hinge unfolding angle) sensed by a sensor in operation 1504.

[0135] According to one embodiment, the processor (320) may, at operation 1506, determine whether the folding angle sensed through the sensor is less than a set threshold value.

[0136] According to one embodiment, the processor (320) may display a guide (e.g., text, image) through the flexible display or output a voice message or warning sound through the speaker to guide unfolding of the electronic device based on determining that the folding angle sensed through the sensor is less than a set threshold value (operation 1506-Y), in operation 1508. According to various embodiments, the processor (320) may display information about an overlapping area between the screen area of ​​the first image and the screen area of ​​the second image based on determining that the folding angle sensed through the sensor is greater than or equal to a set threshold value (operation 1506-N), in operation 1510. As described above in the description of FIG. 13, the user may confirm the area where the stereo image is captured by checking the information about the overlapping area displayed in the preview image when capturing a stereo image. For example, the user may further unfold the screen and capture the image by checking the overlapping area in the area where the stereo image is captured when capturing a stereo image.

[0137] According to one embodiment, an electronic device includes a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a flexible display disposed on the first side and the third side, a rear camera disposed on the second side, a front camera disposed on the fourth side, at least one processor including a processing circuit, and a memory storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: acquire a first image through the rear camera, acquire a second image through the front camera, and display an image, which is rotated by a first setting value from among the first image and the second image, as a preview image through the flexible display.

[0138] According to one embodiment, the first setting value may be set based on a height difference between the rear camera and the front camera.

[0139] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: check the first set value based on preset tilt information, and display an image rotated by the first set value from among the first image and the second image set for the preview image as a preview image through the flexible display.

[0140] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: stereo rectify an image set for a preview image among the first image and the second image based on the first setting value, and display the stereo rectified image as a preview image through the flexible display.

[0141] According to one embodiment, the electronic device further includes a sensor for sensing an inclination of the electronic device, and the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: obtain inclination information of the electronic device from the sensor, determine an inclination in the direction of gravity adjusted by a second set value from the inclination information, and display a horizontal bar guide indicating a horizontal level as the preview image through the flexible display based on the adjusted inclination in the direction of gravity.

[0142] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: correct the first image or the second image based on a difference in performance between the rear camera and the front camera.

[0143] In one embodiment, the performance may include at least one of field of view, resolution, brightness, tone, or frames per second (FPS).

[0144] In one embodiment, a method for controlling an electronic device includes a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a flexible display disposed on the first side and the third side, a rear camera disposed on the second side, a front camera disposed on the fourth side, and at least one processor including a processing circuit, the method comprising: an operation of confirming that a user input for capturing a stereo image is received; an operation of acquiring a first image through the rear camera and a second image through the front camera based on the reception of the user input for capturing the stereo image; and an operation of displaying an image, which is rotated by a first setting value from an image set for a preview image among the first image and the second image, as a preview image through the flexible display.

[0145] According to one embodiment, the first setting value may be set based on a height difference between the rear camera and the front camera.

[0146] According to one embodiment, the method may include an operation of confirming the first set value based on preset inclination information, and an operation of displaying an image rotated by the first set value from among the first image and the second image as a preview image through the flexible display.

[0147] According to one embodiment, the method may include an operation of stereo rectifying an image set for a preview image among the first image and the second image based on the first setting value, and an operation of displaying the stereo rectified image as a preview image through the flexible display.

[0148] According to one embodiment, the method may include an operation of obtaining inclination information of the electronic device from a sensor, an operation of confirming an inclination in the direction of gravity adjusted by a second set value from the inclination information, and an operation of displaying a horizontal bar guide indicating a horizontal level as the preview image through the flexible display based on the adjusted inclination in the direction of gravity.

[0149] According to one embodiment, the method may include an operation of correcting the first image or the second image based on a difference in performance between the rear camera and the front camera.

[0150] In one embodiment, the performance may include at least one of field of view, resolution, brightness, tone, or frames per second (FPS).

[0151] According to one embodiment, an electronic device includes a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a flexible display disposed on the first side and the third side, a rear camera disposed on the second side, a front camera disposed on the fourth side, at least one processor including a processing circuit, and a memory storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: acquire a first image through the rear camera, acquire a second image through the front camera, display the first image as a preview image through the display, and store an image obtained by rotating each of the first image and the second image by a first setting value in the memory as an image for a stereo image.

[0152] According to one embodiment, the first setting value may be set based on a height difference between the rear camera and the front camera.

[0153] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: correct the first image or the second image based on a difference in performance between the rear camera and the front camera.

[0154] In one embodiment, the performance may include at least one of field of view, resolution, brightness, tone, or frames per second (FPS).

[0155] According to one embodiment, an electronic device includes a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a flexible display disposed on the first side and the third side, a rear camera disposed on the second side, a front camera disposed on the fourth side, at least one processor including a processing circuit, and a memory storing instructions, wherein the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: determine a folding angle sensed by the sensor based on a user input for capturing a stereo image being received, and display a guide through the flexible display to guide unfolding of the electronic device based on determining that the folding angle sensed by the sensor is less than a set first threshold value.

[0156] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the electronic device to: acquire a first image through the rear camera based on a user input for capturing the stereo image being received, acquire a second image through the front camera, and display information about an overlapping area between a screen area of ​​the first image and a screen area of ​​the second image through the flexible display based on determining that the folding angle sensed through the sensor is greater than or equal to a set first threshold value.

[0157] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0158] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0159] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0160] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0161] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0162] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In electronic devices, A first housing comprising a first side and a second side opposite to the first side; A second housing comprising a third side and a fourth side opposite to the third side; A hinge structure that rotatably connects the first housing and the second housing; A flexible display disposed on the first side and the third side; A rear camera arranged on the second surface; A front camera arranged on the fourth side; At least one processor comprising a processing circuit; and memory for storing instructions; The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the user input for shooting a stereo image, a first image is acquired through the rear camera, and a second image is acquired through the front camera. An electronic device that displays an image rotated by a first setting value in an image related to the first image or the second image as a preview image through the flexible display.

2. In the first paragraph, the first setting value is, An electronic device, which is set based on the height difference between the rear camera and the front camera.

3. In the first paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Check the first set value based on the preset slope information, An electronic device that displays an image rotated by the first setting value among the first image and the second image set for a preview image as a preview image through the flexible display.

4. In the first paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the first setting value, stereo rectification is performed on an image set for a preview image among the first image and the second image, An electronic device that displays the stereo-corrected image as a preview image through the flexible display.

5. In paragraph 1, Further comprising a sensor for sensing the inclination of the electronic device; The above instructions cause the electronic device to: Obtaining tilt information of the electronic device from the sensor, Check the inclination in the direction of gravity adjusted by the second setting value from the above inclination information, An electronic device that displays a horizontal bar guide indicating the horizontal as a preview image through the flexible display based on the inclination of the adjusted gravity direction.

6. In the first paragraph, the instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: An electronic device that corrects the first image or the second image based on a difference in performance between the rear camera and the front camera.

7. In paragraph 6, the performance is: An electronic device comprising at least one of angle of view, resolution, brightness, tone, or frames per second (FPS).

8. In a method for controlling an electronic device, A method for controlling an electronic device comprising a first housing including a first side and a second side opposite to the first side, a second housing including a third side and a fourth side opposite to the third side, a hinge structure rotatably connecting the first housing and the second housing, a flexible display disposed on the first side and the third side, a rear camera disposed on the second side, a front camera disposed on the fourth side, and at least one processor including a processing circuit, An action to confirm that user input for capturing stereo images has been received; An operation of acquiring a first image through the rear camera and a second image through the front camera based on receiving a user input for capturing the stereo image; and A control method of an electronic device, comprising an action of displaying an image rotated by a first set value from an image related to the first image or the second image as a preview image through the flexible display.

9. In the 8th paragraph, the first setting value is, A control method of an electronic device, which is set based on the height difference between the rear camera and the front camera.

10. In the 8th paragraph, the method, An operation of confirming the first set value based on preset slope information; and A control method of an electronic device, comprising an action of displaying an image rotated by the first setting value among the first image and the second image set for a preview image as a preview image through the flexible display.

11. In the 8th paragraph, the method, An operation of performing stereo rectification on an image set for a preview image among the first image and the second image based on the first setting value; and A control method of an electronic device, comprising an action of displaying the stereo-corrected image as a preview image through the flexible display.

12. In the 8th paragraph, the method, An operation of obtaining tilt information of the electronic device from a sensor; An operation of checking the inclination in the direction of gravity adjusted by the second setting value from the above inclination information; and A control method of an electronic device, comprising an operation of displaying a horizontal bar guide indicating a horizontal direction as a preview image through the flexible display based on the inclination of the adjusted gravity direction.

13. In paragraph 8, the method, A control method of an electronic device, comprising an operation of correcting the first image or the second image based on a difference in performance between the rear camera and the front camera.

14. In electronic devices, A first housing comprising a first side and a second side opposite to the first side; A second housing comprising a third side and a fourth side opposite to the third side; A hinge structure that rotatably connects the first housing and the second housing; A flexible display disposed on the first side and the third side; A rear camera arranged on the second surface; A front camera arranged on the fourth side; At least one processor comprising a processing circuit; and memory for storing instructions; The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the user input for shooting a stereo image, a first image is acquired through the rear camera, and a second image is acquired through the front camera. Displaying the above first image as a preview image through the display, An electronic device that stores an image rotated by a first setting value in each of the first image and the second image in the memory as an image for stereo imaging.

15. In electronic devices, A first housing comprising a first side and a second side opposite to the first side; A second housing comprising a third side and a fourth side opposite to the third side; A hinge structure that rotatably connects the first housing and the second housing; At least a sensor for sensing the folding angle of the first housing and the second housing; A flexible display disposed on the first side and the third side; A rear camera arranged on the second surface; A front camera arranged on the fourth side; At least one processor comprising a processing circuit; and memory for storing instructions; The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the user input received for shooting a stereo image, the folding angle sensed through the sensor is confirmed, An electronic device that displays a guide for inducing unfolding of the electronic device through the flexible display based on confirmation that the folding angle sensed through the sensor is less than a set first threshold value.

Images