Electronic device and image capture method therefor

Abstract

The present disclosure provides an electronic device. The electronic device comprises: a foldable housing; a first hinge structure; a second hinge structure; a flexible display; a display; a first image sensor; a second image sensor; a memory; and at least one processor including a processing circuit. The at least one processor may: in response to identifying that the foldable housing is in a fully folded state, display at least one of the first preview image or the second preview image, through the display; and in response to identifying that the foldable housing is at least partially in a first folded state, display a first part of the first preview image through a first portion of the flexible display disposed in the third housing portion.

Description

Electronic device and method for capturing images thereof

[0001] The present disclosure relates to an electronic device and an image capturing method thereof.

[0002] Thanks to remarkable advancements in information and communication technology and semiconductor technology, the proliferation and use of various electronic devices is rapidly increasing. In particular, recent electronic devices are being developed to enable portability and communication.

[0003] Electronic devices can refer to devices that perform specific functions based on the programs installed on them, such as home appliances, electronic notebooks, portable multimedia players, mobile communication terminals, tablet PCs, audio / video devices, desktop / laptop computers, or car navigation systems. For example, these electronic devices can output stored information as audio or video. As electronic device integration increases and ultra-high-speed, high-capacity wireless communications become more widespread, a single electronic device, such as a mobile communication terminal, can now be equipped with a variety of functions. For example, in addition to communication functions, entertainment functions such as games, multimedia functions such as music / video playback, communication and security functions for mobile banking, and functions such as schedule management and electronic wallets are being integrated into a single electronic device. These electronic devices are becoming smaller and more portable for users.

[0004] As mobile communication services expand into the realm of multimedia services, the display size of electronic devices may increase to accommodate users' full access to multimedia services beyond voice calls and text messages. Accordingly, a foldable, flexible display may be placed across the entire housing structure, allowing for a separate, foldable structure.

[0005] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above-described matters constitute prior art related to the present disclosure.

[0006] An electronic device according to one embodiment of the present disclosure comprises: a foldable housing including a first housing portion, a second housing portion, and a third housing portion; a first hinge structure rotatably connecting the first housing portion and the second housing portion; a second hinge structure rotatably connecting the second housing portion and the third housing portion; a flexible display disposed on a front side of the foldable housing; a display disposed on a rear side of the first housing portion or the second housing portion; a first image sensor disposed on a rear side of the second housing portion or the third housing portion and generating a first preview image; a second image sensor disposed on a front side of the display and generating a second preview image; a memory;And at least one processor including a processing circuit, wherein the memory comprises instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: in response to identifying that the foldable housing is in a fully folded state, display at least one of the first preview image or the second preview image through the display; in response to identifying that the foldable housing is in a first folded state at least partially, display a first part of the first preview image through a first portion of the flexible display disposed in the third housing portion; in response to identifying that the foldable housing is in an unfolded state at least partially, display a second part of the first preview image larger than the first part through a second portion of the flexible display disposed in the first housing portion, the second housing portion, and the third housing portion; and in response to identifying that the foldable housing is in a second folded state at least partially, display a second portion of the first preview image through a second portion of the flexible display disposed in the first housing portion. Through the third area, instructions can be stored that cause the third portion of the first preview image to be displayed smaller than the second portion.;

[0007] According to one embodiment, the first folded state may be a state in which the first housing portion is folded relative to the second housing portion through the first hinge structure, and the second folded state may be a state in which the third housing portion is folded relative to the second housing portion through the second hinge structure.

[0008] According to one embodiment, the at least partially unfolded state of the foldable housing may be at least one of a first unfolded state in which the first housing portion is unfolded relative to the second housing portion through the first hinge structure, a second unfolded state in which the third housing portion is unfolded relative to the second housing portion through the second hinge structure, and the first unfolded state and the second unfolded state simultaneously.

[0009] According to one embodiment, the electronic device further includes a six-axis sensor and a Hall sensor, and the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: identify the first folded state in response to an angle between the first housing portion and the second housing portion being less than a first threshold angle based on a sensor value acquired by the six-axis sensor or the Hall sensor; and identify the second folded state in response to an angle between the second housing portion and the third housing portion being less than the first threshold angle based on a sensor value acquired by the six-axis sensor or the Hall sensor.

[0010] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: store at least one frame of the second preview image while the foldable housing moves from the first folded state to the unfolded state; receive a user input related to a second portion of the first preview image in the unfolded state; in response to the user input, generate a third preview image using the second preview image and the at least one frame of the first preview image through an artificial intelligence (AI) model; and display at least a portion of the third preview image in a second area of ​​the flexible display.

[0011] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: correct the first preview image using the second preview image while the first image sensor and the second image sensor capture the same direction within a certain range, and cause the corrected third preview image to be displayed in a second area of ​​the flexible display.

[0012] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: in response to the foldable housing changing from an unfolded state to the first folded state, stop displaying the second area of ​​the flexible display and cause the first portion of the first preview image to be displayed in the first area of ​​the flexible display.

[0013] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: in response to the foldable housing changing from an unfolded state to a second folded state, stop displaying the second area of ​​the flexible display and display the third portion of the first preview image in the third area of ​​the flexible display.

[0014] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: in response to the foldable housing changing from an unfolded state to a second folded state, stop displaying the second area of ​​the flexible display, display the third portion of the first preview image in the third area of ​​the flexible display, and display the second preview image on the display.

[0015] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: in response to a change in the rear side of the foldable housing from a fully unfolded state to a folded state, a portion of a preview image displayed in the fully unfolded state of the foldable housing that does not include the first image sensor and the second image sensor is cropped and displayed in an externally exposed area of ​​the flexible display.

[0016] According to one embodiment, the memory, when individually or collectively executed by the at least one processor, causes the electronic device to: display a third preview image, through the second area of ​​the flexible display, which connects the first preview image and the second preview image excluding the overlapping portion, while a portion of the first preview image and a portion of the second preview image overlap, wherein an angle of view of the third preview image may be larger than an angle of view of the first preview image and an angle of view of the second preview image.

[0017] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: generate the third preview image by naturally connecting the connection between the first preview image and the second preview image using an image processing artificial intelligence (AI) model.

[0018] In one embodiment, the first hinge and the second hinge may be of an in-folding type, and one of the first hinge and the second hinge may be a first folding narrow hinge and the other may be a second folding wide hinge.

[0019] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: display, through the display, at least one of the first preview image or the second preview image in response to the first image sensor and the second image sensor facing opposite directions.

[0020] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: display at least one of the first preview image or the second preview image over the entire area of ​​the flexible display in response to the first image sensor and the second image sensor facing the same direction.

[0021] In one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: in response to identifying that a housing portion of the foldable housing portion, in which the first image sensor is disposed, is horizontal to a floor and that the first image sensor is held facing the floor for a threshold period of time or longer, deactivate the first image sensor; and in response to identifying that a housing portion of the foldable housing portion, in which the second image sensor is disposed, is horizontal to a floor and that the second image sensor is held facing the floor for a threshold period of time or longer, deactivate the second image sensor.

[0022] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: identify an area of ​​the flexible display exposed to the outside by a folded or unfolded state of the foldable housing, divide the identified area into two or more areas based on an arbitrary boundary line, and display the first preview image or the second preview image in at least two areas among the plurality of areas, respectively.

[0023] According to another embodiment of the present disclosure, an electronic device comprises: a foldable housing including a first housing portion, a second housing portion, and a third housing portion; a first hinge structure rotatably connecting the first housing portion and the second housing portion; a second hinge structure rotatably connecting the second housing portion and the third housing portion; a flexible display disposed on a front side of the foldable housing; a first image sensor disposed on a rear side of the third housing portion and generating a first preview image; a second image sensor disposed on a left front side of the flexible display and generating a second preview image; a memory; and at least one processor including a processing circuit, wherein the memory can store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: display at least one of the first preview image and the second preview image on at least a portion of the flexible display based on an angle between the first housing portion and the second housing portion and an angle between the second housing portion and the third housing portion.

[0024] According to one embodiment, the first hinge may be of an in-folding type, and the second hinge may be of an out-foling type.

[0025] According to one embodiment, the memory may store instructions that, when individually or collectively executed by the at least one processor, cause the electronic device to: display the first preview image and the second preview image together through at least a portion of the flexible display when the foldable housing is fully unfolded.

[0026] In connection with the description of the drawings, the same or similar reference numerals may be used for the same or similar components.

[0027] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0028] FIGS. 2A, 3A, and 4A are front views showing an unfolded state of an electronic device according to one embodiment of the present disclosure.

[0029] FIGS. 2b, 3b, and 4b are rear views showing an unfolded state of an electronic device according to one embodiment of the present disclosure.

[0030] FIGS. 2c, 3c, and 4c are front views showing a folded state of an electronic device according to one embodiment of the present disclosure.

[0031] FIGS. 2d, 3d, and 4d are rear views showing a folded state of an electronic device according to one embodiment of the present disclosure.

[0032] FIGS. 2e, 3e, and 4e are bottom views showing a folded state of an electronic device according to one embodiment of the present disclosure.

[0033] FIG. 5 is a flowchart of a preview image display operation of an electronic device according to one embodiment of the present disclosure.

[0034] FIG. 6 is an example of displaying a preview image of a flexible display or display according to one embodiment of the present disclosure.

[0035] FIG. 7 is a flowchart of a preview image display operation according to a state change of an electronic device according to one embodiment of the present disclosure.

[0036] FIG. 8 is an example of a preview change of an electronic device according to one embodiment of the present disclosure.

[0037] FIG. 9A is an example of an unfolding operation of an e-type electronic device according to one embodiment of the present disclosure.

[0038] FIG. 9b is an example of a folding operation of an e-type electronic device according to one embodiment of the present disclosure.

[0039] FIG. 10A is an example of an unfolding operation of a G-type electronic device according to one embodiment of the present disclosure.

[0040] FIG. 10b is an example of a folding operation of a G-type electronic device according to one embodiment of the present disclosure.

[0041] FIG. 11 is an example of a preview change according to a state change of an electronic device according to an embodiment of the present disclosure.

[0042] FIGS. 12A and 12B are examples of changes in camera angle of view depending on the state of an electronic device, according to one embodiment of the present disclosure.

[0043] FIGS. 13A and 13B are examples of a photographing technique utilizing the state of an electronic device according to one embodiment of the present disclosure.

[0044] FIG. 14 is an example of a panoramic shooting function according to one embodiment of the present disclosure.

[0045] FIG. 15 is an example of panoramic image generation according to one embodiment of the present disclosure.

[0046] FIG. 16 is an example of an electronic device identifying an unused camera based on a state of the electronic device, according to one embodiment of the present disclosure.

[0047] Hereinafter, embodiments of the present disclosure will be described in detail with reference to the drawings so that those skilled in the art can easily implement the present disclosure. However, the present disclosure may be implemented in various different forms and is not limited to the embodiments described herein. In connection with the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and conciseness.

[0048] An embodiment of the present disclosure will be described below with reference to the attached drawings.

[0049] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments.

[0050] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of an electronic device (104) or a server (108) via a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0051] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0052] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0053] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0054] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0055] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0056] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0057] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0058] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0059] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0060] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) to an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multi-media interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0061] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0062] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0063] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0064] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0065] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0066] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0067] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for realizing URLLC.

[0068] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0069] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0070] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0071] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0072] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0073] FIGS. 2A, 3A, and 4A are front views showing an unfolded state of an electronic device according to one embodiment of the present disclosure.

[0074] FIGS. 2b, 3b, and 4b are rear views showing an unfolded state of an electronic device according to one embodiment of the present disclosure.

[0075] FIGS. 2c, 3c, and 4c are front views showing a folded state of an electronic device according to one embodiment of the present disclosure.

[0076] FIGS. 2d, 3d, and 4d are rear views showing a folded state of an electronic device according to one embodiment of the present disclosure.

[0077] FIGS. 2e, 3e, and 4e are bottom views showing a folded state of an electronic device according to one embodiment of the present disclosure.

[0078] Referring to FIGS. 2A to 4E, an electronic device (101) (or foldable electronic device (101)) according to one embodiment of the present disclosure may include a foldable housing (201) including a first housing portion (210), a second housing portion (220), and a third housing portion (230), a first hinge structure (240) rotatably connecting the first housing portion (210) and the second housing portion (220), a second hinge structure (250) rotatably connecting the second housing portion (220) and the third housing portion (230), a flexible display (203) disposed on a front side of the foldable housing (201), a display (204) disposed on a rear side of the foldable housing (201), a rear camera (205), or a front camera (206).

[0079] FIGS. 2A to 2B, 3A to 3B, and 4A to 4B are diagrams illustrating a fully unfolded state among folding states of an electronic device (101) (or a foldable electronic device (101)) according to an embodiment of the present disclosure. FIGS. 2C to 2E, 3C to 3E, and 4C to 4E are diagrams illustrating a fully folded state among folding states of an electronic device (101) (or a foldable electronic device (101)) according to an embodiment of the present disclosure. The electronic device (101) of FIGS. 2A to 4E is an example of the electronic device (101) illustrated in FIG. 1 and may be a foldable or bendable electronic device (101).

[0080] In one embodiment, the electronic device (101) illustrated in FIGS. 2A to 2E has a foldable housing (201) having a shape similar to the lowercase letter e in a bottom view in a folded state.

[0081] In one embodiment, the electronic device (101) illustrated in FIGS. 3A to 3E has a foldable housing (201) having a shape similar to the capital letter G in a bottom view in a folded state.

[0082] In one embodiment, the electronic device (101) illustrated in FIGS. 4A to 4E has a foldable housing (201) having a shape similar to the letter z in a bottom view in a folded state.

[0083] Hereinafter, for convenience of explanation, the electronic device (101) of the form illustrated in FIGS. 2A to 2E may be referred to as an e-type electronic device (101e). The electronic device (101) of the form illustrated in FIGS. 3A to 3E may be referred to as a G-type electronic device (101G). The electronic device (101) of the form illustrated in FIGS. 4A to 4E may be referred to as a z-type electronic device (101z). The above distinction is intended to explain the difference due to the folded shape, and the configuration or function of the electronic device (101) in various embodiments of the present disclosure is not limited by the above distinction.

[0084] Hereinafter, for convenience of explanation, a spatial coordinate system (or an orthogonal coordinate system) including an X-axis, a Y-axis, or a Z-axis is illustrated in FIGS. 2A to 16. The X-axis direction, the Y-axis direction, or the Z-axis direction may differ from the housing that serves as a reference for each description of each drawing. For example, in FIG. 2A, with respect to the first housing part (210), the Z-axis direction is the front of the first housing part (210), and the -Z-axis direction is the rear of the first housing part (210).

[0085] The embodiments of FIGS. 2A to 4E may be combined with the embodiments of FIG. 1 or the embodiments of FIGS. 5 to 16.

[0086] The configuration of the electronic device (101) of FIGS. 2A to 4E may be partially or entirely identical to the configuration of the electronic device (101) of FIG. 1.

[0087] According to one embodiment, the foldable housing (201) may be defined and / or referred to as a foldable housing (201) or a deformable housing (201).

[0088] According to one embodiment, the foldable housing (201) may include a first housing portion (210), a second housing portion (220), a third housing portion (230), a first hinge structure (240), or a second hinge structure (250). The first hinge structure (240) may be defined and / or referred to as a first hinge assembly. The second hinge structure (250) may be defined and / or referred to as a second hinge assembly.

[0089] According to one embodiment, the hinge structure may be an in-folding structure that folds inward or an out-folding structure that folds outward. In one embodiment, the foldable housing (201) may have a structure in which both the first housing portion (210) and the third housing portion (230) fold inward with respect to the second housing portion (220), and the first housing portion (210) may fold outward and the third housing portion (230) may fold inward with respect to the second housing portion (220). For example, the e-type electronic device (101e) and the G-type electronic device (101G) correspond to the former, and both the first hinge structure (240) and the second hinge structure (250) may be in-folding structures. For example, the z-type electronic device (101z) corresponds to the latter, and the first hinge structure (240) may be an outfolding structure, and the second hinge structure (250) may be an infolding structure.

[0090] In one embodiment, the first hinge structure (240) can be connected to the first housing portion (210) or the second housing portion (220). The second housing portion (220) can be rotatably connected to the first housing portion (210) via the first hinge structure (240). In one embodiment, the second hinge structure (250) can be connected to the second housing portion (220) or the third housing portion (230). The third housing portion (230) can be rotatably connected to the second housing portion (220) via the second hinge structure (250).

[0091] According to one embodiment, the first housing portion (210) may be connected to a first hinge structure (240). The first housing portion (210) may include a first front surface facing a first direction (e.g., the +Z direction of FIG. 2a) or a first rear surface facing a second direction opposite to the first direction (e.g., the -Z direction of FIG. 2b). The second housing portion (220) may be connected to the first hinge structure (240). The second housing portion (220) may include a second front surface facing a first direction (e.g., the +Z direction of FIG. 2a) or a second rear surface facing a second direction opposite to the first direction (e.g., the -Z direction of FIG. 2b).

[0092] According to one embodiment, the first housing portion (210) can rotate relative to the second housing portion (220) about the first hinge structure (240). The first housing portion (210) and the second housing portion (220) can be provided in a folded state (e.g., FIGS. 2C to 2E) or an unfolded state (e.g., FIGS. 2A to 2B). In one embodiment, the e-type electronic device (101e) and the G-type electronic device (101G) can have the first hinge structure (240) as an infolding structure. In one embodiment, the z-type electronic device (101z) can have the first hinge structure (250) as an outfolding structure.

[0093] According to one embodiment, the e-type electronic device (101e) of FIGS. 2A to 2E and the G-type electronic device (101G) of FIGS. 3A to 3E can be folded by rotating the second housing portion (220) relative to the first housing portion (210) by the infolding structure of the first hinge structure (240) so that the first front surface of the first housing portion (210) and the second front surface of the second housing portion (220) come into contact with each other.

[0094] In the e-type electronic device (101e) and the G-type electronic device (101G), when the first housing portion (210) and the second housing portion (220) are in a folded state, the first front surface of the first housing portion (210) can face the second front surface of the second housing portion (220). When the first housing portion (210) and the second housing portion (220) are in a folded state, a part (e.g., A1, A2, A4) of the flexible display (203) arranged on the front surfaces of the first housing portion (210) and the second housing portion (220) may not be exposed to the outside. When the first housing portion (210) and the second housing portion (220) are in a folded state, the first rear surface of the first housing portion (210) and the second rear surface of the second housing portion (220) may face opposite directions.

[0095] In the e-type electronic device (101e) and the G-type electronic device (101G), when the first housing part (210) and the second housing part (220) are in an unfolded state, the first front surface of the first housing part (210) and the second front surface of the second housing part (220) may face the same direction. When the first housing part (210) and the second housing part (220) are in an unfolded state, a part (e.g., A1, A2, A4) of the flexible display (203) arranged on the front surfaces of the first housing part (210) and the second housing part (220) may be exposed to the outside. When the first housing part (210) and the second housing part (220) are in an unfolded state, the first rear surface of the first housing part (210) and the second rear surface of the second housing part (220) may face the same direction.

[0096] According to one embodiment, by means of the outfolding structure of the first hinge structure (240) of the z-type electronic device (101z) of FIGS. 4A to 4E, the second housing portion (220) can be rotated with respect to the first housing portion (210) so that the first front surface of the first housing portion (210) and the second front surface of the second housing portion (220) can be folded in opposite directions. When the first housing portion (210) and the second housing portion (220) of the z-type electronic device (101z) are in a folded state, the first rear surface of the first housing portion (210) of the z-type electronic device (101z) can face the second rear surface of the second housing portion (220). When the first housing part (210) and the second housing part (220) of the Z-type electronic device (101z) are in a folded state, the first front side of the first housing part (210) may face in an opposite direction to the second front side of the second housing part (220). When the first housing part (210) and the second housing part (220) of the Z-type electronic device (101z) are in a folded state, a part (A1) of the flexible display (203) arranged on the front side of the first housing part (210) and a part (A2) of the flexible display (203) arranged on the front side of the second housing part (220) may face in opposite directions. Depending on the position of the user, when a part (e.g., A1 or A2) of the flexible display (203) is exposed, another part (e.g., A2 or A1) may be out of the user's field of vision.

[0097] When the first housing part (210) and the second housing part (220) of the Z-type electronic device (101z) are in an unfolded state, the first front side of the first housing part (210) may face in the same direction as the second front side of the second housing part (220). When the first housing part (210) and the second housing part (220) of the Z-type electronic device (101z) are in an unfolded state, the first rear side of the first housing part (210) may face in the same direction as the second rear side of the second housing part (220).

[0098] According to one embodiment, the second housing portion (220) may be connected to a second hinge structure (250). In one embodiment, the second hinge structures (250) of the e-type electronic device (101e), the G-type electronic device (101G), and the z-type electronic device (101z) may all have an infolding structure. The third housing portion (230) may be connected to the second hinge structure (250). The third housing portion (230) may include a third front surface facing a first direction (e.g., the +Z direction of FIG. 2A), or a third rear surface facing a second direction opposite to the first direction (e.g., the -Z direction of FIG. 2B).

[0099] According to one embodiment, the second housing portion (220) can rotate relative to the third housing portion (230) about the second hinge structure (250). The second housing portion (220) and the third housing portion (230) can be provided in a folded state (e.g., FIGS. 3A to 3G) or an unfolded state (e.g., FIGS. 2A to 2B). When the second housing portion (220) and the third housing portion (230) of the e-type electronic device (101e), the G-type electronic device (101G), and the z-type electronic device (101z) are in a folded state, the second front surface of the second housing portion (220) can face the third front surface of the third housing portion (230). When the second housing portion (220) and the third housing portion (230) of the e-type electronic device (101e), the G-type electronic device (101G), and the z-type electronic device (101z) are in a folded state, the second rear surface of the second housing portion (220) may face in the opposite direction to the third rear surface of the third housing portion (230). When the second housing portion (220) and the third housing portion (230) of the e-type electronic device (101e), the G-type electronic device (101G), and the z-type electronic device (101z) are in an unfolded state, the second front surface of the second housing portion (220) may face in the same direction as the third front surface of the third housing portion (230). When the second housing portion (220) and the third housing portion (230) of the e-type electronic device (101e), the G-type electronic device (101G), and the z-type electronic device (101z) are in an unfolded state, the second rear surface of the second housing portion (220) can face the same direction as the third rear surface of the third housing portion (230).

[0100] According to one embodiment, when both the first hinge structure (240) and the second hinge structure (250) are infolding structures, the width of the first hinge structure (240) and the width of the third hinge structure (250) may be different. In one embodiment, the e-type electronic device (101a) and the G-type electronic device (101G) may have the first housing portion (210) folded inwardly by the infolding structure based on the second housing portion (220), and the third housing portion (230) may also fold inwardly by the infolding structure. For example, in the e-type electronic device (101e), the first housing portion (210) may be folded first, and the third housing portion (230) may be folded later. The e-type electronic device (101e) may be in a form in which the second housing portion (220), the first housing portion (210), and the third housing portion (230) are sequentially stacked from the bottom in a folded state. Accordingly, the width of the second hinge structure (250) of the e-type electronic device (101e) may be wider than the width of the first hinge structure (240).

[0101] For example, in the G-type electronic device (101G), the third housing portion (230) may be folded first, and then the first housing portion (210) may be folded later. In contrast to the e-type electronic device (101e), the G-type electronic device (101G) may be configured such that the second housing portion (220), the third housing portion (230), and the first housing portion (210) are sequentially stacked from below. Accordingly, the width of the first hinge structure (240) of the e-type electronic device (101e) may be wider than the width of the second hinge structure (250).

[0102] According to one embodiment, when the first hinge structure (240) and the second hinge structure (250) have one infolding structure and the other outfolding structure, the widths of the first hinge structure (240) and the second hinge structure (250) may be similar or substantially the same. For example, since the first housing portion (210) and the third housing portion (230) of the z-type electronic device (101z) are folded in different directions with respect to the second housing portion (220), the width of the hinge structure connecting the housing portions may not be affected. The z-type electronic device (101z) may include the first hinge structure (240) and the second hinge structure (250) with similar or substantially the same width.

[0103] According to one embodiment, the electronic device (101) may include a foldable housing (201), or a flexible or foldable display (hereinafter, abbreviated as “flexible display (203)”) (e.g., display module (160) of FIG. 1) disposed in a space formed by the foldable housing (201). The flexible display (203) may include a first display area (A1), a second display area (A2), a third display area (A3), a first folding area (A4), and a second folding area (A5).

[0104] According to one embodiment, when the electronic device (101) is in an unfolded state (e.g., FIGS. 2A and 2B), a surface on which the flexible display (203) is disposed (or a surface on which the flexible display (203) is visible from the outside of the electronic device (101)) may be defined as a front surface (201a) of the electronic device (101). When the electronic device (101) is in an unfolded state, a surface opposite to the front surface (201a) may be defined as a rear surface (201b) of the electronic device (101). In addition, a surface surrounding the space between the front surface and the rear surface may be defined as a side surface of the electronic device (101).

[0105] According to one embodiment, the flexible display (204) is disposed on the front side (201a) of the foldable housing (201) and may include a first display area (A1) corresponding to the first housing portion (210), a second display area (A2) corresponding to the second housing portion (220), a third display area (A3) corresponding to the third housing portion (230), a first folding area (A4) corresponding to the first hinge structure (240), and a second folding area (A5) corresponding to the second hinge structure (250).

[0106] In one embodiment, when the foldable housing (201) of the flexible display (203) is fully unfolded, the entire screen of the flexible display (203) can be exposed to the outside. Referring to FIGS. 2A, 3A, and 4A, when the e-type electronic device (101e) and the G-type electronic device (10G) are fully unfolded, the front and back sides of the foldable housing (201) are both unfolded, and the entire area (A1, A2, A3, A4, and A5) of the flexible display (203) can also be exposed to the outside when the z-type electronic device (101z) is fully unfolded, and the front and back sides of the foldable housing (201) are both unfolded.

[0107] In one embodiment, when the foldable housing (201) is completely folded, the entire area of ​​the flexible display (203) may not be exposed to the outside. For example, referring to FIGS. 2C and 3C, when the e-type electronic device (101e) and the G-type electronic device (10G) are completely folded, the entire screen of the flexible display (203) faces the folded inside and is not exposed to the outside.

[0108] In one embodiment, when the foldable housing (201) is completely folded, a portion of the flexible display (203) may be exposed to the outside. For example, referring to FIG. 4C, when the Z-type electronic device (101z) is completely folded, only the first display area (A1) of the flexible display (203) may be exposed to the outside.

[0109] Referring to FIGS. 2A to 3E, the e-type electronic device (101e) and the G-type electronic device (101G) may include a display (204) (e.g., the display module (160) of FIG. 1) disposed in a foldable housing (201) or a portion of a space formed by the foldable housing (201). In one embodiment, the display (204) may be disposed on an opposite surface from the flexible display (203). For example, the flexible display (203) may be disposed on a front surface (201a) of the foldable housing (201), and the display (204) may be disposed on a rear surface (201b) of the foldable housing (201). For example, referring to FIG. 2B, the display (204) may be disposed on the rear side of the second housing portion (220) of the e-type electronic device (101e), or, referring to FIG. 3B, the display (204) may be disposed on the rear side of the first housing portion (210) of the G-type electronic device (101G). In one embodiment, the display (204) may be exposed to the outside (e.g., the rear side of the housing (201)) when the foldable housing (201) is fully unfolded, and may also be exposed to the outside (e.g., the front side of the housing (201)) when the foldable housing (201) is fully folded.

[0110] In one embodiment, the electronic device (101) may not include a display (204) in addition to the flexible display (203). For example, referring to FIGS. 4A to 4E , the z-type electronic device (101z) may include only the flexible display (203) and not the display (204). However, although the z-type electronic device (101z) does not include the display (204), a portion of the flexible display (203) (e.g., the first display area (A1)) may be exposed when fully folded.

[0111] Hereinafter, for convenience of explanation, a flexible display (203) that is fully exposed to the outside when the electronic device (101) is fully unfolded may be referred to as a main display, and a display (204) or a part of the flexible display (203) that is always exposed to the outside even when the electronic device (101) is fully folded (e.g., in the case of a Z-type electronic device (101z)) may be referred to as a sub-display. In various embodiments, the main display may be suitable for displaying images and videos with a wide angle of view. In various embodiments, the sub-display may be exposed to the outside when the electronic device (101) is unfolded, folded, or in an intermediate state.

[0112] In one embodiment, the foldable housing (201) may include a flexible display (203) on the front surface (201a). In one embodiment, the flexible display (203) may refer to a display in which at least a portion of the flexible display (203) may be transformed into a flat or curved surface. For example, the flexible display (203) may be configured to be at least partially folded or at least partially unfolded.

[0113] According to one embodiment, the flexible display (203) may include a first display area (A1), a second display area (A2), a third display area (A3), a first folding area (A4), or a second folding area (A5). The first display area (A1) may be arranged on one side of the first folding area (A4), and the second display area (A2) may be arranged on the other side of the first folding area (A4). The second display area (A2) may be arranged on one side of the second folding area (A5), and the third display area (A3) may be arranged on the other side of the second folding area (A5).

[0114] According to one embodiment, the first display area (A1) may be disposed on the first housing portion (210), the second display area (A2) may be disposed on the second housing portion (220), and the third display area (A3) may be disposed on the third housing portion (230). According to one embodiment, the first folding area (A4) may connect the first display area (A1) and the second display area (A2) and may be disposed on the first hinge structure (240). The second folding area (A5) may connect the second display area (A2) and the third display area (A3) and may be disposed on the second hinge structure (250). The division of regions of the flexible display (203) illustrated in FIGS. 2a to 2b, 3a to 3b, and 4a to 4b is exemplary, and the display may be divided into multiple regions (e.g., 6 or more or 3) depending on the structure or function.

[0115] In one embodiment, the flexible display (203) may be coupled with or disposed adjacent to a touch panel having a touch detection circuit and a pressure sensor capable of measuring the intensity (pressure) of a touch. For example, the flexible display (203) may be coupled with or disposed adjacent to an electromagnetic induction panel that detects a stylus pen using an electromagnetic resonance (EMR) method, as an example of a touch panel.

[0116] According to one embodiment, the first display area (A1) and the second display area (A2) may have an overall symmetrical shape centered around the first folding area (A4). The second display area (A2) and the third display area (A3) may have an overall symmetrical shape centered around the second folding area (A5).

[0117] According to one embodiment, the first folding area (A4) can be folded inward by an infolding structure in an e-type electronic device (101e) and a G-type electronic device (101G), and can be folded outward by an outfolding structure in a z-type electronic device (101z). Hereinafter, embodiments using an infolding structure and embodiments using an outfolding structure will be described separately. In the embodiments of the present disclosure, the first hinge structure and the second hinge structure are described as infolding structures, and the first hinge structure is an outfolding structure, and the second hinge structure is an infolding structure, but the present disclosure is not limited thereto.

[0118] According to one embodiment, the electronic device (101) may further include a display (204) in addition to the flexible display (203). The display (204) may be exposed to the outside even when the electronic device (101) is completely folded. The display (204) may be positioned in an opposite direction to the flexible display (203), and a portion exposed to the user may vary depending on the state of the electronic device (201). In one embodiment, a portion of the flexible display (203) and the display (204) may be exposed together.

[0119] According to one embodiment, the electronic device (101) may include at least one sensor area. Each sensor area may be disposed on a foldable housing (201). At least one of an inertial measurement unit (IMU), a digital Hall sensor (Digital Hall IC), an illumination sensor, and a camera (e.g., an image sensor) may be disposed in the sensor area.

[0120] In one embodiment, the IMU may be a 3-axis or 6-axis acceleration sensor or a gyro sensor. The electronic device (101) may detect the degree of inclination of the foldable housing (201), and more specifically, the angle between the housing parts, based on the IMU sensor value. The electronic device (101) may include a 6-axis sensor for each housing part, and may determine the angle between the housing parts based on the angle between the 6-axis sensors mounted on each housing. The electronic device (101) may determine the folded state, the unfolded state, and the degree (angle) of folding or unfolding of the electronic device (101) based on the angle between the first housing part (210) and the second housing part (220) and the angle between the second housing part (220) and the third housing part (230). The electronic device (101) may detect a change in the state of the foldable housing (201) using the IMU sensor. For example, the electronic device (101) can detect a continuous state in which the third housing part (230) is folded or unfolded based on the second housing part (220) based on continuous changes in the IMU sensor values.

[0121] According to one embodiment, the electronic device (101) can determine whether the first housing portion (210) and the second housing portion (220) of the foldable housing (201) or the second housing portion (220) and the third housing portion (230) are completely unfolded (or opened) or completely folded (or closed) based on a digital Hall sensor value. If the electronic device (101) only needs to determine whether the housing portion is opened / closed, the electronic device (101) can determine whether the housing portion is opened or closed based on an interrupt occurrence event caused by reaching a threshold value of the digital Hall sensor. The digital Hall sensor can be used to detect the opening or closing of the foldable housing (201) that is not accompanied by movement of the image sensor. For example, in an e-type electronic device (101e), a digital Hall sensor can be used to detect complete folding (close) / unfolding (open) when the first housing portion (210) is folded or unfolded. Alternatively, in a G-type electronic device (101G), a digital Hall sensor can be used to detect complete folding / unfolding when the third housing portion (230) is folded or unfolded.

[0122] An electronic device (101) according to one embodiment may include a plurality of cameras. Based on a state in which the foldable housing (201) is fully folded, the electronic device may include a front camera (206) and a rear camera (205). In one embodiment, when the foldable housing (201) is fully unfolded, the front camera (206) and the rear camera (205) may face the same direction. For example, the e-type electronic device (101e) and the G-type electronic device (101G) may have the rear camera (205) disposed on the rear of the second housing portion (220) or the third housing portion (230) of the foldable housing (201), and the front camera (206) may be disposed on the front of the display (204) disposed on the rear (201b) of the foldable housing (201), i.e., on the rear of the first housing portion (210) or the second housing portion (220) of the foldable housing (201). In one embodiment, when the foldable housing (201) is fully unfolded, the front camera (206) and the rear camera (205) may face opposite directions. For example, a Z-type electronic device (101z) may have the rear camera (205) positioned on the rear of the third housing portion (230) of the foldable housing (201), and the front camera (206) positioned on a portion (e.g., the first housing portion (210)) of the flexible display (203) positioned on the front (201a) of the foldable housing (201).

[0123] In one embodiment, the front camera (206) or the rear camera (205) may include one or more lenses, image sensors, and / or image signal processors. The flash may include, for example, a light-emitting diode or a xenon lamp. In one embodiment, two or more lenses (an infrared camera, a wide-angle lens, and a telephoto lens) and image sensors may be arranged on one side of the electronic device (101).

[0124] In one embodiment, the electronic device (101) can display the captured images of the rear camera (205) and the front camera (206) on a flexible display (203) or a screen that divides the display (204) into multiple windows.

[0125] In one embodiment, the plurality of cameras included in the electronic device (101) may have different types and / or performances. The rear camera (205) and the front camera (206) may have different types and / or performances, or the plurality of cameras included in the rear camera (205) may have different types and / or performances. The electronic device (101) may regard one of the two cameras as the main camera and the other as the sub camera, and may use the shooting results of the sub camera to correct or expand the results of the main camera after shooting. The electronic device (101) may prevent problems that may arise due to differences in performance, such as the angle of view (e.g., wide-angle or telephoto) and resolution, between the cameras when outputting images from multiple cameras or using them as input information for an artificial intelligence model. For example, if the performance of the rear camera (205) is better than that of the front camera (206), and if they are shooting in the same direction, the rear camera (205) can be set as the main camera and the front camera (206) can be set as the sub camera, and preview images can be displayed using images acquired by the two cameras. In one embodiment, the electronic device (101) can express various pictures in one image by changing the magnification of each camera or diversifying the target on which it focuses. For example, when two cameras are facing the same direction, a relatively low-performance camera can be used to shoot an image according to user settings, but the high image quality information of the relatively high-performance camera can be reflected for a specific part. In various embodiments, the electronic device (101) can apply various adjustments so that the user can feel the performance difference between the multiple cameras to a minimum. For example, the electronic device (101) can apply image quality adjustments, main camera settings, diversification of focus, adjustment of the distance between previews, etc.

[0126] In one embodiment, the rear camera (205) may include multiple cameras, and the baseline between each of the rear cameras (205) may be smaller than the baseline between one of the rear cameras (205) and the front camera (206). Depth information that can be obtained using the two cameras may have deeper information than the first depth information that can be obtained using one rear camera (205) and the front camera (206) than the second depth information that can be obtained using each of the rear cameras (205). When the rear camera (205) and the front camera (206) are facing the same direction, the depth information of the screen can be increased in accuracy by appropriately combining the captured images of the two cameras, and a three-dimensional picture can be taken.

[0127] In one embodiment, the angle of view of the image that can be captured by the rear camera (205) and / or the front camera (206) and the screen size of the flexible display (203) and / or the display (204) may be different. The electronic device (101) may crop a portion of the preview image to display the preview image with a wide angle of view on a narrow screen.

[0128] In one embodiment, when the electronic device (101) is fully folded, the front camera (205) can capture images in the direction of the user, and the rear camera (205) can capture images in the opposite direction of the user. Alternatively, when the electronic device (101) is fully unfolded, both the front camera (206) and the rear camera (205) can capture images in the opposite direction of the user. In one embodiment, referring to FIGS. 4A and 4B , the Z-type electronic device (101z) can capture images in the direction of the user, and the rear camera (205) can capture images in the opposite direction of the user, even when the device is fully unfolded.

[0129] In one embodiment, the camera may not be visually exposed. For example, the camera may be configured as an under-display camera (UDC). Pixels in a region of the flexible display (203) corresponding to the location of the UDC may be configured differently from pixels in other regions, such that the image sensor and / or the camera may not be visually exposed.

[0130] In one embodiment, the rear camera (205) may be positioned on the rear of the second housing portion (220) or the third housing portion (230) of the foldable housing (201) to generate a first preview image. The front camera (206) may be positioned on the front of the display (204) or the front of the first housing portion (210) to generate a second preview image. The electronic device (101) may determine the user's field of view based on a state of the electronic device (101). The state of the electronic device (101) may be determined based on an angle between the first housing portion (210) and the second housing portion (220) and an angle between the second housing portion (220) and the third housing portion (230). For example, the state of the electronic device (101) may include a first folded state, a first unfolded state, or a first intermediate state by the first housing portion (210) and the second housing portion (220), and a second folded state, a second unfolded state, or a second intermediate state by the second housing portion (220) and the third housing portion (230).

[0131] According to one embodiment, the electronic device (101) can determine whether the flexible display (203) or the display (204) is included in the user's field of view according to the state of the electronic device (101). The electronic device (101) can display the first preview image and the second preview image on the entire flexible display (203), at least a portion of the flexible display (203), the entire display (204), or at least a portion of the display (204) depending on the folded or unfolded state of the electronic device (101). For example, the electronic device (101) can display the second preview image by the front camera (206) on the display (204) in response to the electronic device (101) detecting the first folded state and the second folded state based on values ​​of the IMU sensor and the digital Hall sensor. The electronic device (101) can display a first preview image by the rear camera (205) on a part of the flexible display (203) and a second preview image by the front camera (206) on the display (204) in response to the electronic device (101) detecting the first intermediate state and the second unfolded state based on the IMU sensor and the digital Hall sensor values. The electronic device (101) can display a first preview image by the rear camera (205) on the flexible display (203) and a second preview image by the front camera (206) on the display (204) in response to the electronic device (101) detecting the first unfolded state and the second unfolded state based on the IMU sensor and the digital Hall sensor values.

[0132] In one embodiment, the electronic device (101) can adaptively control the preview images displayed on the flexible display (203) and the display (204) according to a change in the state of the electronic device (101). For example, when the electronic device (101) detects a change in the state in which the third housing part (230) is unfolded from a completely folded state of the electronic device (101), the electronic device (101) can display a first preview image by a rear camera on the third display area (A3) of the flexible display (203).

[0133] According to one embodiment, a key button (207) may be included on one side of the foldable housing (201). The key button (207) may be positioned on the left side (e.g., the left side of the first housing portion (210)) or the right side (e.g., the right side of the third housing portion (230)) of the foldable housing (201). When the foldable housing (201) is completely folded, it may be positioned on the left side or the right side. Depending on the state of the electronic device (101), the key button (207) may be changed to the left side or the right side based on the user.

[0134] FIG. 5 is a flowchart of a preview image display operation of an electronic device according to one embodiment of the present disclosure.

[0135] An electronic device (101) according to one embodiment can capture an image or video using at least one of a front camera (206) or a rear camera (205). The electronic device (101) can display at least one preview image captured by the rear camera (205) and the front camera (206) on at least one of a flexible display (203) or a display (204).

[0136] In step S510, the electronic device (101) according to one embodiment may receive a user input corresponding to camera execution (e.g., clicking a camera icon). The electronic device (101) may initially set multiple cameras to be turned on / off. For example, in response to a request for camera execution, the front camera (206) and the rear camera (205) may be set to be executed together, only the rear camera (205) may be set to be executed, or only the front camera (206) may be set to be executed.

[0137] At step S520, the electronic device (101) can identify a state of the electronic device (101). For example, the state of the electronic device (101) can include a first folded state, a first unfolded state, or a first intermediate state by the first housing portion (210) and the second housing portion (220), and a second folded state, a second unfolded state, or a second intermediate state by the second housing portion (220) and the third housing portion (230). The electronic device (101) can identify each current folding state of the electronic device (101) based on an inertial sensor (IMU) value and a digital Hall sensor value.

[0138] At step S530, the electronic device (101) may select a display (e.g., a flexible display (203) or a display (204)) for outputting a preview according to each folding state of the electronic device (101). For example, when the electronic device (101) is in a state where the first housing part (210), the second housing part (220), and the third housing part (230) are all unfolded, the flexible display (203) may be selected. The display for outputting a preview according to each folding state of the electronic device (101) may be set by initial settings. The electronic device (101) may select a display corresponding to the current state of the electronic device (101) according to initial settings.

[0139] In step S540, the electronic device (101) can display a preview image on the selected display. The electronic device (101) can display the preview image on the entire display or a portion of the display. The electronic device (101) can select and display a preview image from the front camera or a preview image from the rear camera. Alternatively, the electronic device (101) can display a preview image from the rear camera by compensating it with information (e.g., depth information) from the front camera.

[0140] FIG. 6 is an example of displaying a preview image of a flexible display or display according to one embodiment of the present disclosure.

[0141] In various embodiments, the electronic device (101) may display a preview image on the flexible display (203) or display (204).

[0142] A flexible display (203) according to an embodiment may include a first display portion (A1), a second display portion (A2), a third display portion (A3), a first folding area (A4), and a second folding area (A5). The flexible display (203) may have different areas exposed to the outside depending on each folding state of the electronic device (101).

[0143] According to one embodiment, the display (204) may always be exposed to the outside regardless of the folding state of the electronic device (101). However, since the display (204) is arranged on the opposite side from the flexible display (203), the user may use either the flexible display (203) or the display (204). In the folding state of some electronic devices (101), the display (204) and a portion of the flexible display (203) may be exposed to the user simultaneously.

[0144] Referring to FIG. 6, P1 illustrates a case where the electronic device (101) is in a completely folded state. P1 may be a display (204). P1 may display a preview image (A) acquired by a front camera (206) or a preview image (B) acquired by a rear camera (205). P2 and P3, similar to P1, illustrate a case where the electronic device (101) is in a completely folded state. P2 is a case where the electronic device (101) is in a vertical direction, and P3 is a case where the electronic device (101) is in a horizontal direction. P2 or P3 may split the display (204) to display preview images (A, B) acquired by the front camera (206) and the rear camera (205), respectively.

[0145] P4 and P5 illustrate a case where only the first housing portion (210) is unfolded while the electronic device (101) is fully unfolded. Similar to P1 and P2, P4 and P5 can display a preview image (A) acquired by the front camera (206) or a preview image (B) acquired by the rear camera (205) on the entire first display portion (A1) corresponding to the first housing portion exposed to the outside, or can divide the first display portion (A1) to display preview images (A, B) acquired by the front camera (206) and the rear camera (205), respectively.

[0146] P6 and P7 illustrate a case where the third housing portion (230) is folded at an angle of about 90 degrees while the electronic device (101) is fully unfolded. In the cases of P6 and P7, the first display portion (A1) and the second display portion (A2) can be exposed to the outside. P6 can display a preview image (A) acquired by the front camera (206) or a preview image (B) acquired by the rear camera (205). Since the display size displayed is different from that of P1 or P8, a part of the preview image acquired by the front or rear camera (206, 205) can be cropped and displayed. P7 can display a preview image (A) acquired by the front camera (206) or a preview image (B) acquired by the rear camera (205) by dividing it into any area other than the area defined by the first display portion (A1) and the second display portion (A2).

[0147] P8 illustrates a case where the electronic device (101) is fully unfolded. P8 may be a flexible display (203). Since the front camera (206) and the rear camera (205) face the same direction in the fully unfolded state, the electronic device (101) can display a preview image of the rear camera (205), which generally has better camera performance, on the flexible display (203). In various embodiments, the electronic device (101) can display a preview image acquired by the rear camera (205) by correcting it using depth information acquired by the front camera (206), etc. (B'). In this case, since the distance between one lens of the rear camera (205) and the front camera (206) is longer than the distance between the plurality of lenses included in the rear camera (205), the image (B) can include more depth information than the image captured by only the rear camera (205).

[0148] The preview examples disclosed in FIG. 6 are merely examples, and the preview may be displayed in various ways on a display within the user's visible range depending on various states of the electronic device (101). For example, if the area between the first housing portion (210) and the second housing portion (220) of the electronic device (101) corresponds to a first intermediate state, and the area between the second housing portion (220) and the third housing portion (230) corresponds to a second intermediate state, the first housing portion (210) and the third housing portion (320) may be exposed to the user in an inclined state.

[0149] FIG. 7 is a flowchart of a preview image display operation according to a state change of an electronic device according to one embodiment of the present disclosure.

[0150] In step S710, the electronic device (101) according to an embodiment can detect a change in a sensor value due to a change in each folding state or rotational operation of the electronic device (101). For example, when the first housing part (210) and the second housing part (220) of the electronic device (101) are in contact with each other, the inertial sensor value can change according to a change in which the first housing part (210) is unfolded away from the second housing part (220) by the first hinge structure (240). The electronic device (101) can detect a continuous state change of the electronic device (101) based on the inertial sensor value. The electronic device (101) can calculate an angle between each housing part (or display screen) of the electronic device (101) based on a sensor value acquired by an IMU sensor (e.g., a 6-axis acceleration sensor or a gyro sensor). The electronic device (101) can identify whether the electronic device (101) is fully open / closed based on the digital Hall sensor value. In one embodiment, when a housing part that does not include a camera moves, the digital Hall sensor value can be used instead of the IMU sensor value to determine whether the housing part is fully folded (closed) or fully unfolded (open). When the housing part that does not include a camera moves, since the state change of the electronic device (101) is not accompanied by camera rotation, there is no change in the preview by the camera, and the screen size changes due to the complete folding / unfolding of the housing part. An embodiment of a state change of the electronic device (101) that is not accompanied by camera rotation is described in detail in FIG. 11, which will be described later.

[0151] At step S720, the electronic device (101) according to an embodiment can determine whether the IMU sensor value deviates from a first threshold angle set in advance. The electronic device (101) can detect a point in time when the IMU sensor value changes according to the movement of the housing portion and deviates from the first threshold angle. For example, the electronic device (101) can control the display of the preview image in response to the angle between the first housing portion (210) and the second housing portion (220) gradually increasing to become larger than the first threshold angle set in advance. Alternatively, the electronic device (101) can control the display of the preview image in response to the angle between the first housing portion (210) and the second housing portion (220) gradually decreasing to become smaller than the first threshold angle.

[0152] According to one embodiment, the electronic device (101) can identify a first intermediate state and a second intermediate state while moving from a fully folded state to a fully unfolded state based on two critical angles (e.g., a first critical angle and a second critical angle). For example, according to one embodiment, the electronic device (101) can identify a first intermediate state when, when the first housing part (210) and the second housing part (220) are in contact and folded, and when the angle between the first housing part (210) and the second housing part (220) gradually increases and reaches the first critical angle due to an unfolding motion. The first intermediate state may mean a state in which the first surface (A1) of the flexible display (203) arranged on the rear surface of the first housing part (210) is not exposed to the outside, and at least a portion of the second surface (A2) of the flexible display (203) arranged on the rear surface of the second housing part (220) is exposed to the outside. For example, the first critical angle may be 15 degrees. According to an embodiment, the electronic device (101) may, in the first intermediate state, deactivate the first side (A1) of the flexible display (203) and activate the second side (A2) of the flexible display (203), thereby displaying at least a portion of the first preview image or the second preview image. According to an embodiment, the electronic device (101) may identify that it is in the second intermediate state when, by an unfolding operation in the first intermediate state, the angle between the first housing part (210) and the second housing part (220) gradually increases and reaches the second critical angle. The second intermediate state may mean a state in which at least a portion of the first side (A1) of the flexible display (203) disposed on the rear side of the first housing part (210) is exposed to the outside, and the second side (A2) of the flexible display (203) disposed on the rear side of the second housing part (220) is exposed to the outside. For example, the second critical angle may be 90 degrees.An electronic device (101) according to one embodiment can identify that the second intermediate state is reached while maintaining the second face (A2) of the flexible display (203) activated from the first intermediate state, thereby activating the first face (A1) of the flexible display (203) and displaying at least a part of the first preview image or the second preview image through the first face (A1) and the second face (A2) of the flexible display (203).

[0153] In step S730, the electronic device (101) according to one embodiment may select an output display according to the changed state of the electronic device (101) in response to detecting that the IMU sensor value deviates from the threshold angle. The electronic device (101) may determine which display is exposed to the outside or which display is within the user's field of view based on the current state of the electronic device (101). The electronic device (101) may select a display within the user's field of view among the displays exposed to the outside as an output display. If a display is changed so that it is not exposed to the outside among the entire displays, the electronic device (101) may terminate the output of the corresponding display. The electronic device (101) may maintain the output of a preview image for a portion of the display that rotates in the opposite direction to the user's direction among the entire displays. In various embodiments, the flexible display (203) or the display (204) of the electronic device (101) may be utilized by the user even when they are displayed in different directions. In some circumstances, the electronic device (101) may provide a process for the user to determine whether to use a particular display. For example, when the electronic device (101) is fully unfolded from a folded state, a control icon may be displayed on the flexible display (203) to prompt the user to select whether to maintain the output of the display (204) moved to the rear.

[0154] In step S740, the electronic device (101) according to one embodiment may select and output at least one of the preview images acquired by the front camera (206) or the rear camera (205) to the selected display. For example, when the electronic device (101) in a completely folded state comes into contact with the first housing part (210) and the second housing part (220) in the folded state and unfolds together, the sub-display (204) may move in the opposite direction of the user, and a part of the main display (203) may begin to be exposed to the outside. The electronic device (101) may adaptively terminate the output of the sub-display (204) in response to the change in the state of the electronic device (101) and output the preview image by the rear camera (205) to a part of the main display (203). In one embodiment, the electronic device (101) may output the preview image to all or part of the selected display. For example, the electronic device (101) may output at least one of a preview image acquired by the front camera (206) or a preview image acquired by the rear camera (205) to at least a portion of the first display portion (A1) and the second display portion (A2) in a situation where the third housing portion (230) is perpendicular to the second housing portion (220). This may be the same as either P6 or P7 of FIG. 6.

[0155] FIG. 8 is an example of a preview change of an electronic device according to one embodiment of the present disclosure.

[0156] According to one embodiment, the operation (b) of unfolding one side of the e-type electronic device (101e) in a completely folded state (a) is as follows.

[0157] In this state, the e-type electronic device (101e) can display a preview image acquired by the front camera (206) on the sub-display (204). The angle ( )(e.g., the angle at which the first housing portion (210) and the second housing portion (220) in the folded state are unfolded together from the second housing portion (230)) is a specific critical angle ( ), the preview image acquired by the front camera (206) and the preview image acquired by the rear camera (205) may be displayed together on a part of the right side of the main display (e.g., the third housing part (230) or the third display area (A3)). At this time, only the preview image acquired by the front camera (206) may be displayed on the sub-display (204), and no preview image may be displayed on the sub-display (204). In addition, only the preview image coming into the rear camera (205) may be displayed on a part of the right side of the main display (203).

[0158] An electronic device (101) according to one embodiment can identify a first intermediate state and a second intermediate state based on two critical angles (e.g., a first critical angle and a second critical angle). For example, an angle ( )(e.g., the angle at which the first housing portion (210) and the second housing portion (220) in the folded state are unfolded together from the second housing portion (230)) is the first critical angle ( ) is greater than, it can be identified as the first intermediate state, and the angle ( ) becomes larger, the second critical angle ( ) can be identified as a second intermediate state. Referring to FIG. 8, the first intermediate state may mean a state in which at least a part of the third surface (A3) of the flexible display (203) disposed on the rear side of the third housing portion (230) is exposed to the outside, and the display (204) is also exposed to the outside. The second intermediate state may mean a state in which the entire third surface (A3) of the flexible display (203) is exposed to the outside, and the direction of the display (204) and the direction of the third surface (A3) of the flexible display (203) are opposite to each other and face in the opposite direction of the user. In response to identifying that the electronic device (101) changes from a fully folded state (a) to a first intermediate state, the electronic device (101) according to one embodiment may activate the third side (A3) of the flexible display (203) while maintaining the display (204) in an activated state, and display the first preview image or the second preview image on the display (204) and the third side (A3) of the flexible display (203). In response to identifying that the electronic device (101) changes from the first intermediate state to the second intermediate state, the electronic device (101) according to one embodiment may deactivate the display (204) while maintaining the third side (A3) of the flexible display (203) in an activated state, and display the first preview image or the second preview image only on the third side (A3) of the flexible display (203). As described above, the electronic device (101) according to one embodiment can identify the display and output direction exposed to the outside according to the change in the folded state, and determine the display to output the preview image.

[0159] FIG. 9A is an example of an unfolding operation of an e-type electronic device according to one embodiment of the present disclosure.

[0160] The e-type electronic device (101e) is in a completely folded state (a), and when the third housing part (230) is unfolded first (b), only the third display area (A3), which is the right area of ​​the flexible display (203), is exposed to the outside (c). In the c state, when the first housing part (210) is unfolded later (d), the device can be in a completely unfolded state (e) in which all areas of the flexible display (203) are exposed to the outside. The folding operation of the fully unfolded e-type electronic device (101e) is such that when the first housing part (210) is folded toward the second housing part (220) in the c state, only the third display area (A3), which is the right area of ​​the flexible display (203), is exposed to the outside (d). When the third housing part (230) is folded (b') so that it touches the back of the first housing part (210) in the above state, the e-type electronic device (101e) is in a completely folded state (a), and the sub-display (204) of the e-type electronic device (101e) is located on the opposite side.

[0161] As described above, in the e-type electronic device (101e) according to one embodiment, when the first housing part (210), the second housing part (220), and the third housing part (230) are all folded, only the sub-display (204) positioned on the rear side of the first housing (210) can be exposed to the outside. When the e-type electronic device (101e) is folded, the front camera (206) and the rear camera (205) are positioned on opposite sides, so that the front camera (206) can capture a user, and the rear camera (205) can capture a background positioned opposite the user, and the captured images can be displayed on all or part of the sub-display (204). For example, the sub-display (204) may display only the image coming from the front camera (206) on the sub-display (204), or may display only the image coming from the rear camera (205) on the sub-display (204), or may display two previews simultaneously on the sub-display (204).

[0162] When the state of the electronic device (101) changes from A to B through the process, the front camera (206) and the rear camera (205) are positioned in the same direction by the operation of unfolding the first housing part (210) and the second housing part (220) of the folded state of the e-type electronic device (101e) at the same time, and both cameras capture the background. The e-type electronic device (101e) can display the background captured by the two cameras on the third display area (A3) arranged on the front of the third housing part (230) so that the third display area (A3) is exposed to the outside. In the C state, since the first housing part (210) and the second housing part (220) are in contact and folded, the first display area (A1) and the second display area (A2) may not display any image.

[0163] The e-type electronic device (101e) determines a change from the first state to the second state as a camera transition, and displays a preview image acquired by the front camera (206) on the sub-display (204) in the first state, and when changing to the second state, displays a preview image acquired by the rear camera (205) on the third display area (A3) of the flexible display (203). Alternatively, a part of the background captured by the front camera (206) and a part of the background captured by the rear camera (205) may be displayed together on the third display area (A3).

[0164] In one embodiment, the sub-display (204) may display a preview image by applying a function including three-dimensional depth information (depth) using multiple rear cameras (205) based on a user's input (e.g., inputting a swipe gesture on the sub-display (204) screen). For example, if a tree included in the shooting range of the rear camera (205) is closer than a mountain, the depth information may be extracted using the rear camera (205), and a blur effect may be relatively applied to the mountain using the depth information to perform an out-of-focus function on the tree. For such a function, reference may be made to U.S. registered patent US10,430,957.

[0165] In all states, the electronic device (101) may have a screen size of the right side of the main display (e.g., the third housing part (230) or the third display area (A3)) smaller than the angle of view of the preview image acquired by the rear camera (205). The electronic device (101) may crop a part of the preview image acquired by the rear camera (205) to fit the resolution of the third display area (A3) and display it.

[0166] An electronic device (101) according to an embodiment can more effectively apply a blur function by using the front camera (206) and the rear camera (205) in which the baseline is relatively longer than the baseline within the rear camera (205) because the front camera (206) is located on the same plane as the rear camera (205), in multiple states.

[0167] In the above state, the first housing part (210) of the e-type electronic device (101e) can be fully unfolded by a motion of unfolding. The entire flexible display (203) is exposed to the outside, and preview images by the front camera (206) and the rear camera (205) can be displayed on the front of the flexible display (203). In one embodiment, the electronic device (101) can display the preview image acquired by the rear camera (205) on the entire screen of the flexible display (203). In the above state, the portion of the flexible display (203) exposed to the outside is widened in the above state, so that an image having a wider angle of view can be displayed. The electronic device (101) can display a preview image acquired by a camera having a relatively wide angle among the plurality of cameras included in the rear camera (205) on the flexible display (203). Referring to FIG. 9A, a preview transformation according to a state change of the e-type electronic device (101e) is described. For example, when the electronic device (101) is completely folded (the folded state), the preview image coming into the front camera (206) can be displayed on the sub-display (204). When the electronic device (101) is changed to the folded state by a gesture, the image coming into the camera corresponding to a relatively wide-angle camera among the rear cameras (205) is displayed on one side of the right side of the main display, and when the user completely unfolds the terminal, the image corresponding to the relatively wide-angle camera among the rear cameras can be displayed across the entire flexible display (203). At this time, the electronic device (101) can also utilize the image information coming into the front camera (206) to apply a blur effect, as when unfolding only one side.

[0168] FIG. 9b is an example of a folding operation of an e-type electronic device according to one embodiment of the present disclosure.

[0169] In order for the e-type electronic device (101e) according to one embodiment to return from a fully unfolded state (ma state) to a fully folded state (a), the unfolding operation of Fig. 9a must be performed in reverse. That is, in the ma state, the first housing part (210) is folded first (ra'), and when it becomes the da state, the first housing part (210) and the second housing part (220), which are in a folded state while in contact, are folded at the same time (b'), so that the fully folded a state can be achieved.

[0170] In one embodiment, when the third housing part (230) is folded first in a fully unfolded state (unfolded state) of the e-type electronic device (101e), the first hinge structure is narrow and the second hinge structure is wide, so that the first housing part (210) cannot be folded into the second housing part (220) while the third housing part (230) is folded in contact with the second housing part (220).

[0171] Referring to FIG. 9b, when the third housing part (230) is first folded when the e-type electronic device (101e) is in a fully unfolded state (unfolded state), the first display area (A1) of the flexible display (203) is exposed to the outside, and the rear side of the third housing part (230) where the rear camera (205) is arranged is positioned next to the first display area (A1).

[0172] The electronic device (101) can display an image of a user entering the rear camera (205) on the left side of the flexible display (203) (e.g., the first housing part (210) and the first display area (A1)) because the side where the rear camera (205) is located is folded. The electronic device (101) can also turn on the front camera (206) so that the front camera (206) captures a background and the rear camera (205) captures a user, and display them together on the first display area (A1). Alternatively, the front camera (206) can be turned on and the rear camera (205) can be turned off so that only the background entering the front camera (206) is displayed on the left side of the flexible display (203).

[0173] In one embodiment, if the e-type electronic device (101e) can capture images in both directions, it can synthesize bidirectional captured images to create a new image. For example, the e-type electronic device (101e) can create a single image using a Gen AI (generative artificial intelligence) model based on a user image captured by the rear camera (205) and a background image captured by the front camera (206). The e-type electronic device (101e) can provide different shooting ranges of the front camera (206) or the rear camera (205) to the user depending on whether the electronic device (101) is rotated or tilted in addition to the folding / unfolding state.

[0174] FIG. 10A is an example of an unfolding operation of a G-type electronic device according to one embodiment of the present disclosure.

[0175] In a G-type electronic device (101G) according to an embodiment, in a completely folded state (a), the first housing portion (210), the second housing portion (230), and the second housing portion (220) in which the sub-display (204) is arranged are sequentially folded. In order to fully unfold the G-type electronic device (101G), the first housing portion (210) is opened to the left and unfolded first (b), and then the third housing portion (230) is opened to the right and unfolded next (d), so that the device can be in a completely unfolded state (e). In order to fully fold the G-type electronic device (101G) from a completely unfolded state (e), the third housing portion (230), which is the rightmost housing, is folded first (d'), and then the first housing portion (210), which is the left housing, is folded next (b'), so that the device can be in a completely folded state (a).

[0176] A G-type electronic device (101G) in a state in which a sub-display (204) is exposed to the outside can display at least one of the preview images acquired by a front camera (206) or a rear camera (205).

[0177] As the state of the G-type electronic device (101G) changes by the action, the output of the sub-display (204) can be terminated, and a preview image can be output to the first display area (A1) of the main display (203).

[0178] In the D state, in response to the G-type electronic device (101G) changing to a fully unfolded state through the L motion, the G-type electronic device (101G) can output a preview image to the entire area of ​​the flexible display (203) including the second display area (A2) and the third display area (A3).

[0179] When the camera rotates together with the folding / unfolding of the housing parts by the G-type electronic device (101G), the angle at which the camera can capture images can be dramatically improved temporarily. In one embodiment, the UI configuration of the display can be changed depending on whether the display displays a preview image of the front camera or a preview image of the rear camera according to the movement of the camera among various preview examples. The electronic device (101) can not only provide various preview types, but also provide various functions or shooting techniques by applying generative AI. Hereinafter, an embodiment that expands the shooting technique will be described with reference to FIG. 12.

[0180] FIG. 10b is an example of a folding operation of a G-type electronic device according to one embodiment of the present disclosure.

[0181] In Fig. 10a, the G-type electronic device (101G) is described as having an operation in which the right housing part is first unfolded from a completely folded state (a), and then the left housing part is unfolded to become a completely unfolded state (b).

[0182] In one embodiment, when the left housing portion (e.g., the first housing portion (210)) of the G-type electronic device (101G) is folded first, a part of the main display (203) (e.g., the third display area (A3)) and the sub-display (204) may be displayed in the same direction. The difference between the G-type electronic device (101G) and the e-type electronic device (101e) is that, as shown in FIG. 10b, when one side is folded or unfolded, a part of the main display (203) and the sub-display (204) may face the same side. However, when the G-type electronic device (101G) is folded first, the right-side hinge portion (e.g., the third housing portion (230)) cannot be folded further due to the narrow width of the second hinge structure (250).

[0183] In one embodiment, a state in which a portion of the main display (230) and the sub-display (204) are displayed in the same direction can be utilized in various situations.

[0184] For example, the G-type electronic device (101G) can display a preview image (e.g., background) acquired by the rear camera (203) on the front of the main display (203) in the fully unfolded state. When the first housing part (210) of the G-type electronic device (101G) is folded toward the second housing part (220) (b), and when the angle between the first housing part (210) and the second housing part (220) exceeds a specific critical angle, the G-type electronic device (101G) can crop and display a portion of the preview image acquired by the rear camera (205) in a portion of the second display area (A2) and a portion of the third display area (A3) of the main display (203). When the G-type electronic device (101G) is fully unfolded (c), the preview image acquired by the rear camera (205) can be cropped and displayed at a smaller angle than the field of view. The first display area (A1) of the main display (203) temporarily displays a preview image captured by the front camera (206) located at the top of the sub display (203), and when the first housing part (210) is folded beyond a critical angle and the second housing part (220) comes into contact and folds, the output of the first display area (A1) of the main display (203) may be terminated.

[0185] In one embodiment, when the first housing portion (210) is positioned at a right angle to the second housing portion (220) (which may be in an L-shape in a top view), the sub-display (204) may output a preview image captured by the front camera (206). When the first housing portion (210) of the G-type electronic device (101G) is completely folded, the sub-display (204) may output a preview image captured by the front camera (206), and a part of a preview image captured by the rear camera (205) may be output on the right side of the main display (203) (e.g., the third display area (A3)). In this situation, the image displayed on the left side of the main display (203) (e.g., the first display area (A1)) may be displayed with a smaller angle of view than the image that was originally being displayed. Alternatively, if the image sensor of the rear camera (205) is mounted vertically, the angle of view may be displayed larger than the image displayed on the center and right side of the front main display (203). Due to the characteristics of the second hinge structure, there is no case where the sub-display (204) and a part of the main display (203) are folded so as to touch each other. When the G-type electronic device (101G) is in a closed state, if an attempt by the user to fold the housing part (e.g., between the second housing part (220) and the third housing part (230)) is detected, the G-type electronic device (101G) may display a message or indicator on the sub-display (204) and / or at least a part of the right screen of the main display (203) indicating that folding is no longer possible.

[0186] FIG. 11 is an example of a preview change according to a state change of an electronic device according to an embodiment of the present disclosure.

[0187] In one embodiment, the folding / unfolding operation of some housing portion of the electronic device (101) is not accompanied by rotation of the front camera (206) or the rear camera (205).

[0188] For example, referring to FIG. 9a, the e-type electronic device (101e) does not accompany the rotation of the front or rear camera when changing between the da state and the ma state.

[0189] Alternatively, referring to FIG. 10a, in the G-type electronic device (101G), the change between the da state and the ma state is not accompanied by rotation of the front or rear camera.

[0190] In this way, if the change in the housing portion is not accompanied by the rotation of the camera, there is no change in the preview image captured by the front camera (206) or the rear camera (205). In addition, in the above operation, a new display area is not added. This corresponds to the first housing portion (210) in the e-type electronic device (101e) and the third housing portion (230) in the G-type electronic device (101G). In the above operation, the camera does not move, and the folding operation simply covers the screen.

[0191] In one embodiment, if the state change of the electronic device (101) is not accompanied by the rotation of the camera, the screen captured by the rear camera (205) can be simply cropped and displayed according to the screen size. This operation only requires identifying whether the corresponding housing part is open or closed by a digital Hall sensor instead of an IMU sensor value. The electronic device (101) can determine whether to display the screen based on an interrupt occurrence event caused by reaching a threshold value of the Digital Hall IC.

[0192] FIGS. 12A and 12B are examples of changes in camera angle of view depending on the state of an electronic device, according to one embodiment of the present disclosure.

[0193] An electronic device (101) according to one embodiment can capture images or videos simultaneously using a front camera (206) and a rear camera (205) while being folded at a right angle between some housings. FIG. 12a is an example, and in actual use, the electronic device (101) can be operated at various angles to capture images.

[0194] A part (1203) of the range (1202) captured by the front camera (206) overlaps with a part (1203) of the range (1201) captured by the rear camera (205). Excluding the overlapping portion, when connecting the image captured by the front camera (206) and the image captured by the rear camera (205), an image with a wider angle of view than the angle of view that can be captured by the front camera (206) or the rear camera (205) can be captured.

[0195] Referring to FIG. 12B, the electronic device (101) can acquire images of a preview area (P1201) captured by a rear camera (205) and a preview area (P1202) captured by a front camera (206) and generate a single image (IMG1210). At this time, the overlapping portion of the two preview areas can be cropped and the two images can be connected. The electronic device (101) can smoothly correct the portions of the cropped and connected images (or previews) using generative AI. Since the area of ​​image correction is small, such a function can utilize generative AI installed on the electronic device (101) in an on-device form. For example, the electronic device (101) can perform an image crop, connect the two cropped images, and use the generative AI to correct or generate only the portions of the cropped portions that are not smoothly connected. The electronic device (101) can perform generative AI correction while providing a preview in real time because the regeneration area is small. When performing generative AI correction, a smooth preview image can be provided adaptively as the user adjusts the angle of the screen in real time, and images acquired by the front camera (206) and the rear camera (205) can be connected and displayed without any sense of incongruity even when the electronic device (101) is fully unfolded.

[0196] FIGS. 13A and 13B are examples of a photographing technique utilizing the state of an electronic device according to one embodiment of the present disclosure.

[0197] In various embodiments, the user can adjust the state of the electronic device (101), such as folding / unfolding or rotation, to cover the required shooting range. For example, referring to FIG. 13A, if five people (e.g., object 1, object 2, object 3, object 4, and object 5) are positioned in a circle, the camera can capture a photo from the front of the people. The captured image (IMG1310) will inevitably include some people overlapping each other.

[0198] Referring to FIG. 13b, the folding state of the electronic device (101) according to one embodiment is formed into an L shape, and after photographing five people from a position close to the subject, the images captured by the front camera and the images captured by the rear camera are synthesized to create a single image. The synthesized single image (IMG1320) includes all subjects captured without overlapping each other.

[0199] FIG. 14 is an example of a panoramic shooting function according to one embodiment of the present disclosure.

[0200] In various embodiments, the display may expand or contract depending on the movement of the housing portion containing the camera of the electronic device (101), and the range captured may also vary depending on the rotation of the camera. In one embodiment, the electronic device (101) may capture the screen internally within the camera at regular intervals in response to the movement of the housing portion accompanying the rotation of the camera, and regenerate a panoramic image using generative AI based on the captured multiple images. When the housing containing the camera rotates due to a user's operation, the displayed screen may be reduced or expanded. In this case, the electronic device (101) may automatically perform image capture by the camera at a preset specific angle (e.g., 15 degrees). In this case, if a preview image by the camera is output on the display according to the camera operation, the electronic device (101) may assume that the user is aware of the operation of the camera. When the housing portion containing the camera of the electronic device (101) moves due to a user's operation while the user is aware that the camera is running, the electronic device (101) may provide a panoramic image generation function. For example, referring to FIG. 14, when a user image captured by a rear camera (205) is displayed on the first housing part (210) of IMG1401, the electronic device (101) can determine that the user is operating the rear camera (205). When the third housing part (230) is unfolded by the user's operation, the electronic device (101) can automatically capture and store an image whenever the angle between the second display area (A2) and the third display area (A3) becomes a specific angle (e.g., 45 degrees, 60 degrees, 75 degrees, 90 degrees, etc.) according to the rotation of the third housing part (230). The automatically captured image can be internally referenced when the user wants to recreate an area larger than the camera shooting angle after taking a picture.For example, if a camera is placed in the third housing part (230) and rotates to capture and store an image, the electronic device (101) can regenerate an image in the right direction beyond the shooting angle of the rear camera (205). In one embodiment, the electronic device (101) can acquire more image information by performing a panoramic shot according to the night mode shooting method.

[0201] FIG. 15 is an example of panoramic image generation according to one embodiment of the present disclosure.

[0202] According to an embodiment, the electronic device (101) can automatically perform panoramic shooting based on the movement of the housing portion including the camera while the camera is running, and thus can confirm user input for generating a panoramic image. Referring to FIG. 15, after automatic shooting based on the panorama function, the electronic device (101) can display the message "Would you like to generate an AI panoramic image?" on the display screen (1510) and receive user input. Based on the user input, the electronic device (101) can automatically generate a panoramic image based on the captured images.

[0203] The panoramic image (1520) of Fig. 15 can acquire an image of an area (1521) wider than the angle of view of the front camera (206) or the rear camera (205). The panoramic image (1520) of Fig. 15 is a panoramic image automatically generated according to the movement state of Fig. 14, and the image angle of view is expanded in the right direction. In various practical applications, panoramic shooting that expands in various directions according to the state change of the electronic device (101) is possible.

[0204] FIG. 16 is an example of an electronic device identifying an unused camera based on a state of the electronic device, according to one embodiment of the present disclosure.

[0205] An electronic device (101) according to one embodiment may provide various functions or previews depending on the state of the electronic device (101), such as a folded or unfolded state, movement, or rotation state. In one embodiment, the electronic device (101) may identify a user's intention not to use certain cameras or displays based on the current state of the electronic device (101), and terminate output to the corresponding cameras or displays.

[0206] Referring to FIG. 16, when the second housing part of the e-type electronic device (101e) is positioned downward and the first housing part (210) is folded in contact with the second housing part (220), the electronic device (101) can identify that the user does not intend to use the front camera (206) fixed in the downward direction (bottom) for a certain period of time. In response to identifying the camera as not being intended to be used, the electronic device (101) can deactivate the camera. In addition, since the electronic device (101) is folded in such a manner that the first housing part (210) and the second housing part (220) are in contact with each other, the first display area (A1) and the second display area (A2) are not exposed to the outside, and thus it can also identify that there is no intention to use the camera.

[0207] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0208] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0209] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

In electronic devices, A foldable housing comprising a first housing portion, a second housing portion, and a third housing portion; A first hinge structure that rotatably connects the first housing portion and the second housing portion; A second hinge structure that rotatably connects the second housing portion and the third housing portion; A flexible display placed on the front of the above foldable housing; A display disposed on the rear side of the first housing portion or the second housing portion; A first image sensor disposed on the rear surface of the second housing portion or the third housing portion and generating a first preview image; A second image sensor arranged in front of the display to generate a second preview image; memory; and comprising at least one processor comprising a processing circuit; The memory, when executed individually or collectively by the at least one processor, causes the electronic device to: In response to identifying that the foldable housing is in a fully folded state, displaying at least one of the first preview image or the second preview image through the display; In response to identifying that the foldable housing is at least partially in a first folded state, displaying a first portion of the first preview image through a first portion of the flexible display disposed in the third housing portion; In response to identifying that the foldable housing is at least partially unfolded, displaying a second portion of the first preview image larger than the first portion through a second area of ​​the flexible display disposed in the first housing portion, the second housing portion, and the third housing portion, and An electronic device storing instructions that cause a third portion of the first preview image to be displayed smaller than the second portion, through a third region of the flexible display disposed in the first housing portion, in response to at least partially identifying that the foldable housing is in a second folded state. In the first paragraph, The first folded state is a state in which the first housing portion is folded relative to the second housing portion through the first hinge structure, and An electronic device in which the second folded state is a state in which the third housing portion is folded relative to the second housing portion through the second hinge structure. In the first paragraph, An electronic device wherein the at least partially unfolded state of the foldable housing is at least one of a first unfolded state in which the first housing portion is unfolded relative to the second housing portion through the first hinge structure, a second unfolded state in which the third housing portion is unfolded relative to the second housing portion through the second hinge structure, and the first unfolded state and the second unfolded state simultaneously. In the first paragraph, It further includes a 6-axis sensor and a Hall sensor, The memory, when individually or collectively executed by the at least one processor, causes the electronic device to: In response to the angle between the first housing portion and the second housing portion being less than the first threshold angle based on the sensor value acquired by the six-axis sensor or the Hall sensor, identifying that the first folded state is present, An electronic device storing commands that cause the second folded state to be identified in response to an angle between the second housing portion and the third housing portion being less than the first threshold angle based on a sensor value acquired by the six-axis sensor or the Hall sensor. In the first paragraph, the memory, when individually or collectively executed by the at least one processor, causes the electronic device to: While the above folding housing moves from the first folded state to the unfolded state, storing at least one frame of the second preview image, Receive user input related to a second portion of the first preview image in the expanded state, In response to the user input, a third preview image is generated using at least one frame of the second preview image and the first preview image through an artificial intelligence (AI) model, and An electronic device storing commands that cause at least a portion of the third preview image to be displayed in a second area of ​​the flexible display. In the first paragraph, the memory, when individually or collectively executed by the at least one processor, causes the electronic device to: While the first image sensor and the second image sensor are shooting the same direction within a certain range, the first preview image is corrected using the second preview image, and An electronic device storing commands that cause the second area of ​​the flexible display to display the corrected third preview image. In the first paragraph, the memory, when individually or collectively executed by the at least one processor, causes the electronic device to: An electronic device storing commands that cause the second area of ​​the flexible display to stop displaying and the first portion of the first preview image to be displayed in the first area of ​​the flexible display in response to the foldable housing changing from the unfolded state to the first folded state. In the first paragraph, the memory, when individually or collectively executed by the at least one processor, causes the electronic device to: An electronic device storing commands that cause the second area of ​​the flexible display to stop displaying and the third portion of the first preview image to be displayed in the third area of ​​the flexible display in response to the foldable housing changing from the unfolded state to the second folded state. In the first paragraph, the memory, when individually or collectively executed by the at least one processor, causes the electronic device to: An electronic device storing commands that, in response to the folding housing changing from an unfolded state to a second folded state, cause the display of the second area of ​​the flexible display to stop, display the third portion of the first preview image in the third area of ​​the flexible display, and cause the display to display the second preview image. In the first paragraph, the memory, when individually or collectively executed by the at least one processor, causes the electronic device to: An electronic device storing commands that cause a portion of a preview image displayed in a fully unfolded state of the foldable housing to be cropped and displayed in an externally exposed area of ​​the flexible display in response to a change in a folded state of a housing portion of the rear surface of the foldable housing that does not include the first image sensor and the second image sensor when the foldable housing is in a fully unfolded state. In the first paragraph, the memory, when individually or collectively executed by the at least one processor, causes the electronic device to: While a part of the first preview image and a part of the second preview image overlap, a third preview image is displayed through the second area of ​​the flexible display, connecting the first preview image and the second preview image while excluding the overlapping part, An electronic device, wherein the angle of view of the third preview image is larger than the angle of view of the first preview image and the angle of view of the second preview image. In Article 11, The memory, when individually or collectively executed by the at least one processor, causes the electronic device to: An electronic device storing commands that cause the third preview image to be generated by naturally connecting the connection between the first preview image and the second preview image using an image processing artificial intelligence (AI) model. In the first paragraph, The first hinge and the second hinge are of an in-folding type, An electronic device, wherein one of the first hinge and the second hinge is a first folding narrow hinge, and the other is a second folding wide hinge. In electronic devices, A foldable housing comprising a first housing portion, a second housing portion, and a third housing portion; A first hinge structure that rotatably connects the first housing portion and the second housing portion; A second hinge structure that rotatably connects the second housing portion and the third housing portion; A flexible display placed on the front of the above foldable housing; A first image sensor disposed on the rear of the third housing portion and generating a first preview image; A second image sensor arranged on the left front side of the flexible display to generate a second preview image; memory; and comprising at least one processor comprising a processing circuit; The memory, when executed individually or collectively by the at least one processor, causes the electronic device to: An electronic device storing instructions that cause at least one of the first preview image or the second preview image to be displayed on at least a portion of the flexible display based on an angle between the first housing portion and the second housing portion and an angle between the second housing portion and the third housing portion. In Article 14, The above first hinge is of an out-folding type, An electronic device wherein the second hinge is in-folding.

Images