Electronic device comprising camera and display, and operation method thereof

Abstract

An electronic device according to various embodiments may include: a first camera supporting a first angle of view; a second camera supporting a second angle of view; a flexible display; a memory; and at least one processor, wherein the at least one processor is configured to: display a first image acquired through the first camera in a first display area of the flexible display; acquire a second image including an additional area in addition to an area corresponding to the first image on the basis of extension of the display area; display at least a portion of the second image in the first display area of the flexible display and a second display area corresponding to an extended portion; activate the second camera while displaying the at least a portion of the second image; and after the second camera is activated, display a third image obtained by cropping at least a portion of an image obtained through the second camera in a third display area including the first display area and the second display area.

Description

Electronic device including a camera and a display and method of operating the same

[0001] The present disclosure relates to an electronic device including a camera and a display and a method of operating the electronic device.

[0002] An electronic device can acquire image data through a camera. The electronic device may include one or more cameras for acquiring the image data. The electronic device that acquires the image data through the camera can display an image corresponding to the acquired image data through a display. For example, a preview image that continuously displays a stream of images acquired through the camera can be displayed on the display.

[0003] A display capable of displaying a screen can be configured in various forms. For example, the display may include a flexible display composed of a flexible material. A flexible display can be mounted on an electronic device in various forms. For example, a flexible display can be mounted on an electronic device in a slidable, foldable, bendable, or rollable form.

[0004] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art in connection with the present disclosure.

[0005] In one embodiment, an electronic device may include a first camera, a second camera, a flexible display, a memory, and at least one processor. The first camera may be configured to capture an image based on a first angle of view. The second camera may be configured to capture an image based on a second angle of view that is wider than the first angle of view. The flexible display may have a variable display area for displaying a screen. The memory may store executable instructions. At least one processor may be configured to execute the instructions to perform operations of the electronic device. At least one processor may be configured to display a first image acquired through the first camera on the first display area of ​​the flexible display. At least one processor may be configured to acquire a second image including an additional area in addition to the area corresponding to the first image based on an expansion of the display area. At least one processor may be configured to display at least a portion of the second image on the second display area corresponding to the first display area and an expanded portion of the flexible display. At least one processor may be configured to perform an operation of activating the second camera while displaying at least a portion of the second image. After the second camera is activated, the at least one processor may be configured to display a third image, which is a cropped version of at least a portion of the image acquired through the second camera, in a third display area including the first display area and the second display area.

[0006] In one embodiment, an electronic device may include a flexible display, a first camera, and a second camera. The first camera may be configured to capture an image based on a first angle of view, and the second camera may be configured to capture an image based on a second angle of view wider than the first angle of view. A method of operating the electronic device according to one embodiment may include an operation of displaying a first image acquired through the first camera on a first display area of ​​the flexible display. The method of operating the electronic device may include an operation of acquiring a second image including an additional area in addition to an area corresponding to the first image based on an expansion of the display area of ​​the flexible display. The method of operating the electronic device may include an operation of activating the second camera while displaying at least a portion of the second image. The method of operating the electronic device may include an operation of displaying, after the second camera is activated, a third image obtained by cropping at least a portion of the image acquired through the second camera on a third display area including the first display area and the second display area.

[0007] In one embodiment, a computer-readable non-transitory recording medium may have recorded thereon a computer program that, when executed, causes an electronic device including a flexible display, a first camera, and a second camera to execute the method described above.

[0008] FIG. 1 is a block diagram of an electronic device within a network environment according to various embodiments.

[0009] FIG. 2 is a block diagram illustrating a camera module according to various embodiments.

[0010] FIG. 3 is a front perspective view of an electronic device with a second display area housed within a housing according to one embodiment.

[0011] FIG. 4 is a front perspective view of an electronic device according to one embodiment with a second display area exposed to the outside of the housing.

[0012] FIG. 5 is a drawing showing a state in which a display area according to one embodiment is housed within a housing.

[0013] FIG. 6 is a drawing showing a state in which a display area according to one embodiment is exposed outside the housing.

[0014] FIG. 7 is a conceptual diagram illustrating a cross-section of a display area of ​​an electronic device according to one embodiment when the display area is housed within a housing and when the display area is exposed to the outside of the housing.

[0015] FIG. 8 is a diagram illustrating an example of an expansion of a display area of ​​a display of an electronic device according to one embodiment.

[0016] FIG. 9 is a flowchart illustrating a process by which an electronic device displays an image acquired through a camera according to one embodiment.

[0017] FIG. 10 is a diagram illustrating an example of a method for an electronic device to display an image according to one embodiment.

[0018] FIG. 11 is a diagram illustrating a method for an electronic device according to one embodiment to acquire images displayed on a flexible display before and after a second camera is activated.

[0019] FIG. 12 is a flowchart illustrating a process in which an electronic device, according to one embodiment, controls an optical image stabilizer to acquire a second image.

[0020] FIG. 13 illustrates an example of a method in which an electronic device controls an optical image stabilizer to acquire a second image according to one embodiment.

[0021] FIG. 14 is a flowchart illustrating a process in which an electronic device, according to one embodiment, controls a focus adjuster to acquire a second image.

[0022] FIG. 15 illustrates an example of a method by which an electronic device controls a focus adjuster to acquire a second image according to one embodiment.

[0023] FIG. 16 is a flowchart illustrating a process by which an electronic device performs an operation of acquiring a second image according to one embodiment.

[0024] FIG. 17 illustrates an example of a method for an electronic device according to one embodiment to obtain image data including an additional area based on an expansion direction of a display area.

[0025] Hereinafter, embodiments are described in detail with reference to the attached drawings so that those skilled in the art can easily implement the present disclosure. However, the disclosed embodiments may be implemented in various different forms and are not limited to the embodiments described herein.

[0026] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100) according to various embodiments. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0027] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0028] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0029] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0030] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0031] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0032] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0033] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0034] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0035] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0036] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0037] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0038] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0039] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0040] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0041] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0042] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0043] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0044] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0045] According to various embodiments, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0046] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0047] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0048] Electronic devices according to the various embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments of this document are not limited to the aforementioned devices.

[0049] The various embodiments of this document and the terminology used therein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another component (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0050] The term "module" used in various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0051] Various embodiments of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0052] According to one embodiment, the method according to various embodiments disclosed in this document may be provided as included in a computer program product. The computer program product may be traded as a product between a seller and a buyer. The computer program product may be distributed in the form of a machine-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or may be distributed online (e.g., downloaded or uploaded) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smart phones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily generated in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0053] According to various embodiments, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to various embodiments, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In such a case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to various embodiments, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0054] FIG. 2 is a block diagram (200) illustrating a camera module (180) according to various embodiments. Referring to FIG. 2, the camera module (180) may include a lens assembly (210), a flash (220), an image sensor (230), an image stabilizer (240), a memory (250) (e.g., a buffer memory), or an image signal processor (260). The lens assembly (210) may collect light emitted from a subject that is a target of image capturing. The lens assembly (210) may include one or more lenses. According to one embodiment, the camera module (180) may include a plurality of lens assemblies (210). In this case, the camera module (180) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (210) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties that are different from the lens properties of the other lens assemblies. A lens assembly (210) may include, for example, a wide-angle lens or a telephoto lens.

[0055] The flash (220) can emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (220) can include one or more light-emitting diodes (e.g., red-green-blue (RGB) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp. The image sensor (230) can acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly (210) into an electrical signal. According to one embodiment, the image sensor (230) can include one image sensor selected from among image sensors having different properties, such as an RGB sensor, a black and white (BW) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same property, or a plurality of image sensors having different properties. Each image sensor included in the image sensor (230) can be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0056] The image stabilizer (240) can move at least one lens or image sensor (230) included in the lens assembly (210) in a specific direction or control the operating characteristics of the image sensor (230) (e.g., adjusting the read-out timing, etc.) in response to the movement of the camera module (180) or the electronic device (101) including the same. This allows compensating for at least some of the negative effects of the movement on the captured image. In one embodiment, the image stabilizer (240) can detect such movement of the camera module (180) or the electronic device (101) using a gyro sensor (not shown) or an acceleration sensor (not shown) disposed inside or outside the camera module (180). In one embodiment, the image stabilizer (240) can be implemented as, for example, an optical image stabilizer. The memory (250) can temporarily store at least a portion of the image acquired through the image sensor (230) for the next image processing task. For example, when image acquisition is delayed due to the shutter, or when multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) is stored in the memory (250), and a corresponding copy image (e.g., a low-resolution image) can be previewed through the display module (160). Thereafter, when a specified condition is satisfied (e.g., a user input or a system command), at least a portion of the original image stored in the memory (250) can be acquired and processed, for example, by the image signal processor (260). According to one embodiment, the memory (250) can be configured as at least a portion of the memory (130) or as a separate memory that operates independently therefrom.

[0057] The image signal processor (260) can perform one or more image processing operations on an image acquired through an image sensor (230) or an image stored in a memory (250). The one or more image processing operations may include, for example, depth map generation, 3D modeling, panorama generation, feature extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softening). Additionally or alternatively, the image signal processor (260) may perform control (e.g., exposure time control, read-out timing control, etc.) for at least one of the components included in the camera module (180) (e.g., image sensor (230)). An image processed by the image signal processor (260) may be stored back in the memory (250) for further processing or provided to an external component of the camera module (180) (e.g., memory (130), display module (160), electronic device (102), electronic device (104), or server (108)). According to one embodiment, the image signal processor (260) may include at least one of the processors (120). It may be configured as a separate processor that is configured as a part of the processor (120) or operates independently of the processor (120). If the image signal processor (260) is configured as a separate processor from the processor (120), at least one image processed by the image signal processor (260) may be displayed through the display module (160) as is or after undergoing additional image processing by the processor (120).

[0058] According to one embodiment, the electronic device (101) may include a plurality of camera modules (180), each having different properties or functions. In this case, for example, at least one of the plurality of camera modules (180) may be a wide-angle camera, and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (180) may be a front camera, and at least another may be a rear camera.

[0059] FIG. 3 is a front perspective view of an electronic device (101) in which a second display area (322) is housed within a housing (310) according to one embodiment. FIG. 4 is a front perspective view of an electronic device (101) in which a second display area (322) is exposed to the outside of a housing (310) according to one embodiment.

[0060] In the present disclosure, a surface facing substantially the same direction as a direction in which at least a portion (e.g., a first display area (321)) of a flexible display (320) positioned outside an electronic device (101) faces may be defined as a front surface of the electronic device (101). A surface facing the front surface of the electronic device (101) may be defined as a back surface of the electronic device (101). A surface surrounding a space between the front surface and the back surface may be defined as a side surface of the electronic device (101).

[0061] According to one embodiment, at least a portion of an electronic device (101) may be provided with a flexible display (320). The flexible display (320) may include, for example, a rollable display, a slidable display, or a foldable display. In one embodiment, at least a portion of the flexible display (320) may be provided in a flat shape, and at least another portion may be provided in a curved shape. In one embodiment, a slidable housing (310) surrounding the flexible display (320) and at least a portion of an edge of the flexible display (320) may be provided on the front surface of the electronic device (101).

[0062] In one embodiment, the housing (310) may form at least a portion of a front surface (e.g., an outer surface of the electronic device (101) facing the +z direction of FIGS. 3 and 4 ), a back surface (e.g., an outer surface of the electronic device (101) facing the -z direction of FIGS. 3 and 4 ), and a side surface (e.g., a surface connecting the front and back surfaces of the electronic device (101)). According to one embodiment, the housing (310) may form at least a portion of a side surface and a back surface of the electronic device (101).

[0063] In one embodiment, the housing (310) may include a first housing (311) and a second housing (312) movably coupled to the first housing (311) within a predetermined range.

[0064] In one embodiment, the flexible display (320) may include a first display area (321) coupled to a second housing (312) and a second display area (322) extending from the first display area (321) and retractable into the interior of the electronic device (101). The state of the electronic device (101) may be determined based on the relative position of the second housing (312) with respect to the first housing (311). The electronic device (101) may be changed from a state in which the second display area (322) of FIG. 3 is retracted into the interior of the housing (310) to a state in which the second display area (322) of FIG. 4 is exposed to the exterior of the housing (310) by a user's manipulation or mechanical operation. The fact that the second display area (322) of the flexible display (320) is exposed to the exterior may mean that it is viewable from the exterior of the electronic device (101). As the second housing (312) moves, the second display area (322) of the flexible display (320) can be brought into the space formed by the housing (310). That the second display area (322) is brought into the space may mean that the second display area (321) is not visually visible from the outside of the electronic device (101).

[0065] In one embodiment, the electronic device (101) may include a camera module (e.g., the camera module (180) of FIG. 1). The camera module may include a plurality of cameras. The electronic device (101) may include two or more cameras arranged to capture images in similar directions among the plurality of cameras. For example, the electronic device (101) may include a first front camera (341) and a second front camera (342) arranged to capture a scene in a direction in which the front of the electronic device (101) faces. The first front camera (341) may be configured to capture an image based on a first angle of view. The second front camera (342) may be configured to capture an image based on a second angle of view that is wider than the first angle of view. In the present disclosure, the term "angle of view" may refer to a field of view (FOV) for a scene that a camera can capture. However, the plane on which the plurality of cameras are arranged is not limited to that illustrated in FIG. 3. For example, the plurality of cameras may include at least one camera positioned to capture a scene in a direction in which the rear of the electronic device (101) faces (e.g., the -z direction).

[0066] FIG. 5 is a diagram showing a state in which a second display area (522) according to one embodiment is housed within a housing (510). FIG. 6 is a diagram showing a state in which a second display area (522) according to one embodiment is exposed to the outside of the housing (510). FIGS. 5 and 6 illustrate an electronic device (101) in which a display area of ​​a flexible display (520) according to one embodiment is expanded in a direction different from that illustrated in FIGS. 3 and 4. FIGS. 5 and 6 illustrate a structure in which a display area of ​​a flexible display (520) is expanded in a longitudinal direction (e.g., +Y direction) when viewed from the front of the electronic device (101). In the present disclosure, the expansion of the display area of ​​the flexible display (520) may mean that an area of ​​the flexible display (520) that is visually exposed to the outside is expanded. However, the direction of expansion of the display area of ​​the flexible display (520) is not limited to the direction shown in FIGS. 3 to 6. For example, the flexible display (520) may be designed and changed so that the display area can be expanded in at least one of the +Y direction, the +X direction, the -Y direction, or the -X direction.

[0067] In one embodiment, the second housing (512) may be relatively movable with respect to the first housing (511). In one embodiment, the first housing (511) and / or the second housing (512) may form a space for accommodating various components, such as a circuit board having mounted thereon electronic components (e.g., a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), a haptic module (179), a camera module (180), a communication module (190), a subscriber identification module (196) of FIG. 1) or a battery (e.g., a battery (189) of FIG. 1).

[0068] The state illustrated in FIG. 3 or FIG. 5 may be referred to as a slide-in state of the electronic device (101) or a state in which the second display area (322, 522) is closed. The state illustrated in FIG. 4 or FIG. 6 may be referred to as a slide-out state of the electronic device (101) or a state in which the second display area (322, 522) is open.

[0069] In one embodiment, an electronic device (101) in a slide-in state (or slide-out state) can transition to a slide-out state (or slide-in state) based on a predefined user input. For example, in response to a user input to a physical button exposed through a portion of the first housing (311, 511) or the second housing (312, 512), the electronic device (101) can transition between the slide-in state and the slide-out state. For example, in response to a touch input to an executable object displayed within a display area (e.g., the first display area (321, 521) or the second display area (322, 522)), the electronic device (101) can transition between the slide-in state and the slide-out state. For example, in response to a pressing intensity greater than or equal to a reference intensity detected through a display area (e.g., a first display area (321, 521) or a second display area (322, 522)), the electronic device (101) may perform a transition between a slide-in state and a slide-out state. The operation for performing a transition between the slide-in state and the slide-out state is not limited thereto.

[0070] In one embodiment, the electronic device (101) may include a flexible display (520) and at least one camera module (e.g., the camera module (180) of FIG. 1).

[0071] In one embodiment, the flexible display (520) may include a second display area (522) configured to be visually exposed to the outside of the electronic device (101) as the first display area (521) and the second housing (512) slide. In one embodiment, the first display area (521) may be arranged to move along with the movement of the second housing (512). The second display area (522) may be formed to extend from the first display area (521). The second display area (522) may be accommodated within a space formed by the first housing (511) as the second housing (512) moves relative to the first housing (511), or may be visually exposed to the outside of the electronic device (101). In one embodiment, while the electronic device (101) changes from a slide-in state to a slide-out state, the display area of ​​the flexible display (520) may be expanded as the area in the −Y direction is pulled out of the housing. For example, while the electronic device (101) is in a slide-out state, the second display area (522) may be arranged in the -Y direction of the flexible display (520) and may be visually exposed. However, the present invention is not limited thereto, and the direction in which the display area of ​​the flexible display (520) expands or the direction in which the second display area (522) is arranged in the slide-out state may be implemented differently depending on the configuration of the electronic device (101).

[0072] In one embodiment, the camera module of the electronic device (101) may include a plurality of cameras (241, 242, 243). For example, the camera module may include at least one front camera (241). For example, the camera module may include a first rear camera (242) and a second rear camera (243).

[0073] In one embodiment, the electronic device (101) may include cameras having different angles of view. The first rear camera (242) may be configured to capture images based on a first angle of view. The second rear camera (243) may be configured to capture images based on a second angle of view that is wider than the first angle of view. For example, the first rear camera (242) may include a telephoto camera, and the second rear camera (243) may include a wide-angle camera.

[0074] FIG. 7 is a conceptual diagram illustrating a cross-section (A-A') of a second display area (722-1, 722-2) of an electronic device (101) according to one embodiment when the second display area (722-1, 722-2) is housed within a housing (711-1, 712-1) (e.g., in a slide-in state) and a cross-section (B-B') when the second display area (722-1, 722-2) is visually exposed to the outside of the housing (711-2, 712-2) (e.g., in a slide-out state).

[0075] In one embodiment, as the second housing (712-1) is accommodated inside the space formed by the first housing (711-1), the second display area (722-1) of the flexible display (720-1) can move while being guided by one area of ​​the first housing (711-1) to be accommodated inside the space formed by the first housing (711-1). When the second display area (722-1) is accommodated inside the space formed by the first housing (711-1), at least a portion of the second display area (722-1) can have a curved shape. For example, the second display area (722-1) can be deformed into a curved shape at a position corresponding to a curved surface of the first housing (711-1). FIG. 7 illustrates a case where the second display area (722-1) is stored by sliding into the first housing (711-1) while being stored inside the space formed by the first housing (711-1), but is not limited thereto. For example, in the slide-in state, the second display area (722-1) may be configured to be rollable at least in part.

[0076] In one embodiment, as the second housing (712-2) is withdrawn from the inside of the space formed by the first housing (711-2), the second display area (722-2) of the flexible display (720-2) may move under the guidance of one area of ​​the first housing (711-2) to be visually exposed to the outside of the electronic device (101). Hereinafter, the term "second display area" may be understood to mean an area among the second display areas (722-1, 722-2) of FIG. 7 that is visually exposed to the outside. The term "expansion of the display area" may be understood to mean that an area that outputs a screen that is visually exposed to the outside of the electronic device (101) is expanded.

[0077] FIG. 8 is a drawing illustrating an example of an expansion of a display area of ​​a flexible display (800) of an electronic device (101) according to one embodiment (e.g., a display module (160) of FIG. 1, a flexible display (320) of FIGS. 3 and 4, a flexible display (520) of FIGS. 5 and 6).

[0078] In one embodiment, the flexible display (800) included in the electronic device (101) may be configured such that the display area is expandable in at least one direction. The flexible display (800) included in the electronic device (101) may be configured such that the display area is expandable in only one predetermined direction, but may also be configured such that the display area is expandable in at least one of a plurality of directions.

[0079] Referring to FIG. 8, the flexible display (800) can be configured such that the display area expands in a first direction (810). The flexible display (800) can be configured such that the display area expands in a second direction (820). The flexible display (800) can also be configured such that the display area can expand in the first direction (810) and the second direction (820) simultaneously. For example, the electronic device (101) can display a graphical user interface (GUI) for selecting a direction in which to expand the display area through the flexible display (800). The electronic device (101) can expand the display area of ​​the flexible display (800) in the first direction (810) in response to receiving a user input (e.g., a touch input) for selecting the first direction (810) for the GUI. The electronic device (101) can expand the display area of ​​the flexible display (800) in the second direction (820) in response to receiving a user input (e.g., a touch input) selecting a second direction (820) for the GUI. However, the method for selecting the direction for expanding the display area of ​​the flexible display (800) is not limited thereto.

[0080] FIG. 9 is a flowchart (900) illustrating a process of displaying an image acquired through a camera by an electronic device (101) according to one embodiment. In the present disclosure, the operation of the electronic device (101) may be understood as being performed by a processor (e.g., processor (120) of FIG. 1) including a processing circuit of the electronic device (101) executing instructions (e.g., program (140) of FIG. 1) stored in a memory (e.g., memory (130) of FIG. 1) to perform operations or control components of the electronic device (101).

[0081] According to one embodiment, in operation 910, the electronic device (101) may display a first image acquired through a first camera (e.g., the first front camera (341) of FIGS. 3 and 4 , the first rear camera (242) of FIGS. 5 and 6 ) on a first display area (e.g., the first display area (321) of FIGS. 3 and 4 , the first display area (521) of FIGS. 5 and 6 ) of a flexible display (e.g., the display module (160) of FIG. 1 , the flexible display (320) of FIGS. 3 and 4 , the flexible display (520) of FIGS. 5 and 6 ). The first camera may be configured to capture an image based on a first angle of view. For example, the electronic device (101) may execute a camera application for capturing an image. The electronic device (101) may select a first camera based on a setting value for capturing an image according to an operation of the executed camera application, and activate the selected first camera. The act of activating the first camera may include an act of setting the first camera to capture an image through the first camera (e.g., an act of supplying power to the first camera, an act of setting an exposure level for the first camera, an act of setting a sensitivity for an image sensor of the first camera). The electronic device (101) may display an image captured through the first camera as a preview image on the first display area of ​​the flexible display.

[0082] According to one embodiment, while displaying a first image in a first display area, the electronic device (101) may determine whether the area of ​​the flexible display is expanded at operation 920. For example, if a user input is received for a physical button that causes a transition from a slide-in state to a slide-out state, the electronic device (101) may determine that expansion of the display area has been initiated. For example, if a touch input is received for an executable object that causes a transition between a slide-in state and a slide-out state displayed through the flexible display, the electronic device (101) may determine that expansion of the display area has been initiated. For example, the electronic device (101) can identify expansion of the display area based on the output of a sensor that detects physical movement of a second housing (e.g., the second housing (312) of FIGS. 3 and 4 , the second housing (512) of FIGS. 5 and 6 , the second housing (712-1) of FIG. 7) relative to a first housing (e.g., the first housing (311) of FIGS. 3 and 4 , the first housing (511) of FIGS. 5 and 6 , the first housing (711-1) of FIG. 7). For example, the electronic device (101) can determine that expansion of the display area has been initiated based on the detection on the flexible display of a pressing strength greater than or equal to a reference strength that causes a transition between a slide-in state and a slide-out state. However, the method for determining whether the display area is expanded is not limited thereto. In one embodiment, based on the determination that the display area is not expanded, the electronic device (101) may perform operation 910 again to update the first image displayed in the first display area.

[0083] According to one embodiment, based on the determination that the display area is expanded, the electronic device (101) may acquire a second image including an additional area through the first camera in operation 930. The additional area may refer to a peripheral area adjacent to an area corresponding to the first image displayed in the first display area in operation 910. The additional area may be acquired from a margin excluding an area for acquiring the first image within an image of image data output from the first camera. The first camera may output an image including the margin for acquiring the additional area. For example, the image sensor of the first camera may be configured to acquire an additional margin in the direction in which the display area expands in addition to the area for acquiring the first image. For example, the electronic device (101) may control the operation of the first camera to capture an additional image (acquire more image data) corresponding to the additional area. For example, the electronic device (101) may control an optical image stabilizer (e.g., image stabilizer (240) of FIG. 2) or focus adjuster of the first camera to acquire an image corresponding to the additional area.

[0084] According to one embodiment, in operation 940, the electronic device (101) can display at least a portion of the second image in the first display area and the extended second display area. By displaying at least a portion of the second image in the extended area of ​​the flexible display in operation 940, an image acquired through the camera can be displayed in the extended area of ​​the display even before a second camera supporting a wider angle of view than the first camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6) is activated.

[0085] In one embodiment, while displaying at least a portion of a second image on the first display area and the second display area (or at least a portion of an extended second display area) in operation 940, the electronic device (101) may perform an operation of activating a second camera for capturing an image to be displayed on the extended display area in operation 945. The operation of activating the second camera may include an operation of configuring the second camera to seamlessly switch from an image captured by the first camera to an image captured by the second camera. For example, the operation of activating the second camera may include an operation of the electronic device (101) turning on the second camera or waking up the second camera (or switching to a normal power operation mode) when the second camera is powered off or in a sleep state (or a low power operation mode). For example, the operation of activating the second camera may include an operation of matching an angle of view corresponding to the second image with an angle of view of an image acquired through the second camera. For example, the act of activating the second camera may include the act of adjusting at least one of a brightness setting or a color setting for an image captured through the second camera based on a difference between the characteristics of the first camera and the characteristics of the second camera.

[0086] According to one embodiment, in operation 950, the electronic device (101) may determine whether the operation of activating the second camera is completed. For example, the electronic device (101) may determine that the operation of activating the second camera is completed when a predetermined time (or a predetermined frame) has elapsed from the time of initiating the operation of activating the second camera. For example, the electronic device (101) may also determine whether the operation of activating the second camera is completed by obtaining information related to the settings of the second camera. However, the method of determining whether the activation of the second camera is completed is not limited thereto. The electronic device (101) may perform operations 930, 940, and 945 until the operation of activating the second camera is completed. The electronic device (101) may display an image corresponding to the size of the expanded display area through the flexible display based on an image obtained through the first camera until the second camera is activated.

[0087] In one embodiment, the size of the margin area for acquiring the additional area in operation 930 may be determined based on at least one of the time it takes for the second camera to be activated or the speed at which the display area expands. The time it takes for the second camera to be activated may vary depending on the performance of the processor or the camera module including the second camera. For example, the electronic device may determine the area for acquiring the first image within the image data that can be acquired through the image sensor in operation 910 so as to secure a larger margin area as the time it takes for the second camera to be activated increases. The electronic device may determine the speed at which the display area expands using a sensor that detects the movement of the housings. For example, the electronic device may determine the area for acquiring the first image within the image data that can be acquired through the image sensor in operation 910 so as to secure a larger margin area as the speed at which the display area expands increases.

[0088] According to one embodiment, based on the activation of the second camera, the electronic device (101) may display a third image (e.g., the third image (1090) of FIG. 10) acquired through the second camera in a third display area at operation 960. The third display area may include at least a portion of the first display area and a second display area extended from the first display area. The electronic device (101) may acquire the third image by cropping at least a portion of the image data acquired through the second camera. For example, the electronic device (101) may crop an area corresponding to the second image displayed through the flexible display before the second camera is activated from the image acquired through the second camera.

[0089] FIG. 10 is a diagram illustrating an example of a method in which an electronic device (101) displays an image according to one embodiment.

[0090] In one embodiment, the electronic device (101) can display a first image (1070) acquired through a first camera (1010) (e.g., a first front camera (341) of FIGS. 3 and 4, a first rear camera (242) of FIGS. 5 and 6) through the flexible display (1030) during a first period (P1) between a first point in time (1001) at which operation of a camera module (e.g., a camera module (180) of FIG. 1) is initiated and a second point in time (1002) at which expansion of a display area of ​​a flexible display (1030) (e.g., a display module (160) of FIG. 1, a flexible display (320) of FIGS. 3 and 4, a flexible display (520) of FIGS. 5 and 6) is initiated. In one embodiment, the electronic device (101) may obtain a first image (1070) from first image data (1040) output from the first camera (1010). The electronic device (101) may obtain the first image (1070) based on an area (1041) corresponding to the first image (1070) of the first image data (1040). Referring to FIG. 10, the first camera (1010) may output the first image data (1040) including an area (1041) corresponding to the first image (1070) and an additional area (margin) (1042). However, the present invention is not limited thereto. For example, the first image data (1040) may include only an area (1041) corresponding to the first image (1070) without an additional area (margin) (1042).

[0091] In one embodiment, the electronic device (101) may perform an operation to activate the second camera (1020) (e.g., the second front camera (342) of FIGS. 3 and 4 , the second rear camera (243) of FIGS. 5 and 6 ) within a second period (P2) from a second point in time (1002) at which expansion of the display area is initiated. The electronic device (101) may acquire a second image (1050) including an area (1051) corresponding to the first image (1070) and an additional area (1052) from image data output from the first camera (1010) during the second period (P2). When the image sensor of the first camera (1010) (e.g., the image sensor (230) of FIG. 2) has a resolution that cannot output image data including an area (1051) corresponding to the first image (1070) and an additional area (1052), the electronic device (101) can control the first camera (1010) to obtain image data for the additional area (1052). The electronic device (101) can display at least a portion (1080) of the second image (1050) through the flexible display (1030). At least a portion (1080) of the second image (1050) may include a first portion (1081) displayed in a first display area of ​​the flexible display (1030) (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6) and a second portion (1082) displayed in at least a portion of a second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5).

[0092] In one embodiment, the electronic device (101) can display a third image (1090) through the flexible display (1030) based on image data (1060) acquired through the second camera (1020) during a third period (P3) from a third point in time (1003) when the second camera (1020) is activated. The electronic device (101) can acquire the third image (1090) by cropping a portion (1061) of the image data (1060).

[0093] FIG. 11 is a diagram illustrating a method for an electronic device (101) according to one embodiment to acquire an image displayed on a flexible display (e.g., a display module (160) of FIG. 1, a flexible display (320) of FIGS. 3 and 4, a flexible display (520) of FIGS. 5 and 6, a flexible display (1030) of FIG. 10) before and after a third time point (1003) at which a second camera (e.g., a second front camera (342) of FIGS. 3 and 4, a second rear camera (243) of FIGS. 5 and 6, a second camera (1020) of FIG. 10) is activated.

[0094] In one embodiment, the electronic device (101) can display a second image (1031) corresponding to at least a portion (1011) of image data (1010) acquired through a first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10) on the flexible display before a third point in time (1003) when the second camera is activated.

[0095] In one embodiment, the electronic device (101) can determine an area (1021) corresponding to a second image (1031) displayed on the flexible display immediately before the third point in time (1003) from image data (1020) acquired through a second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, and the second camera (1020) of FIG. 10) after the third point in time (1003). The electronic device (101) can display a third image (1032) obtained by cropping an area (1021) corresponding to the second image (1031) from the image data (1020) on the flexible display. Since the second image (1031) and the third image (1032) are images captured with corresponding angles of view, the electronic device (101) can seamlessly switch the camera used to obtain an image to be displayed on the flexible display from the first camera to the second camera.

[0096] FIG. 12 is a flowchart (1200) illustrating a process in which an electronic device (101) controls an optical image stabilizer (e.g., image stabilizer (240) of FIG. 2) to acquire a second image according to one embodiment. For example, the operations illustrated in the flowchart (1200) may be performed in operation 930 of FIG. 9.

[0097] In one embodiment, the electronic device (101) can capture an image while controlling the position of an optical image stabilizer of a first camera (e.g., the first front camera (341) of FIGS. 3 and 4 , the first rear camera (242) of FIGS. 5 and 6 ) to obtain a second image including an additional region (e.g., the additional region (1052) of FIG. 10 ). The electronic device (101) can drive an (optical image stabilizer) actuator to move at least a portion of an optical system (e.g., a lens, a prism, a reflector) or an image sensor of the first camera based on the position of the optical image stabilizer. For example, as the electronic device (101) controls the position of the optical image stabilizer, the position of at least a portion of the optical system (e.g., a lens) or an image sensor of the first camera can be adjusted by the optical image stabilizer (OIS) actuator. For example, at least one of the lens or the image sensor may be moved in a direction substantially perpendicular to the optical axis by the OIS actuator. The position of the optical image stabilizer may refer to a position or posture in which at least a portion of the optical system (e.g., the lens) or the image sensor controlled by the OIS actuator is arranged. As the electronic device (101) controls the position of the optical image stabilizer, the first camera may tilt. Since the position at which the image is formed on the image sensor is changed, the electronic device can acquire an image corresponding to an additional area through the first camera.

[0098] According to one embodiment, in operation 1210, the electronic device (101) may acquire a fourth image through the first camera based on the first angle of view. For example, the electronic device (101) may acquire the fourth image through the first camera to capture an image based on a first position (basic position) of an optical image stabilizer determined based on information about the movement of the electronic device (101). The first position may be a reference position for controlling the optical image stabilizer to capture an image. For example, the first position may mean a position corresponding to the center of an area in which the optical image stabilizer can move.

[0099] According to one embodiment, in operation 1220, the electronic device (101) may determine a position of an optical image stabilizer included in a first camera. The position determined in operation 1220 may be referred to as a second position. The electronic device (101) may drive the OIS actuator to move at least a part of the optical system or the position of the image sensor based on the determined position of the image stabilizer. For example, when a display area of ​​a flexible display (e.g., the display module (160) of FIG. 1 , the flexible display (320) of FIGS. 3 and 4 , the flexible display (520) of FIGS. 5 and 6 , and the flexible display (1030) of FIG. 10 ) is expanded (e.g., expanded in the first direction) in a first direction, the electronic device (101) may drive the OIS actuator included in the optical image stabilizer to move at least a part of the optical system (e.g., a lens) or the position of the image sensor based on a direction corresponding to the first direction.

[0100] According to one embodiment, in operation 1230, the electronic device (101) may acquire a fifth image while controlling the position of the optical image stabilizer based on the first angle of view. For example, the electronic device (101) may control the optical image stabilizer to move based on the second position. Even if the fifth image is captured based on the same angle of view as the fourth image, the image of an additional area may be included by moving the area of ​​the scene being captured.

[0101] According to one embodiment, in operation 1240, the electronic device (101) may obtain a second image by synthesizing the fourth image and the fifth image. For example, the electronic device (101) may obtain a second image by adding an area corresponding to an additional area included in the fifth image to the fourth image. The electronic device (101) may display at least a portion of the second image on a first display area (e.g., the first display area (321) of FIGS. 3 and 4 , the first display area (521) of FIGS. 5 and 6 ) and a second display area (e.g., the second display area (322) of FIG. 4 , the second display area (522) of FIG. 5 )) that are visually exposed to the outside of the electronic device (101).

[0102] In one embodiment, the electronic device (101) can acquire a fourth image in a state in which the position of the optical image stabilizer is controlled in a second control direction opposite to the first control direction in which the position of the optical image stabilizer is controlled in operation 1230, in order to secure an operating range for controlling the position of the optical image stabilizer in operation 1210. For example, when the operating range of the optical image stabilizer is approximately 3 degrees, the electronic device (101) can acquire a fourth image in a state in which the position of the optical image stabilizer is controlled by approximately -3 degrees in operation 1210. By acquiring a fifth image in a state in which the position of the optical image stabilizer is controlled by approximately +3 degrees in operation 1230, the electronic device (101) can acquire a fifth image in which the position of the optical image stabilizer is controlled by +6 degrees compared to the fourth image.

[0103] FIG. 13 illustrates an example of a method in which an electronic device (101) controls an optical image stabilizer (e.g., image stabilizer (240) of FIG. 2) to acquire a second image according to one embodiment.

[0104] In one embodiment, the electronic device (101) may acquire a fourth image (1310). For example, the fourth image may be an image captured by the first camera (e.g., the first front camera (341) of FIGS. 3 and 4 , the first rear camera (242) of FIGS. 5 and 6 ) with the optical image stabilizer positioned at a central position (or default position). However, the present invention is not limited thereto. For example, the fourth image may be an image captured by the first camera with the optical image stabilizer positioned at a position opposite to the direction in which the display area is determined.

[0105] In one embodiment, the electronic device (101) can acquire a fifth image (1320) through the first camera while controlling the position of the optical image stabilizer in a direction corresponding to the direction in which the display area is expanded (1300) for the fourth image (1310). By controlling the position of the optical image stabilizer, the area captured in the fifth image (1320) can be moved in the direction in which the display area is expanded (1300) compared to the fourth image (1310).

[0106] In one embodiment, the electronic device (101) can obtain a second image (1330) based on the fourth image (1310) and the fifth image (1320). The electronic device (101) can synthesize the fourth image (1310) and the fifth image (1320). For example, the electronic device (101) can generate a second image (1330) that includes at least a portion of the fourth image (1310) and at least a portion of the fifth image (1320). For example, the electronic device (101) can also generate the second image (1330) by adding at least a portion of the fifth image (1320) to the fourth image (1310). For example, the electronic device (101) can generate the second image (1330) by synthesizing overlapping areas of the fourth image (1310) and the fifth image (1320) and adding a non-overlapping area to the synthesized image. However, the method of synthesizing the fourth image (1310) and the fifth image (1320) is not limited thereto. The electronic device (101) can display at least a portion of the second image (1330) on an extended display area of ​​the flexible display (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6) and a second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5).

[0107] FIG. 14 is a flowchart (1400) illustrating a process in which an electronic device (101) controls a focus adjuster to acquire a second image according to one embodiment. For example, the operations illustrated in the flowchart (1400) may be performed in operation 930 of FIG. 9.

[0108] In one embodiment, the electronic device (101) can capture an image while controlling the position of the focus adjuster of the first camera (e.g., the first front camera (341) of FIGS. 3 and 4 , the first rear camera (242) of FIGS. 5 and 6 ) to obtain a second image including an additional area (e.g., the additional area (1052) of FIG. 10 ). For example, the electronic device (101) can control the focus adjuster of the first camera to a position where the focus position is infinite. When capturing an image at a position where the focus position of the focus adjuster is infinite, the focus on the subject may be defocused, but the range of the scene captured in the image may be expanded. The electronic device (101) can capture a second image based on image data captured through the first camera while controlling the position of the focus adjuster.

[0109] According to one embodiment, in operation 1410, the electronic device (101) may acquire a sixth image through the first camera. For example, the electronic device (101) may acquire the sixth image captured by the first camera based on an auto focus (AF) function. The AF function may refer to a function of automatically focusing by adjusting the position of a lens. The electronic device (101) may determine a focus position (e.g., a distance between a lens included in the lens assembly (210) of FIG. 2 and a focal plane) according to a distance to a subject through an AF actuator. The electronic device (101) may control the position of the focus adjuster (control the operation of the AF actuator) based on the determined focus position to acquire the sixth image. The sixth image may include a scene corresponding to the first angle of view.

[0110] According to one embodiment, in operation 1420, the electronic device (101) may determine the position of the focus adjuster of the first camera. The electronic device (101) may drive the AF actuator so that the position of the lens unit (e.g., the focus adjustment lens) or the image sensor is controlled based on the determined position of the focus adjuster. For example, the electronic device (101) may control the AF actuator based on the focus position being infinity. By controlling the position of the focus adjuster, the first camera may capture a wider area than the sixth image.

[0111] According to one embodiment, in operation 1430, the electronic device (101) may acquire a seventh image while controlling the position of the focus adjuster. The seventh image may include an image captured over a wider range than the sixth image, but the seventh image may be an image out of focus.

[0112] According to one embodiment, in operation 1440, a second image may be obtained by synthesizing a sixth image and a seventh image. Since the seventh image may be an out-of-focus image, the electronic device (101) may configure an area corresponding to the sixth image within the second image based on pixel values ​​of the sixth image, and may configure pixel values ​​of an area for which pixel values ​​cannot be obtained from the sixth image based on the seventh image. For example, based on the expansion of the display area of ​​the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10), at least a portion of the sixth image may be displayed in the first display area (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6), and at least a portion of the seventh image may be displayed in the expanded second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5).

[0113] FIG. 15 illustrates an example of a method in which an electronic device (101) controls a focus adjuster to acquire a second image according to one embodiment.

[0114] In one embodiment, the electronic device (101) can acquire a sixth image (1510) through a first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6). The sixth image (1510) can be a focused image.

[0115] In one embodiment, the electronic device (101) can acquire the seventh image (1520) while controlling the position of the focus adjuster. For example, the electronic device (101) can acquire the second image (1520) through the first camera while controlling the AF actuator based on a position where the focus position is infinite.

[0116] In one embodiment, the electronic device (101) can obtain a second image (1530) by synthesizing the sixth image (1510) and the seventh image (1520). For example, the central region (1540) of the second image (1530) may correspond to the sixth image (1510), and the remaining region may be configured based on the seventh image (1520). In one embodiment, the electronic device (101) can display an image (1555) that is a cropped image of at least a portion (1550) of the second image (1530) on an extended area of ​​the flexible display.

[0117] FIG. 16 is a flowchart (1600) illustrating a process in which an electronic device (101) performs an operation to acquire a second image according to one embodiment.

[0118] According to one embodiment, a flexible display of an electronic device (101) (e.g., a display module (160) of FIG. 1, a flexible display (320) of FIGS. 3 and 4, a flexible display (520) of FIGS. 5 and 6, and a flexible display (1030) of FIG. 10) may be configured to expand an externally exposed display area in at least one direction. In operation 1610, the electronic device (101) may identify a direction in which the area of ​​the display is expanded. For example, when the display area is expanded using an actuator (e.g., a motor) of the electronic device (101) in a direction corresponding to a user input (e.g., a touch input, a physical key input, a pressure detection), the electronic device (101) may identify a direction in which the display area is expanded based on the user input. However, the method for identifying the direction in which the display area is expanded is not limited to the above-described examples. For example, when a relative position between the plurality of housings (e.g., the first housing (311) of FIGS. 3 and 4, the first housing (511) of FIGS. 5 and 6, the first housing (711-1) of FIG. 7, the second housing (312) of FIGS. 3 and 4, the second housing (512) of FIGS. 5 and 6, the second housing (712-1) of FIG. 7) included in the electronic device moves due to a physical force, the electronic device (101) may identify a direction in which the display area expands by using a sensor that detects the relative movement between the plurality of housings.

[0119] According to one embodiment, in operation 1620, the electronic device (101) may obtain a second image based on the direction identified in operation 1610. For example, the electronic device (101) may display the first image on the first display area (e.g., the first display area (321) of FIGS. 3 and 4 , the first display area (521) of FIGS. 5 and 6 ) in operation 910 of FIG. 9 . While the first image is displayed on the first display area, the electronic device (101) may perform operation 1610 of identifying a direction in which the display area is extended in operation 910. The electronic device (101) may perform operation 1620 to obtain a second image including an additional area for the identified direction so as to display a screen on the display area extended in the direction identified in operation 930.

[0120] FIG. 17 illustrates an example of a method for an electronic device (101) to obtain image data including an additional area based on an extension direction of a display area (1700) according to one embodiment.

[0121] In one embodiment, when the display area (1700) is extended in the first direction (1711), a second display area (1721) may be added to the first direction (1711) of the first display area (1701). In order to display a screen in the second display area (1721) based on image data acquired through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4 , the first rear camera (242) of FIGS. 5 and 6 , the first camera (1010) of FIG. 10 ) until the second camera (e.g., the second front camera (342) of FIGS. 3 and 4 , the second rear camera (243) of FIGS. 5 and 6 , the second camera (1020) of FIG. 10 )) is activated, the electronic device (101) may acquire a second image (1731) including an additional area (1741) corresponding to the first direction (1711).

[0122] In one embodiment, when the display area (1700) is extended in the second direction (1712), a second display area (1722) may be added to the second direction (1712) of the first display area (1702). In order to display a screen in the second display area (1722) based on image data acquired through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10) until the second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10)) is activated, the electronic device (101) may acquire a second image (1732) including an additional area (1742) corresponding to the second direction (1712).

[0123] In one embodiment, when the display area (1700) is extended in the third direction (1713), a second display area (1723) may be added to the third direction (1713) of the first display area (1703). In order to display a screen in the second display area (1723) based on image data acquired through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10) until the second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10)) is activated, the electronic device (101) may acquire a second image (1733) including an additional area (1743) corresponding to the third direction (1713).

[0124] An electronic device, an operating method thereof, and a recording medium according to one embodiment may be configured to seamlessly display an image acquired through a camera in an expanded display area during a process in which the display area is expanded.

[0125] An electronic device, an operating method thereof, and a recording medium according to one embodiment may be for reducing power consumption for operating a plurality of cameras.

[0126] The technical problems to be achieved in this document are not limited to the technical problems mentioned above, and other technical problems not mentioned can be clearly understood by a person having ordinary skill in the technical field to which this document belongs from the description of this disclosure.

[0127] In one embodiment, an electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5 or 6) includes at least one processor (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10), a second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10), a flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10), a memory (e.g., the memory (130) of FIG. 1), and processing circuitry. 1 may include a processor (120)). The first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, and the first camera (1010) of FIG. 10) may be configured to capture an image based on a first angle of view. The second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, and the second camera (1020) of FIG. 10) may be configured to capture an image based on a second angle of view that is wider than the first angle of view. The flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, and the flexible display (1030) of FIG. 10) may have a variable display area that displays a screen. Memory (e.g., memory (130) of FIG. 1) can store executable instructions.The above instructions, when executed individually or collectively by at least one processor (e.g., processor (120) of FIG. 1), may cause an electronic device (e.g., electronic device (101) of FIG. 1, 3, 4, 5 or 6) to operate. The instructions, when executed collectively by at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause an electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5 or 6) to display a first image acquired through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10)) on a first display area (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6) of the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10)). The instructions, when executed collectively by at least one processor (e.g., processor (120) of FIG. 1) or collectively, may cause an electronic device (e.g., electronic device (101) of FIG. 1, 3, 4, 5 or 6) to obtain a second image including an additional area in addition to an area corresponding to the first image based on the expansion of the display area.The instructions, when executed collectively by at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause an electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5 or 6) to display at least a portion of the second image on the first display area (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6) of the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10)) and a second display area corresponding to an extended portion (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5). The instructions, when executed collectively by the at least one processor (e.g., the processor (120) of FIG. 1), may cause the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5 or 6) to perform an operation of activating the second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10) while displaying at least a portion of the second image.The instructions, when executed collectively by at least one processor (e.g., the processor (120) of FIG. 1) or collectively, cause the electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5 or 6) to crop at least a portion of an image acquired through the second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10) after the second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10)) on the first display area (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6)) and the second display area (e.g., FIG. It can be displayed in a third display area including the second display area (322) of Fig. 4 and the second display area (522) of Fig. 5.

[0128] In one embodiment, the second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5) may be arranged in a first direction with respect to the first display area (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6). The first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10) may include an image sensor configured to acquire image data corresponding to an area corresponding to the first image and an additional area. The instructions, when executed by at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause an electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5 or 6) to obtain the first image by cropping an area corresponding to the first image from the image data output from the image sensor. The instructions, when executed by at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause an electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5 or 6) to obtain the second image from the area corresponding to the first image and the image data corresponding to the additional area based on the expansion of the display area.

[0129] In one embodiment, the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5 or 6) comprises a first housing (e.g., the first housing (311) of FIGS. 3 and 4, the first housing (511) of FIGS. 5 and 6, the first housing (711-1) of FIG. 7) and a second housing (e.g., the second housing of FIGS. 3 and 4) in which at least a portion is drawn into the first housing (e.g., the first housing (311) of FIGS. 3 and 4, the first housing (511) of FIGS. 5 and 6, the first housing (711-1) of FIG. 7) as it moves in a first direction or is withdrawn from the interior of the first housing (e.g., the first housing (311) of FIGS. 3 and 4, the first housing (511) of FIGS. 5 and 6, the first housing (711-1) of FIG. 7) as it moves in a second direction opposite to the first direction. The second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5) may be further included. The second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5) may be pulled out from inside the first housing (e.g., the first housing (311) of FIGS. 3 and 4, the first housing (511) of FIGS. 5 and 6, the second housing (712-1) of FIG. 7) as the second housing (e.g., the second housing (312) of FIGS. 3 and 4, the second housing (512) of FIGS. 5 and 6, the second housing (712-1) of FIG. 7)) moves in the second direction.

[0130] In one embodiment, the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, and the first camera (1010) of FIG. 10) may include an image sensor, an optical system forming an optical path, and an optical image stabilizer. The optical image stabilizer may be configured to control movement of at least a portion of the optical system or the image sensor based on movement of the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5, or 6). The instructions, when executed by the at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5, or 6) to acquire a fourth image through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10). The instructions, when executed by the at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5, or 6) to control the position of the optical image stabilizer to a first position in a direction corresponding to the position of the additional area based on the expansion of the display area. The instructions, when executed collectively by at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause an electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5 or 6) to acquire a fifth image through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10) while controlling the optical image stabilizer based on the first position.The instructions, when executed collectively by at least one processor (e.g., processor (120) of FIG. 1) or collectively, may cause an electronic device (e.g., electronic device (101) of FIG. 1, 3, 4, 5 or 6) to obtain the second image based on the fourth image and the fifth image.

[0131] In one embodiment, the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, and the first camera (1010) of FIG. 10) may include an image sensor and a focus module that adjusts a focus position of the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, and the first camera (1010) of FIG. 10). The instructions, when executed collectively by at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause an electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5 or 6) to control the position of the focus module to a second position such that the angle of view of the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10) is expanded based on the expansion of the display area. The instructions, when executed collectively by at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause an electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5 or 6) to acquire the second image based on image data acquired through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10) based on the second location.

[0132] In one embodiment, the instructions, when executed by the at least one processor (e.g., the processor (120) of FIG. 1) or collectively, cause the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5, or 6) to obtain a sixth image based on a third position of the focus module where the focus position of the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10) is aligned with the image sensor. The at least one processor (e.g., the processor (120) of FIG. 1) may obtain a seventh image based on the second position of the focus module through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10)). The instructions, when executed collectively by at least one processor (e.g., processor (120) of FIG. 1) or collectively by an electronic device (e.g., electronic device (101) of FIG. 1, 3, 4, 5 or 6), may cause the electronic device to obtain the second image based on at least a portion of the sixth image and at least a portion of the seventh image.

[0133] In one embodiment, the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5, or 6) may be configured such that a display area of ​​the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10) is expandable in at least one of a third direction or a fourth direction different from the third direction. The instructions, when executed by the at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause the electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5, or 6) to identify a direction in which a display area of ​​the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10) is expanded based on the expansion of the display area. The instructions, when executed by the at least one processor (e.g., the processor (120) of FIG. 1) or collectively, may cause the electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5, or 6) to acquire the second image based on the identified direction.

[0134] In one embodiment, an electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5, or 6) may include a flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10), a first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10)) and a second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10). The first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, and the first camera (1010) of FIG. 10) may be configured to capture an image based on a first angle of view, and the second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, and the second camera (1020) of FIG. 10) may be configured to capture an image based on a second angle of view that is wider than the first angle of view. A method of operating the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5 or 6) according to one embodiment may include an operation of displaying a first image acquired through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10)) on a first display area (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6) of the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10)).A method of operating the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5, or 6) may include an operation of acquiring a second image including an additional area in addition to an area corresponding to the first image based on an expansion of a display area of ​​the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10). A method of operating the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5, or 6) may include an operation of activating the second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10)) while displaying at least a portion of the second image. A method of operating the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5 or 6) comprises: after the second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10)) is activated, cropping at least a part of an image obtained through the second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10)) and displaying a third image including the first display area (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6) and the second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5)) It may include actions that are displayed in the display area.

[0135] In one embodiment, the second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5) may be arranged in a first direction with respect to the first display area (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6). The operation of displaying the first image on the first display area (e.g., the first display area (321) of FIGS. 3 and 4, the first display area (521) of FIGS. 5 and 6) of the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10) may include an operation of obtaining the first image by cropping an area corresponding to the first image from image data output from the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10).

[0136] In one embodiment, the electronic device (e.g., the electronic device (101) of FIGS. 1, 3, 4, 5 or 6) comprises a first housing (e.g., the first housing (311) of FIGS. 3 and 4, the first housing (511) of FIGS. 5 and 6, the first housing (711-1) of FIG. 7) and a second housing (e.g., the second housing of FIGS. 3 and 4) in which at least a portion is drawn into the first housing (e.g., the first housing (311) of FIGS. 3 and 4, the first housing (511) of FIGS. 5 and 6, the first housing (711-1) of FIG. 7) as it moves in a first direction or is withdrawn from the interior of the first housing (e.g., the first housing (311) of FIGS. 3 and 4, the first housing (511) of FIGS. 5 and 6, the first housing (711-1) of FIG. 7) as it moves in a second direction opposite to the first direction. The second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5) may be further included. The second display area (e.g., the second display area (322) of FIG. 4, the second display area (522) of FIG. 5) may be pulled out from inside the first housing (e.g., the first housing (311) of FIGS. 3 and 4, the first housing (511) of FIGS. 5 and 6, the second housing (712-1) of FIG. 7) as the second housing (e.g., the second housing (312) of FIGS. 3 and 4, the second housing (512) of FIGS. 5 and 6, the second housing (712-1) of FIG. 7)) moves in the second direction.

[0137] In one embodiment, the operation of acquiring the second image may include an operation of acquiring a fourth image through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, and the first camera (1010) of FIG. 10). The operation of acquiring the second image may include an operation of controlling the position of the optical image stabilizer of the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, and the first camera (1010) of FIG. 10) to a first position in a direction corresponding to a position of the additional area, based on the expansion of the display area. The operation of acquiring the second image may include an operation of acquiring a fifth image through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, and the first camera (1010) of FIG. 10) while controlling the optical image stabilizer based on the first position. The operation of acquiring the second image may include an operation of acquiring the second image based on the fourth image and the fifth image.

[0138] In one embodiment, the operation of acquiring the second image may include an operation of controlling the position of the focus module to a second position such that the angle of view of the first camera (e.g., the first front camera (341) of FIGS. 3 and 4 , the first rear camera (242) of FIGS. 5 and 6 , and the first camera (1010) of FIG. 10 ) is expanded based on the expansion of the display area. The operation of acquiring the second image may include an operation of acquiring the second image based on image data acquired through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4 , the first rear camera (242) of FIGS. 5 and 6 , and the first camera (1010) of FIG. 10 ) based on the second position.

[0139] In one embodiment, the operation of acquiring the second image may include an operation of acquiring a sixth image based on a third position of the focus module in which a focus position of the first camera (e.g., the first front camera (341) of FIGS. 3 and 4 , the first rear camera (242) of FIGS. 5 and 6 , and the first camera (1010) of FIG. 10 ) is aligned with the image sensor. The operation of acquiring the second image may include an operation of acquiring a seventh image based on the second position of the focus module through the first camera (e.g., the first front camera (341) of FIGS. 3 and 4 , the first rear camera (242) of FIGS. 5 and 6 , and the first camera (1010) of FIG. 10 ). The operation of acquiring the second image may include an operation of acquiring the second image based on at least a portion of the sixth image and at least a portion of the seventh image.

[0140] In one embodiment, the display area of ​​the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, and the flexible display (1030) of FIG. 10) may be expandable in at least one of a third direction or a fourth direction different from the third direction. The operation of acquiring the second image may include an operation of identifying a direction in which the display area of ​​the flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, and the flexible display (1030) of FIG. 10) expands based on the expansion of the display area. The operation of acquiring the second image may include an operation of acquiring the second image based on the identified direction.

[0141] In one embodiment, a non-transitory computer-readable recording medium may record a computer program for causing an electronic device (e.g., the electronic device (101) of FIG. 1, 3, 4, 5 or 6) to execute the method described above, when executed, including a flexible display (e.g., the display module (160) of FIG. 1, the flexible display (320) of FIGS. 3 and 4, the flexible display (520) of FIGS. 5 and 6, the flexible display (1030) of FIG. 10), a first camera (e.g., the first front camera (341) of FIGS. 3 and 4, the first rear camera (242) of FIGS. 5 and 6, the first camera (1010) of FIG. 10)) and a second camera (e.g., the second front camera (342) of FIGS. 3 and 4, the second rear camera (243) of FIGS. 5 and 6, the second camera (1020) of FIG. 10).

[0142] An electronic device and an operating method thereof according to various embodiments can seamlessly display an image acquired through a camera during a process in which a display area is expanded.

[0143] An electronic device and an operating method thereof according to various embodiments can display an image in an expanded display area until the switching of the camera is completed when a camera for obtaining an image displayed on a flexible display is switched from a first camera to a second camera as the display area is expanded.

[0144] An electronic device and its operating method according to various embodiments can reduce power consumption due to pre-activating the second camera by displaying an image in an extended display area using an image acquired through a first camera during the time required to activate the second camera, without pre-activating the second camera.

[0145] The effects that can be obtained from the present disclosure are not limited to the effects mentioned above, and other effects that are not mentioned can be clearly understood by a person having ordinary skill in the art to which the present disclosure belongs from the description below.

[0146] The methods according to the embodiments described in the claims or specification of the present disclosure may be implemented in the form of hardware, software, or a combination of hardware and software.

[0147] When implemented in software, a computer-readable storage medium storing one or more programs (software modules) may be provided. The one or more programs stored in the computer-readable storage medium are configured for execution by one or more processors within an electronic device. The one or more programs include instructions that cause the electronic device to execute methods according to the embodiments described in the claims or specification of the present disclosure.

[0148] These programs (software modules, software) may be stored in a random access memory, a non-volatile memory including a flash memory, a read only memory (ROM), an electrically erasable programmable read only memory (EEPROM), a magnetic disc storage device, a compact disc ROM (CD-ROM), a digital versatile disc (DVD) or other forms of optical storage, a magnetic cassette, or a memory formed by a combination of some or all of these. In addition, each configuration memory may be included in multiple numbers.

[0149] Additionally, the program may be stored in an attachable storage device that is accessible via a communication network such as the Internet, an intranet, a local area network (LAN), a wide LAN (WLAN), or a storage area network (SAN), or a combination thereof. Such a storage device may be connected to a device performing an embodiment of the present disclosure via an external port. Additionally, a separate storage device on the communication network may be connected to a device performing an embodiment of the present disclosure.

[0150] In the specific embodiments of the present disclosure described above, components included in the disclosure are expressed singularly or plurally, depending on the specific embodiment presented. However, the singular or plural expressions are selected to suit the presented situation for convenience of explanation, and the present disclosure is not limited to singular or plural components. Components expressed in plural may be composed of singular elements, or components expressed in singular may be composed of plural elements.

[0151] Additionally, in the present disclosure, terms such as “part”, “module”, etc. may refer to a hardware component such as a processor or circuit, and / or a software component executed by a hardware component such as a processor.

[0152] A "component" or "module" may be implemented by a program stored in an addressable storage medium and executed by a processor. For example, a "component" or "module" may be implemented by components such as software components, object-oriented software components, class components, and task components, as well as processes, functions, attributes, procedures, subroutines, segments of program code, drivers, firmware, microcode, circuitry, data, databases, data structures, tables, arrays, and variables.

[0153] The specific implementations described in this disclosure are merely exemplary and do not limit the scope of the present disclosure in any way. For the sake of brevity, descriptions of conventional electronic components, control systems, software, and other functional aspects of the systems may be omitted.

[0154] Additionally, in the present disclosure, “comprising at least one of a, b, or c” may mean “comprising only a, including only b, including only c, or including a combination of two or more (including a and b, including b and c, including a and c, or including all of a, b, and c).

[0155] While the detailed description of this disclosure has described specific embodiments, it should be understood that various modifications are possible without departing from the scope of this disclosure. Therefore, the scope of this disclosure should not be limited to the described embodiments, but should be defined not only by the scope of the claims described below, but also by equivalents thereof.

Claims

1. In electronic devices, A first camera configured to capture an image based on a first angle of view; A second camera configured to capture an image based on a second angle of view wider than the first angle of view; A flexible display with a variable display area that displays the screen; Memory for storing instructions; and comprising at least one processor comprising processing circuitry; The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Displaying a first image acquired through the first camera on the first display area of ​​the flexible display, Based on the expansion of the above display area, a second image including an additional area in addition to the area corresponding to the first image is obtained, Displaying at least a portion of the second image in a second display area corresponding to the first display area and an extended portion of the flexible display, performing an action of activating said second camera while displaying at least a portion of said second image; An electronic device that, after the second camera is activated, displays a third image obtained by cropping at least a portion of an image acquired through the second camera on a third display area including the first display area and the second display area.

2. In claim 1, The second display area is arranged in a first direction with respect to the first display area, The first camera comprises an image sensor configured to acquire image data corresponding to an area corresponding to the first image and corresponding to the additional area, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Obtaining the first image by cropping an area corresponding to the first image from the image data output from the image sensor, An electronic device that obtains the second image from image data corresponding to the area corresponding to the first image and corresponding to the additional area based on the expansion of the display area.

3. In claim 1, The above electronic device: 1st housing; and Further comprising a second housing, at least a portion of which is drawn into the interior of the first housing as it moves in the first direction, or at least a portion of which is withdrawn from the interior of the first housing as it moves in the second direction opposite to the first direction; An electronic device wherein the second display area is pulled out from inside the first housing as the second housing moves in the second direction.

4. In claim 1, The above first camera: image sensor; an optical system forming an optical path; and An optical image stabilizer for controlling movement of at least a portion of the optical system or the image sensor based on movement of the electronic device, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Obtaining a fourth image through the first camera, Based on the expansion of the above display area, the position of the optical image stabilizer is controlled to a first position in a direction corresponding to the position of the additional area, A fifth image is acquired through the first camera while controlling the optical image stabilizer based on the first position, An electronic device configured to obtain the second image based on the fourth image and the fifth image.

5. In claim 1, The above first camera: Image sensor, and A focus module for adjusting the focus position of the first camera is included, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the expansion of the above display area, the position of the focus module is controlled to a second position so that the angle of view of the first camera is expanded, An electronic device that acquires the second image based on image data acquired through the first camera based on the second location.

6. In claim 5, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Acquire a sixth image based on the third position of the focus module where the focus position of the first camera is aligned with the image sensor, A seventh image is acquired based on the second position of the focus module through the first camera, An electronic device that obtains the second image based on at least a portion of the sixth image and at least a portion of the seventh image.

7. In claim 1, The display area of ​​the flexible display is expandable in at least one of a third direction or a fourth direction different from the third direction, The above instructions, when individually or collectively executed by the at least one processor, cause the electronic device to: Based on the expansion of the display area, the direction in which the display area of ​​the flexible display expands is identified, An electronic device that acquires the second image based on the identified direction.

8. A method of operating an electronic device including a flexible display, a first camera, and a second camera, wherein the first camera is configured to capture an image based on a first angle of view, and the second camera is configured to capture an image based on a second angle of view that is wider than the first angle of view. An operation of displaying a first image acquired through the first camera on a first display area of ​​the flexible display; An operation of obtaining a second image including an additional area in addition to an area corresponding to the first image based on an expansion of a display area of ​​the flexible display; An action of performing activation of said second camera while displaying at least a portion of said second image; and A method comprising: after the second camera is activated, displaying a third image obtained by cropping at least a portion of an image acquired through the second camera in a third display area including the first display area and the second display area.

9. In claim 8, The second display area is arranged in a first direction with respect to the first display area, A method wherein the operation of displaying the first image on the first display area of ​​the flexible display includes an operation of obtaining the first image by cropping an area corresponding to the first image from image data output from the first camera.

10. In claim 8, The above electronic device: 1st housing; and Further comprising a second housing, at least a portion of which is drawn into the interior of the first housing as it moves in the first direction, or at least a portion of which is withdrawn from the interior of the first housing as it moves in the second direction opposite to the first direction; An electronic device wherein the second display area is pulled out from inside the first housing as the second housing moves in the second direction.

11. In claim 8, The operation of obtaining the second image is: An operation of acquiring a fourth image through the first camera; An operation of controlling the position of the optical image stabilizer of the first camera to a first position in a direction corresponding to the position of the additional area based on the expansion of the display area; An operation of acquiring a fifth image through the first camera while controlling the optical image stabilizer based on the first position, and A method comprising an operation of obtaining the second image based on the fourth image and the fifth image.

12. In claim 8, The operation of obtaining the second image is: An operation of controlling the position of the focus module to a second position so that the angle of view of the first camera is expanded based on the expansion of the display area, and An operation of acquiring the second image based on image data acquired through the first camera based on the second position, The operation of obtaining the second image is: An operation of acquiring a sixth image based on a third position of the focus module in which the focus position of the first camera is aligned with the image sensor; An operation of acquiring a seventh image based on the second position of the focus module through the first camera, and A method comprising obtaining the second image based on at least a portion of the sixth image and at least a portion of the seventh image.

13. In claim 12, The operation of obtaining the second image is: An operation of acquiring a sixth image based on a third position of the focus module in which the focus position of the first camera is aligned with the image sensor; An operation of acquiring a seventh image based on the second position of the focus module through the first camera, and A method comprising obtaining the second image based on at least a portion of the sixth image and at least a portion of the seventh image.

14. In claim 8, The display area of ​​the flexible display is expandable in at least one of a third direction or a fourth direction different from the third direction, The operation of obtaining the second image is: An operation for identifying a direction in which the display area of ​​the flexible display is expanded based on the expansion of the display area, and A method comprising an operation of acquiring the second image based on the identified direction.

15. A computer-readable non-transitory recording medium, when executed, comprises an electronic device including a flexible display, a first camera and a second camera: An operation of displaying a first image acquired through the first camera on a first display area of ​​the flexible display; An operation of obtaining a second image including an additional area in addition to an area corresponding to the first image based on an expansion of a display area of ​​the flexible display; An action of performing activation of said second camera while displaying at least a portion of said second image; and A computer program is stored that causes the computer to perform an operation of displaying a third image, which is a cropped image of at least a portion of an image acquired through the second camera, on a third display area including the first display area and the second display area after the second camera is activated, A recording medium having recorded thereon a computer program that causes the first camera to capture an image based on a first angle of view, and causes the second camera to capture an image based on a second angle of view that is wider than the first angle of view.

Images