Electronic device having flexible display and method for photographing according to state change thereof

Abstract

Various embodiments of the present disclosure disclose an electronic device having a flexible display and a method for capturing images based on a change in the state thereof. An electronic device according to various embodiments includes a camera module, a display module, and a processor, wherein the processor captures an image based on an output resolution specified in a first state of the display module, displays a preview screen based on a first preview resolution according to the first state of the display module, detects a state change transitioning from the first state of the display module to a second state, displays a preview screen based on a second preview resolution according to the second state of the display module, identifies a hidden area based on a change amount of the display module, and, while performing image capture, acquires and provides a first image based on the output resolution and a second image based on the hidden area based on a change in the state of the display module. Various embodiments are possible.

Description

Technology Field

[0001] Various embodiments of the present disclosure disclose an electronic device having a flexible display (e.g., a rollable device or a slideable device) and a method of taking images according to a change in the state thereof. Background Technology

[0002] With the advancement of digital technology, various types of electronic devices such as mobile communication terminals, PDAs (personal digital assistants), electronic notebooks, smartphones, tablet PCs (personal computers), and / or laptop PCs are widely used. To support and enhance the functionality of these electronic devices, the hardware and / or software components are continuously being improved.

[0003] Electronic devices may have limited sizes for the sake of portability, which consequently restricts the size of their displays. Consequently, various types of electronic devices that provide expanded screens are being developed recently. For example, electronic devices are gradually increasing the screen size from limited-size displays and are being designed to provide users with various services (or functions) through large screens.

[0004] Recently, electronic devices can have new form factors such as rollable devices and / or slideable devices. For example, electronic devices may be equipped with a flexible display or a slideable display, and at least a portion of the display can be rolled up or unfolded for use. As electronic devices adopt new form factors, there is an increasing need for the development of corresponding user interfaces (UI) and their operation. The problem to be solved

[0005] The electronic device may be implemented to expand the screen, for example, by sliding. For example, a portion of the flexible display may slide out of or retract into the internal space of the electronic device, thereby allowing the screen to expand or contract. However, when capturing video using a camera module, the electronic device may perform shooting at an initially set output resolution regardless of whether the screen is expanded or contracted. For example, the electronic device may not be able to change the resolution in real time during video capture, and the resolution set at the time of the initial capture (e.g., recording) may be fixed. Therefore, while the electronic device may expand or contract according to the user's intention during video capture, the actual captured video is not an image corresponding to what the user intended in the preview screen, but is captured based on the output resolution; consequently, the actual captured video may differ from what the user intended in the preview screen.

[0006] In various embodiments, a method and apparatus are disclosed for capturing and storing an image in response to a change in the state of a display when the display area changes according to a change in the state of the display during image capture in an electronic device including an expandable display.

[0007] In various embodiments, a method and apparatus are disclosed for, when the preview ratio of a display area of ​​an electronic device including an expandable display changes due to a sliding motion during image capture (e.g., recording), to continue capturing an image in response to the change in the preview ratio, and to obtain an original image and a corrected image when saving the captured image.

[0008] In various embodiments, a method and apparatus are disclosed that can provide an image exactly as a user intended for a preview screen according to a change in the state of the display during image capture in an electronic device including an expandable display. means of solving the problem

[0009] An electronic device according to an embodiment of the present disclosure comprises a camera module, a display module, and a processor, wherein the processor captures an image based on an output resolution specified in a first state of the display module, displays a preview screen based on a first preview resolution according to the first state of the display module, detects a state change in which the display module transitions from a first state to a second state, displays a preview screen based on a second preview resolution according to the second state of the display module, identifies a hidden area based on a change amount of the display module, and, while performing image capture, acquires a first image based on the output resolution and a second image based on the hidden area based on a state change of the display module.

[0010] A method of operation of an electronic device according to an embodiment of the present disclosure may include: capturing an image based on an output resolution specified in a first state of a display module; displaying a preview screen based on a first preview resolution according to the first state of the display module; detecting a state change in which the display module transitions from a first state to a second state; displaying a preview screen based on a second preview resolution according to the second state of the display module; identifying a hidden area based on a change amount of the display module; and, while performing image capture, acquiring a first image based on the output resolution and a second image based on the hidden area based on a state change of the display module.

[0011] In order to solve the above problems, various embodiments of the present disclosure may include a computer-readable recording medium that records a program for executing the method on a processor.

[0012] Further scopes of the applicability of the present disclosure will become apparent from the following detailed description. However, since various changes and modifications within the spirit and scope of the present disclosure are clearly understood by those skilled in the art, specific embodiments, such as the detailed description and preferred embodiments of the present disclosure, should be understood as being given merely as examples. Effects of the invention

[0013] According to various embodiments, an electronic device and a method of operation thereof, when the preview ratio of the display area of ​​an electronic device including an expandable display changes due to a sliding motion during video recording (e.g., recording), the video can be captured and stored in response to the change in the preview ratio. According to various embodiments, an electronic device including an expandable display can provide video exactly as the preview screen intended by the user during video recording in response to changes in the state of the display. According to various embodiments, when capturing video in an electronic device including an expandable display, a video corresponding to the user's intended preview based on the amount of input / output of the display can be captured, and when playing the corresponding video, a continuous and natural video (e.g., a video with changed (corrected) size and ratio) can be provided to the user.

[0014] In addition, various effects that can be identified directly or indirectly through this document may be provided. Brief explanation of the drawing

[0015] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2a is a front perspective view of an electronic device in a closed state according to one embodiment. FIG. 2b is a rear perspective view of an electronic device in a closed state according to one embodiment. FIG. 3a is a front perspective view of an electronic device in an open state according to one embodiment. FIG. 3b is a rear perspective view of an electronic device in an open state according to one embodiment. FIG. 4 is an exploded perspective view relating to the electronic device of FIG. 2a according to one embodiment. FIGS. 5a to 5g are drawings illustrating the structure of an expandable display of an electronic device according to various embodiments. FIG. 6 is a block diagram illustrating a camera module according to various embodiments. FIG. 7 is a block diagram relating to the electronic device of FIG. 2a according to one embodiment. FIG. 8 is a flowchart illustrating the operation method of an electronic device according to various embodiments. FIGS. 9A and 9B are drawings illustrating changes in the state of a display and examples of shooting taken according to the same while shooting is performed in an electronic device according to various embodiments. FIGS. 10a and FIGS. 10b are drawings illustrating examples of playback of images captured according to a change in the state of a display in an electronic device according to various embodiments. FIGS. 11a and FIGS. 11b are drawings illustrating examples of playback of images captured according to a change in the state of a display in an electronic device according to various embodiments. FIGS. 12a and FIGS. 12b are drawings illustrating changes in the state of a display and examples of shooting taken therefrom while shooting is performed in an electronic device according to various embodiments. FIG. 13 is a flowchart illustrating the operation method of an electronic device according to various embodiments. FIG. 14 is a flowchart illustrating the operation method of an electronic device according to various embodiments. FIG. 15 is a drawing illustrating an example of processing an effect on an original image in an electronic device according to various embodiments. FIG. 16 is a drawing illustrating an example of storing a captured image in an electronic device according to various embodiments. FIG. 17 is a drawing illustrating an example of shooting according to a change in the state and focus of a display in an electronic device according to various embodiments. Specific details for implementing the invention

[0016] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.

[0017] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).

[0018] The processor (120) can control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., a program (140)), and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store the resulting data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit (CPU) or an application processor (AP)) or an auxiliary processor (123) that can operate independently or together with it (e.g., a graphic processing unit (GPU), a neural processing unit (NPU), an image signal processor (ISP), a sensor hub processor, or a communication processor (CP). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.

[0019] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence is performed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.

[0020] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).

[0021] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (OS) (142), middleware (144), or an application (146).

[0022] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0023] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.

[0024] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.

[0025] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).

[0026] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0027] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, a secure digital (SD) card interface, or an audio interface.

[0028] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0029] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.

[0030] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0031] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).

[0032] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0033] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or a WAN (wide area network)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).

[0034] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (eMBB, enhanced mobile broadband), minimization of terminal power and connection of multiple terminals (mMTC, massive machine type communications), or high reliability and low-latency (URLLC, ultra-reliable and low-latency communications). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.

[0035] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).

[0036] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.

[0037] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.

[0038] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0039] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.

[0040] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.

[0041] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0042] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.

[0043] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.

[0044] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

[0045] FIG. 2a is a front perspective view of an electronic device (101) in a closed state according to one embodiment. FIG. 2b is a rear perspective view of an electronic device (101) in a closed state according to one embodiment. FIG. 3a is a front perspective view of an electronic device (101) in an open state according to one embodiment. FIG. 3b is a rear perspective view of an electronic device (101) in an open state according to one embodiment.

[0046] Referring to FIGS. 2a, 2b, 3a, and 3b, in one embodiment, the electronic device (101) may be implemented to allow the screen (2301) to be extended in a sliding manner. For example, the screen (2301) may be an area of ​​the flexible display (230) that is visible to the outside. FIGS. 2a and 2b illustrate the electronic device (101) in a state where the screen (2301) is not extended, and FIGS. 3a and 3b illustrate the electronic device (101) in a state where the screen (2301) is extended. The state where the screen (2301) is not extended is a state in which the sliding plate (220) for the sliding motion of the flexible display (230) is not slid out, and may be referred to as the 'closed state' below. The expanded state of the screen (2301) is a maximally expanded state in which the screen (2301) is no longer expanded by the sliding out of the sliding plate (220), and may be referred to as the 'open state' below. For example, the sliding out may be the sliding plate (220) moving at least partially in a first direction (e.g., +x axis direction) when the electronic device (101) is switched from a closed state to an open state. According to various embodiments, the open state may be defined as a state in which the screen (2301) is expanded compared to a closed state, and may provide screens of various sizes depending on the movement position of the sliding plate (220). According to various embodiments, an intermediated state may refer to a state between the closed state of FIG. 2a and the open state of FIG. 3a.

[0047] The screen (2301) may include an active area of ​​a flexible display (230) that is visually exposed and capable of outputting an image, and the electronic device (101) may adjust the active area according to the movement of the sliding plate (220) or the movement of the flexible display (230). In the following description, the open state may refer to a state in which the screen (2301) is maximally expanded. In some embodiments, the flexible display (230) that is slidably positioned on the electronic device (101) of FIG. 2a to provide the screen (2301) may be referred to as a 'slide-out display' or an 'expandable display'.

[0048] According to one embodiment, the electronic device (101) may include a sliding structure associated with a flexible display (230). For example, when the flexible display (230) is moved by an external force to a set distance, due to the elastic structure included in the sliding structure, it may be switched from a closed state to an open state or from an open state to a closed state (e.g., semi-automatic sliding motion) without further external force.

[0049] According to some embodiments, when a signal is generated through an input device included in the electronic device (101), the electronic device (101) can be switched from a closed state to an open state, or from an open state to a closed state, by a driving device such as a motor connected to the flexible display (230). For example, when a signal is generated through a hardware button, or a software button provided through a screen, the electronic device (101) can be switched from a closed state to an open state, or from an open state to a closed state.

[0050] According to various embodiments, when a signal is generated from various sensors, such as a pressure sensor, the electronic device (101) may be switched from a closed state to an open state, or from an open state to a closed state. For example, when the electronic device (101) is held or grasped by hand, a squeeze gesture in which a part of the hand (e.g., palm or fingers) presses within a designated section of the electronic device (101) may be detected through the sensor, and in response, the electronic device (101) may be switched from a closed state to an open state, or from an open state to a closed state.

[0051] According to one embodiment, the display (230) may include a second section (②) (see FIG. 3a). The second section (②) may include an extended portion of the screen (2301) when the electronic device (101) is switched from a closed state to an open state. When the electronic device (101) is switched from a closed state to an open state, the second section (②) is slid out from the internal space of the electronic device (101), thereby expanding the screen (2301). When the electronic device (101) is switched from an open state to a closed state, at least a portion of the second section (②) is slid into the internal space of the electronic device (101), thereby shrinking the screen (2301). When the electronic device (101) is switched from an open state to a closed state, at least a portion of the second section (②) may be bent and moved into the internal space of the electronic device (101). For example, the flexible display (230) may include a flexible substrate (e.g., a plastic substrate) formed from a polymer material including polyimide (PI (polyimide)) or polyester (PET (polyester)). The second section (②) is a part of the flexible display (230) that bends when the electronic device (101) switches between an open state and a closed state, and may be referred to, for example, as a bendable section. In the following description, the second section (②) may be referred to as a bendable section.

[0052] According to one embodiment, the electronic device (101) may include a housing (210), a sliding plate (220), or a flexible display (230).

[0053] The housing (or case) (210) may include, for example, a back cover (212), a first side cover (213), or a second side cover (214). The back cover (212), the first side cover (213), or the second side cover (214) may be connected to a support member (not shown) located inside the electronic device (101) and may form at least a part of the exterior of the electronic device (101).

[0054] The back cover (212) may, for example, form at least a portion of the rear surface (200B) of the electronic device (101). In one embodiment, the back cover (212) may be substantially opaque. For example, the back cover (212) may be formed by coated or colored glass, ceramic, polymer, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of the above materials. According to some embodiments, when the bendable section (②) of the flexible display (230) is retracted into the internal space of the housing (210) (e.g., closed), at least a portion of the bendable section (②) may be positioned so that it is visible from the outside through the back cover (212). In this case, the back cover (212) may be formed of a transparent material and / or a translucent material.

[0055] According to one embodiment, the back cover (212) may include a flat portion (212a) and curved portions (212b, 212c) located opposite each other with the flat portion (212a) in between. The curved portions (212b, 212c) are formed adjacent to each of the relatively long edges (not shown) on both sides of the back cover (212) and may be curved and seamlessly extended toward a screen located opposite the back cover (212). According to some embodiments, the back cover (212) may include one of the curved portions (212b, 212c) or may be implemented without the curved portions (212b, 212c).

[0056] According to one embodiment, the first side cover (213) and the second side cover (214) may be positioned opposite each other. For example, the first side cover (213) and the second side cover (214) may be positioned opposite each other with the flexible display (230) in between in a second direction (e.g., y-axis direction) that is orthogonal to the first direction (e.g., +x-axis direction) of the sliding plate (220) sliding out. The first side cover (213) may form at least a portion of the first side (213a) of the electronic device (101), and the second side cover (214) may form at least a portion of the second side (214a) of the electronic device (101) facing in the opposite direction to the first side (213a). The first side cover (213) may include a first rim portion (or, first rim) (213b) extending from the edge of the first side (213a). For example, the first rim portion (213b) may form at least a portion of the bezel on one side of the electronic device (101). The second side cover (214) may include a second rim portion (or, second rim) (214b) extending from the edge of the second side (214a). For example, the second rim portion (214b) may form at least a portion of the bezel on the other side of the electronic device (101). According to one embodiment, in the closed state of FIG. 2a, the surface of the first edge portion (213b), the surface of the second edge portion (214b), and the surface of the sliding plate (220) are smoothly connected to form a one-sided curved portion (not shown) corresponding to the first curved portion (230b) of the screen (2301). According to various embodiments, the surface of the first edge portion (213b) or the surface of the second edge portion (214b) may include a other-sided curved portion (not shown) corresponding to the second curved portion (230c) of the screen (2301) located on the opposite side from the first curved portion (230b).

[0057] According to one embodiment, the sliding plate (220) may slide on a support member (not shown) located inside the electronic device (101). At least a portion of the flexible display (230) may be placed on the sliding plate (220), and the closed state of FIG. 2a or the open state of FIG. 3a may be formed based on the position of the sliding plate (220) on the support member. According to one embodiment, the flexible display (230) may be attached to the sliding plate (120) through an adhesive member (or adhesive member) (not shown). According to one embodiment, the adhesive member may include a thermal adhesive member, a photoreactive adhesive member, a general adhesive and / or double-sided tape. According to some embodiment, the flexible display (230) may be placed and fixed on the sliding plate (220) by slidingly inserting it into a recess formed in the sliding plate (220). The sliding plate (230) serves to support at least a portion of the flexible display (230), and in some embodiments may be referred to as a display support structure.

[0058] According to one embodiment, the sliding plate (220) may include a third edge portion (220b) that forms the outer surface of the electronic device (101) (e.g., a surface exposed to the outside to form the exterior of the electronic device (101)). For example, the third edge portion (220b) may form a bezel around the screen together with the first edge portion (213b) and the second edge portion (214b) in the closed state of FIG. 2a. In the closed state, the third edge portion (220b) may extend in a second direction (e.g., the y-axis direction) to connect one end of the first side cover (213) and one end of the second side cover (214). For example, in the closed state of FIG. 2a, the surface of the third edge portion (220b) may be smoothly connected to the surface of the first edge portion (213b) and / or the surface of the second edge portion (214b).

[0059] According to one embodiment, due to the sliding out of the sliding plate (220), at least a portion of the bendable section (②) comes out from inside the electronic device (101), and the screen (2301) can be provided in an extended state (e.g., open state) as in FIG. 3a.

[0060] According to one embodiment, in the closed state of FIG. 2a, the screen (2301) may include a flat section (230a) and a first curved section (230b) and / or a second curved section (230c) located opposite each other with the flat section (230a) in between. For example, the first curved section (230b) and the second curved section (230c) may be substantially symmetrical with respect to the flat section (230a). For example, in the closed state of FIG. 2a, the first curved section (230b) and / or the second curved section (230c) may be positioned corresponding to the curved sections (212b, 212c) of the back cover (212), respectively, and may be curved toward the back cover (212). When transitioning from the closed state of FIG. 2a to the open state of FIG. 3a, the flat section (230a) may be extended. For example, a portion of the bendable section (②) forming the second curved section (230c) in the closed state of FIG. 2a may be included in the expanded planar section (230a) when transitioning from the closed state of FIG. 2a to the open state of FIG. 3a, and may be formed as another portion of the bendable section (②).

[0061] According to one embodiment, the electronic device (101) may include an opening (not shown) for inserting or withdrawing a bendable section (②), and / or a pulley (not shown) located at the opening. The pulley may be positioned corresponding to the bendable section (②), and the movement of the bendable section (②) and the direction of movement thereof may be guided through the rotation of the pulley in the transition between the closed state of FIG. 2a and the open state of FIG. 3a. The first curved surface (230b) may be formed corresponding to a curved surface formed on one side of the sliding plate (220). The second curved surface (230c) may be formed by a portion of the bendable section (②) corresponding to the curved surface of the pulley. The first curved surface (230c) may be positioned on the opposite side of the second curved surface (230b) in the closed or open state of the electronic device (101) to improve the aesthetics of the screen (2301). According to some embodiments, the planar portion (230a) may be implemented in an extended form without the first curved portion (230b).

[0062] According to one embodiment, the flexible display (230) may further include a touch sensing circuit (e.g., a touch sensor). According to various embodiments, the flexible display (230) may be combined with or placed adjacent to a pressure sensor capable of measuring the intensity (pressure) of a touch, and / or a digitizer capable of detecting a magnetic field-based pen input device (e.g., a stylus pen). For example, the digitizer may include a coil member disposed on a dielectric substrate to detect an electromagnetic induction-based resonant frequency applied from a pen input device.

[0063] According to one embodiment, the electronic device (101) may include a microphone hole (251) (e.g., input module (150) of FIG. 1), a speaker hole (252) (e.g., sound output module (155) of FIG. 1), a connector hole (253) (e.g., connection terminal (178) of FIG. 1), a camera module (254) (e.g., camera module (180) of FIG. 1), or a flash (255). According to various embodiments, the flash (255) may be implemented by being included in the camera module (254). In some embodiments, the electronic device (101) may omit at least one of the components or additionally include other components.

[0064] A microphone hole (251) may be formed in at least a portion of the second side (214a) corresponding to a microphone (not shown) located inside the electronic device (101), for example. The location of the microphone hole (251) may vary and is not limited to the embodiment of FIG. 2a. According to some embodiments, the electronic device (101) may include a plurality of microphones capable of detecting the direction of sound.

[0065] A speaker hole (252) may be formed in at least a portion of the second side (214a) corresponding to a speaker located inside the electronic device (101), for example. The location of the speaker hole (252) may vary and is not limited to the embodiment of FIG. 2a. According to various embodiments, the electronic device (101) may include a receiver hole for communication. In some embodiments, the microphone hole (251) and the speaker hole (252) may be implemented as a single hole, or the speaker hole (252) may be omitted, such as in a piezo speaker.

[0066] A connector hole (253) may be formed in at least a portion of the second side (214a) corresponding to a connector (e.g., a USB connector) located inside the electronic device (101), for example. The electronic device (101) may transmit and / or receive power and / or data to and from an external electronic device electrically connected to the connector through the connector hole (253). The location of the connector hole (253) may vary and is not limited to the embodiment of FIG. 2a.

[0067] A camera module (254) and a flash (255) may be located, for example, on the rear (200B) of the electronic device (101). The camera module (254) may include one or more lenses, an image sensor, and / or an image signal processor. The flash (255) may include, for example, a light-emitting diode or a xenon lamp. In some embodiments, two or more lenses (e.g., an infrared camera, a wide-angle and a telephoto lens) and an image sensor may be located on one side of the electronic device (101). According to various embodiments, the electronic device (101) may include a plurality of camera modules, not limited to the embodiment of FIG. 2b or FIG. 3b. The camera module (254) may be one of the plurality of camera modules. For example, the electronic device (101) may include a plurality of camera modules (e.g., a dual camera or a triple camera), each having different attributes (e.g., a field of view) or functions. For example, a plurality of camera modules (e.g., camera module (254)) including lenses having different angles of view may be configured, and the electronic device (101) may control the change of the angle of view of the camera module performed in the electronic device (101) based on the user's selection. Additionally, the plurality of camera modules may include at least one of a wide-angle camera, a telephoto camera, a color camera, a monochrome camera, or an IR (infrared) camera (e.g., a TOF (time of flight) camera, a structured light camera). According to one embodiment, the IR camera may be operated as at least part of a sensor module (not shown).

[0068] According to various embodiments, the electronic device (101) may further include a camera module (e.g., front camera) that receives light through one side of the electronic device (101) (e.g., front (200A)) facing the screen (2301) and generates an image signal based on the received light. For example, the camera module (254) may be located inside the housing (210) aligned with an opening (e.g., through hole, or notch) formed in the flexible display (230), not limited to the embodiment of FIG. 2b or FIG. 3b. The camera module (254) may generate an image signal by receiving light through the opening and a portion of the transparent cover that overlaps with the opening. The transparent cover serves to protect the flexible display (230) from the outside and may include a material such as polyimide or ultra-thin glass (UTG).

[0069] According to some embodiments, not limited to the embodiments of FIG. 2b or FIG. 3b, the camera module (254) may be positioned at the bottom of at least a portion of the screen (2301) of the flexible display (230), and the position of the camera module (254) may not be visually distinguishable (or exposed) and may perform related functions (e.g., image capture). In this case, for example, when viewed from above the screen (2301) (e.g., when viewed in the -z axis direction), the camera module (254) may be positioned to overlap at least a portion of the screen (2301) so as to acquire an image of an external subject without being exposed to the outside.

[0070] According to various embodiments, the electronic device (101) may further include a key input device (e.g., the input module (150) of FIG. 1). The key input device may be located, for example, on a first side (213a) of the electronic device (101) formed by a first side cover (213). In some embodiments, the key input device may include at least one sensor module.

[0071] According to various embodiments, the electronic device (101) may include various sensor modules (e.g., sensor module (176) of FIG. 1). The sensor module may generate electrical signals or data values ​​corresponding to the internal operating state of the electronic device (101) or the external environmental state. For example (not shown), the sensor module may include a proximity sensor that generates a signal regarding the proximity of an external object based on light received through the front (200A) of the electronic device (101) positioned in the direction facing the screen (2301). In another example, the sensor module may include various biometric sensors, such as a fingerprint sensor or an HRM sensor, for detecting biometric information based on light received through the front (200A) or rear (200B) of the electronic device (101). The electronic device (101) may include at least one of various other sensor modules, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0072] According to various embodiments, the electronic device (101) may be implemented in a structure in which the screen is extended toward the third edge portion (220b) when the sliding plate (220) slides out, not limited to the embodiments of FIG. 2a, 2b, 3a, and 3c. For example, a portion of the flexible display (230) forming the first curved portion (230b) in the closed state of FIG. 2a may be included in the extended flat portion (230a) when transitioning from the closed state of FIG. 2a to the open state of FIG. 3a, and may be formed as another portion of the flexible display (230).

[0073] FIG. 4 is an unfolded perspective view of the electronic device (101) of FIG. 2a according to one embodiment.

[0074] Referring to FIG. 4, in one embodiment, the electronic device (101) may include a back cover (212), a first side cover (213), a second side cover (214), a support member assembly (400), a pulley (460), a sliding plate (220), a flexible display (230), a support sheet (470), a multi-bar structure (or multi-bar assembly) (480), or a printed circuit board (490) (e.g., a printed circuit board (PCB), a flexible PCB (FPCB), or a rigid-flexible PCB (RFPCB)). Redundant descriptions of some of the reference numerals in FIG. 4 are omitted.

[0075] According to one embodiment, a support member assembly (or, support structure) (400) may contribute to the durability or rigidity of an electronic device (101) as a load-bearing frame structure. At least a portion of the support member assembly (400) may include a non-metallic material (e.g., a polymer) or a metallic material. A housing (210) including a back cover (212), a first side cover (213), or a second side cover (214) (e.g., see FIG. 2a), a pulley (460), a sliding plate (220), a flexible display (230), a support sheet (470), a multi-bar structure (480), or a printed circuit board (490) may be placed or coupled to the support member assembly (400).

[0076] According to one embodiment, the support member assembly (400) may include a first support member (410), a second support member (420), a third support member (430), a fourth support member (440), or a fifth support member (450).

[0077] The first support member (or first bracket) (410) may be in the form of a plate, for example. A sliding plate (220) may be disposed on one side (410a) of the first support member (410). The second support member (or second bracket) (420) may be in the form of a plate that overlaps at least a portion of the first support member (410) when viewed in the z-axis direction, for example, or may be coupled with the first support member (410) and / or the third support member (430). The second support member (420) may be positioned between the first support member (410) and the third support member (430). The third support member (430) may be coupled with the first support member (410) and / or the second support member (420) with the second support member (420) in between.

[0078] A printed circuit board (490) may be placed on the second support member (420) between the first support member (410) and the second support member (420). A fourth support member (440) may be attached to one side of an assembly (or structure) (not shown) in which the first support member (410), the second support member (420), and the third support member (430) are combined. A fifth support member (450) may be attached to the other side of an assembly (or structure) (not shown) in which the first support member (410), the second support member (420), and the third support member (430) are combined, and may be located on the opposite side from the fourth support member (440).

[0079] The first side cover (213) may be coupled to the support member assembly (400) on the side of the fourth support member (440). The second side cover (214) may be coupled to the support member assembly (400) on the side of the fifth support member (450). The back cover (212) may be coupled to the support member assembly (400) on the side of the third support member (430). At least a portion of the first support member (410), the second support member (420), the third support member (430), the fourth support member (440), or the fifth support member (450) may comprise a metallic material and / or a non-metallic material (e.g., a polymer).

[0080] According to various embodiments, at least two of the first support member (410), the second support member (420), the third support member (430), the fourth support member (440), and the fifth support member (450) may be implemented integrally. According to some embodiments, the support member assembly (400) may refer to a structure forming at least some of the first support member (410), the second support member (420), the third support member (430), the fourth support member (440), and the fifth support member (450). According to some embodiments, some of the first support member (410), the second support member (420), the third support member (430), the fourth support member (440), and the fifth support member (450) may be omitted.

[0081] The first support member (410) may include, for example, a first side (not shown) facing the fourth support member (440), a second side (410c) facing the fifth support member (450) and located on the opposite side from the first side, a third side (not shown) connecting one end of the first side and one end of the second side (410c), or a fourth side (410d) connecting the other end of the first side and the other end of the second side (410c) and located on the opposite side from the third side.

[0082] According to one embodiment, the pulley (460) may be located near the third side of the first support member (410). As another example, in the case of an electronic device formed with a reversed sliding direction, the pulley (460) may be located near the fourth side (410d) of the first support member (460). The pulley (460) may include a cylindrical roller (461) extending in a direction (e.g., +y axis direction) from the fifth support member (450) toward the fourth support member (440). The pulley (460) may include a first rotation shaft (not shown) and a second rotation shaft (463) connected to the roller (461), and the first rotation shaft and the second rotation shaft (463) may be located on opposite sides of each other with the roller (461) in between. The first rotation axis may be located between the roller (461) and the first side cover (213) and may be connected to the fourth support member (440). The second rotation axis (463) may be located between the roller (461) and the second side cover (214) and may be connected to the fifth support member (450). The fourth support member (440) may include a first through hole (441) into which the first rotation axis is inserted, and the fifth support member (450) may include a second through hole (451) into which the second rotation axis (463) is inserted. The roller (461) may be rotatable based on the first rotation axis placed on the fourth support member (440) and the second rotation axis (463) placed on the fifth support member (450).

[0083] According to one embodiment, a sliding plate (220) may be disposed in a support member assembly (400) so as to be slidably movable on a first support member (410). For example, a sliding structure may be provided between the first support member (410) and the sliding plate (220) to support and guide the connection between them and the movement of the sliding plate (220). According to one embodiment, the sliding structure may include at least one elastic structure (401). For example, when the sliding plate (220) is moved to a set distance by an external force, due to the at least one elastic structure (401), it may be switched from the closed state of FIG. 2a to the open state of FIG. 3a, or from the open state to the closed state, without further external force.

[0084] At least one elastic structure (401) may include various elastic members, such as, for example, a torsion spring. For example, the torsion spring as the elastic structure (401) may include one end connected to the sliding plate (220), the other end connected to the first support member (410), and a spring portion between the one end and the other end. When the sliding plate (220) is moved by an external force to a distance set in a first direction of slide-out (e.g., the +x axis direction), the position of the one end relative to the other end is changed so that the sliding plate (220) can be moved in the first direction due to the elasticity of the spring portion without further external force, thereby allowing it to transition from the closed state of FIG. 2a to the open state of FIG. 3a. When the sliding plate (220) is moved by an external force to a distance set in a second direction opposite to the first direction (e.g., -x axis direction), the position of the first end relative to the other end is changed so that the sliding plate (220) can be moved in the second direction due to the elasticity of the spring part without further external force, and thus can be switched from the open state of FIG. 3a to the closed state of FIG. 2a.

[0085] According to various embodiments, the housing (210) may be defined to further include at least a portion of the support member assembly (400). For example, the housing (210) may include one side facing in a first direction (e.g., +z axis direction) (e.g., one side (410a) formed by the first support member (410)), and another side facing in a second direction (e.g., -z axis direction) opposite to the first side (410a) (e.g., rear side (200B) of FIG. 2B). The display support structure (220) may be disposed on one side of the housing (210) (e.g., one side (410a) formed by the first support member (410)) so as to be slidable in a third direction (e.g., x axis direction) perpendicular to the first direction.

[0086] According to one embodiment, the flexible display (230) may include a first section (①) extending from a bendable section (②). The first section (①) may be placed on a sliding plate (220). When transitioning from the closed state of FIG. 2a to the open state of FIG. 3a, the bendable section (②) connected to the first section (①) may slide outward due to the movement of the sliding plate (220), thereby expanding the screen (see screen (2301) in FIG. 3a). When transitioning from the open state of FIG. 2a to the closed state of FIG. 3a, the screen (e.g., see screen (2301) in FIG. 2a) may be reduced due to the movement of the sliding plate (220), causing the bendable section (②) to move at least partially into the electronic device (101). The support member assembly (400) may include an opening (not shown) for the insertion or withdrawal of the bendable section (②), and a pulley (460) may be positioned in the opening. The opening includes a gap on one side between the first support member (410) and the third support member (430), and a portion (431) of the third support member (430) adjacent to the opening may be curved to correspond to the curved surface of the roller (461). The pulley (460) may be positioned corresponding to the bendable section (②), and the pulley (460) may be rotated by the movement of the bendable section (②) in the transition between the closed state of FIG. 2a and the open state of FIG. 3a.

[0087] According to one embodiment, a support sheet (470) may be attached to the back surface of a flexible display (230). The back surface of the flexible display (230) may refer to a surface located opposite to the side from which light is emitted from a display panel containing a plurality of pixels. The support sheet (470) may contribute to the durability of the flexible display (230). The support sheet (470) may reduce the impact of load or stress on the flexible display (230) that may occur during the transition between the closed state of FIG. 2a and the open state of FIG. 3a. The support sheet (470) may prevent the flexible display (230) from being damaged by the force transmitted from the sliding plate (220) when it is moved.

[0088] Although not illustrated, the flexible display (230) may include a first layer comprising a plurality of pixels and a second layer combined with the first layer.

[0089] The first layer may include a light-emitting layer (e.g., a display panel) comprising a plurality of pixels implemented as a light-emitting element such as an OLED (organic light-emitting diode) or a micro LED (light-emitting diode), and various other layers (e.g., an optical layer for improving image quality or outdoor visibility, such as a polarizing layer). According to one embodiment, the optical layer may selectively allow light generated from a light source of the light-emitting layer and vibrating in a certain direction to pass through.

[0090] According to one embodiment, when viewed from above on the screen (2301) (e.g., in the -z axis direction), a plurality of pixels may not be placed in a portion of the flexible display (230) that partially overlaps with at least one electronic component (e.g., camera module, or sensor module) included in the electronic device (101). According to some embodiments, when viewed from above on the screen (2301), a portion of the flexible display (230) that partially overlaps with at least one electronic component (e.g., camera module, or sensor module) included in the electronic device (101) may have a different pixel structure and / or wiring structure compared to other portions. For example, a portion of the flexible display (230) that partially overlaps with at least one electronic component (e.g., camera module, or sensor module) may have a different pixel density compared to other portions. For example, a portion of the flexible display (230) that overlaps at least partially with the at least one electronic component (e.g., camera module, or sensor module) may be implemented as a substantially transparent area formed by a change in the pixel structure and / or wiring structure, even if it does not include an opening.

[0091] The second layer may include various layers for supporting and protecting the first layer (e.g., cushioning), shielding light, absorbing or shielding electromagnetic waves, or diffusing, dispersing, or dissipating heat. According to one embodiment, at least a portion of the second layer may be a conductive member (e.g., a metal plate) to help reinforce the rigidity of the electronic device (101), shield ambient noise, and dissipate heat emitted from an ambient heat dissipation component (e.g., a display driving circuit). According to one embodiment, the conductive member may include at least one of copper (Cu(copper)), aluminum (Al(aluminum)), stainless steel (SUS), or CLAD (e.g., a laminated member in which SUS and Al are alternately arranged).

[0092] A support sheet (470) may be attached to the back surface of the second layer of the flexible display (230) by covering at least a portion of the second layer. The support sheet (470) may be formed from various metallic materials and / or non-metallic materials (e.g., polymers). According to one embodiment, the support sheet (470) may comprise stainless steel. According to some embodiments, the support sheet (470) may comprise engineering plastic. According to some embodiments, the support sheet (470) may be implemented integrally with the flexible display (230). According to one embodiment, the support sheet (470) may comprise a lattice structure (not shown) that is at least partially superimposed with a portion of the flexible display (230) that is bent and positioned (e.g., the bendable section (②) of FIG. 3a or 4, the first curved section (230b) of FIG. 2a or 3a). The grid structure may include a plurality of openings or a plurality of slits and may contribute to the flexibility of the flexible display (230). According to various embodiments, the support sheet (470) may include a recess pattern (not shown) including a plurality of recesses instead of the grid structure, and the recess pattern may contribute to the flexibility of the flexible display (230). According to various embodiments, the grid structure or the recess pattern may extend to at least a portion of the planar portion (230a) of FIG. 2a or FIG. 3a. According to various embodiments, the support sheet (470) including the grid structure or the recess pattern, or the corresponding conductive member, may be formed in a plurality of layers.

[0093] According to one embodiment, the multi-bar structure (480) may be connected to the sliding plate (220) and may include a first surface (481) facing the support sheet (470) and a second surface (482) located opposite the first surface (481). When the sliding plate (220) moves, the movement and direction of the multi-bar structure (480) may be guided by a roller (461) that rotates in friction with the second surface (482). According to one embodiment, the second surface (482) may include a form in which a plurality of bars (not shown) are arranged extending in a direction (e.g., +y axis direction) from the second rotation axis (463) of the pulley (460) toward the first rotation axis (not shown). The multi-bar structure (480) may be bent at portions having a relatively thin thickness between the plurality of bars. In various embodiments, this multi-bar structure (480) may be referred to by other terms such as 'flexible track' or 'hinge rail'.

[0094] According to one embodiment, in the closed state of FIG. 2a or the open state of FIG. 3a, at least a portion of the multi-bar structure (480) is positioned to overlap with the screen (2301) (see FIG. 2a or FIG. 3a) and can support the bendable section (②) so that the bendable section (②) of the flexible display (230) is maintained in a form that is smoothly connected to the first section (①) of the flexible display (230) without lifting. The multi-bar structure (480) can contribute to movability in the transition between the closed state of FIG. 2a and the open state of FIG. 3a while maintaining the bendable section (②) in a form that is smoothly connected to the first section (①) without lifting.

[0095] According to one embodiment, the support sheet (470) can make elements (e.g., multi-bar structure (480)) located inside the electronic device (101) substantially invisible through the flexible display (230).

[0096] In an expanded state (e.g., the open state of FIG. 3a), an uneven screen may be provided due to lifting caused by the elasticity of the flexible display (230) and / or support sheet (470). According to various embodiments, a tension structure (not shown) for the flexible display (230) and / or support sheet (470) may be provided to prevent this. The tension structure can contribute to smooth sliding motion while maintaining tension.

[0097] According to one embodiment, the printed circuit board (490) may be equipped with a processor (e.g., processor (120) of FIG. 1), memory (e.g., memory (130) of FIG. 1), and / or an interface (e.g., interface (177) of FIG. 1). The processor may include, for example, one or more of a central processing unit, an application processor, a graphics processing unit, an image signal processor, a sensor hub processor, or a communication processor.

[0098] The memory may include, for example, volatile memory or non-volatile memory. The interface may include, for example, HDMI (high definition multimedia interface), USB (universal serial bus) interface, SD card interface, and / or audio interface. The interface may, for example, electrically or physically connect the electronic device (101) to an external electronic device and may include a USB connector, an SD card / MMC connector, or an audio connector.

[0099] The electronic device (101) may include various other elements disposed on or electrically connected to the printed circuit board (490). For example, the electronic device (101) may include a battery (not shown) located between the first support member (410) and the second support member (420), or between the second support member (420) and the back cover (212). The battery (not shown) is a device for supplying power to at least one component of the electronic device (101) and may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell. The battery (not shown) may be integrally disposed inside the electronic device (101) or may be detachably disposed from the electronic device (101).

[0100] According to one embodiment, the electronic device (101) may include an antenna (not shown) positioned between the first support member (410) and the second support member (420), or between the second support member (420) and the back cover (212). The antenna (not shown) may include, for example, a near field communication (NFC) antenna, a wireless charging antenna, and / or a magnetic secure transmission (MST) antenna. The antenna (not shown) may, for example, communicate near-field with an external device or wirelessly transmit and receive power required for charging. In another embodiment, the antenna structure may be formed by a part of the first side cover (213) and / or the second side cover (214) or a combination thereof.

[0101] According to one embodiment, the electronic device (101) may include a flexible printed circuit board (FPCB, flexible printed circuit board) (237) that electrically connects a flexible display (230) and a printed circuit board (490). For example, the flexible printed circuit board (237) may be electrically connected to the printed circuit board (490) through an opening (not shown) formed in a sliding plate (220) and an opening (not shown) formed in a first support member (410).

[0102] FIGS. 5a to 5g are drawings illustrating the structure of an expandable display of an electronic device according to various embodiments.

[0103] Referring to FIGS. 5a to 5g, an electronic device according to various embodiments (e.g., the electronic device (101) of FIG. 1) may include a housing structure in which a display can be extended in at least one direction among up, down, left, and right.

[0104] As illustrated in FIG. 5a, the electronic device may be implemented to enable sliding movement in one direction. For example, the electronic device may include a display (510) that is expandable in a first direction (e.g., to the right). For example, in a first state where the display (510) is not expanded (e.g., closed state), the screen may be displayed through a first display area (511), and a second display area (512) may be received within a housing and remain in a deactivated state.

[0105] According to one embodiment, the electronic device can be switched from a first state to a second state by user operation or preset input.

[0106] According to one embodiment, when the electronic device transitions from a first state to a second state, the second display area (512) may be drawn out in a first direction and exposed to the outside. In the second state (e.g., open state) in which the display (510) is extended, the electronic device may switch the second display area (512) to an active state and display a screen through the first display area (511) and the second display area (512). According to another embodiment, when the electronic device transitions from a first state to a second state, if the second housing is unidirectional (e.g., in a first direction) relative to the first housing, at least a portion of the display (510) housed in the first housing (e.g., corresponding to a portion of the left side of the first display area (511) in the illustrated drawing) may be drawn out, and the display area of ​​the display (510) may be extended. When the electronic device transitions from a second state to a first state, if the second housing is slid in a second direction relative to the first housing, a part of the display (510) (e.g., corresponding to a part of the left side of the first display area (511) in the illustrated drawing) is drawn into the first housing, and the display area of ​​the display (510) can be reduced. According to one embodiment, in the case of the electronic device, in the first state (e.g., closed state), the display area of ​​the display (510) (e.g., first display area (511)) may have, for example, a 4:3 ratio, and in the second state (e.g., open state), the display area of ​​the display (510) (e.g., first display area (511) and second display area (512)) may be expanded to, for example, a 21:9 ratio.

[0107] According to another embodiment, the electronic device may include a first display area (516) that displays a screen in a first state (e.g., closed state) in which the display (515) is not extended, and a second display area (517) that is extendable in a second direction (e.g., left direction) and displays a screen in a second state (e.g., open state) in which the display (515) is extended.

[0108] As illustrated in FIG. 5b, the electronic device may include a display that is expandable in a third direction (e.g., upward direction) or a fifth direction (e.g., downward direction).

[0109] According to one embodiment, the electronic device may include a first display area (521) that displays a screen in a first state where the display (520) is not extended, and a second display area (522) that is expandable in a third direction and displays a screen in a second extended state. According to another embodiment, the electronic device may include a first display area (526) that displays a screen in a first state where the display (525) is not extended, and a second display area (527) that is expandable in a fourth direction and displays a screen in a second extended state.

[0110] As illustrated in FIG. 5c, the electronic device may include a display that is expandable in both left and right directions or in both up and down directions.

[0111] According to one embodiment, the electronic device may include a first display area (531) that displays a screen in a first state where the display (530) is not expanded, a second display area (532) that is expandable in a first direction and displays a screen in an expanded second state, and a third display area (533) that is expandable in a second direction and displays a screen in an expanded second state. In this case, at least one of the second display area (532) and the third display area (533) may be expanded depending on user operation, a preset input, or the type of content being output.

[0112] According to one embodiment, an electronic device having a housing structure illustrated in FIG. 5c may be implemented to enable sliding movement in both directions. For example, in a first state (e.g., closed state), the display area of ​​the display (530) (e.g., first display area (531)) of the electronic device may have, for example, a 21:9 ratio, and in a second state (e.g., open state), the display area of ​​the display (530) (e.g., first display area (531), second display area (532) and third display area (533)) may be expanded to, for example, a 4:3 ratio. When the electronic device transitions from a first state to a second state, if the second housing and the third housing are slid in both directions relative to the first housing, for example, in a first direction (e.g., left direction) and a second direction (e.g., right direction), a part of the display (532) housed in the first housing (e.g., the second display area (532)) is pulled out in the first direction, and another part (e.g., the third display area (533)) is pulled out in the second direction, so that the display area of ​​the display (530) can be expanded. Although not shown in the drawing, the electronic device may expand only a part of the display (530) in the first direction (e.g., the first display area (531) and the second display area (532)) or expand only another part of the display (530) in the second direction (e.g., the first display area (531) and the third display area (533)).

[0113] According to another embodiment, the electronic device may include a first display area (536) that displays a screen in a first state where the display (535) is not extended, a second display area (537) that is extendable in a third direction and displays a screen in an extended second state, and a third display area (538) that is extendable in a fourth direction and displays a screen in an extended second state.

[0114] According to various embodiments, the electronic device may include a display that is expandable in both the upward direction (or downward direction) and the right direction (or left direction).

[0115] As illustrated in FIG. 5d, the electronic device may include a display capable of stepwise expansion, and the display may be expanded only partially.

[0116] According to one embodiment, the electronic device may include a first display area (551) that displays a screen in a first state where the display (550) is not expanded, a second display area (552) that displays a screen and can be expanded in a first direction (e.g., right direction) in a second expanded state, and a third display area (553) that displays a screen and can be further expanded in a first direction (e.g., right direction) in a third expanded state.

[0117] According to one embodiment, the electronic device may display a screen by activating only the second display area (552) of the display (550). According to one embodiment, the electronic device may display a screen by activating both the second display area (552) and the third display area (553) of the display (550). For example, the display (550) is fixed through a support structure when extended to the second display area (552), and may be extended from the second display area (552) to the third display area (553) depending on additional force.

[0118] As illustrated in FIG. 5e, the electronic device may include a display that is expandable in a third direction (e.g., upward direction) or a fourth direction (e.g., downward direction). According to one embodiment, the electronic device illustrated in FIG. 5e may include a bar-type form factor in a closed state.

[0119] According to one embodiment, the electronic device may include a first display area (561) that displays a screen in a first state where the display (560) is not extended, and a second display area (562) that displays a screen in a second state where it is extended and can be extended in a third direction. According to another embodiment, the electronic device may include a first display area (566) that displays a screen in a first state where the display (565) is not extended, and a second display area (567) that displays a screen in a second state where it is extended and can be extended in a fourth direction.

[0120] As illustrated in FIG. 5f, the electronic device may include a display that is expandable in both upward and downward directions. According to one embodiment, the electronic device illustrated in FIG. 5f may include a bar-type form factor in a closed state.

[0121] According to one embodiment, the electronic device may include a first display area (571) that displays a screen in a first state where the display (570) is not expanded, a second display area (572) that is expandable in a third direction and displays a screen in an expanded second state, and a third display area (573) that is expandable in a fourth direction and displays a screen in an expanded second state. In this case, at least one of the second display area (532) and the third display area (533) may be expanded according to user operation, preset input, or type of output content.

[0122] The electronic device (101) in the various embodiments described below may include a display having at least one structure of FIGS. 2a to 5f. According to the various embodiments, in addition to the form factor described in FIGS. 2a to 5f, various expandable form factors of various forms of the display may be included.

[0123] According to various embodiments, the electronic device (101) may be implemented in various form factors according to various sliding movements of the display, in addition to the form factors of the electronic device of FIGS. 5a to 5f. An example of this is shown in FIG. 5g.

[0124] For example, as illustrated in FIG. 5g, the electronic device may include various form factors such as a rollable (or slideable) device (580, 585, 590, 595) capable of expanding the area of ​​the display in a rolling manner and / or a sliding manner. According to one embodiment, as illustrated in FIG. 5g, the electronic device may be implemented in various forms, and depending on the implementation form of the electronic device, the display may be provided in various ways.

[0125] According to one embodiment, an electronic device (e.g., 580, 585, 590, 595) may include a roll-up type display (e.g., a rollable display) within a housing. According to one embodiment, the electronic device may mean an electronic device in which the display is capable of bending and deforming, so that at least a portion may be wound or rolled, or stored inside a housing (not shown). Depending on the user's needs, the electronic device may expand the screen display area by unfolding the display or by exposing a larger area of ​​the display to the outside. For example, the electronic device (101) may have a different area of ​​the display exposed to the outside depending on the extent to which the user unfolds the display.

[0126] According to one embodiment, the electronic device (101) includes a housing structure for protecting a circularly rolled display, and the display may operate in a structure that opens (e.g., expands) inside the housing. For example, as illustrated in FIG. 5g, at least a portion of the display may be housed within a cylindrical housing or a flat housing.

[0127] According to various embodiments, the electronic device (101) may be manually switched by a user or automatically switched via a driving mechanism (e.g., a driving motor, a reduction gear module and / or a gear assembly) placed inside the housing in a change of the display state (e.g., open state, intermediated state, closed state). According to one embodiment, the driving mechanism may be triggered to operate based on user input. According to one embodiment, user input to trigger the operation of the driving mechanism may include touch input, force touch input, and / or gesture input through the display module (160). For example, when a signal is generated from various sensors, such as a pressure sensor, the electronic device (101) may be switched from a closed state to an open state, or from an open state to a closed state. For example, when the electronic device (101) is held or grasped by hand, a squeeze gesture in which a part of the hand (e.g., palm or fingers) presses within a designated section of the electronic device (101) may be detected by a sensor, and in response, the electronic device (101) may be switched from a closed state to an open state, or from an open state to a closed state. In another embodiment, user input for triggering the operation of the driving mechanism may include voice input (or voice input) or input from a physical button visually exposed to the outside of the housing.

[0128] As exemplified above, according to various embodiments, the electronic device (101) can be implemented as a device capable of changing the display area of ​​the display in various rolling (or sliding) ways.

[0129] FIG. 6 is a block diagram (300) illustrating a camera module (180) according to various embodiments.

[0130] Referring to FIG. 6, the camera module (180) may include a lens assembly (310), a flash (320), an image sensor (330), an image stabilizer (340), a memory (350) (e.g., a buffer memory), or an image signal processor (360).

[0131] A lens assembly (310) can collect light emitted from a subject that is the subject of image capture. The lens assembly (310) may include one or more lenses. According to one embodiment, a camera module (180) may include a plurality of lens assemblies (310). In this case, the camera module (180) may form, for example, a dual camera, a 360-degree camera, or a spherical camera. Some of the plurality of lens assemblies (310) may have the same lens properties (e.g., angle of view, focal length, autofocus, f-number, or optical zoom), or at least one lens assembly may have one or more lens properties different from the lens properties of other lens assemblies. The lens assembly (310) may include, for example, a wide-angle lens or a telephoto lens.

[0132] The flash (320) may emit light used to enhance light emitted or reflected from a subject. According to one embodiment, the flash (320) may include one or more light-emitting diodes (e.g., RGB (red-green-blue) LED, white LED, infrared LED, or ultraviolet LED), or a xenon lamp.

[0133] The image sensor (330) can acquire an image corresponding to the subject by converting light emitted or reflected from the subject and transmitted through the lens assembly (310) into an electrical signal. According to one embodiment, the image sensor (330) may include, for example, one image sensor selected from image sensors with different attributes such as an RGB sensor, a BW (black and white) sensor, an IR sensor, or a UV sensor, a plurality of image sensors having the same attribute, or a plurality of image sensors having different attributes. Each image sensor included in the image sensor (330) may be implemented using, for example, a CCD (charged coupled device) sensor or a CMOS (complementary metal oxide semiconductor) sensor.

[0134] The image stabilizer (340) may move at least one lens or image sensor (330) included in the lens assembly (310) in a specific direction in response to the movement of the camera module (180) or the electronic device (101) containing it, or control the operational characteristics of the image sensor (330) (e.g., adjusting read-out timing). This allows for compensating for at least some of the negative effects caused by the movement on the image being captured. According to one embodiment, the image stabilizer (340) may detect such movement of the camera module (180) or the electronic device (101) using a gyroscope sensor (not shown) or an accelerometer sensor (not shown) placed inside or outside the camera module (180). According to one embodiment, the image stabilizer (340) may be implemented, for example, as an optical image stabilizer.

[0135] The memory (350) may temporarily store at least a portion of the image acquired through the image sensor (330) for the next image processing operation. For example, if image acquisition by the shutter is delayed or multiple images are acquired at high speed, the acquired original image (e.g., a Bayer-patterned image or a high-resolution image) may be stored in the memory (350), and the corresponding copy image (e.g., a low-resolution image) may be previewed through the display module (160). Subsequently, when a specified condition is satisfied (e.g., user input or system command), at least a portion of the original image stored in the memory (350) may be acquired and processed by, for example, an image signal processor (360). According to one embodiment, the memory (350) may be configured as at least a portion of the memory (130) or as a separate memory that operates independently thereof.

[0136] The image signal processor (360) can perform one or more image processing on an image acquired through the image sensor (330) or an image stored in memory (350). The one or more image processing may include, for example, depth map generation, 3D modeling, panorama generation, feature point extraction, image synthesis, or image compensation (e.g., noise reduction, resolution adjustment, brightness adjustment, blurring, sharpening, or softing). Additionally or generally, the image signal processor (360) can perform control (e.g., exposure time control, or readout timing control, etc.) over at least one of the components included in the camera module (180) (e.g., image sensor (330)). An image processed by the image signal processor (360) may be stored back in memory (350) for further processing or provided to an external component of the camera module (180) (e.g., memory (130), display module (160), electronic device (102), electronic device (104), or server (108)). According to one embodiment, the image signal processor (360) may be configured as at least part of the processor (120) or as a separate processor operating independently of the processor (120). If the image signal processor (360) is configured as a separate processor from the processor (120), at least one image processed by the image signal processor (360) may be displayed through the display module (160) as is or after further image processing by the processor (120).

[0137] According to one embodiment, the electronic device (101) may include a plurality of camera modules (180), each having different attributes or functions. In this case, for example, at least one of the plurality of camera modules (180) may be a wide-angle camera and at least another may be a telephoto camera. Similarly, at least one of the plurality of camera modules (180) may be a front camera and at least another may be a rear camera.

[0138] FIG. 7 is a block diagram relating to the electronic device (101) of FIG. 2a according to one embodiment.

[0139] Referring to FIG. 7, in one embodiment, the electronic device (101) may include a processor (710) (e.g., processor (120) of FIG. 1), a memory (720) (e.g., memory (130) of FIG. 1), a display module (730) (e.g., display module (160) of FIG. 1), a sensor IC (integrated circuit) (740), a tension control module (750), a sensor module (760) (e.g., sensor module (176) of FIG. 1), or an input module (770) (e.g., input module (150) of FIG. 1). According to various embodiments, the electronic device (101) may be the electronic device (101) of FIG. 1, or may be implemented by including at least some of the components of the electronic device (101) of FIG. 1, or additionally including other components. According to some embodiments, the electronic device (101) may be implemented by omitting some of the components of the electronic device (101) of FIG. 1.

[0140] A processor (710) (e.g., processor (120) of FIG. 1) may include, for example, a microcontroller unit (MCU) and may control a number of hardware components connected to the processor (710) by running an operating system (OS) or an embedded software program. The processor (710) may control a number of hardware components according to instructions (e.g., program (140) of FIG. 1) stored in memory (720) (e.g., memory (130) of FIG. 1).

[0141] According to one embodiment, a processor (710) (e.g., processor (120) of FIG. 1) can capture an image based on a specified output resolution in a first state (e.g., open state or closed state) of a display module (160). According to one embodiment, the processor (710) can display a preview screen based on a first preview resolution according to the first state of the display module (160). According to one embodiment, while displaying the preview screen, the processor (710) can detect a state change in which the display module (160) transitions from the first state to a second state. According to one embodiment, the processor (710) can display a preview screen based on a second preview resolution according to the second state of the display module (160) based on the state change detection. According to one embodiment, the processor (120) can identify a hidden area based on a change amount (e.g., input amount or output amount) of the display module (160). According to one embodiment, the processor (710) may acquire and provide (e.g., store) a first image based on output resolution and a second image based on a hidden area based on a change in the state of the display module (160) while performing image capture. According to one embodiment, when capturing an image in an electronic device (101) including an expandable display module (160), the processor (120) may capture an image corresponding to a user's intentional preview based on the amount of change of the display module (160) (e.g., input amount or output amount), and when playing the corresponding image, may provide the user with a continuous and natural image (e.g., an image with changed (corrected) size and aspect ratio).

[0142] The display module (730) (e.g., the display module (160) of FIG. 1) may include, for example, a flexible display (230) or a display driving circuit (732).

[0143] According to one embodiment, the flexible display (230) may be implemented such that a part thereof (e.g., the bendable section (②) of FIG. 4) can be withdrawn from the internal space of the electronic device (101). For example, when the electronic device (101) is switched from a closed state (see FIG. 2a) to an open state (see FIG. 3a), the bendable section (②) of the flexible display (230) is withdrawn from the internal space of the electronic device (101) by sliding, thereby expanding the screen. When the electronic device (101) is switched from an open state to a closed state, the bendable section (②) is retracted into the internal space of the electronic device (101) by sliding, thereby shrinking the screen.

[0144] According to one embodiment, the display driving circuit (732) is a circuit for controlling the flexible display (230) and may include, for example, a DDI (display drive integrated circuit) or a DDI chip. According to one embodiment, the display driving circuit (732) may include a TDDI (touch display driver IC) arranged in a COP (chip on panel) or COF (chip on film) manner. A processor (710) (e.g., AP, application processor) may be placed on the printed circuit board (490) of FIG. 4, and a signal commanded by the processor (710) may be transmitted to the display driving circuit (732). The display driving circuit (732) acts as a signal path between the flexible display (230) and the processor (710) to control pixels through the TFTs within the flexible display (230). For example, the display driving circuit (732) has the function of turning pixels included in the flexible display (230) on or off and can be electrically connected to the gate electrode of the TFT.

[0145] The display driving circuit (732) has the function of creating a color difference by adjusting the amount of RGB (red, green, blue) signals of the pixels and can be electrically connected to the source electrode of the TFT. The TFT may include a gate line that electrically connects the display driving circuit (732) and the gate electrode of the TFT, and a source line (or data line) that electrically connects the display driving circuit (732) and the source electrode of the TFT. According to various embodiments, the display driving circuit (732) may operate in correspondence with an RGBW (red, green, blue, white) method in which a white pixel is added to the RGB pixels.

[0146] According to various embodiments, the display driving circuit (732) may be a DDI package. The DDI package may include a DDI (or DDI chip), a timing controller (T-CON), a graphics RAM (GRAM), or power generating circuits. According to various embodiments, the graphics RAM may be omitted, or a memory provided separately from the display driving circuit (732) may be utilized. The timing controller may convert a data signal input from the processor (710) into a signal required by the DDI. The timing controller may play a role in adjusting the input data information into a signal suitable for the gate driver (or gate IC) and source driver (or source IC) of the DDI. The graphics RAM may serve as a memory that temporarily stores data to be input to the driver (or IC) of the DDI. The graphics RAM may store the input signal and send it back to the driver of the DDI, and at this time, it may interact with the timing controller to process the signal. The power driving unit can generate a voltage to drive the flexible display (230) and supply the necessary voltage to the gate driver and source driver of the DDI.

[0147] According to one embodiment, the flexible display (230) may include a touch detection circuit (or touch sensor) (731). The touch detection circuit (731) may include, for example, a transmitter (Tx) including a plurality of first electrode lines (or a plurality of driving electrodes) and a receiver (Rx) including a plurality of second electrode lines (or a plurality of receiving electrodes). According to one embodiment, a sensor IC (integrated circuit) (740) may supply current (e.g., alternating current) to the touch detection circuit (731), and an electric field may be formed between the transmitter and the receiver of the touch detection circuit (731). The sensor IC (740) may convert an analog signal obtained through the touch detection circuit (731) into a digital signal. For example, when a finger comes into contact with the screen (see screen (2301) in FIG. 2a or FIG. 3a) or reaches within a critical distance from the screen, a change in the electric field occurs, and a change in capacitance (or voltage drop) may occur. When the change in capacitance exceeds a critical value, the sensor IC (740) may generate an electrical signal regarding coordinates on the screen as a valid touch input or hovering input and output it to the processor (710). The processor (710) may recognize coordinates on the screen based on the electrical signal received from the sensor IC (740). The sensor IC (740) may be placed on the printed circuit board (490) of FIG. 4.

[0148] According to one embodiment, the sensor IC (740) may include a touch controller integrated circuit. The touch controller IC can perform various functions such as noise filtering, noise removal, and sensing data extraction in relation to the touch detection circuit (731). According to various embodiments, the touch controller IC may include various circuits such as an analog-digital converter (ADC), a digital signal processor (DSP), and / or a micro control unit (MCU).

[0149] According to one embodiment, the tension control module (750) may be included in, for example, a tension structure that provides tension acting on the flexible display (230), or connected to the tension structure. The tension control module (750) may control the tension acting on the flexible display (230) according to a control signal from the processor (710).

[0150] The sensor module (760) (e.g., the sensor module (176) of FIG. 1) may, for example, measure physical quantities or detect the operating state of the electronic device (101) and generate a corresponding electrical signal or data value. According to one embodiment, the sensor module (760) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor. According to various embodiments, the sensor module (760) may further include at least one control circuit for controlling at least one sensor included therein.

[0151] According to one embodiment, the sensor module (760) may be a device that detects the tilted angle of the electronic device (101) with respect to the surface and / or the direction in which the electronic device (101) faces in a three-dimensional coordinate system using sensing data obtained from at least one sensor among a plurality of sensors. However, it is not limited thereto, and various sensors capable of obtaining information regarding the tilted angle of the electronic device (101) (e.g., azimuth) may be used. For example, an accelerometer may sense information regarding the linear movement of the electronic device (101) and / or acceleration of the electronic device (101) along three axes. A gyroscope may sense information related to the rotation of the electronic device (101), and a geomagnetic sensor may sense information regarding the direction in which the electronic device (101) faces within an absolute coordinate system. According to one embodiment, the processor (710) may use 9-axis motion data obtained using the gyroscope and the geomagnetic sensor. For example, the processor (710) can form a virtual coordinate space based on the azimuth (e.g., yaw, pitch, and / or roll values) measured from the 9-axis motion data, and can divide one area of ​​the virtual coordinate space into a landscape range and another area into a portrait range.

[0152] An input module (770) (e.g., the input module (150) of FIG. 1) can receive user input, for example. The input module (770) may include, for example, a key input device. According to one embodiment, the key input device may include various types of keys, such as physical keys, capacitive keys, or optical keys, for example. The input module (770) may include various other types of user interfaces.

[0153] According to one embodiment, the memory (720) (e.g., the memory (130) of FIG. 1) may store a closed state / open state check instruction (721), a lift phenomenon check instruction (722), or a tension control instruction (723).

[0154] According to one embodiment, the closed state / open state check instruction (721) may include instructions that cause the processor (710) to check the closed state (e.g., see FIG. 2a), open state (e.g., see FIG. 3a), or transition between the closed state and the open state of the electronic device (101) using at least one sensor included in the sensor module (760).

[0155] For example, the processor (710) can use a magnetic sensor (e.g., hall IC) of the sensor module (760) to determine the closed state, open state, or transition between the closed state and the open state of the electronic device (101). The magnetic sensor may be placed on the support member assembly (400) of FIG. 4 (e.g., the first support member (410)). A magnetic body (e.g., magnetic) may be placed on the sliding plate (220) of FIG. 4. When the electronic device (101) is in the open state, the magnetic sensor is moved away from the magnetic body compared to the closed state, and it may be difficult to detect the magnetic body. When the electronic device (101) is in the closed state, the magnetic sensor is positioned adjacent to or facing the magnetic body so that it can detect the magnetic body. The magnetic sensor can provide an electrical signal generated by detecting a magnetic material to the processor (710), and the processor (710) can check the closed state of the electronic device (101) based on the electrical signal from the magnetic sensor.

[0156] According to various embodiments, the magnetic sensor may be driven continuously or periodically using a constant power source. When an electrical signal is detected continuously or periodically from the magnetic sensor, the processor (710) can determine the closed state of the electronic device (101). According to one embodiment, the processor (710) can determine that the electronic device (700) is switched from an open state to a closed state or from a closed state to an open state using the magnetic sensor. According to some embodiments, when the electronic device (700) is in an open state, the magnetic sensor may be positioned adjacent to or facing the magnetic body to detect the magnetic body. According to various embodiments, the magnetic sensor may be positioned on the sliding plate (220) of FIG. 4, and the magnetic body may be positioned on the support member assembly (400) of FIG. 4.

[0157] According to various embodiments, the first magnetic sensor and the second magnetic sensor may be positioned at different locations on the support member assembly (400) of FIG. 4 (e.g., the first support member (410)). The magnetic body may be positioned on the sliding plate (220) of FIG. 4. When the electronic device (101) is in a closed state, the first magnetic sensor may be positioned adjacent to or facing the magnetic body to detect the magnetic body. When the electronic device (101) is in an open state, the second magnetic sensor may be positioned adjacent to or facing the magnetic body to detect the magnetic body. When an electrical signal is detected from the first magnetic sensor, the processor (710) may determine the closed state of the electronic device (101). When an electrical signal is detected from the second magnetic sensor, the processor (710) may determine the open state of the electronic device (101).

[0158] According to various embodiments, various other sensors may be utilized to detect the closed state, open state, or transition between the closed state and the open state of the electronic device (101). For example, referring to FIG. 4, a sensor capable of detecting the position and / or movement of the sliding plate (220), the flexible display (230), or the support sheet (470) may be utilized. As another example, referring to FIG. 4, a sensor capable of detecting the rotation of the pulley (460) may be utilized.

[0159] According to some embodiments (not shown), a first contact may be placed on a support member assembly (400) of FIG. 4 (e.g., a first support member (410)), and a second contact may be placed on a sliding plate (220) of FIG. 4. When the electronic device (101) is in a closed or open state, the first contact and the second contact may be physically in contact and energized. A processor (710) may determine the closed state, open state, or transition between the closed state and the open state of the electronic device (101) based on the energization between the first contact and the second contact.

[0160] According to one embodiment, the lifting phenomenon check instruction (722) may include instructions that cause the processor (710) to check whether there is a lifting phenomenon in the bendable section (②) of the flexible display (230) (e.g., see FIG. 4) using the touch detection circuit (731) and the sensor IC (740). Based on the lifting phenomenon check instruction (722), the processor (710) may detect a lifting phenomenon in the bendable section (②) of the flexible display (230).

[0161] According to one embodiment, the tension control instruction (723) may include instructions that cause the processor (710) to control the tension of the flexible display (230) using the tension control module (750).

[0162] An electronic device (101) according to various embodiments of the present disclosure comprises a camera module (e.g., camera module (180) of FIG. 1), a display module (e.g., display module (160) of FIG. 1), and a processor (e.g., processor (120) of FIG. 1 or processor (710) of FIG. 7), wherein the processor (120) captures an image based on an output resolution specified in a first state of the display module (160), displays a preview screen based on a first preview resolution according to the first state of the display module (160), detects a state change in which the display module (160) transitions from a first state to a second state, displays a preview screen based on a second preview resolution according to the second state of the display module (160), identifies a hidden area based on a change amount of the display module (160), and, while performing image capture, based on a state change of the display module (160), the first image based on the output resolution and the hidden It is possible to acquire a second image based on the region.

[0163] According to various embodiments of the present disclosure, the processor (120) may control the camera module (180) to capture an image based on the specified output resolution while performing image capture. According to various embodiments of the present disclosure, the output resolution may include a resolution corresponding to a full preview screen corresponding to an open state of the display module (160) or an initial image resolution set corresponding to the first state at the time of capture.

[0164] According to various embodiments of the present disclosure, the processor (120) may control the display module (160) to display a preview screen related to an image obtained through the camera module (180) based on a first preview resolution according to the first state when performing image shooting. According to various embodiments of the present disclosure, the processor (120) may control the display module (160) to display a preview screen related to an image obtained through the camera module (180) based on a second preview resolution according to the second state, based on the state change while performing image shooting.

[0165] According to various embodiments of the present disclosure, the state change may include changing the display ratio of the display area of ​​the display module (160) based on the transition of the display module (160) from an open state to a closed state or from a closed state to an open state while the image capture is performed.

[0166] According to various embodiments of the present disclosure, the processor (120) may create the hidden area based on the input amount of the display module (160) when the display module (160) is in a state change from an open state to a closed state. According to various embodiments of the present disclosure, the processor (120) may create the hidden area based on the output amount of the display module (160) when the display module (160) is in a state change from a closed state to an open state.

[0167] According to various embodiments of the present disclosure, the processor (120) may hide the remaining area other than the preview area within the output resolution area when the display module (160) is in a state change from an open state to a closed state. According to various embodiments of the present disclosure, the processor (120) may expand the preview area within the output resolution area and hide the expanded preview area when the display module (160) is in a state change from a closed state to an open state.

[0168] According to various embodiments of the present disclosure, the processor (120) may maintain the output resolution based on the state change and generate a hidden area corresponding to the state change of the display module (160). According to various embodiments of the present disclosure, the hidden area may include, in addition to the area corresponding to the preview screen, an area that is variable according to the amount of change of the display module and is not visible as a preview, and may represent a target area where at least one designated effect among blackout, blur, and / or mono is processed.

[0169] According to various embodiments of the present disclosure, the processor (120) may acquire a first image captured according to the output resolution while performing image capture, and acquire a second image based on post-processing correction of an area corresponding to the hidden area in the first image.

[0170] According to various embodiments of the present disclosure, the first image may include an image captured based on the output resolution. According to various embodiments of the present disclosure, the second image may include an image portion captured based on the output resolution and an image portion in which an effect designated in the hidden area is processed according to a change in the state of the display module.

[0171] According to various embodiments of the present disclosure, the processor (120) may simultaneously capture a first image captured according to the output resolution and a second image excluding the hidden area while performing the image capture, and at the end of the image capture, save the first image and the second image respectively.

[0172] Hereinafter, the operation method of the electronic device (101) of various embodiments is described in detail. According to various embodiments, the operations performed by the electronic device (101) described below may be executed by a processor (e.g., the processor (120) of FIG. 1 and / or the processor (710) of FIG. 7) (hereinafter referred to as 'processor (120)') comprising at least one processing circuitry of the electronic device (101). According to one embodiment, the operations performed by the electronic device (101) may be executed by instructions that are stored in memory (130) and cause the processor (120) to operate when executed.

[0173] FIG. 8 is a flowchart illustrating the operation method of an electronic device according to various embodiments.

[0174] Referring to FIG. 8, in operation 801, the processor (120) of the electronic device (101) can detect the execution of video recording. According to one embodiment, the processor (120) may be in a state of displaying an execution screen (or user interface) (e.g., preview) of an application related to video recording (e.g., camera application) through a display module (160). According to one embodiment, while displaying the execution screen of the application through the display module (160), the processor (120) can detect the execution of video recording based on user input for executing video recording (e.g., video recording).

[0175] In operation 803, the processor (120) can capture an image based on an output resolution (or initial resolution) specified in a first state of the display module (160). According to one embodiment, when the processor (120) executes image capture, it can control the camera module (180) to capture an image based on an output resolution corresponding to a first state (e.g., open state, intermediate state, or closed state). According to one embodiment, the output resolution may include a resolution corresponding to a full preview screen corresponding to the open state of the display module (160) or an initial image resolution set corresponding to the current state (e.g., first state) at the time of capture.

[0176] In operation 805, the processor (120) may display a preview screen based on a first preview resolution according to a first state of the display module (160). According to one embodiment, when the processor (120) executes video recording, the display module (160) may control the display module (160) to display a preview screen related to an image acquired through the camera module (180) based on a first preview resolution (e.g., open state, intermediate state, or closed state) according to a first state (or current state) of the electronic device (101) (e.g., open state, intermediate state, or closed state). An example of this is illustrated in FIGS. 9a and 9b and / or FIGS. 12a and 12b.

[0177] According to one embodiment, operations 803 and 805 are illustrated for convenience of explanation and are not limited to the illustrated order. For example, operations 803 and 805 may be performed in parallel or simultaneously based on the timing of the image capture.

[0178] In operation 807, the processor (120) can detect a state change in which the display module (160) changes from a first state (or current state) (e.g., open state, intermediate state, or closed state) to a second state (or a state different from the first state) (e.g., closed state, intermediate state, or open state). For example, the processor (120) can detect a state change in which the preview resolution of the display module (160) changes (or the display ratio of the display area changes) while performing video recording. According to one embodiment, the processor (120) can detect that the display module (160) switches from an open state to a closed state, or from a closed state to an open state, while performing video recording. According to one embodiment, the state change may include a change in the display ratio of the display area of ​​the display module (160) based on the switch of the display module (160) from an open state to a closed state, or from a closed state to an open state, while performing video recording.

[0179] In operation 809, the processor (120) may display a preview screen based on a second preview resolution according to a second state of the display module (160). According to one embodiment, the processor (120) may control the display module (160) to display a preview screen related to an image acquired through the camera module (180) while performing image capture, based on a second preview resolution according to a second state (or a state different from the first state) of the electronic device (101) (e.g., changing from an open state to a closed state or changing from a closed state to an open state). An example of this is illustrated in FIGS. 9a and 9b and / or FIGS. 12a and 12b.

[0180] In operation 811, the processor (120) can identify a hidden area based on the amount of change of the display module (160) (e.g., the amount of withdrawal or the amount of inflow). According to one embodiment, if the change from the first state to the second state of the display module (160) is a state change transitioning from an open state to a closed state, the processor (120) can create a hidden area based on (or proportionally) the amount of inflow of the display module (160) (or the preview ratio that is reduced). According to another embodiment, if the change from the first state to the second state of the display module (160) is a state change transitioning from a closed state to an open state, the processor (120) can create a hidden area based on (or proportionally) the amount of withdrawal of the display module (160) (or the preview ratio that is expanded). According to one embodiment, the hidden area may be generated based on the actual output resolution being captured and the preview resolution (e.g., preview ratio), and may include a remaining area (or an area not visible in the preview) that varies according to the amount of change of the display module (160) in addition to the area corresponding to the preview screen within the entire area corresponding to the output resolution. According to one embodiment, the hidden area may represent a processing target area where a specified effect (e.g., blackout, blur, and / or mono) is processed. According to one embodiment, the hidden area is described with reference to the drawings described below.

[0181] In operation 813, the processor (120) can capture an image based on the output resolution specified in the first state of the display module (160). According to one embodiment, the processor (120) can capture an image (e.g., original image) based on the output resolution (or initial resolution) initially set at the time of capturing the image.

[0182] In operation 815, the processor (120) may acquire a first image based on output resolution and a second image based on hidden areas. According to one embodiment, when the processor (120) captures (or stores) images, the images substantially acquired may include a first image (e.g., original image) captured according to output resolution and a second image (e.g., corrected image) created by post-processing (e.g., specified effect processing) the first image according to hidden areas, and may store the first image and / or the second image. According to another embodiment, when capturing images, the processor (120) may simultaneously capture (e.g., recording) the first image and the second image excluding hidden areas, and when storing, may store the first image and the second image separately.

[0183] FIGS. 9A and 9B are drawings illustrating changes in the state of a display and examples of shooting taken according to the same while shooting is performed in an electronic device according to various embodiments.

[0184] According to one embodiment, FIGS. 9a and 9b may illustrate an example in which an electronic device (101) starts capturing images while the display module (160) is open, and during the image capture, the display module (160) switches from an open state to a closed state, thereby changing the preview screen and capturing images. According to one embodiment, FIG. 9a may illustrate an example in which the display module (160) is reduced horizontally (e.g., slide-in) based on horizontal image capture while the electronic device (101) is open. According to one embodiment, FIG. 9b may illustrate an example in which the display module (160) is reduced vertically based on vertical image capture while the electronic device (101) is open.

[0185] Referring to Fig. 9a, example <901> In this case, the electronic device (101) can perform video recording based on the horizontal direction while the display module (160) is open, according to the user's intention. According to one embodiment, the electronic device (101) can provide various objects (910, 920) related to video recording through a preview screen (900) when recording video. For example, the electronic device (101) can provide a first object (910) (e.g., control object) capable of controlling functions such as pausing, restarting, and / or ending video recording, and / or a second object (920) (e.g., recording object) indicating the state of video recording (e.g., recording state) by placing them in a designated area on the preview screen (900).

[0186] According to one embodiment, the electronic device (101) can be switched from an open state to a closed state based on user input. For example, the electronic device (101) can reduce the display area in a rolling manner and / or a sliding manner in direction A and / or B. In changing the state of the display module (160) (e.g., switching from an open state to a closed state), the electronic device (101) can be switched manually by the user or automatically via a driving mechanism (e.g., a driving motor, a reduction gear module and / or a gear assembly) located inside the housing.

[0187] example <903> Silver can represent an intermediate state in which the electronic device (101) transitions from an open state to a closed state. Example <905> can indicate a closed state of the electronic device (101). In one embodiment, an intermediate state is an example <901> Open state and example of <905> It can represent all operable states between the closed states.

[0188] example <903> and examples <905> In this case, the electronic device (101) can reduce the preview screen (900) in the horizontal direction according to a change in the state of the display module (160) (e.g., rolling or sliding). According to one embodiment, when the state of the display module (160) changes, the electronic device (101) can maintain the actual output resolution being captured (e.g., a resolution corresponding to the area of ​​the entire preview screen (900) in the open state) and set the remaining area (e.g., an invisible area) excluding the area of ​​the preview screen (900) from the entire area corresponding to the output resolution as a hidden area (930). According to one embodiment, the electronic device (101) is an example <901> As shown in [image], at the time of video recording (e.g., start of recording), the output resolution can be set based on a full-screen preview screen (900), and example <903> and examples <905> As shown in the figure, when the state changes, the output resolution set at the time of video recording is fixed and recording is continued, while a hidden area (930) for a corrected image is internally processed (or background processed) in correspondence with the reduced preview screen (900) (or the display ratio of the display area) according to the user's intention. According to one embodiment, the size of the hidden area (930) may be set differently depending on the amount of change of the display module (160) (e.g., input amount or output amount). For example, as illustrated in FIG. 9a and FIG. 9b, the hidden area (930) may be variable (e.g., expanded) in proportion to the amount of input of the display module (160).

[0189] According to one embodiment, the hidden area (930) may be configured in various ways depending on the form factor (or rolling (or sliding) method) of the electronic device (101). For example, if the electronic device (101) is of a form factor that slides in one direction, the hidden area (930) may be integrated into one area (e.g., an area corresponding to the first hidden area (930A) or the second hidden area (930B)) in one direction or in the direction opposite to the one direction, in response to a change in state in one direction of the display module (160). As another example, if the electronic device (101) is of a form factor that slides in both directions, the hidden area (930) may be divided into two areas (e.g., an area corresponding to the first hidden area (930A) and the second hidden area (930B)) in both directions, in response to a change in state in both directions of the display module (160).

[0190] According to one embodiment, when the electronic device (101) switches from an open state to a closed state of the display module (160), it can continue to perform shooting based on the output resolution set at the time of shooting the video, and display a preview screen (900) in which an area corresponding to a hidden area (930) is excluded in correspondence with the preview resolution of the display module (160) that has been reduced in the horizontal direction.

[0191] Referring to Fig. 9b, example <911> In this case, the electronic device (101) can perform video recording based on the vertical orientation while the display module (160) is open, according to the user's intention. According to one embodiment, the electronic device (101) can provide various objects (910, 920) related to video recording through a preview screen (900) when recording video. For example, the electronic device (101) can provide a first object (910) (e.g., control object) capable of controlling functions such as pausing, restarting, and / or ending video recording, and / or a second object (920) (e.g., recording object) indicating the state of video recording (e.g., recording state) by placing them in a designated area on the preview screen (900).

[0192] According to one embodiment, the electronic device (101) can be switched from an open state to a closed state based on user input. For example, the electronic device (101) can reduce the display area by rolling and / or sliding in the C direction and / or D direction. In changing the state of the display module (160) (e.g., switching from an open state to a closed state), the electronic device (101) can be switched manually by the user or automatically via a driving mechanism (e.g., a driving motor, a reduction gear module and / or a gear assembly) located inside the housing.

[0193] example <913> Silver can represent an intermediate state in which the electronic device (101) transitions from an open state to a closed state. Example <915> can indicate a closed state of the electronic device (101). In one embodiment, an intermediate state is an example <911> Open state and example of <915> It can represent all operable states between the closed states.

[0194] example <913> and examples <915> In this case, the electronic device (101) can reduce the preview screen (900) in the vertical direction according to a change in the state of the display module (160) (e.g., rolling or sliding). According to one embodiment, when the state of the display module (160) changes, the electronic device (101) can maintain the actual output resolution being captured (e.g., a resolution corresponding to the area of ​​the entire preview screen (900) in the open state) and set the remaining area (e.g., an invisible area) excluding the area of ​​the preview screen (900) from the entire area corresponding to the output resolution as a hidden area (930). According to one embodiment, the electronic device (101) is an example <911> As shown in [image], at the time of video recording (e.g., start of recording), the output resolution can be set based on a full-screen preview screen (900), and example <913> and examples <915> As shown in the figure, when the state changes, the output resolution set at the time of video recording is fixed and recording is continued, while a hidden area (930) for a corrected image is internally processed (or background processed) in correspondence with the reduced preview screen (900) (or the display ratio of the display area) according to the user's intention. According to one embodiment, the size of the hidden area (930) may be set differently depending on the amount of change of the display module (160) (e.g., input amount or output amount). For example, as illustrated in FIGS. 9a and 9b, the hidden area (930) may be variable (e.g., expanded) in proportion to the amount of input of the display module (160).

[0195] According to one embodiment, the hidden area (930) may be configured in various ways depending on the form factor (or rolling (or sliding) method) of the electronic device (101). For example, if the electronic device (101) is of a form factor that slides in one direction, the hidden area (930) may be integrated into one area (e.g., an area corresponding to the third hidden area (930C) or the fourth hidden area (930D)) in one direction or in the direction opposite to the one direction, in response to a change in state in one direction of the display module (160). As another example, if the electronic device (101) is of a form factor that slides in both directions, the hidden area (930) may be divided into two areas (e.g., areas corresponding to the third hidden area (930C) and the fourth hidden area (930D)) in both directions, in response to a change in state in both directions of the display module (160).

[0196] According to one embodiment, when the electronic device (101) switches from an open state to a closed state of the display module (160), it can continue to perform shooting based on the output resolution set at the time of shooting the video, and display a preview screen (900) in which an area corresponding to a hidden area (900) is excluded in correspondence with the preview resolution of the display module (160) reduced in the vertical direction.

[0197] FIGS. 10a and FIGS. 10b are drawings illustrating examples of playback of images captured according to a change in the state of a display in an electronic device according to various embodiments.

[0198] According to one embodiment, FIGS. 10a and FIGS. 10b may illustrate an example in which, as illustrated in FIG. 9a, an electronic device (101) starts capturing a vertical image with the display module (160) in an open state, and during the image capture, plays back the captured image as the display module (160) transitions from an open state to a closed state (e.g., direction A and / or direction B). According to one embodiment, FIG. 10a may illustrate an example in which the electronic device (101) plays back the image while in an open state. According to one embodiment, FIG. 10b may illustrate an example in which the electronic device (101) plays back the image while in a closed state.

[0199] Referring to Fig. 10a, an example <1001> In this case, the electronic device (101) can perform video playback with the display module (160) open according to user input. According to one embodiment, the electronic device (101) can provide various objects (1010, 1020) related to video playback through the playback screen (1000) when playing video. For example, the electronic device (101) can provide a third object (1010) (e.g., a control object) capable of controlling functions such as pausing, restarting, rewinding, and / or fast-forwarding video playback, and / or a fourth object (1020) (e.g., a progress bar object) indicating the state of video playback by placing them in a designated area on the playback screen (1000).

[0200] example <1003> This can illustrate an example in which the electronic device (101) plays back a portion corresponding to an image captured in an intermediate state where the display module (160) is transitioning from an open state to a closed state. Example <1005> This can be an example in which the electronic device (101) plays back a portion corresponding to an image captured in a closed state of the display module (160).

[0201] example <1003> and examples <1005> In this case, the electronic device (101) may provide a playback screen (1000) in which the display area of ​​an image is variable based on shooting according to a change in the state (e.g., rolling or sliding) of the display module (160). According to one embodiment, the electronic device (101) is an example <1001> In this case, a playback screen (1000) can be displayed based on the entire screen of the display module (160) (e.g., a full screen corresponding to the display area of ​​the display module (160)). According to one embodiment, the electronic device (101) is an example <1003> and examples <1005> In this case, the area set as a hidden area (930) among the entire area corresponding to the output resolution (e.g., correction area (1030) or margin area) is excluded (or effect processed), and a correction image (e.g., a reduced screen having margin among the display area of ​​the display module (160)) corresponding to the reduced preview screen (900) (or the display ratio of the display area) at the time of shooting can be provided. According to one embodiment, the correction area (1030) may correspond to the size of the hidden area (930) which is set differently depending on the amount of change (e.g., input amount or output amount) of the display module (160) at the time of shooting. For example, as illustrated in FIG. 10a, the correction area (1030) may be variable (e.g., expanded) in response to the change in the hidden area (930) in the open state of the display module (160).

[0202] According to one embodiment, when the electronic device (101) plays a captured image in the open state as the display module (160) transitions from the open state to the closed state, as illustrated in FIG. 10a, the playback screen (1000) is the entire screen of the display module (160) (e.g., example <1001> It can be displayed as )), and as playback progresses, both edge areas of the playback screen (1000) (e.g., correction area (1030)) are blacked out (or subjected to a specified effect) and gradually expanded, so that, for example, it can be displayed as if the focus is concentrated on a specific subject.

[0203] Referring to Fig. 10b, example <1011> In this case, the electronic device (101) can perform video playback with the display module (160) closed according to user input. According to one embodiment, the electronic device (101) can provide various objects (1010, 1020) related to video playback through the playback screen (1000) when playing video. For example, the electronic device (101) can provide a third object (1010) (e.g., a control object) capable of controlling functions such as pausing, restarting, rewinding, and / or fast-forwarding video playback, and / or a fourth object (1020) (e.g., a progress bar object) indicating the state of video playback by placing them in a designated area on the playback screen (1000).

[0204] example <1013> This can illustrate an example in which the electronic device (101) plays back a portion corresponding to an image captured in an intermediate state where the display module (160) is transitioning from an open state to a closed state. Example <1015> This can be an example in which the electronic device (101) plays back a portion corresponding to an image captured in a closed state of the display module (160).

[0205] example <1013> and examples <1015> In this case, the electronic device (101) may provide a playback screen (1000) in which the display area of ​​an image is variable based on shooting according to a change in the state (e.g., rolling or sliding) of the display module (160). According to one embodiment, the electronic device (101) is an example <1011> In this case, a playback screen (1000) can be displayed based on a portion of the screen of the display module (160) (e.g., a reduced screen having margins among the display areas of the display module (160)). According to one embodiment, the electronic device (101) is an example <1013> and examples <1015> In this case, the area set as a hidden area (930) among the entire area corresponding to the output resolution (e.g., correction area (1030)) is excluded (or effect processed), and a correction image (e.g., a full screen corresponding to the display area of ​​the display module (160)) corresponding to the reduced preview screen (900) (or the display ratio of the display area) at the time of shooting can be provided. According to one embodiment, the correction area (1030) may correspond to the size of the hidden area (930) which is set differently depending on the amount of change (e.g., input amount or output amount) of the display module (160) at the time of shooting. For example, as illustrated in FIG. 10b, the correction area (1030) may be variable (e.g., reduced) in response to the change in the hidden area (930) when the display module (160) is in a closed state.

[0206] According to one embodiment, when the electronic device (101) plays a captured image in a closed state as the display module (160) transitions from an open state to a closed state, as illustrated in FIG. 10b, both edge areas (e.g., correction area (1030)) of the playback screen (1000) are blacked out (or subjected to a specified effect), so that a part of the screen of the display module (160) (e.g., example <1011> It can be displayed as (e.g., a reduced screen display resized to fit the width of the closed display module (160)) and as playback progresses, the edge areas on both sides of the playback screen (1000) (e.g., correction area (1030)) gradually shrink, so that, for example, it can be displayed as if the focus is concentrated on a specific subject (e.g., a full screen display resized to fit the width of the closed display module (160)).

[0207] As illustrated in FIGS. 10a and 10b, the electronic device (101) can adaptively provide a playback screen (1000) depending on whether the display module (160) is open or closed when playing back a captured image as illustrated in FIG. 9a. For example, the electronic device (101) can resize the playback screen (1000) to match the display ratio (e.g., width) of the display area of ​​the display module (160) so that the entire playback screen (1000) is displayed within the display area. For example, the electronic device (101) can provide the playback screen (1100) by maintaining the ratio and resizing (e.g., shrinking or expanding) to correspond to the initial output resolution.

[0208] FIGS. 11a and FIGS. 11b are drawings illustrating examples of playback of images captured according to a change in the state of a display in an electronic device according to various embodiments.

[0209] According to one embodiment, FIGS. 11a and 11b may illustrate an example in which, as illustrated in FIG. 9b, an electronic device (101) starts capturing a horizontal image with the display module (160) open, and during the image capture, plays back the captured image as the display module (160) transitions from an open state to a closed state (e.g., C direction and / or D direction). According to one embodiment, FIG. 11a may illustrate an example in which the electronic device (101) plays back the image while it is open. According to one embodiment, FIG. 11b may illustrate an example in which the electronic device (101) plays back the image while it is closed.

[0210] Referring to Fig. 11a, an example <1101> In this case, the electronic device (101) can perform video playback with the display module (160) open according to user input. According to one embodiment, the electronic device (101) can provide various objects (1110, 1120) related to video playback through the playback screen (1100) when playing video. For example, the electronic device (101) can provide a third object (1110) (e.g., a control object) capable of controlling functions such as pausing, restarting, rewinding, and / or fast-forwarding video playback, and / or a fourth object (1120) (e.g., a progress bar object) indicating the state of video playback by placing them in a designated area on the playback screen (1000).

[0211] example <1103> This can illustrate an example in which the electronic device (101) plays back a portion corresponding to an image captured in an intermediate state where the display module (160) is transitioning from an open state to a closed state. Example <1105> This can be an example in which the electronic device (101) plays back a portion corresponding to an image captured in a closed state of the display module (160).

[0212] example <1103> and examples <1105> In this case, the electronic device (101) may provide a playback screen (1100) in which the display area of ​​the image is variable based on shooting according to a change in the state (e.g., rolling or sliding) of the display module (160). According to one embodiment, the electronic device (101) is an example <1101> In this case, a playback screen (1100) can be displayed based on the entire screen of the display module (160) (e.g., a full screen corresponding to the display area of ​​the display module (160)). According to one embodiment, the electronic device (101) is an example <1103> and examples <1105> In this case, the area set as a hidden area (930) among the entire area corresponding to the output resolution (e.g., correction area (1130) or margin area) is excluded (or effect processed), and a correction image (e.g., a reduced screen having margin among the display area of ​​the display module (160)) corresponding to the reduced preview screen (900) (or the display ratio of the display area) at the time of shooting can be provided. According to one embodiment, the correction area (1130) may correspond to the size of the hidden area (930) which is set differently depending on the amount of change (e.g., input amount or output amount) of the display module (160) at the time of shooting. For example, as illustrated in FIG. 11a, the correction area (1130) may be variable (e.g., expanded) in response to the change in the hidden area (930) in the open state of the display module (160).

[0213] According to one embodiment, when the electronic device (101) plays a captured image in the open state as the display module (160) transitions from the open state to the closed state, as illustrated in FIG. 11a, the playback screen (1100) is the entire screen of the display module (160) (e.g., example <1101> It can be displayed as )), and as playback progresses, both edge areas of the playback screen (1100) (e.g., correction area (1130)) are blacked out (or subjected to a specified effect) and gradually expanded, so that, for example, it can be displayed as if the focus is concentrated on a specific subject.

[0214] Referring to Fig. 11b, example <1111> In this case, the electronic device (101) can perform video playback with the display module (160) closed according to user input. According to one embodiment, the electronic device (101) can provide various objects (1110, 1120) related to video playback through the playback screen (1100) when playing video. For example, the electronic device (101) can provide a third object (1110) (e.g., a control object) capable of controlling functions such as pausing, restarting, rewinding, and / or fast-forwarding video playback, and / or a fourth object (1120) (e.g., a progress bar object) indicating the state of video playback by placing them in a designated area on the playback screen (1000).

[0215] example <1113> This can illustrate an example in which the electronic device (101) plays back a portion corresponding to an image captured in an intermediate state where the display module (160) is transitioning from an open state to a closed state. Example <1115> This can be an example in which the electronic device (101) plays back a portion corresponding to an image captured in a closed state of the display module (160).

[0216] example <1113> and examples <1115> In this case, the electronic device (101) may provide a playback screen (1100) in which the display area of ​​the image is variable based on shooting according to a change in the state (e.g., rolling or sliding) of the display module (160). According to one embodiment, the electronic device (101) is an example <1111> In this case, a playback screen (1100) can be displayed based on a portion of the screen of the display module (160) (e.g., a reduced screen having margins among the display areas of the display module (160)). According to one embodiment, the electronic device (101) is an example <1113> and examples <1115> In this case, the area set as a hidden area (930) among the entire area corresponding to the output resolution (e.g., correction area (1130)) is excluded (or effect processed), and a correction image (e.g., a full screen corresponding to the display area of ​​the display module (160)) corresponding to the reduced preview screen (900) (or the display ratio of the display area) at the time of shooting can be provided. According to one embodiment, the correction area (1130) may correspond to the size of the hidden area (930) which is set differently depending on the amount of change (e.g., input amount or output amount) of the display module (160) at the time of shooting. For example, as illustrated in FIG. 11b, the correction area (1130) may be variable (e.g., reduced) in response to the change in the hidden area (930) when the display module (160) is in a closed state.

[0217] According to one embodiment, when the electronic device (101) plays a captured image in a closed state as the display module (160) transitions from an open state to a closed state, as illustrated in FIG. 11b, both edge areas (e.g., correction area (1130)) of the playback screen (1100) are blacked out (or subjected to a specified effect), so that a part of the screen of the display module (160) (e.g., example <1111> It can be displayed as (e.g., a reduced screen display resized to fit the width of the closed display module (160)) and as playback progresses, the edge areas on both sides of the playback screen (1100) (e.g., correction area (1130)) gradually shrink, so that, for example, it can be displayed as if the focus is concentrated on a specific subject (e.g., a full screen display resized to fit the width of the closed display module (160)).

[0218] As illustrated in FIGS. 11a and 11b, the electronic device (101) can adaptively provide a playback screen (1100) depending on whether the display module (160) is open or closed when playing back a captured image as illustrated in FIG. 9b. For example, the electronic device (101) can resize the playback screen (1100) to match the display ratio (e.g., width) of the display area of ​​the display module (160) so that the entire playback screen (1100) is displayed within the display area. For example, the electronic device (101) can provide the playback screen (1100) by maintaining the ratio and resizing (e.g., shrinking or expanding) it to correspond to the initial output resolution.

[0219] FIGS. 12a and FIGS. 12b are drawings illustrating changes in the state of a display and examples of shooting taken therefrom while shooting is performed in an electronic device according to various embodiments.

[0220] According to one embodiment, FIG. 12a and FIG. 12b may illustrate an example in which an electronic device (101) starts capturing images while the display module (160) is closed, and during the image capture, the display module (160) switches from a closed state to an open state, thereby changing the preview screen and capturing images. According to one embodiment, FIG. 12a may illustrate an example in which the display module (160) is extended horizontally (e.g., slide out) based on horizontal image capture while the electronic device (101) is closed. According to one embodiment, FIG. 12b may illustrate an example in which the display module (160) is extended vertically based on vertical image capture while the electronic device (101) is closed.

[0221] Referring to Fig. 12a, an example <1201> In this case, the electronic device (101) can perform video recording based on the horizontal direction while the display module (160) is closed, according to the user's intention. According to one embodiment, the electronic device (101) can provide various objects (1210, 1220) related to video recording through a preview screen (1200) when recording video. For example, the electronic device (101) can provide a first object (1210) (e.g., control object) capable of controlling functions such as pausing, restarting, and / or ending video recording, and / or a second object (1220) (e.g., recording object) indicating a state of video recording (e.g., recording state) by placing them in a designated area on the preview screen (1200).

[0222] According to one embodiment, the electronic device (101) can be switched from a closed state to an open state based on user input. For example, the electronic device (101) can expand the display area in a rolling manner and / or a sliding manner in the A' direction and / or B' direction. In changing the state of the display module (160) of the electronic device (101) (e.g., switching from a closed state to an open state), the electronic device (101) can be switched manually by the user or automatically via a driving mechanism (e.g., a driving motor, a reduction gear module and / or a gear assembly) located inside the housing.

[0223] example <1203> Silver can represent an intermediate state in which the electronic device (101) transitions from a closed state to an open state. Example <1205> can indicate an open state of the electronic device (101). In one embodiment, an intermediate state is an example <1201> Closed state and example <1205> It can represent all operable states between the open states.

[0224] example <1203> and examples <1205> In this case, the electronic device (101) can extend the preview screen (1200) horizontally according to a change in the state of the display module (160) (e.g., rolling or sliding). According to one embodiment, when the state of the display module (160) changes, the electronic device (101) may maintain the actual output resolution being captured (e.g., a resolution corresponding to the area of ​​the entire preview screen (1200) in the open state) and not display the remaining area (e.g., an invisible area) excluding the area of ​​the preview screen (1200) from the entire area corresponding to the output resolution. According to one embodiment, the electronic device (101) is an example <1201> As shown in [image], at the time of video recording (e.g., start of recording), the output resolution can be set based on a full-screen preview screen (1200), and example <1203> and examples <1205> As shown in the figure, when the state changes, the output resolution set at the time of video recording is fixed and recording is continued, while the hidden area (1230) for the correction image can be internally processed (or background processed) in correspondence with the expanded preview screen (1200) (or the display ratio of the display area) according to the user's intention. According to one embodiment, the size of the hidden area (1230) may be set differently depending on the amount of change of the display module (160) (e.g., input amount or output amount). For example, as illustrated in FIG. 12a and FIG. 12b, the hidden area (1230) may be variable (e.g., expanded) in proportion to the output amount of the display module (160).

[0225] According to one embodiment, the hidden area (1230) can be configured in various ways depending on the form factor (or rolling (or sliding) method) of the electronic device (101). For example, if the electronic device (101) is of a form factor that slides in one direction, the hidden area (1230) may be integrated into one area (e.g., an area corresponding to the first hidden area (1230A) or the second hidden area (1230B)) in one direction or in the direction opposite to the one direction, in response to a change in state in one direction of the display module (160). As another example, if the electronic device (101) is of a form factor that slides in both directions, the hidden area (1230) may be divided into two areas (e.g., an area corresponding to the first hidden area (1230A) and the second hidden area (1230B)) in both directions, in response to a change in state in both directions of the display module (160).

[0226] According to one embodiment, when the electronic device (101) switches from a closed state to an open state of the display module (160), it can continue to perform shooting based on the output resolution set at the time of video shooting, and display a preview screen (1200) in which an area corresponding to a hidden area (1230) is excluded in correspondence with the preview resolution of the horizontally expanded display module (160).

[0227] According to one embodiment, when the electronic device (101) transitions from a closed state to an open state during shooting, it can provide a preview screen (1200) according to the user's intention by capturing (e.g., recording) it as is through hidden processing based on the preview ratio while maintaining the initial output resolution. For example, the electronic device (101) can display a corresponding preview screen (1200) while virtually processing a zoom (e.g., zoom-out) in the background based on the state change from a closed state to an open state, and at this time, the preview ratio can be expanded to match the expansion of the display module (160), and the remaining area outside the preview screen (1200) (e.g., hidden area (1230)) can be hidden. According to one embodiment, the electronic device (101) is, for example <1201> As such, when shooting video in the closed state of the display module (160), the video is shot at a resolution corresponding to the open state (e.g., initial output resolution), and the remaining area outside the preview screen (1200) (e.g., hidden area (1230)) is hidden, and the hidden area (1230) may be changed by a proportion according to the change in the open state.

[0228] Referring to Fig. 12b, example <1211> In this case, the electronic device (101) can perform video recording based on the vertical orientation while the display module (160) is closed, according to the user's intention. According to one embodiment, the electronic device (101) can provide various objects (1210, 1220) related to video recording through a preview screen (1200) when recording video. For example, the electronic device (101) can provide a first object (1210) (e.g., control object) capable of controlling functions such as pausing, restarting, and / or ending video recording, and / or a second object (1220) (e.g., recording object) indicating a state of video recording (e.g., recording state) by placing them in a designated area on the preview screen (1200).

[0229] According to one embodiment, the electronic device (101) can be switched from a closed state to an open state based on user input. For example, the electronic device (101) can have its display area expanded in a rolling manner and / or a sliding manner in the C' direction and / or D' direction. In changing the state of the display module (160) of the electronic device (101) (e.g., switching from a closed state to an open state), the electronic device (101) can be switched manually by the user or automatically via a driving mechanism (e.g., a driving motor, a reduction gear module and / or a gear assembly) located inside the housing.

[0230] example <1213> Silver can represent an intermediate state in which the electronic device (101) transitions from a closed state to an open state. Example <1215> can indicate an open state of the electronic device (101). In one embodiment, an intermediate state is an example <1211> Closed state and example <1215> It can represent all operable states between the open states.

[0231] example <1213> and examples <1215> In this case, the electronic device (101) can extend the preview screen (1200) in the vertical direction according to a change in the state of the display module (160) (e.g., rolling or sliding). According to one embodiment, when the state of the display module (160) changes, the electronic device (101) may maintain the actual output resolution being captured (e.g., a resolution corresponding to the area of ​​the entire preview screen (900) in the open state) and not display the remaining area (e.g., an invisible area) excluding the area of ​​the preview screen (1200) from the entire area corresponding to the output resolution. According to one embodiment, the electronic device (101) is an example <1211> As shown in [image], at the time of video recording (e.g., start of recording), the output resolution can be set based on a full-screen preview screen (1200), and example <1213> and examples <1215> As shown in the figure, when the state changes, the output resolution set at the time of video recording is fixed and recording is continued, while a hidden area (1230) for a corrected image can be internally processed (or background processed) in correspondence with the expanded preview screen (1200) (or the display ratio of the display area) according to the user's intention. According to one embodiment, the size of the hidden area (1230) may be set differently depending on the amount of change of the display module (160) (e.g., input amount or output amount). For example, as illustrated in FIG. 12a and FIG. 12b, the hidden area (1230) may be variable (e.g., expanded) in proportion to the output amount of the display module (160).

[0232] According to one embodiment, the hidden area (1230) can be configured in various ways depending on the form factor (or rolling (or sliding) method) of the electronic device (101). For example, if the electronic device (101) is of a form factor that slides in one direction, the hidden area (1230) may be integrated into one area (e.g., an area corresponding to the third hidden area (1230C) or the fourth hidden area (1230D)) in one direction or in the direction opposite to the one direction, in response to a change in state in one direction of the display module (160). As another example, if the electronic device (101) is of a form factor that slides in both directions, the hidden area (1230) may be divided into two areas (e.g., an area corresponding to the third hidden area (1230C) and the fourth hidden area (1230D)) in both directions, in response to a change in state in both directions of the display module (160).

[0233] According to one embodiment, when the electronic device (101) switches from a closed state to an open state of the display module (160), it can continue to perform shooting based on the output resolution set at the time of video shooting, and display a preview screen (1200) in which an area corresponding to a hidden area (1200) is excluded in correspondence with the preview resolution of the vertically expanded display module (160).

[0234] According to one embodiment, when the electronic device (101) transitions from a closed state to an open state during shooting, it can provide a preview screen (1200) according to the user's intention by capturing (e.g., recording) it as is through hidden processing based on the preview ratio while maintaining the initial output resolution. For example, the electronic device (101) can display a corresponding preview screen (1200) by virtually zooming (e.g., zoom-out processing) in the background based on the state change of the display module (160) transitioning from a closed state to an open state, and at this time, expand the preview ratio to match the expansion of the display module (160), and hide the remaining area outside the preview screen (1200) (e.g., hidden area (1230)). According to one embodiment, the electronic device (101) is, for example <1211> As such, when shooting video in the closed state of the display module (160), the video is shot at a resolution corresponding to the open state (e.g., initial output resolution), and the remaining area outside the preview screen (1200) (e.g., hidden area (1230)) is hidden, and the hidden area (1230) may be changed by a proportion according to the change in the open state.

[0235] FIG. 13 is a flowchart illustrating the operation method of an electronic device according to various embodiments.

[0236] Referring to FIG. 13, in operation 1301, the processor (120) of the electronic device (101) can detect the execution of video recording based on a first state of the display module (160). According to one embodiment, the processor (120) may be in a state where it displays an execution screen (or user interface) (e.g., preview) of an application related to video recording (e.g., camera application) through the display module (160). According to one embodiment, while the execution screen of the application is displayed through the display module (160), the processor (120) can detect the execution of video recording based on user input for executing video recording (e.g., video recording).

[0237] In operation 1303, the processor (120) can capture an image displayed on a preview screen in a first state (e.g., open state, intermediate state, or closed state) of the display module (160) based on a specified output resolution (or initial resolution). According to one embodiment, when the processor (120) executes image capture, it can control the camera module (180) to capture an image based on an output resolution corresponding to the first state (e.g., a resolution corresponding to the entire preview screen corresponding to the open state of the display module (160), or an initial image resolution set corresponding to the current state at the time of initial capture). According to one embodiment, the processor (120) can process a time stamp indicating a point on the time axis in the captured image while capturing the image. According to one embodiment, the processor (120) can process a continuous time stamp corresponding to a state change of the display module (120).

[0238] In operation 1305, the processor (120) can detect a state change in which the display module (160) changes from a first state (or current state) (e.g., open state, intermediate state, or closed state) to a second state (or a state different from the first state) (e.g., closed state, intermediate state, or open state) while capturing video. For example, the processor (120) can detect a state change in which the preview resolution of the display module (160) changes (or the display ratio of the display area changes) while capturing video. According to one embodiment, the processor (120) can detect that the display module (160) switches from an open state to a closed state, or from a closed state to an open state, while capturing video.

[0239] In operation 1307, the processor (120) can maintain the output resolution and identify a hidden area corresponding to the state change. According to one embodiment, the processor (120) can identify a hidden area based on the amount of change of the display module (160) (e.g., the amount of output or the amount of input). According to one embodiment, if the change from the first state to the second state is from an open state to a closed state, the processor (120) can create a hidden area based on (or proportionally to) the amount of output of the display module (160) (or the preview ratio that is expanded). According to another embodiment, if the change from the first state to the second state is from a closed state to an open state, the processor (120) can create a hidden area based on (or proportionally to) the amount of input of the display module (160) (or the preview ratio that is reduced). According to one embodiment, the hidden area may be generated based on the actual output resolution being captured and the preview resolution (e.g., preview ratio), and may include a remaining area (or an area not visible in the preview) that varies according to the amount of change of the display module (160) in addition to the area corresponding to the preview screen within the entire area corresponding to the output resolution. According to one embodiment, the hidden area may represent a processing target area where a specified effect (e.g., blackout, blur, and / or mono) is processed.

[0240] In operation 1309, the processor (120) can capture an image displayed on a preview screen in a second state of the display module (160) based on a specified output resolution. According to one embodiment, the processor (120) can continuously (or consecutively) capture an image (e.g., original image) based on an output resolution (or initial resolution) initially set at the time of capturing the image. According to one embodiment, while capturing the image, the processor (120) can process a time stamp indicating a point on the time axis in the captured image. According to one embodiment, the processor (120) can process a continuous time stamp in response to a change in the state of the display module (120).

[0241] In operation 1311, the processor (120) can detect the end of shooting while shooting video. According to one embodiment, the processor (120) can detect the end of shooting video based on user input to end shooting video while shooting video (e.g., video recording or video recording).

[0242] In operation 1313, the processor (120) can acquire a first image (e.g., original image) related to the output resolution based on the detection of the end of shooting. According to one embodiment, the processor (120) can acquire a first image captured according to the output resolution in a first state of the display module (160), an intermediate state transitioning from the first state to the second state, and a second state.

[0243] In operation 1315, the processor (120) can perform post-processing correction to apply a specified effect based on a hidden area in the first image. For example, the processor (120) can acquire a second image based on post-processing correction of an area corresponding to a hidden area in the first image. According to one embodiment, the processor (120) can process an effect (e.g., blackout, blur, and / or mono) specified on a hidden area in the first image. According to one embodiment, the processor (120) can process the effect according to the size of the hidden area which varies in response to a change in the state of the display module (160). According to one embodiment, the processor (120) can distinguish a hidden area by state of the display module (160) based on a time stamp processed during image capture, and can process an effect based on the distinguished hidden area.

[0244] In operation 1317, the processor (120) can obtain a second image (e.g., a corrected image) that has been post-processed and corrected based on the first image. According to one embodiment, the second image may include an image portion corresponding to the output resolution and an image portion in which an effect is processed in a hidden area according to a change in the state of the display module (160) (e.g., an image corresponding to a preview screen).

[0245] In operation 1319, the processor (120) may store a first image based on output resolution and / or a second image based on hidden areas. According to one embodiment, when the processor (120) captures (or stores) an image, the images substantially acquired include a first image (e.g., original image) captured according to output resolution and a second image (e.g., corrected image) created by post-processing (e.g., specified effect processing) the first image according to hidden areas, and may store the first image and / or the second image. According to another embodiment, when capturing an image, the processor (120) may simultaneously capture (e.g., recording) the first image and the second image excluding hidden areas, and when capturing (or storing) the image, the first image and the second image may be stored separately.

[0246] FIG. 14 is a flowchart illustrating the operation method of an electronic device according to various embodiments.

[0247] Referring to FIG. 14, in operation 1401, the processor (120) of the electronic device (101) can perform image capture based on a specified state. According to one embodiment, the processor (120) can capture an image based on a specified output resolution (or initial resolution) in an open state, an intermediate state, or a closed state of the display module (160).

[0248] In operation 1403, the processor (120) can detect that the preview ratio of the display module (160) is changed. According to one embodiment, the processor (120) can detect that the area of ​​the display changes as the display module (160) transitions from an open state to a closed state or from a closed state to an open state while performing video recording.

[0249] In operation 1405, the processor (120) can determine whether the change in the preview ratio corresponds to reduction or expansion based on the detection of a change in the preview ratio. According to one embodiment, the processor (120) can determine whether the area of ​​the display is reduced as the display module (160) transitions from an open state to a closed state, or whether the area of ​​the display is expanded as the display module (160) transitions from a closed state to an open state.

[0250] In operation 1405, if the change in the preview ratio is reduced (e.g., 'Yes' of operation 1405), the processor (120) may hide an area other than the preview area within the output resolution in operation 1407. For example, the processor (120) may identify (or create) a hidden area corresponding to a change in the state of the display module (160) while capturing an image.

[0251] In operation 1405, if the change in the preview ratio is an expansion (e.g., 'No' in operation 1405), the processor (120) may zoom in (e.g., zoom out) the preview area based on the preview ratio in operation 1409. According to one embodiment, the processor (120) may display a corresponding preview screen while virtually zooming in the background based on a state change in which the display module (160) transitions from a closed state to an open state. According to one embodiment, the processor (120) may expand the preview area within the output resolution area and hide the expanded preview area.

[0252] In operation 1411, the processor (120) can hide areas other than the output resolution in the extended preview area. For example, the processor (120) can identify (or create) hidden areas corresponding to changes in the state of the display module (160) while capturing an image.

[0253] In operation 1413, the processor (120) can determine whether to end the shooting. According to one embodiment, while performing video shooting (e.g., video recording or video recording), the processor (120) can determine whether to end the video shooting based on user input to end the video shooting sequentially or in parallel to a hidden processing operation according to operation 1407 or operation 1411.

[0254] In operation 1413, if the processor (120) does not detect the end of video recording (e.g., ‘No’ in operation 1413), it may proceed to operation 1401 and perform operations 1401 and below.

[0255] In operation 1413, when the end of video recording is detected (e.g., 'Yes' in operation 1413), the processor (120) may display a user interface related to option settings in operation 1415. According to one embodiment, the processor (120) may provide a user interface containing various selection options for selecting a video recording method at the end of video recording through a pop-up window (or overlay). According to one embodiment, the video recording method (or option) may be a pre-set storage method specified by the user, and if the specified storage method is pre-set, the processor (120) may not perform user interface-based operations such as operations 1415 and 1417, and may automatically save at least one corresponding video according to the specified storage method.

[0256] In operation 1417, the processor (120) may receive user input based on a user interface. According to one embodiment, the processor (120) may identify, based on the user input, an option selected by the user among various options (or storage methods) provided through the user interface. According to one embodiment, FIG. 14 describes an example in which an option to generate a corrected image based on a hidden area is selected by the user.

[0257] In operation 1419, the processor (120) can perform post-processing corresponding to user input based on the original image. According to one embodiment, the processor (120) can perform post-processing correction by applying a specified effect based on the hidden area of ​​the original image. According to one embodiment, the processor (120) can process an effect specified on the hidden area (e.g., blackout, blur, and / or mono) in the original image. According to one embodiment, the processor (120) can process the effect according to the size of the hidden area which varies in response to the state change of the display module (160). According to one embodiment, the processor (120) can distinguish the hidden area by state of the display module (160) based on the time stamp processed during image capture, and can process the effect based on the distinguished hidden area.

[0258] In operation 1421, the processor (120) may obtain at least one corrected image that is post-processed and corrected based on the original image. According to one embodiment, the corrected image may include an image portion corresponding to the output resolution and an image portion in which an effect is processed in a hidden area according to a change in the state of the display module (160) (e.g., an image corresponding to a preview screen).

[0259] In operation 1423, the processor (120) may store an original image based on output resolution and / or at least one corrected image based on hidden areas. According to one embodiment, when the processor (120) captures (or stores) an image, the image substantially acquired may include an original image captured according to output resolution and a corrected image created by post-processing (e.g., applying a specified effect) to the original image according to hidden areas, and may store the original image and / or the corrected image. According to another embodiment, when capturing an image, the processor (120) may simultaneously capture (e.g., recording) the original image and the corrected image excluding hidden areas, and when the image capture ends (or stores), the original image and the corrected image may be stored separately.

[0260] FIG. 15 is a drawing illustrating an example of processing an effect on an original image in an electronic device according to various embodiments.

[0261] According to one embodiment, the electronic device (101) may provide an original image and / or a corrected image in which the original image has been post-processed and corrected based on a capture resulting from a change in the state of the display module (160). According to one embodiment, the corrected image may represent an image in which an effect (e.g., blackout, blur, and / or mono) specified in a hidden area has been processed.

[0262] According to one embodiment, an example <1501> can represent an example of the original image (1500). According to one embodiment, an example <1503> , example <1505> and / or examples <1507> Examples of corrected images (1500A, 1500B, 1500C) that are post-processed and corrected based on the original image (1500) may be shown. According to one embodiment, the corrected image may include an image (e.g., an image corresponding to a preview screen) in which an effect (e.g., blackout, blur, and / or mono) is applied to a hidden area (1530) according to a change in the state of the display module (160).

[0263] According to one embodiment, an example <1503> It may show an example of a post-processed corrected image (1500A) by applying a blackout effect to a hidden area (1530) using the original image (1500). According to one embodiment, an example <1505> This can show an example of a post-processed corrected image (1500B) by applying a blur effect to a hidden area (1530) using the original image (1500). According to one embodiment, an example <1507> It can show an example of a post-processed corrected image (1500C) by applying a mono effect to a hidden area (1530) using the original image (1500).

[0264] FIG. 16 is a drawing illustrating an example of storing a captured image in an electronic device according to various embodiments.

[0265] Referring to Fig. 16, an example <1601> It can represent an example of capturing a video. According to one embodiment, an example <1601> In this example, an electronic device (101) may start shooting video while the display module (160) is open, change the state of the display module (160) from open to closed during video shooting, and end the video shooting while the display module (160) is closed.

[0266] According to one embodiment, an example <1603> An example may be provided that a user interface (1600) related to option settings is provided based on the end of video recording. According to one embodiment, the user interface (1600) may be provided so that the user can select (e.g., touch) various options related to the storage method. According to one embodiment, the user interface (1600) may be provided through a pop-up window (or overlay) on the screen (e.g., preview) at the time when video recording ends.

[0267] According to one embodiment, options related to the storage method may include a first option (e.g., saving only the original image), a second option (e.g., saving both the original image and the corrected image), and a third option (e.g., saving only the corrected image). According to one embodiment, options related to the storage method may include an option to set the application of effects related to the corrected image (e.g., a first effect, a second effect, and / or a third effect). For example, an option to specify at least one effect to be applied to the corrected image when saving the corrected image may be included. For example, when a user selects simultaneous saving of the corrected image (e.g., the second option) or saving only the corrected image (e.g., the third option), the user may select a first effect (e.g., blackout), a second effect (e.g., blur), and / or a third effect (e.g., mono).

[0268] According to one embodiment, an example <1605> is an example <1603> Examples of images (1610, 1620, 1630, 1640, 1650) stored based on user selection may be shown. According to one embodiment, the electronic device (101) may store one or more corrected images (1620, 1630, 1640, 1650) in parallel with or independently of the original image (1610), such as the original image (1610), the first corrected image (1620), the second corrected image (1630), the third corrected image (1640), and / or the fourth corrected image (1650).

[0269] According to one embodiment, the first correction image (1620), the second correction image (1630), the third correction image (1640), and / or the fourth correction image (1650) may each represent an image in which a different effect is applied to a hidden area.

[0270] According to some embodiments, the electronic device (101) may separately generate and provide images separated (divided) by the state of the display module (160) and / or images separated by focus when video recording ends (or video storage). For example, the electronic device (101) may extract a partial image corresponding to an open state, a partial image corresponding to an intermediate state, and a partial image corresponding to a closed state, respectively, and generate and provide them as a single independent image.

[0271] FIG. 17 is a drawing illustrating an example of shooting according to a change in the state and focus of a display in an electronic device according to various embodiments.

[0272] According to one embodiment, FIG. 17 may illustrate an example of an operation scenario in which, during image capture in an electronic device (101), the state of a display module (160) is changed and the focus is automatically set based on focus tracking.

[0273] Referring to Fig. 17, an example <1701> As exemplified in [Image], the electronic device (101) can take an image while open and can set a first focus (1750) on a specific subject of the image being taken (e.g., an image displayed on a preview screen (1700)).

[0274] According to one embodiment, the electronic device (101) is an example <1701> In the open state, based on user input, example <1703> and examples <1705> As such, the display area of ​​the display module (160) can be sequentially reduced in a designated direction and switched to a closed state. According to one embodiment, the electronic device (101) is an example <1707> In the closed state, based on user input, example <1709> and examples <1711> The display area of ​​the display module (160) can be sequentially expanded in a designated direction as shown above and switched to an open state.

[0275] According to one embodiment, the electronic device (101) reduces the preview screen (1700) according to a change in the state of the display module (160) (e.g., example <1703> and examples <1705> Reduction) or expansion (e.g., example <1709> and examples <1711> (Extension of) can be done. According to one embodiment, when the state of the display module (160) changes, the electronic device (101) may maintain the actual output resolution being captured (e.g., resolution corresponding to the area of ​​the entire preview screen (1700) in the open state) and set the remaining area (e.g., invisible area) excluding the area of ​​the preview screen (1700) from the entire area corresponding to the output resolution as a hidden area (1730). According to one embodiment, the hidden area (1730) may be created based on the actual output resolution being captured and the preview resolution (e.g., preview ratio), and may include a remaining area (or an area not visible in the preview) that varies according to the amount of change of the display module (160) in addition to the area corresponding to the preview screen within the entire area corresponding to the output resolution.

[0276] According to one embodiment, an example <1703> and examples <1705> As exemplified in [Image], the electronic device (101) can maintain a set focus (1750) on a preview screen (1700) displayed according to a change in the state of the display module (160) (e.g., a change in the preview ratio). According to one embodiment, the electronic device (101) can perform focus tracking during a change in the state of the display module (160) and can capture an image aligned with the focus (1750) assigned to the subject.

[0277] According to one embodiment, an example <1707> As exemplified in [Image], the electronic device (101) can continue to shoot video while closed, and if the video being shot (e.g., the video displayed on the preview screen (1700)) changes (e.g., the subject changes), a second focus (1770) can be set on the changed subject. For example, the user can change the subject being shot by changing the direction of the electronic device (101). According to one embodiment, the electronic device (101) can perform focus tracking during video shooting and shoot video by adjusting the focus to the changed subject based on the subject change.

[0278] According to one embodiment, an example <1709> and examples <1707> As exemplified in [Image], the electronic device (101) can maintain a set focus (1770) on a preview screen (1700) displayed according to a change in the state of the display module (160) (e.g., a change in the preview ratio). According to one embodiment, the electronic device (101) can perform focus tracking during a change in the state of the display module (160) and can capture an image aligned with the focus (1770) assigned to the subject.

[0279] According to one embodiment, the electronic device (101) can recognize a new subject based on a specified subject and automatically set the focus to the new subject when the focused subject changes during video recording, for example, when the initially focused subject is not within the preview screen (1700). For example, the electronic device (101) can recognize the subject based on various subjects such as people, movement, sound, and / or user-defined subjects.

[0280] A method of operation performed in an electronic device (101) according to various embodiments of the present disclosure may include: capturing an image based on an output resolution specified in a first state of a display module (e.g., a display module (160) of FIG. 1); displaying a preview screen based on a first preview resolution according to the first state of the display module (160); detecting a state change in which the display module (160) transitions from a first state to a second state; displaying a preview screen based on a second preview resolution according to the second state of the display module (160); identifying a hidden area based on a change amount of the display module (160); and, while capturing an image, acquiring a first image based on the output resolution and a second image based on the hidden area based on a state change of the display module (160).

[0281] According to various embodiments of the present disclosure, the operation of capturing the image may include capturing the image based on the specified output resolution while performing the image capture. According to various embodiments of the present disclosure, the output resolution may include a resolution corresponding to the entire preview screen corresponding to the open state of the display module (160) or an initial image resolution set corresponding to the first state at the time of capture.

[0282] According to various embodiments of the present disclosure, the operation of capturing the image may include controlling the display module (160) to display a preview screen related to the image obtained through the camera module (e.g., the camera module (180) of FIG. 1) based on a first preview resolution according to the first state when the image capture is executed. According to various embodiments of the present disclosure, the operation of capturing the image may include controlling the display module (160) to display a preview screen related to the image obtained through the camera module (180) based on a second preview resolution according to the second state, based on the state change while the image capture is performed.

[0283] According to various embodiments of the present disclosure, the state change may include changing the display ratio of the display area of ​​the display module based on the transition of the display module from an open state to a closed state or from a closed state to an open state while performing the image capture.

[0284] According to various embodiments of the present disclosure, the operation of identifying the hidden area may include the operation of creating the hidden area based on the input amount of the display module (160) when the display module (160) is in a state change from an open state to a closed state. According to various embodiments of the present disclosure, the operation of identifying the hidden area may include the operation of creating the hidden area based on the output amount of the display module (160) when the display module (160) is in a state change from a closed state to an open state.

[0285] According to various embodiments of the present disclosure, the operation of identifying the hidden area may include, when the display module (160) is in a state change from an open state to a closed state, the operation of hiding the remaining area other than the preview area within the output resolution area. According to various embodiments of the present disclosure, the operation of identifying the hidden area may include, when the display module (160) is in a state change from a closed state to an open state, the operation of expanding the preview area within the output resolution area and hiding the expanded preview area.

[0286] According to various embodiments of the present disclosure, the operation of identifying the hidden area may include maintaining the output resolution based on the state change and creating a hidden area corresponding to the state change of the display module. According to various embodiments of the present disclosure, the hidden area may include, in addition to the area corresponding to the preview screen, an area that is variable according to the amount of change of the display module (160) and is not visible as a preview, and may represent a target area where at least one designated effect among blackout, blur, and / or mono is processed.

[0287] According to various embodiments of the present disclosure, the acquiring operation may include, while performing image capture, acquiring a first image captured according to the output resolution, and acquiring a second image based on post-processing correction of an area corresponding to the hidden area in the first image.

[0288] According to various embodiments of the present disclosure, the first image may include an image captured based on the output resolution. According to various embodiments of the present disclosure, the second image may include an image portion captured based on the output resolution and an image portion in which an effect designated in the hidden area is processed according to a change in the state of the display module.

[0289] According to various embodiments of the present disclosure, the acquiring operation may include, while performing the image capturing, simultaneously capturing a first image captured according to the output resolution and a second image excluding the hidden area, and, upon completion of the image capturing, saving the first image and the second image respectively.

[0290] The various embodiments of the present disclosure disclosed in this specification and drawings are provided merely as specific examples to facilitate the explanation of the technical content of the present disclosure and to aid in understanding the present disclosure, and are not intended to limit the scope of the present disclosure. Accordingly, the scope of the present disclosure should be interpreted to include all modifications or variations derived based on the technical concept of the present disclosure, in addition to the embodiments disclosed herein. Explanation of the symbols

[0292] 101: Electronic devices 120, 710: Processor 130, 720: Memory 160, 730: Display module 180: Camera module

Claims

Claim 1 An electronic device comprising: a camera module; a display module; a memory for storing instructions; and a processor, wherein, when the instructions are executed by the processor, the electronic device captures a video in response to a user input for capturing a video, displays a screen of the captured video acquired through the camera module based on a first resolution of the display module, detects a change in the resolution of the display module while capturing the video, and, in accordance with the detected change in the resolution of the display module, displays a screen of the captured video acquired through the camera module based on a second resolution of the display module, identifies a hidden area of ​​the captured video, wherein the hidden area is a part of the video that is not displayed on the screen of the captured video based on the first resolution of the display module, and uses information of the identified hidden area to post-process the captured video to generate a corrected image, and stores the captured video and the generated corrected image. Claim 2 An electronic device according to claim 1, wherein the instructions are configured such that, when executed by the processor, the electronic device controls the camera module to capture video based on the output resolution of the display module while performing video recording, and the output resolution includes a resolution corresponding to the full screen corresponding to the open state of the display module or an initial image resolution set corresponding to a first state of the display module at the time of recording. Claim 3 An electronic device according to claim 1, wherein the instructions, when executed by the processor, control the display module to display a screen related to a video acquired through the camera module based on the first resolution when the electronic device performs video recording, and control the display module to display a screen related to a video acquired through the camera module based on the second resolution based on the resolution change while performing video recording. Claim 4 An electronic device according to claim 1, wherein the resolution change comprises changing the display ratio of the display area of ​​the display module based on the transition of the display module from an open state to a closed state or from a closed state to an open state while performing the video recording. Claim 5 An electronic device according to claim 1, wherein the instructions, when executed by the processor, identify the hidden area based on the input amount of the display module when the display module is in a state change from an open state to a closed state, and identify the hidden area based on the output amount of the display module when the display module is in a state change from a closed state to an open state. Claim 6 delete Claim 7 An electronic device according to claim 1, wherein, when the instructions are executed by the processor, the electronic device is configured to maintain an output resolution based on the resolution change and to create a hidden area corresponding to the resolution change of the display module, and the hidden area is a target area where at least one designated effect among blackout, blur, or mono is processed. Claim 8 delete Claim 9 An electronic device according to claim 1, wherein the captured video includes a video captured based on the output resolution of the display module, and the corrected video includes a portion of the video captured based on the output resolution of the display module and a portion of the video in which an effect designated in the hidden area is processed according to the resolution change of the display module. Claim 10 An electronic device according to claim 1, wherein, when the instructions are executed by the processor, the electronic device simultaneously captures a video captured according to the output resolution of the display module and a correction image excluding the hidden area while performing the video recording, and saves the captured video and the correction image respectively when the video recording ends. Claim 11 A method of operating an electronic device comprising: an operation of capturing a video in response to a user input for executing video recording; an operation of displaying a screen of the video acquired through a camera module of the electronic device based on a first resolution of a display module of the electronic device; an operation of detecting a change in the resolution of the display module while capturing the video; an operation of displaying a screen of the captured video acquired through a camera module based on a second resolution of the display module according to the detected change in the resolution of the display module; an operation of identifying a hidden area of ​​the captured video, wherein the hidden area is a part of the video that is not displayed on the screen of the captured video based on the first resolution of the display module; an operation of generating a corrected image by post-processing the captured video using information of the identified hidden area; and an operation of storing the captured video and the corrected image. Claim 12 A method according to claim 11, wherein the operation of capturing the video includes, while performing video capturing, an operation of capturing the video based on the output resolution of the display module, and the output resolution includes a resolution corresponding to the full screen corresponding to the open state of the display module or an initial image resolution set corresponding to the first state of the display module at the time of capturing. Claim 13 A method according to claim 11, wherein the operation of shooting the video comprises: an operation of controlling the display module to display a screen related to the video obtained through the camera module based on the first resolution when the video shooting is executed; and an operation of controlling the display module to display a screen related to the video obtained through the camera module based on the second resolution based on the resolution change while the video shooting is performed. Claim 14 A method according to claim 11, wherein the resolution change comprises changing the display ratio of the display area of ​​the display module based on the transition of the display module from an open state to a closed state or from a closed state to an open state while the video recording is being performed. Claim 15 In claim 11, the operation of identifying the hidden area comprises: an operation of identifying the hidden area based on the input amount of the display module when the display module is in a state change from an open state to a closed state; and an operation of identifying the hidden area based on the output amount of the display module when the display module is in a state change from a closed state to an open state. Claim 16 delete Claim 17 In claim 11, the operation of identifying the hidden area includes maintaining the output resolution based on the resolution change and creating a hidden area corresponding to the state change of the display module, wherein the hidden area is a target area where at least one designated effect among blackout, blur, or mono is processed. Claim 18 delete Claim 19 A method according to claim 11, wherein the captured video includes a video captured based on the output resolution of the display module, and the corrected video includes a portion of the video captured based on the output resolution of the display module and a portion of the video in which an effect designated in the hidden area is processed according to a change in the state of the display module. Claim 20 A method according to claim 11, wherein the acquisition operation comprises, while performing the video recording, simultaneously recording a video recorded according to the output resolution of the display module and a correction image excluding the hidden area, and, upon termination of video recording, storing the recorded video and the correction image respectively.

Images