Electronic device including flexible display and method for automatically executing camera in the same
The electronic device with a flexible display enhances user interaction by automatically expanding the display for camera functions upon specific motion, addressing the inconvenience of traditional camera invocation methods in flexible devices.
Patent Information
- Application Number
- KR1020220075078
- Authority / Receiving Office
- KR · KR
- Patent Type
- Patents
- Current Assignee / Owner
- Priority Date
- 2022-04-18
- Filing Date
- 2022-06-20
- Publication Date
- 2026-11-10
- Estimated Expiration
- 2042-06-20
AI Technical Summary
Electronic devices with flexible displays do not effectively utilize their expandable or shrinkable display areas when invoking camera functions, requiring inconvenient step-by-step inputs and failing to adapt the camera UI to the currently running app or situation.
An electronic device with a flexible display that includes a first and second housing, a driving device, and a processor to control the movement of the housings, allowing a quick camera mode by expanding the display area upon detecting a specific motion and tilt angle, enabling the camera function to be called in the expanded area while the main app remains running.
The device improves user convenience by automatically expanding the display for camera functions related to the running app, allowing seamless camera invocation and termination without disrupting the main app's operation.
Smart Images

Figure 112022064287218-PAT00009_ABST
Abstract
Description
Technology Field
[0001] Various embodiments relate to an electronic device including a flexible display and a method for automatically running a camera thereof. Background Technology
[0002] Electronic devices are evolving away from uniform shapes into structures that expand displays or improve their usability. Electronic devices can have deformable structures that allow for adjusting the size of the display. Recently, flexible electronic devices capable of expanding displays using sliding or roller methods are being released.
[0003] For example, a flexible electronic device places a flexible display within a space formed by a first housing and a second housing, and the flexible display can be expanded or contracted by sliding movement between the first housing and the second housing. As a result, the display of the flexible electronic device may contract or expand the display area (or active area) where visual information is displayed, depending on the combined state of the first housing and the second housing. The problem to be solved
[0004] Electronic devices (e.g., smartphones) provide a shooting function that can capture a subject through a camera (or camera module).
[0005] However, when the camera is invoked, the electronic device switches the currently running screen to the background and provides the camera user interface (UI) in full screen. Even if the camera function is invoked while an app is running, the device provides a camera UI with a uniform design regardless of the currently running app or situation, causing inconvenience to the user by requiring step-by-step input to invoke the camera.
[0006] Moreover, in the case of flexible electronic devices, the advantages of a shrinkable or expandable display are not being utilized when calling camera functions.
[0007] Various embodiments aim to provide improved interaction that utilizes a display extension area in a flexible electronic device to quickly and easily call camera functions related to a currently running app. means of solving the problem
[0008] An electronic device according to various embodiments comprises: a first housing; a second housing disposed to be movable in a first direction or a second direction relative to the first housing; a driving device driven to move the first housing relative to the second housing; a flexible display including a first display area exposed when the first housing is coupled to the second housing in a first direction and a second display area extended integrally with the first display area and exposed when the first housing is moved to the second housing in a second direction by the driving device; at least one camera disposed within the first housing and the second housing; a sensor disposed within the first housing and the second housing; and a processor operatively connected to the flexible display and the driving device, wherein the processor executes a first app supporting a quick camera mode in the first display area while the second housing is coupled to the first housing in a first direction, and when a specific motion is detected through the sensor in which the electronic device maintains a set time within a set tilt angle, the driving device controls the second housing to move the second housing from the first housing in the second direction so as to move the second A display area may be exposed, and while maintaining a first app running in the first display area, at least one camera may be called in the second display area to execute a quick camera mode corresponding to the first app, and based on the completion of the camera function execution based on the quick camera mode, the quick camera mode may be terminated and the second housing may be changed back to a state where it is coupled to the first housing in a first direction.
[0009] A method for automatically running a camera of an electronic device including a flexible display according to various embodiments may include: running a first app that supports a quick camera mode in a reduced state in which a display, in which a display area for displaying visual information can be reduced or expanded, has a first display area; changing the display to an expanded state that exposes a second display area extending from the first display area when a specific motion is detected in which the electronic device maintains a set time within a set tilt angle; calling a camera to the second display area to run a quick camera mode corresponding to the first app while maintaining the first app running in the first display area; and, based on the completion of the camera function execution based on the quick camera mode, terminating the quick camera mode and changing the display back to a reduced state having the first display area. Effects of the invention
[0010] A flexible electronic device according to various embodiments can improve the interaction for calling a camera by automatically changing the display to an expanded state by a specific motion while an app is running on an electronic device in a reduced state, calling a camera function related to the currently running app in the expanded area, and automatically changing the display to a reduced state when the camera function is completed.
[0011] A flexible electronic device according to various embodiments can easily provide a camera function related to the currently running app by calling a camera function in a specific area within the app execution screen by a specific motion during app execution.
[0012] A flexible electronic device according to various embodiments can improve user convenience by visually notifying the user of a state where a camera can be called while using an app (e.g., displaying an object) and providing a camera function suitable for the running app or situation. Brief explanation of the drawing
[0013] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments. FIG. 2a is a drawing showing the front of an electronic device in a slide-in state according to various embodiments. FIG. 2b is a drawing showing the rear of an electronic device in a slide-in state according to various embodiments. FIG. 3a is a drawing showing the front of an electronic device in a slide-out state according to various embodiments. FIG. 3b is a drawing showing the rear of an electronic device in a slide-out state according to various embodiments. FIG. 4 is an exploded perspective view of an electronic device according to various embodiments. FIG. 5 is a block diagram of an electronic device including a flexible display according to various embodiments. FIG. 6 illustrates a method for automatically running a camera in a flexible electronic device according to one embodiment. FIG. 7 illustrates a method for automatically running a camera in a flexible electronic device according to one embodiment. FIGS. 8A and 8B illustrate examples of screens for camera auto-run in a flexible electronic device according to one embodiment. FIGS. 9a and FIGS. 9b illustrate examples of screens for camera auto-run in a flexible electronic device according to one embodiment. FIGS. 10a and FIGS. 10b illustrate examples of screens for camera auto-run in a flexible electronic device according to one embodiment. FIG. 11 illustrates a method for automatically running a camera of a flexible electronic device according to one embodiment. FIG. 12 illustrates examples of screens for camera auto-run in a flexible electronic device according to one embodiment. Specific details for implementing the invention
[0014] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.
[0015] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0016] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0017] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence is performed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0018] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0019] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0020] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0021] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0022] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0023] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0024] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0025] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0026] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0027] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0028] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0029] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0030] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0031] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0032] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0033] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0034] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0035] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0036] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0037] FIG. 2a is a drawing showing the front of an electronic device in a slide-in state according to various embodiments. FIG. 2b is a drawing showing the rear of an electronic device in a slide-in state according to various embodiments. FIG. 3a is a drawing showing the front of an electronic device in a slide-out state according to various embodiments. FIG. 3b is a drawing showing the rear of an electronic device in a slide-out state according to various embodiments.
[0038] Referring to FIGS. 2a through 3b, the electronic device (101) may include a first housing (210) (e.g., a first housing structure, a moving part, or a slide housing), a second housing (220) (e.g., a second housing structure, a fixed part, or a base housing) slidably coupled to the first housing (210) in a designated direction (e.g., direction ① or direction ②) (e.g., ± y-axis direction), and a flexible display (230) (e.g., an expandable display or a stretchable display) positioned to be supported through at least a portion of the first housing (210) and the second housing (220). According to one embodiment, the electronic device (101) may be positioned such that the first housing (210) slides out in a first direction (direction ①) or slides in in a second direction (direction ②) opposite to the first direction (direction ①) with respect to the second housing (220) held by a user. According to one embodiment, at least a portion of the first housing (210) including the first space (2101) can be changed to a slide-in state by being received in the second space (2201) of the second housing (220). According to one embodiment, the electronic device (101) may include a bendable member (e.g., bendable member (240) of FIG. 4) (e.g., multi-joint hinge module or multi-bar assembly) which, in the slide-out state, forms at least partially the same plane as at least a portion of the first housing (210), and in the slide-in state, is received at least partially into the second space (2201) of the second housing (220).According to one embodiment, at least a portion of the flexible display (230) may be positioned so as not to be seen from the outside by being received into the internal space (2201) of the second housing (220) while being supported by a bendable member (e.g., the bendable member (240) of FIG. 4) in the retracted state. According to one embodiment, at least a portion of the flexible display (230) may be positioned so as to be seen from the outside while being supported by a bendable member (e.g., the bendable member (240) of FIG. 4) that forms at least partially the same plane as the first housing (210) in the extended state.
[0039] According to various embodiments, the electronic device (101) may include a first housing (210) comprising a first side member (211) and a second housing (220) comprising a second side member (221). According to one embodiment, the first side member (211) may include a first side (2111) having a first length along a first direction (e.g., y-axis direction), a second side (2112) extended to have a second length shorter than the first length along a direction substantially perpendicular from the first side (2111) (e.g., x-axis direction), and a third side (2113) extended from the second side (2112) substantially parallel to the first side (2111) and having a first length. According to one embodiment, the first side member (211) may be formed of at least a partially conductive material (e.g., metal). In one embodiment, the first side member (211) may be formed by combining a conductive material and a non-conductive material (e.g., a polymer). According to one embodiment, the first housing (210) may include a first support member (212) extending from at least a portion of the first side member (211) to at least a portion of the first space (2101). According to one embodiment, the first support member (212) may be formed integrally with the first side member (211). In one embodiment, the first support member (212) may be configured separately from the first side member (211) and may be structurally coupled with the first side member (211).
[0040] According to various embodiments, the second side member (221) may include a fourth side (2211) having a third length that corresponds at least partially to the first side (2111), a fifth side (2212) having a fourth length shorter than the third length that extends from the fourth side (2211) in a direction substantially parallel to the second side (2112), and a sixth side (2213) having a third length that extends from the fifth side (2212) to correspond to the third side (2113). According to one embodiment, the second side member (221) may be formed at least partially from a conductive material (e.g., metal). In one embodiment, the second side member (221) may be formed by a combination of a conductive material and a non-conductive material (e.g., polymer). According to one embodiment, at least a portion of the second side member (221) may include a second support member (222) that extends to at least a portion of the second space (2201) of the second housing (220). According to one embodiment, the second support member (222) may be formed integrally with the second side member (221). In one embodiment, the second support member (222) may be configured separately from the second side member (221) and may be structurally coupled with the second side member (221).
[0041] According to various embodiments, the first side (2111) and the fourth side (2211) may be slidably coupled to each other. According to one embodiment, the third side (2113) and the sixth side (2213) may be slidably coupled to each other. According to one embodiment, in the retracted state, the first side (2111) may be positioned so as not to be substantially visible from the outside by overlapping with the fourth side (2211). According to one embodiment, in the retracted state, the third side (2113) may be positioned so as not to be substantially visible from the outside by overlapping with the sixth side (2213). In one embodiment, at least a portion of the first side (2111) and the third side (2113) may be positioned so as to be at least partially visible from the outside in the retracted state. According to one embodiment, the first support member (212) may be positioned so as not to be substantially visible from the outside by overlapping with the second support member (222) in the retracted state. In one embodiment, a portion of the first support member (212) is positioned so as not to be seen from the outside by overlapping with the second support member (222) in the retracted state, and the remaining portion of the first support member (212) may be positioned so as to be seen from the outside.
[0042] According to various embodiments, the electronic device (101) may include a first rear cover (213) coupled to a first housing (210) at the rear. According to one embodiment, the first rear cover (213) may be positioned through at least a portion of the first support member (212). In one embodiment, the first rear cover (213) may be formed integrally with the first side member (211). According to one embodiment, the first rear cover (213) may be formed by a polymer, coated or colored glass, ceramic, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of these materials. In one embodiment, the first rear cover (213) may extend to at least a portion of the first side member (211). In one embodiment, at least a portion of the first support member (212) may be replaced by the first rear cover (213).
[0043] According to various embodiments, the electronic device (101) may include a second rear cover (223) coupled to a second housing (220) at the rear. According to one embodiment, the second rear cover (223) may be positioned through at least a portion of the second support member (222). In one embodiment, the second rear cover (223) may be formed integrally with the second side member (221). According to one embodiment, the second rear cover (223) may be formed by a polymer, coated or colored glass, ceramic, metal (e.g., aluminum, stainless steel (STS), or magnesium), or a combination of at least two of these materials. In one embodiment, the second rear cover (223) may extend to at least a portion of the second side member (221). In one embodiment, at least a portion of the second support member (222) may be replaced by the second rear cover (223).
[0044] According to various embodiments, the electronic device (101) may include a flexible display (230) positioned to be supported by at least a portion of a first housing (210) and a second housing (220). According to one embodiment, the flexible display (230) may include a first portion (230a) (e.g., a flat portion or a display area) that is always visible from the outside, and a second portion (230b) (e.g., a bendable portion) that extends from the first portion (230a) and is at least partially received by the first housing (210) into a second space (2201) of the second housing (220) so that at least a portion is not visible from the outside in a retracted state. According to one embodiment, the first portion (230a) may be positioned to be supported by the first housing (210), and the second portion (230b) may be positioned to be at least partially supported by a bendable member (e.g., a bendable member (240) of FIG. 4). According to one embodiment, a second portion (230b) of the flexible display (230) may be extended from the first portion (230a) while being supported by a bendable member (e.g., bendable member (240) of FIG. 4) when the first housing (210) is drawn out along the first direction (direction ①), and may be positioned to form substantially the same plane as the first portion (230a) and be visible from the outside. According to one embodiment, the second portion (230b) of the flexible display (230) may be received into the second space (2201) of the second housing (220) when the first housing (210) is drawn in along the second direction (direction ②) and may be positioned so as not to be visible from the outside. Accordingly, the electronic device (101) can induce the display area of the flexible display (230) to vary as the first housing (210) moves in a sliding manner along a specified direction (e.g., ±y axis direction) from the second housing (220).
[0045] According to various embodiments, the length of the flexible display (230) in a first direction (direction ①) (or a second direction (direction ②)) may vary according to the sliding movement of the first housing (210) which is moved relative to the second housing (220). For example, in the retracted state, the flexible display (230) may have a first display area corresponding to a first length (L1) (e.g., an area corresponding to the first part (230a)). According to one embodiment, in the extended state, the flexible display (230) may be extended to have a second display area (e.g., an area including the first part (230a) and the second part (230b)) which is larger than the first display area and corresponds to a third length (L3) which is longer than the first length (L1), according to the sliding movement of the first housing (210) which is moved by an additional second length (L2) relative to the second housing (220).
[0046] According to various embodiments, the electronic device (101) may include at least one of an input device (e.g., a first microphone (203-1)), an acoustic output device (e.g., a call receiver (206) or a speaker (207)), a sensor module (204, 217), a camera module (e.g., a first camera module (205) or a second camera module (216)), a connector port (208), a key input device (219), or an indicator (not shown) disposed in a first space (2101) of a first housing (210). According to one embodiment, the electronic device (101) may include another input device (e.g., a second microphone (203)) disposed in a second housing (220). In another embodiment, the electronic device (101) may be configured such that at least one of the above-described components is omitted or other components are additionally included. In another embodiment, at least one of the above-described components may be placed in the second space (2201) of the second housing (220).
[0047] According to various embodiments, the input device may include a first microphone (203-1) and / or a second microphone (203). In one embodiment, the input device (e.g., the first microphone (203-1) and / or the second microphone (203)) may include a plurality of microphones arranged to detect the direction of sound. The acoustic output device may include, for example, a call receiver (206) and a speaker (207). According to one embodiment, the speaker (207) may correspond to the outside through at least one speaker hole formed in the first housing (210) at a location that is always exposed to the outside regardless of the inlet / outlet state (e.g., the second side (2112)). According to one embodiment, the connector port (208) may correspond to the outside through a connector port hole formed in the first housing (210) when in the outlet state. In one embodiment, the connector port (208) may be formed in the second housing (220) in the retracted state and may be connected to the outside through an opening formed to correspond to the connector port hole. In one embodiment, the call receiver (206) may include a speaker (e.g., a piezo speaker) that operates without a separate speaker hole.
[0048] According to various embodiments, the sensor module (204, 217) may generate an electrical signal or data value corresponding to an internal operating state of the electronic device (101) or an external environmental state. The sensor module (204, 217) may include, for example, a first sensor module (204) (e.g., a proximity sensor or an illuminance sensor) placed on the front of the electronic device (101) and / or a second sensor module (217) (e.g., a heart rate monitoring (HRM) sensor) placed on the rear of the electronic device (101). According to one embodiment, the first sensor module (204) may be placed on the front of the electronic device (101), below the flexible display (230). According to one embodiment, the first sensor module (204) and / or the second sensor module (217) may include at least one of a proximity sensor, an illuminance sensor, a time of flight (TOF) sensor, an ultrasonic sensor, a fingerprint recognition sensor, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a color sensor, an infrared (IR) sensor, a biosensor, a temperature sensor, or a humidity sensor.
[0049] According to various embodiments, the camera modules (205, 216) may include a first camera module (205) positioned on the front of the electronic device (101) and a second camera module (216) positioned on the rear of the electronic device (101). According to one embodiment, the electronic device (101) may include a flash (not shown) positioned near the second camera module (216). According to one embodiment, the camera modules (205, 216) may include one or more lenses, an image sensor, and / or an image signal processor. According to one embodiment, the first camera module (205) may be positioned below a flexible display (230) and configured to capture a subject through a portion of the display area of the flexible display (230).
[0050] According to various embodiments, some of the camera modules (205, 216) and sensor modules (204, 217) may be positioned to detect the external environment through the flexible display (230). For example, the first camera module (205) or some sensor modules (204) may be positioned in the first space (2201) of the first housing (210) to come into contact with the external environment through a transparent area or a perforated opening formed in the flexible display (230). According to one embodiment, the area of the flexible display (230) facing the first camera module (205) may be formed as a transparent area having a specified transmittance as part of the display area for displaying content. According to one embodiment, the transparent area may be formed to have a transmittance in the range of about 5% to about 20%. These transparent areas may include an area that overlaps with the effective area (e.g., field of view area) of the first camera module (205) through which light passes to form an image with an image sensor to generate an image. For example, the transparent area of the flexible display (230) may include an area where the pixel placement density and / or wiring density is lower than the surrounding area. For example, the transparent area may replace the opening described above. For example, some camera modules (205) may include an under-display camera (UDC). In one embodiment, some sensor modules (204) may be positioned to perform their function without being visually exposed through the flexible display (230) within the internal space of the electronic device (101).
[0051] According to various embodiments, the electronic device (101) may include at least one antenna electrically connected to a wireless communication circuit (e.g., the wireless communication module (192) of FIG. 1) disposed in the second housing (220). According to one embodiment, the electronic device (101) may include a bezel antenna (A) disposed through a conductive second side member (221) of the second housing (220). For example, the bezel antenna (A) may include a conductive portion (227) that is disposed on at least a portion of the fifth side (2212) and the sixth side (2213) of the second side member (221) and is electrically segmented through at least one segment (2271, 2272) formed of a non-conductive material (e.g., a polymer). According to one embodiment, a wireless communication circuit (e.g., the wireless communication module (192) of FIG. 1) may be configured to transmit or receive a wireless signal in at least one designated frequency band (e.g., about 800 MHz to 6000 MHz) (e.g., legacy band) through a conductive portion (227). According to one embodiment, the electronic device (101) may include a side cover (2212a) disposed on a fifth side (2212) to cover at least a portion of at least one segment (2271). In one embodiment, a bezel antenna (A) may be disposed on at least one of the second side (2112), the fourth side (2211), the fifth side (2212), and the sixth side (2213). In one embodiment, the electronic device (101) may further include at least one antenna module (e.g., a 5G antenna module or an antenna structure) disposed in an internal space (e.g., a first space (2101) or a second space (2201)) and disposed to transmit or receive a wireless signal in a frequency band ranging from about 3 GHz to 100 GHz through another wireless communication circuit (e.g., a wireless communication module (192) of FIG. 1).
[0052] According to various embodiments, the insertion / extraction operation of the electronic device (101) can be performed automatically. For example, the insertion / extraction operation of the electronic device (101) can be performed through a gearing operation of a drive motor (e.g., drive motor (260) of FIG. 4) comprising a pinion gear (e.g., pinion gear (261) of FIG. 4) disposed in the first space (2101) of the first housing (210), and a rack gear (e.g., rack gear (2251) of FIG. 4) disposed in the second space (2201) of the second housing (220) and meshed with the pinion gear (261). For example, when a processor of an electronic device (101) (e.g., processor 120 of FIG. 1) detects a triggering operation to change from an incoming state to an outgoing state or from an outgoing state to an incoming state, it may operate a driving device (e.g., driving motor (260) of FIG. 4) placed inside the electronic device (101). According to one embodiment, the triggering operation may include at least one of selecting (e.g., touching) an object displayed on a flexible display (230), operating a physical button (e.g., a key button) included in the electronic device (101), voice input, or receiving a wireless signal related to triggering.
[0053] An electronic device (101) according to exemplary embodiments of the present invention can provide an extended sliding distance (stroke) by having a design structure in which a driving device (e.g., a driving motor (260) of FIG. 4) is positioned at an end in the retraction direction (direction ②) in the first space (2101) of the first housing (210), and a pinion gear (e.g., a pinion gear (261) of FIG. 4) of the driving device (e.g., a driving motor (260)) moves along a rack gear (e.g., a rack gear (2251) of FIG. 4) correspondingly positioned in the second space (2201) of the second housing (220) (e.g., a structure in which the driving motor (260) is positioned at the bottom of the first housing (210) in the retraction state). Additionally, the electronic device (101) can provide an efficient electrical connection structure with the driving device (e.g., driving motor (260)) by including electronic components (e.g., a substrate or a battery) disposed together with the driving device (e.g., a driving motor (260)) in the first space (2101) of the first housing (210). Additionally, the electronic device (101) can help improve operational reliability by including a support structure disposed in the second space (2201) of the second housing (220) to support at least a portion of the flexible display (230) in a slide-out state.
[0054] FIG. 4 is an exploded perspective view of an electronic device according to various embodiments. In describing the electronic device (101) of FIG. 4 below, the same reference numerals have been used for components that are substantially identical to the electronic device (101) of FIG. 2a to FIG. 3b, and a detailed description thereof may be omitted.
[0055] Referring to FIG. 4, the electronic device (101) may include a first housing (210) comprising a first space (2101), a second housing (220) slidably coupled to the first housing (210) and comprising a second space (e.g., the second space (2201) of FIG. 3a), a bendable member (240) positioned to be at least partially rotatable in the second space (2201), a flexible display (230) positioned to be supported by at least a part of the bendable member (240) and the first housing (210), and a driving device (e.g., the driving device (540) of FIG. 5) for driving the first housing (210) in a direction to be drawn in from the second housing (220) (e.g., the -y-axis direction) and / or in a direction to be drawn out (e.g., the y-axis direction). According to one embodiment, the driving device may include a driving motor (260) comprising a pinion gear (261) disposed in a first space (2101) and a rack gear (2251) disposed to mesh with the pinion gear (261) in a second space (2201). According to one embodiment, the driving device may further include a reduction module disposed to reduce the rotational speed and increase the driving force by being coupled with the driving motor (260). According to one embodiment, the driving motor (260) may be disposed to be supported through at least a portion of a first support member (212) in the first space (2101) of the first housing (210). According to one embodiment, the driving motor (260) may be fixed to an end (e.g., edge) of the first support member (212) in the first space (2101) in the inlet direction (e.g., -y-axis direction).
[0056] According to various embodiments, the electronic device (101) may include a plurality of electronic components disposed in a first space (2101). According to one embodiment, the plurality of electronic components may include a first substrate (251) (e.g., a main substrate), a camera module (216) disposed around the first substrate (251), a socket module (218) (e.g., a SIM tray), a speaker (207), a connector port (208), and a battery (B). According to one embodiment, efficient electrical connection may be possible because the plurality of electronic components are disposed around the first substrate (251) in the first space (2101) of the first housing (210) together with a drive motor (260).
[0057] According to various embodiments, the electronic device (101) may include a rear bracket (214) positioned to cover at least some of a plurality of electronic components between a first support member (212) of a first housing (210) and a first rear cover (213). According to one embodiment, the bracket (214) may be structurally coupled to at least some of the first support member (212). In one embodiment, the rear bracket (214) may be omitted. According to one embodiment, the rear bracket (214) may be positioned to cover a plurality of electronic components and support the first rear cover (213). According to one embodiment, the rear bracket (214) may include a notch area (214a) or an opening (214a) (e.g., a through hole) formed in an area corresponding to a camera module (216) and / or a sensor module (e.g., a sensor module (217) in FIG. 3b). According to one embodiment, the camera module (216) and / or sensor module (217) may be positioned to detect the external environment through a notch area (214a) or an opening (214a). According to one embodiment, the first rear cover (213) may be transparent in an area corresponding to at least the camera module (216) and / or sensor module (217). In one embodiment, the camera module (216) and / or sensor module (217) may be configured to operate only when the electronic device (101) is in a drawn-out state.
[0058] According to various embodiments, the electronic device (101) may include a plate-type support bracket (225) (e.g., DSB, display support bar) that is disposed in a second space (2201) of a second housing (220) and is slidably coupled to at least a portion of a first support member (212). According to one embodiment, the support bracket (225) may include an opening (225a) of a specified size. According to one embodiment, the support bracket (225) may include a support portion (2252) that is disposed at one end and has a curved outer surface to support the back surface of a bendable member (240) that bends during a sliding motion. According to one embodiment, the support bracket (225) may include a support plate (2253) formed to support the back surface of the bendable member (240) in a pulled-out state by extending from at least a portion of the support portion (2252) to at least a portion of the opening (225a). According to one embodiment, the support bracket (225) may include a fixed rack gear (2251) that spans the opening (225a) and has a length along a direction parallel to the sliding direction. In one embodiment, the rack gear (2251) may be formed integrally with the support bracket (225). According to one embodiment, the electronic device (101) may include a pair of guide rails (226) for guiding both ends of the bendable member (240) in the sliding direction by being positioned on both sides of the support bracket (225).
[0059] According to various embodiments, the second housing (220) may include an opening (222a) (e.g., a through hole) located in an area corresponding to a camera module (216) and / or sensor module (217) located in the first housing (210) when the electronic device (101) is in a retracted state in the second support member (222). According to one embodiment, the camera module (216) and / or sensor module (217) may detect the external environment through the opening (222a) formed in the second housing (220) when the electronic device (101) is in a retracted state. In this case, at least the area of the second rear cover (223) corresponding to the camera module (216) and / or sensor module (217) may be treated transparently.
[0060] According to various embodiments, the electronic device (101) may include a second substrate (252) and an antenna member (253) disposed in the space between the second support member (222) and the second rear cover (223) of the second housing (220). According to one embodiment, the second substrate (252) and the antenna member (253) may be electrically connected to the first substrate (251) through at least one electrical connection member (e.g., FPCB, flexible printed circuit board or FRC, flexible RF cable). In one embodiment, the antenna member (253) may be electrically connected to the second substrate (252) so as to be electrically connected to the first substrate (251) through the second substrate (252).
[0061] According to various embodiments, the electronic device (101) may include a flexible display (230) whose length varies in a direction different from a first direction (e.g., y-axis direction) or a second direction (e.g., -y-axis direction). According to one embodiment, the flexible display (230) may have its length varied in a third direction (e.g., x-axis direction) or a fourth direction (e.g., -x-axis direction) depending on the sliding movement of another housing relative to one of the plurality of housings.
[0062] An electronic device (101) according to various embodiments may have various types of housing structures to mount a flexible display. The electronic device may have a slideable (or rollable) housing that allows at least a portion of the flexible display to be wound onto a driving device (e.g., a roller part, a rotating assembly, a sliding motor) formed in the internal space of the electronic device or to be unwound from the driving device. In the following, the term "state" may refer to the structural form, shape, or form of the electronic device (or display).
[0063] FIG. 5 is a block diagram of an electronic device including a flexible display according to various embodiments.
[0064] According to various embodiments with reference to FIG. 5, the electronic device (101) may include a flexible display (510) (e.g., the display module (160) of FIG. 1, the flexible display (230) of FIG. 2a), a processor (520) (e.g., the processor (120) of FIG. 1), a memory (530) (e.g., the memory (130) of FIG. 1), a driving device (540), a camera (550) (e.g., the camera module (150) of FIG. 1), and a sensor (560) (e.g., the sensor module (176) of FIG. 1). The electronic device (101) may further include at least some of the configurations and / or functions of the electronic device (101) of FIG. 1, and the configurations that overlap with FIG. 1 may be substantially the same.
[0065] According to one embodiment, the flexible display (510) may be substantially the same as the flexible display (230) of FIG. 2a, FIG. 2b, FIG. 3a, FIG. 3b and FIG. 4. The flexible display (510) may have a variable display area (e.g., expanded or contracted). For example, the display area may represent the size of a display area exposed to the outside of the flexible display (510) where information is displayed.
[0066] According to one embodiment, the flexible display (510) may be positioned to be supported by at least a portion of the first housing (e.g., the first housing (210) of FIG. 2a) and the second housing (e.g., the second housing (220) of FIG. 2a) of the electronic device (101).
[0067] The flexible display (510) may include a first display area exposed to the outside (e.g., the first part (230a) of FIG. 3a)) and a second display area (e.g., the second part (230b) of FIG. 3a) that extends from the first display area and is either drawn into the housing or drawn out to the outside depending on the housing coupling state of the electronic device (101). The second display area (e.g., the second part (230b) of FIG. 3a) may be at least partially received into the second space (2201) of the second housing (220) so that at least a part of it is not visible from the outside when the first housing (210) is drawn into the second housing (220) along the second direction (direction ② of FIG. 2a).
[0068] For example, the flexible display (510) may have a first display area (e.g., a first part (230a)) corresponding to a first length (L1) when the first housing (210) is inserted into the second housing (220).
[0069] As another example, the flexible display (510) may have a second display area (e.g., a second part (230b)) corresponding to a second length (L2) exposed to the outside when the first housing (210) is withdrawn from the second housing (220) along a first direction (direction ① in FIG. 3b). The flexible display (510) may have a first display area (e.g., a first part (230a)) and a second display area (e.g., a second part (230b)) corresponding to a third length (L3) when the first housing (210) is withdrawn from the second housing (220). The display area of the flexible display (510) when the first housing (210) is withdrawn from the second housing (220) may be larger than the display area when the first housing (210) is inserted into the second housing (220).
[0070] According to one embodiment, the flexible display (510) can display visual information processed by the electronic device (101). For example, the visual information processed by the electronic device (101) can be displayed through a display area (e.g., a first display area, a second display area) of the flexible display (510). For example, the information processed by the electronic device (101) may include at least one object related to an application program running on the electronic device (101), such as a wallpaper (or background image), an icon, a service screen of an application, an image, or a widget. Based on the housing coupling state of the electronic device (101), the flexible display (510) may have a variable display area (e.g., a first display area) for displaying visual information (e.g., an execution screen). It can be a first display area and a second display area.
[0071] According to one embodiment, the flexible display (510) may vary the area (or degree of expansion) of a second display area (e.g., second part (230b)) exposed outside the electronic device (101) according to the number of physical external forces or accumulated inputs of the user. For example, the user may apply physical external forces to expand the flexible display (510) to a desired area or reduce it again. As another example, the flexible display (510) may be implemented so that the second display area (A2) is exposed in stages (e.g., 1st stage expansion, 2nd stage expansion) in response to the number of accumulated expansion requests.
[0072] According to one embodiment, the driving device (540) can be understood as a driving motor control module or a driving module.
[0073] According to various embodiments, the driving device (540) can vary the display area of the flexible display (510). For example, the variation of the display area may include a state in which the size (or length) of the display area of the flexible display (510) is expanded or contracted as the first housing (210) is moved in a sliding manner from the second housing (220) of the electronic device (101). According to one embodiment, the driving device (540) can control the first housing (210) and / or the second housing (220) so that the first housing (210) is drawn into the second housing (220) or the first housing (210) is drawn out into the second housing (220). For example, the driving device (540) may include the driving motor (260) of FIG. 4.
[0074] According to various embodiments, the processor (520) may control the driving device (540) to change the display area of the flexible display (510). According to one embodiment, when the processor (520) detects a triggering operation for changing the display area of the flexible display (510), the driving device (540) may operate to expand or reduce the display area of the flexible display (510). For example, when the first housing (210) is inserted into the second housing (220), the driving device (540) may operate to withdraw the first housing (210) from the second housing (220) based on the control of the processor (520). For example, the driving device (540) may operate to bring the first housing (210) into the second housing (220) based on the control of the processor (520) when the first housing (210) is withdrawn from the second housing (220). For example, the triggering operation may include at least one of selecting (e.g., touching) an object displayed on the flexible display (510), operating a physical button (e.g., a key button) included in the electronic device (101), voice input, or receiving a wireless signal related to triggering.
[0075] According to some embodiments, the electronic device (101) can control the driving device (540) by a physical external force (e.g., a squeeze gesture that presses the electronic device (101)). The electronic device (101) can be switched from a closed state to an open state, or from an open state to a closed state (e.g., semi-automatic slide motion) without further external force due to the elastic structure of the driving device (540).
[0076] According to various embodiments, the processor (520) can detect a change in the display area of the flexible display (510). According to one embodiment, the processor (520) can detect the distance the first housing (210) has moved from the second housing (220) for a change in the display area of the flexible display (510). For example, the distance the first housing (210) has moved can be estimated based on magnetic data (e.g., magnetic strength and / or the number of detected magnetic bodies) detected through at least one magnetic sensor (e.g., hall IC). For example, the distance the first housing (210) has moved can be estimated based on the driving state of the driving device (540) for moving the first housing (210) (or the second housing (220)) (e.g., the number of rotations and / or direction of rotation of the driving motor (261)). For example, the distance the first housing (210) has moved can be estimated based on a change in capacitance (e.g., touch information) detected through the second part (230a) of the flexible display (510). For example, the amount of change in the display area of the flexible display (510) may include the distance the first housing (210) has moved from the second housing (220).
[0077] According to one embodiment, the camera (550) can capture an image. The camera (550) transmits the collected image to a flexible display (510) as a preview image, and the image data captured through the camera (550) can be provided to a processor (520).
[0078] The sensor (560) can acquire data used to determine the expansion, contraction, or / and expansion information of the flexible display (510). The sensor (560) can detect a change in the area or size of the active area where visual information is to be displayed in response to a change in the state of the electronic device (101). The sensor (560) can sense data that detects a closed state in which a part of the flexible display (510) is housed inside the electronic device (101), an open state in which the entire flexible display (510) is exposed, or an intermediate state between the closed state and the open state, and transmit this to the processor (520). For example, the sensor (560) may include a sensor (e.g., encoder, Hall sensor) that is attached to the driving device (540) and generates and outputs data corresponding to the rotation angle of the driving device (540). As another example, the sensor (560) may include a sensor that is placed in a designated part of the flexible display (510) (e.g., part of the second display area (A2)) and generates data corresponding to the curvature of the bendable section (②) (see FIG. 2b).
[0079] The sensor (560) can acquire data used to recognize the electronic device posture (e.g., tilt, horizontal posture). For example, the sensor (560) can detect a specific motion (or pose) that the electronic device (101) maintains for a set time within a set tilt angle range. For example, the sensor (560) may include a geomagnetic sensor and a gyroscope sensor.
[0080] According to various embodiments, the memory (530) can store various data used by at least one component of the electronic device (101) (e.g., processor (5250), flexible display (510), driving device (540), camera (550)). According to one embodiment, the memory (530) can store various instructions that can be executed through the processor (520).
[0081] According to various embodiments, the processor (520) may be operatively, functionally, and / or electrically connected to the flexible display (510), the driving device (540), the camera (550), and / or the memory (530).
[0082] The operations of the processor (520) described below can be performed by loading instructions stored in memory (530).
[0083] According to one embodiment, the processor (520) may display a Quick Camera notification object that indicates that entry into Quick Camera mode is possible when a specific app is running while the flexible display (510) is in a reduced state (or the first housing is retracted in a first direction relative to the second housing). The user may recognize that Quick Camera mode is available through the Quick Camera notification object and take a specific motion (or pose) to call Quick Camera mode.
[0084] According to one embodiment, when the electronic device (101) detects a motion (or pose) for camera shooting, for example, a specific motion maintained for a set time within a set tilt angle range, the processor (520) may automatically change the flexible display (510) to an extended state (or a state where the first housing is pulled out in a second direction relative to the second housing) and execute a quick camera mode corresponding to an app running in the extended area (e.g., the second area). The processor (520) may control the quick camera mode to terminate the quick camera mode and automatically change the flexible display (510) to a retracted state (or a state where the first housing is pulled in in a first direction relative to the second housing) based on the completion of the camera function execution (e.g., end of shooting) based on the quick camera mode.
[0085] According to some embodiments, when the processor (520) detects a motion (or pose) for camera shooting, for example, a specific motion maintained for a set time within a set tilt angle range, while the electronic device (101) is running a specific app, it can run a quick camera mode in a specific area within the app execution screen and insert a captured image in the specific area based on the completion of the camera function execution (e.g., end of shooting).
[0086] An electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1) comprises a first housing (e.g., the first housing (210) of FIG. 2), a second housing (e.g., the second housing (220) of FIG. 2) disposed to be movable in a first direction or a second direction relative to the first housing, a driving device (e.g., the driving motor (260) of FIG. 4, the driving device (540) of FIG. 5) driven to move the first housing relative to the second housing, a flexible display (e.g., the flexible display (230) of FIG. 2, the flexible display (510) of FIG. 5)) including a first display area exposed when the first housing is coupled to the second housing in a first direction relative to the second housing, and a second display area extended integrally with the first display area and exposed when the first housing is moved to the second housing in a second direction relative to the second housing by the driving device, and at least one camera (e.g., the camera module (160) of FIG. 1) disposed within the first housing and the second housing, The apparatus includes a camera (550) of FIG. 5, a sensor (e.g., sensor module (176) of FIG. 1, sensor (560) of FIG. 5) disposed within the first housing and the second housing, a flexible display, and a processor (520) operatively connected to the driving device, wherein the processor (520) executes a first app supporting a quick camera mode in the first display area while the second housing is coupled to the first housing in a first direction, and when a specific motion is detected through the sensor in which the electronic device maintains a set time within a set tilt angle, the processor controls the driving device to move the second housing from the first housing in the second direction to expose the second display area, and while maintaining the first app running in the first display area, calls the at least one camera in the second display area to execute a quick camera mode corresponding to the first app, and based on the completion of the camera function execution based on the quick camera mode,The quick camera mode may be exited and the second housing may be set to change back to a state where it is coupled to the first housing in a first direction.
[0087] According to one embodiment, the processor (520) may be configured to execute the quick camera mode in a specific area within the execution screen of the first app without exposing the second display area in response to the specific motion when the first app supporting the quick camera mode is not set as a display extension.
[0088] According to one embodiment, the quick camera mode may be characterized as a camera mode that provides only some camera functions specified per app characteristic or specific activity screen of the app, and differently designates the calling lens among the camera lenses.
[0089] According to one embodiment, the processor (520) may be configured to display a camera user interface of a quick camera mode specified in relation to the first app in the second display area while maintaining the execution screen of the first app in the first display area.
[0090] According to one embodiment, the processor (520) may be configured to display a camera switching screen indicating that the at least one camera is in progress in the second display area while the second display area is exposed, and to activate the camera based on the completion of the exposure of the second display area to display an image acquired through the camera as a preview screen in the second display area.
[0091] According to one embodiment, the processor (520) may be configured to display a quick camera notification object guiding the quick camera mode call when the first app supports the quick camera mode call, and to visually provide a different display state of the quick camera notification object after the at least one camera call.
[0092] According to one embodiment, the quick camera notification object may be characterized by being displayed in an indicator area.
[0093] According to one embodiment, the quick camera notification object may be set not to be displayed if the second app executed in the first display area does not support the quick camera mode, or if the quick camera mode is not supported on a specific activity screen within the first app.
[0094] According to one embodiment, the processor (520) may be further configured to insert or attach an image or video captured through the quick camera mode based on the completion of the camera function execution based on the quick camera mode to the execution screen of the first app displayed in the first display area.
[0095] According to one embodiment, the processor (520) may be configured to provide an additional function user interface in the second display area if there is an additional function related to the image or video after capturing an image or video through a quick camera mode running in the second display area.
[0096] According to one embodiment, the additional function may include at least one of a post-correction function, a text input function, and a drawing function.
[0097] According to one embodiment, the processor (520) may be further configured such that when the second housing is coupled to the first housing in a first direction and a lock screen is displayed in the first display area, and a specific motion is detected through the sensor in which the electronic device maintains a set time within a set tilt angle, the camera mode is not called as a full screen of the first display area, but the driving device is controlled to move the second housing from the first housing in the second direction to expose the second display area, and the camera is called in the second display area to display a camera user interface.
[0098] The operations of the processor (520) are described in detail below. Additionally, additional operations of the processor (520) are described below.
[0099] In the following embodiments, operations may be performed sequentially, but are not necessarily performed sequentially. For example, the order of operations may be changed, and at least two operations may be performed in parallel.
[0100] FIG. 6 illustrates a method for automatically running a camera in a flexible electronic device according to various embodiments.
[0101] Referring to FIG. 6, a processor (520) of an electronic device (101) according to one embodiment (e.g., processor (120) of FIG. 1) can check in operation 610 whether a first app capable of calling a quick camera mode is running in a reduced display state having a first display area (e.g., first part (230a) of FIG. 2) (or a state in which the second housing (e.g., second housing (220) of FIG. 2a) is pulled in a first direction with respect to a first housing (e.g., first housing (210) of FIG. 2a). If the processor (520) is not running a first app capable of calling a quick camera mode, the processor (520) can terminate the process of FIG. 6.
[0102] According to one embodiment, the processor (520) can determine whether the first app is an app designated as a quick camera mode support app, or determine whether among the activity screens displayed on the display when the first app is executed, there is a screen that supports the quick camera mode.
[0103] According to some embodiments, the processor (520) may determine that the first app is running when, at the time of the first app execution, if an image / video attachment item or a shooting-related item is included in the activity screen displayed on the display, the first app is capable of calling the quick camera mode.
[0104] In various embodiments, the electronic device (101) can set (or specify) an app or app-specific activity screen capable of calling the quick camera mode. The electronic device (101) can set the quick camera mode differently depending on the app characteristics.
[0105] Quick Camera Mode is a mode that calls only some camera functions (e.g., basic functions) specified by app characteristics or screen characteristics among camera functions, but is not limited to these. Quick Camera Mode may also call camera functions related to the currently running app.
[0106] For example, Table 1 lists examples of quick camera call settings, but is not limited to the listed examples.
[0107] App type or screen type Quick Camera Mode Support Whether additional features are provided after shooting Camera lens selective call (priority) Example of application scenario message / messenger APP Photo shooting function, front / rear switching, video switching, and camera mode changing for shooting functions are not supported. X Rear camera, dual camera, or triple camera call You can quickly attach photos while keeping the message conversation screen open. contact profile APP Photo taking function, front / rear switching, call up Quick Camera mode in the profile picture area Provides color filter / post-processing features Front dual camera call When registering a profile, you can take a quick face shot and perform color correction and face retouching. note / memo APP Photo shooting function, video recording not provided Provides text input tool functions / drawing input functions Rear camera, dual camera, or triple camera call You can quickly attach photos when writing a memo. email APP Photo shooting function, video recording not provided X Rear camera, dual camera, or triple camera call You can quickly attach photos while viewing the email body in the composition screen. calendar APP Photo shooting function, video recording not provided X Rear camera, dual camera, or triple camera call Easy to attach related shots / photos when saving schedules reminder APP Photo shooting function, video recording not provided X Rear camera, dual camera, or triple camera call You can attach photos / shots related to tasks on the to-do list editing screen. Lockscreen Full camera features provided X Provides the same settings as the last lens used in the camera app. Quick camera access is possible via the extended area rather than the full screen while on the lock screen.
[0108] According to various embodiments, the electronic device (101) may be configured to call the quick camera mode only on specific activity screens within the app. For example, in the case of a contacts app, the contact list screen among the app's activity screens may be set as a screen that does not support camera calling, but the contact profile editing screen may be set as a screen that supports camera calling.
[0109] According to various embodiments, the electronic device (101) may have the camera lens that is called first differently depending on the running app among the front camera, rear camera, dual camera, or triple camera when the quick camera mode is called.
[0110] In operation 620, the processor (520) may display a Quick Camera notification object that guides the Quick Camera mode enabled state when the condition is satisfied that a first app capable of calling Quick Camera mode is executed in a reduced display state having a first display area.
[0111] The processor (520) may terminate the process of FIG. 6 if the condition that the first app capable of calling the quick camera mode is executed in a reduced display state having the first display area is not satisfied.
[0112] According to one embodiment, the processor (520) may provide guidance that a quick camera mode call is possible only when a specific app is running or on a specific screen. After displaying the quick camera notification object, the processor (520) may control the quick camera notification object so that it is not displayed when the specific app capable of calling the quick camera mode is terminated or when the user moves away from the specific screen capable of calling the quick camera mode.
[0113] For example, the processor (520) may display the quick camera notification object in an indicator area, but may also notify via a notification bar. The electronic device (101) may guide the user to take a specific motion to call the quick camera mode by providing the quick camera notification object only on a specific app or a specific screen.
[0114] According to one embodiment, the 620 operation may be omitted.
[0115] In operation 630, the processor (520) can determine whether a specific motion (e.g., an action or pose for a user to lift the electronic device to take a picture) is detected, which the electronic device (101) maintains for a set time within a set angle of inclination.
[0116] For example, the processor (520) can calculate the tilt angle of the electronic device (101) through a sensor (e.g., geomagnetic sensor, gyroscope sensor) and recognize horizontal maintenance, and if the tilt angle is maintained within a set range (e.g., 80 degrees to 110 degrees) for a set time, it can determine that the user is taking a specific motion that is intended to be captured using the electronic device.
[0117] The processor (520) may not call the quick camera mode if it is in a state where it can call the quick camera mode in operation 630 but no specific motion is detected.
[0118] In operation 640, the processor (520) can determine whether the quick camera mode associated with the currently running app is a display extension setting. The electronic device (101) can pre-designate (or set) an app or activity screen capable of calling the quick camera mode. If the app designated as the quick camera mode as the display extension setting is running, the processor (520) can proceed to operation 650, and if the app designated as the quick camera mode as the display extension setting is not running, the processor (520) can proceed to operation 660. In operation 650, the processor (520) can control a driving device in response to the detection of a specific motion while the app designated as the quick camera mode as the display extension setting is running, automatically change the display to an extended state (or a state in which the second housing is pulled out in a second direction relative to the first housing), and call the quick camera mode corresponding to the first app to the second display area (or extended area) (e.g., the second part (230b) of FIG. 2a).
[0119] For example, the processor (520) can display a camera switching screen (or camera transaction screen) in the exposed second display area while the display is automatically changed to an extended state.
[0120] In operation 655, the processor (520) may display a Quick Camera UI (user interface) corresponding to the first app in the expanded second display area while maintaining the display of the execution screen of the first app running in the first display area, based on the completion of the exposure of the second display area. For example, the Quick Camera UI (user interface) corresponding to the first app may be a UI designed based on a Quick Camera mode set according to the characteristics of the first app.
[0121] The quick camera UI (user interface) may include shooting items and camera switching items within the preview screen, but may additionally provide image editing items or image correction items depending on the app or screen specific being displayed in the first display area.
[0122] In operation 660, the processor (520) can call the Quick Camera mode in a specific area of the app execution screen and display the Quick Camera UI in response to the detection of a specific motion while the app is running in a state where the Quick Camera mode is not set as a display extension setting.
[0123] For example, the processor (520) can call the Quick Camera mode in the profile photo area (e.g., a specific area) when a specific motion is detected that calls the Quick Camera mode while the profile editing screen of the contacts app or contacts app activity screen is running.
[0124] In operation 670, the processor (520) can perform the shooting function of the camera in quick camera mode according to a user request. For example, the processor (520) can shoot and save an image obtained from the camera in response to an input (e.g., selection of a shooting item) that shoots a preview image displayed on the camera UI.
[0125] In operation 675, the processor (520) checks whether additional features are supported after shooting in the Quick Camera mode associated with the first app, and if additional features are supported, in operation 680, the additional feature UI can be displayed in the Quick Camera UI. If no additional features exist, the processor (520) can skip operation 680 and proceed to operation 685.
[0126] For example, when the quick camera mode is called while the profile app or profile editing screen is displayed, the processor (520) can display a color filter UI for post-processing the captured photo in the area where the quick camera mode was called (e.g., the area where the quick camera mode UI is displayed) after the photo is taken. The user can easily correct the photo by applying a specific color filter to the captured photo.
[0127] In operation 685, the processor (520) can determine whether the execution of the quick camera function associated with the first app is completed (e.g., end of shooting).
[0128] In operation 690, the processor (520) can exit the quick camera mode based on the completion of the quick camera function execution.
[0129] According to one embodiment, when the processor (520) automatically changes the display area to an expanded state upon calling the quick camera mode, it can control the driving device to automatically change the display to a reduced state (or a state in which the first housing is retracted in the first direction relative to the second housing) and then terminate the quick camera mode. If the execution of the quick camera function is not completed, the processor (520) can maintain the process of FIG. 6 until the execution of the function is completed.
[0130] FIG. 7 illustrates a method for automatically running a camera in a flexible electronic device according to various embodiments.
[0131] Referring to FIG. 7, a processor (520) of an electronic device (101) according to one embodiment may execute a first app in a reduced display state having a first display area (e.g., the first part (230a) of FIG. 2) (or a second housing (e.g., the second housing (220) of FIG. 2a) in a first direction with respect to a first housing (e.g., the first housing (210) of FIG. 2a).
[0132] In operation 720, the processor (520) checks whether the execution screen of the first app displayed in the first display area is a quick camera mode support screen, and in operation 730, if the condition that it is a quick camera mode support screen is satisfied, the processor (520) can display a quick camera notification object that indicates the quick camera mode enabled state.
[0133] For example, the processor (520) can determine whether the activity screen displayed on the display during the execution of the first app through the first display area is switched to a screen that allows entry into quick camera mode.
[0134] As another example, the processor (520) may determine that the screen is a Quick Camera Mode support screen when the first app is executed and the screen is switched to an activity screen displayed on the display that includes an image / video attachment item or a shooting-related item.
[0135] The processor (520) may terminate the process of FIG. 6 if the condition that the first app capable of calling the quick camera mode is executed in a reduced display state having a first display area is not satisfied.
[0136] According to one embodiment, step 730 may be omitted.
[0137] According to some embodiments, the processor (520) may display a Quick Camera notification object in a first display area while the first app is running, regardless of a specific appivity screen within the app as shown in FIG. 6, when the entire app is set as a Quick Camera call support app.
[0138] According to one embodiment, the processor (520) may display the quick camera notification object in an indicator area, but may also notify through a notification bar.
[0139] In operation 740, the processor (520) can determine whether a specific motion (e.g., an action or pose to lift the electronic device to take a picture) is detected, which the electronic device (101) maintains for a set time within a set angle of inclination.
[0140] For example, the processor (520) can calculate the tilt angle of the electronic device (101) through a sensor (e.g., geomagnetic sensor, gyroscope sensor) and recognize horizontal maintenance, and if the tilt angle is maintained within a set range (e.g., 80 degrees to 110 degrees) for a set time, it can determine that the user is taking a specific motion that is intended to be captured using the electronic device.
[0141] The processor (520) may not call the quick camera mode if it is in a state where quick camera mode can be called but no specific motion is detected.
[0142] In operation 750, the processor (520) can control the driving device in response to detecting a specific motion to automatically change the display from an extended state (or a state where the second housing is pulled out in a second direction relative to the first housing) and call a quick camera mode corresponding to the first app in the second display area (or extended area) (e.g., the second part (230b) of FIG. 2a). For example, while the processor (520) automatically changes the display to an extended state, it can display a camera switching screen (or camera transaction screen) in the exposed second display area.
[0143] According to some embodiments, if the activity screen of the running app is not designated as a display extension setting in relation to the quick camera mode, the processor (520) may skip step 750 and call the extension camera mode to a specific area within the app screen.
[0144] In operation 755, the processor (520) may display a Quick Camera UI (user interface) corresponding to the first app while maintaining the first app execution screen currently displayed in the first display area. For example, the Quick Camera UI (user interface) corresponding to the first app may be a UI designed based on a Quick Camera mode set according to the characteristics of the first app.
[0145] According to one embodiment, the processor (520) may display a Quick Camera UI in a second display area (or expanded area) with the display expanded when the Quick Camera mode associated with the app is called and the display expansion setting is specified. According to another embodiment, the processor (520) may display a Quick Camera UI in a specific area within the app's activity screen without expanding the display when the Quick Camera mode associated with the app is not called and the display expansion setting is not specified.
[0146] In practice, simultaneously or in parallel, in the operation of 760, the processor (520) can change the display of the Quick Camera Notification Object status. For example, the processor (520) can change the color of the Quick Camera Notification Object displayed in the indicator area, but can also change the display of effects, design, etc., in addition to color.
[0147] In operation 770, the processor (520) can perform camera functions in quick camera mode according to a user request. For example, the processor (520) can save a captured image obtained from the camera in response to an input (e.g., selection of a shooting item) that captures a preview image output to the second display area.
[0148] Although not shown in the drawing, the 660 and 665 operations of FIG. 6 may be additionally performed after video recording, and are omitted in FIG. 7.
[0149] In operation 775, the processor (520) can attach or apply the captured image stored on the first app screen based on the image being saved through shooting.
[0150] In operation 780, the processor (520) can determine whether the execution of the quick camera function associated with the first app is completed (e.g., end of shooting).
[0151] In operation 790, the processor (520) can exit the quick camera mode based on the completion of the quick camera function execution.
[0152] According to one embodiment, when the processor (520) automatically changes the display area to an expanded state upon calling the quick camera mode, it can control the driving device to automatically change the display to a reduced state (or a state in which the first housing is retracted in the first direction relative to the second housing) and then terminate the quick camera mode. If the execution of the quick camera function is not completed in the 780 operation, the processor (520) can maintain the process of FIG. 7 until the execution of the function is completed.
[0153] In fact, simultaneously or in parallel, in the 795 operation, the processor (520) can restore the changed display of the quick camera notification object.
[0154] FIGS. 8A and 8B illustrate examples of screens for camera auto-run in a flexible electronic device according to various embodiments.
[0155] Referring to FIGS. 8a and 8b, an electronic device (101) according to various embodiments can provide a quick camera call guide to the user by displaying a quick camera notification object when a specific app or a specific activity screen within an app that supports quick camera calls in a reduced display state is executed.
[0156] An electronic device (101) according to various embodiments can automatically expand the display when a quick camera mode is called and call a quick camera mode related to an app running in the expanded display area while maintaining the app execution screen.
[0157] According to one embodiment, the electronic device (101) can distinguish between apps that support quick camera mode calls and apps that do not support them. The electronic device (101) can set or specify apps that support quick camera mode calls, and can store data related to the user interface per app or per app activity screen in relation to quick camera mode.
[0158] For example, an electronic device (101) <801> As illustrated in the figure, when the display (810) (e.g., the flexible display (230) of FIG. 2a, the flexible display (510) of FIG. 5) is in a reduced state having a first display area (e.g., the first part (230a) of FIG. 2) (or in a state where the second housing (e.g., the second housing (220) of FIG. 2a) is pulled in a first direction relative to the first housing (e.g., the first housing (210) of FIG. 2a)), a web browser app can be executed or a web browser screen (820) can be displayed.
[0159] The processor (520) may not display the Quick Camera notification object if it does not satisfy the display conditions of the Quick Camera notification object (e.g., display minimized state and display of an app or specific activity screen that supports Quick Camera calling).
[0160] For example, a processor (e.g., the processor (520) of FIG. 5) may determine that the web browser screen (820) or the web browser app is an activity screen that does not support quick camera calls, and may not display a quick camera notification object in the indicator area (815).
[0161] As another example, the electronic device (101) <802> As illustrated in the figure, a display (810) (e.g., the flexible display (230) of FIG. 2a, the flexible display (510) of FIG. 5) can run a message / messenger app or display a messenger conversation screen (830) in a reduced state (or in a state where the first housing is inserted into the second housing in a first direction) having a first display area (A1) (e.g., the first part (230a) of FIG. 2a).
[0162] A processor (e.g., the processor (520) of FIG. 5) can determine that the messenger conversation screen (830) or the message / messenger app is a quick camera call support app or activity screen and display a quick camera notification object (840) in the indicator area (815).
[0163] The user can recognize that Quick Camera mode can be called through the Quick Camera notification object (840) displayed in the indicator area (815) and the app or screen currently displayed in the first display area (A1). The user can recognize that Quick Camera mode can be called through the Quick Camera notification object (840) and can take a Quick Camera call motion (or pose, action).
[0164] When the processor (520) detects a specific motion (or quick camera call action) in which the electronic device (101) in a reduced display state maintains a set time within a set tilt angle range, <803> As illustrated in the figure, the display (810) can be automatically changed to an extended state while maintaining the messenger conversation screen (830) currently displayed in the first display area (A1). The electronic device (101) exposes a second display area (A2) extended from the first display area (A1) in the extended display state (i.e., the first housing is pulled out in the second direction into the second housing), and can call a quick camera mode in the extended second display area (A2). While the processor (520) changes from the reduced display state to the extended display state, it can display a camera transition screen (e.g., camera call transition screen) (850) in the second display area (A2) that is exposed externally. When a quick camera is called, the processor (520) can provide a quick camera notification object (840) by changing at least one of the object's size, shape, color, or design to be visually different from the display before the camera call (e.g., 840 -> 840a).
[0165] The processor (520) <804> As illustrated in [Image], based on the completion of exposure of the second display area (A2), the camera can be activated in the second display area (A2) and switched to display the quick camera UI screen (860).
[0166] The quick camera UI screen (860) may include at least one of a shooting item (870), a camera switching item (875), a save item (880), and a cancel item (890) within the preview video, but this is merely an example and is not limited thereto.
[0167] When a user needs a camera function while the display is in a reduced state, the user can change to an expanded state by taking a specific motion and call a quick camera mode in the expanded area (e.g., second display area (A2)) to more easily perform camera functions associated with the currently running app or screen.
[0168] FIG. 9 illustrates examples of screens for camera auto-run in a flexible electronic device according to various embodiments.
[0169] Referring to FIG. 9, an electronic device (101) according to various embodiments may display a quick camera user interface related to a running app by calling a quick camera mode in a specific area within the app execution screen without expanding the display. If additional functions are supported in the quick camera mode, the electronic device (101) according to various embodiments may support additional functions for the captured image. The additional functions may include at least one of a photo correction function, a text input function, and a drawing function, but are not limited thereto, and may vary depending on the characteristics of the app or the characteristics of a specific activity screen within the app.
[0170] The electronic device (101) according to various embodiments can provide a quick camera UI that is designed differently for each app characteristic.
[0171] For example, an electronic device (1010) <901> As illustrated in the figure, a display (810) (e.g., the flexible display (230) of FIG. 2a, the flexible display (510) of FIG. 5) can display a contact profile editing screen (920) of a contact app in a reduced state having a first display area (e.g., the first part (230a) of FIG. 2) (or in a state where the second housing (e.g., the second housing (220) of FIG. 2a) is pulled in a first direction relative to the first housing (e.g., the first housing (210) of FIG. 2a). Since the profile editing screen (920) is an activity screen capable of supporting quick camera mode calls, a processor (e.g., the processor (520) of FIG. 5) can display a quick camera mode notification object.
[0172] The processor (520) <902> As illustrated in the figure, when a contact profile editing screen (920) designated as a quick camera call support app or activity screen is displayed in a reduced display state, and when a specific motion (or quick camera call action) is detected in which the electronic device (101) maintains a set time within a set tilt angle range, a quick camera mode may be called in a specific area within the contact profile editing screen (920) of the first display area (A1), and a quick camera UI screen (930) associated with the contact app or contact profile editing screen (920) may be displayed. For example, the contact profile editing screen (920) may include a profile image area (921). The processor (520) may display a camera transition screen (e.g., camera call transition screen) (925) during a quick camera mode call in the profile image area (921).
[0173] The processor (520) <903> As illustrated in the figure, a Quick Camera UI screen (930) can be displayed by calling the Quick Camera mode in the profile image area (921) of the contact profile editing screen (920). The Quick Camera UI screen (930) may include a shooting item (950), a camera switching item (940), and menu items (960) that provide image correction functions.
[0174] For example, the contact profile editing screen (930) can be perceived as a situation where the user's face is being photographed. The electronic device (101) can call the quick camera mode for video recording when the contact profile editing screen (920) of the contact app is displayed.
[0175] According to one embodiment, the contact app or contact profile editing screen (920) may support an additional function that provides a correction filter for the image color after shooting.
[0176] The user can select a shooting item (950) to take an image obtained from the camera.
[0177] The processor (520) <904> As illustrated in the figure, additional function UI (970) can be provided to a captured image (935) taken through the quick camera mode. The additional function specified in the contact app or contact profile editing screen (920) may be, for example, a color correction function for the captured image, and multiple color filters may be provided.
[0178] If the user selects one of the correction filters, the processor (520) can correct the color of the captured image (935) displayed in the second display area (A2). If the user selects the save item (980), the captured image can be saved, and if the user selects the cancel item (990), the captured image can be restored to its original color.
[0179] Additionally, although not illustrated in the drawing, based on the user completing the execution of the correction function (or selecting the save item (980)), the processor (520) can automatically add (or insert) a captured image (935) to the profile image area (921) of the contact profile editing screen (i.e., image addition area) (920) running in the first display area (A1).
[0180] FIGS. 10a and FIGS. 10b illustrate examples of screens for camera auto-run in a flexible electronic device according to various embodiments.
[0181] Referring to FIGS. 10a and 10b, a processor of an electronic device (101) according to various embodiments (e.g., processor (520) of FIG. 5) is, <10001> As illustrated in the figure, a display (1010) (e.g., the flexible display (230) of FIG. 2a, the flexible display (510) of FIG. 5) can run a handwriting app (e.g., a note app, a memo app, a drawing app, etc.) that supports a quick camera mode call in a reduced state (e.g., the first part (230a) of FIG. 2) with respect to a first housing (e.g., the first housing (210) of FIG. 2a) in a first direction with respect to a second housing (e.g., the second housing (220) of FIG. 2a) in a first direction)). The processor (520) can display a handwriting app screen (1020) in the first display area (A1) and display a quick camera notification object (1015) in the indicator area (1017).
[0182] When a user performs a specific motion (or pose, action) in which the electronic device is maintained within a set tilt angle for a specified time, the processor (520) detects the specific motion that calls the quick camera and can automatically switch the display (1010) to an extended state (or a state in which the first housing is pulled out in a second direction into the second housing). For example, the processor (520) can control a driving device to automatically expose a second display area (A2) extending from the first display area (A2) to switch the display (1010) to an extended state.
[0183] The processor (520) <10002> As illustrated in the figure, while the display (1010) is transitioning to an extended state, a camera switching screen (or camera transaction screen) (1025) may be displayed in the second display area (A2). The processor (520) may transition the quick camera notification object (1015) to a display state (1015a) indicating that the camera is in use.
[0184] The processor (520) <10003> As illustrated, in response to the completion of the exposure of the second display area (A2), a quick camera UI (1030) corresponding to a handwriting app or a handwriting app screen (1020) can be displayed in the second display area (A2). The quick camera UI (1030) may include a shooting item (1040) and a camera switching item (1045) within the preview image.
[0185] The user can take an image through the quick camera mode called in the second display area (A2) while keeping the handwriting app running in the first display area (A1). For example, if the user takes an image by selecting a shooting item (1040), the processor (520) <10004> As illustrated in [Image], a saved item (1050) and a re-shot item (1055) can be displayed in the second display area (A2) along with the captured image (1035).
[0186] The processor (520) can provide additional features, such as drawing / text tool feature items (1060), specified in the quick camera mode of the handwriting app to the captured image (1035).
[0187] When the user selects the drawing / text tool function item (1060), the processor <10005> As illustrated in [Image], a drawing / text tool UI (1065) can be displayed in the second display area (A2).
[0188] After performing additional functions using the drawing / tool UI (1065), the user can select a save item (1050).
[0189] When a storage item (1050) is selected, the processor (520) confirms that the camera function execution is complete and can insert (or attach) a captured image (1035) taken through the second display area (A2) as an attached image (1075) of the handwriting app screen (1020) displayed in the first display area (A1). The processor (520) may also provide editing items (1070) related to the image (1075) inserted (or attached) in the first display area, but is not limited thereto.
[0190] The processor (520) based on the completion of the camera function execution, <10006> As illustrated in the figure, the quick camera mode can be exited and the display (1010) can be automatically changed to a reduced state so that the first display area (A1) is present.
[0191] FIG. 11 illustrates a method for automatically running a camera of a flexible electronic device according to one embodiment.
[0192] Referring to FIG. 11, according to various embodiments, an electronic device (101) may support the function of automatically switching the display (e.g., the flexible display (230) of FIG. 2a, the flexible display (510) of FIG. 5) to an expanded state (or the second housing (220) of FIG. 2a) in a second direction with respect to the first housing (e.g., the first housing (210) of FIG. 2a)) when a specific motion specified in the reduced state (e.g., the first part (230a) of FIG. 2) is detected in the first direction with respect to the first housing, and calling a camera function in the expanded second display area (A2).
[0193] In operation 1110, the processor (520) can determine whether the electronic device (101) is operating in a reduced display state having a first display area. If the processor (520) is not in a reduced display state, it can terminate the process of FIG. 11.
[0194] In operation 1120, the processor (520) can determine whether a specific motion is detected in which the electronic device maintains a set tilt angle for camera calling in a reduced display state for a specified time. If the processor (520) does not detect a specific motion in a reduced display state, the process of FIG. 11 can be terminated.
[0195] In operation 1130, the processor (520) can change the display to an extended state (or a state where the second housing is pulled out in a second direction relative to the first housing) and call a camera to the second display area when the condition is satisfied that the electronic device (101) maintains a specific motion while the display is in a reduced state.
[0196] In operation 1140, the processor (520) can display a camera UI (or quick camera UI) in a second display area while maintaining the screen running in the first display area.
[0197] In this case, when the electronic device calls the camera, it switches the screen currently displayed in the first display area to the background and does not display the camera UI as a full screen in the foreground, but can display the camera UI (or quick camera UI) in the size of the expanded second display area.
[0198] FIG. 12 illustrates examples of screens for camera auto-run in a flexible electronic device according to various embodiments.
[0199] Referring to FIG. 12, a processor of an electronic device (101) according to various embodiments (e.g., processor (520) of FIG. 5) is, <120001> As illustrated in the figure, a display (1210) (e.g., the flexible display (230) of FIG. 2a, the flexible display (510) of FIG. 5) may display a lock screen (1210) in which at least some functions are restricted in a reduced state having a first display area (e.g., the first part (230a) of FIG. 2) (or in a state where the second housing (e.g., the second housing (220) of FIG. 2a) is pulled in a first direction relative to the first housing (e.g., the first housing (210) of FIG. 2a)).
[0200] The lock screen (1220) may include some functions allowed on the lock screen (1220), such as a phone function item (1225) and a camera item (1227). Although not illustrated in the drawing, for example, if the user selects the camera item (1227) on the lock screen (1220), the electronic device (101) may call the camera function and provide a camera UI over the entire first display area (A1) as a full screen.
[0201] As another example, when the processor (520) of the electronic device (101) detects a specific motion (or pose, action) that the electronic device (101) maintains for a specified time within a set tilt angle while in a reduced display state, the processor (520) <12002>As illustrated in the figure, the display (1210) can be automatically switched to an extended state (or a state where the first housing is pulled out in the second direction into the second housing) while maintaining the lock screen (1220) displayed in the first display area (A1).
[0202] The processor (520) can display a camera switching screen (or camera transaction screen) (1230) in the second display area (A2) while the display (1010) is switched to an extended state. The processor (520) can display a quick camera notification object (1240) in the indicator area.
[0203] The processor (520) <12003> As illustrated in the figure, a camera can be called in the second display area (A2) to display a quick camera UI (1240) in response to the completion of exposure of the second display area (A2). At this time, the camera mode called in the second display area may be provided as a UI that provides all camera functions but is limited by the size of the second area. For example, the quick camera UI (1240) may include a shooting item (1250), a camera switching item (1260), and camera mode menu items (1270). As another example, the camera mode called in the second display area may be provided as a quick camera UI that provides only some camera functions depending on the settings.
[0204] A method for automatically running a camera of an electronic device including a flexible display according to one embodiment may include: an operation of running a first app that supports a quick camera mode in a reduced state in which a display, in which a display area for displaying visual information can be reduced or expanded, has a first display area; an operation of changing the display to an expanded state that exposes a second display area extending from the first display area when a specific motion is detected in which the electronic device maintains a set time within a set tilt angle; an operation of running a quick camera mode corresponding to the first app by calling a camera in the second display area while maintaining the first app running in the first display area; and an operation of terminating the quick camera mode and changing the display back to a reduced state having the first display area based on the fact that the execution of the camera function based on the quick camera mode is completed.
[0205] The operation of changing the display according to one embodiment to an extended state that exposes a second display area extending from the first display area and the operation of executing the quick camera mode may be characterized in that, if the first app supporting the quick camera mode is an app that is not set to display extension, the quick camera mode is executed in a specific area within the execution screen of the first app without changing the display to an extended state that exposes the second display area.
[0206] The quick camera mode according to one embodiment may be characterized as a camera mode that provides only some camera functions designated per app characteristic or specific activity screen of the app, and designates a different calling lens among the camera lenses.
[0207] In one embodiment, if the first app supports a quick camera mode call, it further includes an operation of displaying a quick camera notification object that guides the quick camera mode call, and the operation of executing a quick camera mode corresponding to the first app may further include an operation of visually changing and displaying the display state of the quick camera notification object in the second display area after the camera call.
[0208] The operation of displaying the quick camera notification object according to one embodiment may further include the operation of removing the display of the quick camera notification object when, after displaying the quick camera notification object, a second app that does not support the quick camera mode is displayed in the first display area, or when switching to a specific activity screen that does not support the quick camera mode within the first app displayed in the first display area.
[0209] The operation of changing the display according to one embodiment back to a reduced state having the first display area may further include the operation of inserting or attaching an image or video captured through the quick camera mode based on the completion of the camera function execution based on the quick camera mode to the execution screen of the first app displayed in the first display area.
[0210] The operation of executing a quick camera mode corresponding to the first app according to one embodiment may further include, after capturing an image or video through the quick camera mode executing in the second display area, if there is an additional function related to the image or video, an additional function user interface in the second display area.
[0211] According to one embodiment, the additional function may include at least one of a post-correction function, a text input function, and a drawing function.
[0212] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as "coupled" or "connected" to another (e.g., 2nd) component, with or without the terms "functionally" or "communicationly," it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0213] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0214] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored in the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0215] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0216] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
Claim 1 An electronic device comprises: a first housing; a second housing disposed to be movable in a first direction or a second direction relative to the first housing; a driving device driven to move the first housing relative to the second housing; a flexible display comprising a first display area exposed when the first housing is coupled to the second housing in a first direction and a second display area extending integrally with the first display area and exposed when the first housing is moved to the second housing in a second direction by the driving device; at least one camera disposed within the first housing and the second housing; and a sensor disposed within the first housing and the second housing. An electronic device comprising: a processor operatively connected to the flexible display and the driving device; wherein the processor executes a first app supporting a quick camera mode in the first display area while the second housing is coupled to the first housing in a first direction, and when a specific motion is detected through the sensor in which the electronic device maintains a set time within a set tilt angle, the processor controls the driving device to move the second housing from the first housing in the second direction to expose the second display area, while maintaining the first app running in the first display area, calls the at least one camera in the second display area to execute a quick camera mode corresponding to the first app, and, based on the completion of the camera function execution based on the quick camera mode, terminates the quick camera mode and changes the state in which the second housing is coupled to the first housing in a first direction. Claim 2 In claim 1, the processor is an electronic device configured to execute the quick camera mode in a specific area within the execution screen of the first app without exposing the second display area in response to the specific motion when the first app supporting the quick camera mode is not set as a display extension. Claim 3 An electronic device according to claim 1, wherein the quick camera mode is a camera mode that provides only some camera functions designated per app characteristic or specific activity screen of the app, and designates a different calling lens among the camera lenses. Claim 4 An electronic device configured such that, in the first paragraph, the processor displays a camera user interface of a quick camera mode specified in relation to the first app in the second display area while maintaining the execution screen of the first app in the first display area. Claim 5 An electronic device according to claim 1, wherein the processor displays a camera switching screen indicating that a camera is being called in the second display area while the second display area is exposed, and activates the at least one camera based on the completion of the exposure of the second display area to display an image acquired through the at least one camera as a preview screen in the second display area. Claim 6 An electronic device according to claim 5, wherein the processor displays a quick camera notification object guiding a quick camera mode call when the first app supports a quick camera mode call, and visually provides a different display state of the quick camera notification object after at least one camera call, and the quick camera notification object is configured not to be displayed in an indicator area, or when the second app executed in the first display area does not support a quick camera mode, or when a specific activity screen within the first app does not support a quick camera mode. Claim 7 delete Claim 8 delete Claim 9 An electronic device according to claim 1, wherein the processor is further configured to insert or attach an image or video captured through the quick camera mode to the execution screen of the first app displayed in the first display area based on the completion of the execution of the camera function based on the quick camera mode. Claim 10 An electronic device according to claim 1, wherein the processor, after capturing an image or video through a quick camera mode running in the second display area, if there is an additional function related to the image or video, further provides an additional function user interface in the second display area, and the additional function includes at least one of a post-correction function, a text input function, and a drawing function. Claim 11 delete Claim 12 An electronic device further configured such that, in the first paragraph, when the second housing is coupled to the first housing in a first direction and a lock screen is displayed in the first display area, and a specific motion is detected through the sensor that maintains a set time within a set tilt angle of the electronic device, the processor does not call a camera mode as a full screen of the first display area, but controls the driving device to move the second housing from the first housing in the second direction to expose the second display area, and calls the camera in the second display area to display a camera user interface. Claim 13 A method for automatically executing a camera of an electronic device including a flexible display, comprising: an action of executing a first app that supports a quick camera mode in a reduced state in which a display, in which a display area for displaying visual information can be reduced or expanded, has a first display area; an action of changing the display to an expanded state that exposes a second display area extending from the first display area when a specific motion is detected in which the electronic device maintains a set time within a set tilt angle; an action of calling a camera to the second display area to execute a quick camera mode corresponding to the first app while maintaining the first app running in the first display area; and an action of terminating the quick camera mode and changing the display back to a reduced state having the first display area based on the completion of the camera function execution based on the quick camera mode. Claim 14 delete Claim 15 delete Claim 16 delete Claim 17 delete Claim 18 delete Claim 19 delete Claim 20 delete
Citation Information
Patent Citations
Mobile terminal and method of controlling the same
KR1020170037466A
Elelctronic device for controlling a plurality of applications
KR1020190089374A
A method and an electronic device providing a function or a content relating to an application
KR1020190098340A
Electronic device including flexible display and method for controlling thereof
KR1020190141518A
Electronic device of sliding type
KR1020210041380A
