Electronic device including flexible display, and operation method and storage medium thereof
The electronic device with a flexible display dynamically adjusts AI functions based on folding states, addressing inefficiencies in existing devices by enhancing user experience and energy efficiency through intelligent AI integration.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-10-23
- Publication Date
- 2026-06-11
Smart Images

Figure KR2025016890_11062026_PF_FP_ABST
Abstract
Description
Electronic device including a flexible display, method of operation thereof, and storage medium
[0001] The present disclosure relates to an electronic device including a flexible display according to one embodiment, a method of operation thereof, and a storage medium.
[0002] The artificial intelligence (AI) features of electronic devices (e.g., smartphones) aim to provide a better user experience and improve the energy efficiency of electronic devices by having AI assist users in various tasks such as taking photos, editing, and writing text.
[0003] With the recent widespread adoption of electronic devices including flexible displays, the importance of technology for controlling the screen displayed on flexible displays is increasing.
[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.
[0005] According to one embodiment, an electronic device that can be arranged in a folded state including a fully folded state, a partially folded state, and a fully unfolded state may include a housing comprising a first housing, a second housing, and a third housing. In the fully unfolded state of the electronic device, the second housing may be positioned between the first housing and the third housing. The electronic device may include a first hinge structure configured to rotatably connect the first housing and the second housing, and a second hinge structure configured to rotatably connect the second housing and the third housing. The electronic device may include a first display comprising a first display area corresponding to the first housing, a second display area corresponding to the second housing, and a third display area corresponding to the third housing. The electronic device may include a second display configured to face in the opposite direction to the direction in which the first display faces in the fully unfolded state of the electronic device. The electronic device may include at least one sensor including a sensing circuit, at least one processor including a processing circuit, and a memory for storing instructions. When the instructions are executed individually or collectively by at least one processor, they may cause the electronic device to check the folding state of the electronic device. When the instructions are executed individually or collectively by at least one processor, they may cause the electronic device to display a first screen of a first application through the second display in the fully folded state.When the above instructions are executed individually or collectively by at least one processor, the electronic device may be caused to identify at least one artificial intelligence (AI) function related to the execution of the first application based on identifying a first change from the fully folded state to the partially folded state, and to display a second screen including a user interface (UI) representing the at least one AI function in a display area visually exposed in the partially folded state on the first display. When the above instructions are executed individually or collectively by at least one processor, the electronic device may be caused to apply the selected first AI function to the first application based on a first user input for selecting the first AI function among the at least one AI function.
[0006] According to one embodiment, a method of operating an electronic device may include an operation of checking the folding state of the electronic device. The folding state may include a fully folded state, a partially folded state, and a fully unfolded state. The method may include an operation of displaying a first screen of a first application through a second display of the electronic device in the fully folded state. The method may include an operation of identifying at least one artificial intelligence (AI) function related to the execution of the first application based on identifying a first change from the fully folded state to the partially folded state, and displaying a second screen including a user interface (UI) representing the at least one AI function on a first display (202; 302) of the electronic device (101; 200; 300) in a display area visually exposed in the partially folded state. The above method may include an operation of applying the selected first AI function to the first application based on a first user input for selecting a first AI function among the at least one AI function.
[0007] According to one embodiment, in a non-transitory computer-readable storage medium for storing instructions, the instructions may cause the electronic device to perform at least one operation when executed individually or collectively by at least one processor of the electronic device. The at least one operation may include an operation of checking the folding state of the electronic device. The folding state may include a fully folded state, a partially folded state, and a fully unfolded state. The at least one operation may include an operation of displaying a first screen of a first application through a second display of the electronic device in the fully folded state. The above at least one operation may include identifying at least one artificial intelligence (AI) function related to the execution of the first application based on identifying a first change from the fully folded state to the partially folded state, and displaying a second screen including a user interface (UI) representing the at least one AI function in a display area visually exposed in the partially folded state on the first display (202; 302) of the electronic device (101; 200; 300). The above at least one operation may include applying the selected first AI function to the first application based on a first user input for selecting a first AI function among the at least one AI function.
[0008] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0009] FIG. 1a is a block diagram of an electronic device in a network environment according to one embodiment.
[0010] FIG. 1b is a block diagram of an electronic device (101) according to one embodiment.
[0011] FIG. 2a is a perspective view of a first type of electronic device according to one embodiment in an unfolded state.
[0012] FIG. 2b is a perspective view of a first type of electronic device according to one embodiment in an unfolded state.
[0013] FIG. 2c is a perspective view of a first type of electronic device according to one embodiment in a completely folded state.
[0014] FIG. 2d is a drawing of a first type of electronic device according to one embodiment in a partially folded state.
[0015] FIG. 2e is a drawing of a first type of electronic device according to one embodiment in a partially folded state.
[0016] FIG. 3a is a perspective view of a second type of electronic device according to one embodiment in an unfolded state.
[0017] FIG. 3b is a perspective view of a second type of electronic device according to one embodiment in an unfolded state.
[0018] FIG. 3c is a drawing illustrating the folded state of a second type of electronic device according to one embodiment.
[0019] FIG. 4a is a drawing illustrating types of electronic devices according to one embodiment.
[0020] FIG. 4b is a front view of a third type electronic device in an unfolded state according to one embodiment.
[0021] FIG. 4c is a rear view of a third type electronic device in an unfolded state according to one embodiment.
[0022] FIG. 4d is a perspective view of a third type electronic device in a folded state according to one embodiment.
[0023] FIG. 4e is a front perspective view of a third type electronic device in a folded state according to one embodiment.
[0024] FIG. 4f is a rear perspective view of a third type electronic device in a folded state according to one embodiment.
[0025] FIG. 4g is a front view of a third type electronic device in a folded state according to one embodiment.
[0026] FIG. 4h is a rear view of a third type electronic device in a folded state according to one embodiment.
[0027] FIG. 5 is a flowchart of a method of operation of an electronic device according to one embodiment.
[0028] FIG. 6 is a flowchart of a method of operation of an electronic device according to one embodiment.
[0029] FIG. 7 is a diagram illustrating the operation of an electronic device according to one embodiment.
[0030] FIG. 8 is a diagram illustrating the operation of an electronic device according to one embodiment.
[0031] FIG. 9 is a diagram illustrating the operation of an electronic device according to one embodiment.
[0032] FIG. 10 is a drawing illustrating the operation of an electronic device according to one embodiment.
[0033] FIG. 11 is a drawing illustrating the operation of an electronic device according to one embodiment.
[0034] FIG. 12 is a drawing illustrating the operation of an electronic device according to one embodiment.
[0035] FIG. 13 is a diagram illustrating the operation of an electronic device according to one embodiment.
[0036] FIG. 14 is a drawing illustrating the operation of an electronic device according to one embodiment.
[0037] FIG. 15 is a diagram illustrating the operation of an electronic device according to one embodiment.
[0038] FIG. 16 is a drawing illustrating the operation of an electronic device according to one embodiment.
[0039] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily implement them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0040] FIG. 1a is a block diagram of an electronic device (101) in a network environment (100) according to one embodiment.
[0041] Referring to FIG. 1a, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0042] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0043] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0044] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0045] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0046] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0047] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0048] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0049] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0050] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor. In one embodiment, the sensor module (176) may include sensor circuitry. In one embodiment, the sensor module (176) may include a first sensor, a second sensor, and / or a third sensor. In one embodiment, the sensor circuitry may include a first sensor, a second sensor, and / or a third sensor.
[0051] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0052] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0053] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0054] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0055] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0056] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0057] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0058] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.
[0059] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0060] According to one embodiment, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0061] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0062] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0063] FIG. 1b is a block diagram of an electronic device (101) according to one embodiment.
[0064] Referring to FIG. 1b, according to one embodiment, an electronic device (101) (e.g., the display module (160) of FIG. 1) may include a flexible display (162) (e.g., 202 of FIG. 2a, 302 of FIG. 3a, the flexible display of FIG. 4a, or 403 of FIG. 4b). According to one embodiment, an electronic device (101) (e.g., the display module (160) of FIG. 1) may include a cover display (161) (e.g., 203 of FIG. 2a, 303 of FIG. 3a, or the cover display of FIG. 4a). For example, the cover display (161) may be configured to face in a direction opposite to the direction in which the flexible display (162) faces when the electronic device (101) is unfolded. According to one embodiment, the electronic device (101) may not include a cover display (161). For example, a portion of the flexible display (403) of the electronic device (400) of FIG. 4b can perform the operation performed by the cover display (161) of the electronic device (101) by being exposed to the outside in a fully folded state of the electronic device (400).
[0065] According to one embodiment, the electronic device (101) may include a housing (e.g., 201 in FIG. 2a, 301 in FIG. 3a, the housing in FIG. 4a, or 401 in FIG. 4b) configured to form an outer surface of the electronic device (101). For example, the housing of the electronic device (101) (e.g., 201 in FIG. 2a, 301 in FIG. 3a, the housing in FIG. 4a, or 401 in FIG. 4b) may be a foldable housing (e.g., 201 in FIG. 2a, 301 in FIG. 3a, the housing in FIG. 4a, or 401 in FIG. 4b). According to one embodiment, a foldable housing (e.g., 201 in FIG. 2a, 301 in FIG. 3a, the housing in FIG. 4a, or 401 in FIG. 4b) may include a plurality of housing parts (e.g., 210, 220, 230 in FIG. 2a, 310, 320, 330 in FIG. 3a, the housings in FIG. 4a, or 410, 420, 430 in FIG. 4b).
[0066] According to one embodiment, the electronic device (101) may include at least one hinge (e.g., at least one hinge structure) (e.g., 270, 280 in FIG. 2b, 370, 380 in FIG. 3b, the hinge in FIG. 4a, or 440, 450 in FIG. 4b) configured to rotatably connect housings (e.g., a plurality of housing parts of a foldable housing) (e.g., 210, 220, 230 in FIG. 2a, 310, 320, 330 in FIG. 3b, the housings in FIG. 4a, or 410, 420, 430 in FIG. 4b).
[0067] According to one embodiment, the flexible display (162) may be disposed in a foldable housing (e.g., 201 in FIG. 2a, 301 in FIG. 3a, the housing in FIG. 4a, or 401 in FIG. 4b). For example, the flexible display (162) may be disposed across a plurality of housing parts (e.g., 210, 220, 230 in FIG. 2a, 310, 320, 330 in FIG. 3a, the housings in FIG. 4a, or 410, 420, 430 in FIG. 4b) of the foldable housing (e.g., 201 in FIG. 2a, 301 in FIG. 3a, the housing in FIG. 4a, or 410, 420, 430 in FIG. 4b). According to one embodiment, the flexible display (162) has, as described below, a foldable region (e.g., 202d, 202e in FIG. 2a, 302d, 302e in FIG. 3a, or A4 in FIG. 4b) among a plurality of regions of the flexible display (162), depending on the rotation of at least one hinge (e.g., at least one hinge structure) (e.g., 270, 280 in FIG. 2b, 370, 380 in FIG. 3b, hinge in FIG. 4a, or 440, 450 in FIG. 4b), a region corresponding to at least one hinge (e.g., 270, 280 in FIG. 2b, 370, 380 in FIG. 3b, hinge in FIG. 4a, or 440, 450 in FIG. 4b). A5) can be folded.
[0068] Referring to FIGS. 2a, FIGS. 3a, and FIGS. 4a, the type of electronic device (101) will be described.
[0069] FIG. 2a is a perspective view of a first type of electronic device (200) according to one embodiment in an unfolded state. FIG. 2b is a perspective view of a first type of electronic device (200) according to one embodiment in an unfolded state. FIG. 2a may be a view of one side (e.g., front) of the electronic device (200) taken obliquely, and FIG. 2b may be a view of the other side (e.g., rear) of the electronic device (200) taken obliquely. According to one embodiment, the electronic device (200) may be the electronic device (101) of FIG. 1a.
[0070] According to one embodiment, the electronic device (200) may include a housing (201). The electronic device (200) may include a display (202). The housing (201) may form a space in which the display (202) is placed. The display (202) may be a flexible display (202). Depending on the folding state of the electronic device (200), at least a portion of the display (202) may be folded or unfolded.
[0071] According to one embodiment, the housing (201) may include a first housing (210). The housing (201) may include a second housing (220). The housing (201) may include a third housing (230). The first housing (210) may be positioned between the second housing (220) and the third housing (230). The second housing (220) may be rotatably coupled to the first housing (210). The third housing (230) may be rotatably coupled to the first housing (210). A display (202) may be visually exposed through a first portion of the first housing (210), a second portion of the second housing (220), and a third portion of the third housing (230). The display (202) may include a first display area (202a) corresponding to a first housing (210), a second display area (202b) corresponding to a second housing (220), and a third display area (202c) corresponding to a third housing (230). According to one embodiment, the first display area (202a) may include a portion of a foldable area (202d). According to one embodiment, the second display area (202b) may include a portion of a foldable area (202d). According to one embodiment, the first display area (202a) may be in contact with the second display area (202b). According to one embodiment, the first display area (202a) may include a portion of a foldable area (202e). According to one embodiment, the third display area (202c) may include a portion of a foldable area (202e). According to one embodiment, the first display area (202a) may be in contact with the third display area (202c).
[0072] According to one embodiment, a camera (291) (e.g., a front camera) may be placed in an area of the display (202). The camera (291) (e.g., a front camera) may be configured to capture a scene in the direction the display (202) is facing when the electronic device (200) is fully unfolded. For example, the camera (291) may be placed in a first display area (202a). For example, the camera (291) may be placed in a second display area (202b). For example, the camera (291) may be placed in a third display area (202c). In FIG. 2a, the camera (291) is shown placed in the first display area (202a), but this is exemplary.
[0073] According to one embodiment, referring to FIG. 2b, the electronic device (200) may include a camera (292) (e.g., a rear camera) exposed through the rear of the housing (201). The camera (292) (e.g., a rear camera) may be configured to capture a scene in a direction opposite to the direction in which the display (202) (e.g., a flexible display) is facing when the electronic device (200) is fully unfolded. For example, the camera (292) may be exposed through the rear of the first housing (210). For example, the camera (292) may be exposed through the rear of the second housing (220). For example, the camera (292) may be exposed through the rear of the third housing (230). In FIG. 2b, the camera (292) is shown exposed through the rear of the first housing (210), but this is exemplary.
[0074] According to one embodiment, the electronic device (200) may include a support (240, 250, 260). The support (240, 250, 260) may support a display (202). The support (240, 250, 260) may be coupled to a housing (201). The support (240, 250, 260) may be positioned to surround the edge of the display (202). The support (240, 250, 260) may extend along the perimeter of the housing (201). The support members (240, 250, 260) may include a first support member (240) disposed in a first housing (210), a second support member (250) disposed in a second housing (220), and a third support member (260) disposed in a third housing (230).
[0075] According to one embodiment, the support (240, 250, 260) may include a first support (240). The first support (240) may support at least a portion of the display (202). The first support (240) may be positioned along the edge of the first housing (210). The first support (240) may include a first-1 support (241) and a first-2 support (242). At least a portion of the display (202) may be positioned between the first-1 support (241) and the first-2 support (242). The first-1 support (241) may be positioned at one end of the first housing (210), and the first-2 support (242) may be positioned at the other end of the first housing (210). Each of the first, second, and third supports (240, 250, 260) may be named "support." The supports (240, 250, 260) may include a non-conductive member. The supports (240, 250, 260) may be named "deco," "finishing member," or "non-conductive member."
[0076] According to one embodiment, the support (240, 250, 260) may include a second support (250). The second support (250) may support at least a portion of the display (202). The second support (250) may be positioned along the edge of the second housing (220). The second support (250) may include a second-1 support (251), a second-2 support (252), and a second-3 support (253). At least a portion of the display (202) may be positioned between the second-2 support (252) and the second-3 support (253). The second-1 support (251) may connect the second-2 support (252) and the second-3 support (253). The second-1 support (251) may extend along the edge of the second housing (220). The 2-1 support (251) may be named "support frame" or "first support frame". The 2-2 support (252) and the 2-3 support (253) may each be named "second support frame".
[0077] According to one embodiment, the support (240, 250, 260) may include a third support (260). The third support (260) may support at least a portion of the display (202). The third support (260) may be positioned along the edge of the third housing (230). The third support (260) may include a third-1 support (261), a third-2 support (262), and a third-3 support (263). At least a portion of the display (202) may be positioned between the third-2 support (262) and the third-3 support (263). The third-1 support (261) may connect the third-2 support (262) and the third-3 support (263). The third-1 support (261) may extend along the edge of the third housing (230) (e.g., the edge (232) in FIG. 2b). The third-1 support (261) may be named "support frame" or "first support frame". The third-2 support (262) and the third-3 support (263) may each be named "second support frame".
[0078] According to one embodiment, the first housing (210) may include a first-1 side member (211) and a first-2 side member (212). Each of the first-1 side member (211) and the first-2 side member (212) may form opposite sides of the first housing (210). The second housing (220) may be coupled with the first-1 side member (211). The third housing (230) may be coupled with the first-2 side member (212). The first-1 side member (211) may be named the "first coupling part." The first-2 side member (212) may be named the "second coupling part." The first-1 side member (211) may be named the "first part." The first-2 side member (212) may be named the "second part."
[0079] According to one embodiment, the second housing (220) may include a second-1 side member (221) and a second-2 side member (222). Each of the second-1 side member (221) and the second-2 side member (222) may form opposite sides of the second housing (220). The second-1 side member (221) may be coupled to the first housing (210). The second-2 side member (222) may form a side of the housing (201). The second-2 side member (222) may be named "edge". The second-1 side member (221) may be named "third side member". The second-2 side member (222) may be named "fourth side member".
[0080] According to one embodiment, the electronic device (200) may include a cover display (203). A second housing (220) may form a space in which the cover display (203) is placed. For example, the cover display (203) may be placed between a second-1 side member (221) and a second-2 side member (222). The cover display (203) may be a flat display.
[0081] According to one embodiment, the second housing (220) may be positioned such that one side surrounds the edge of a part of the display (202) and the other side surrounds the edge of the cover display (203). The electronic device (200) may include an internal space of the second housing (220) formed by wrapping the second housing (220), wherein one side is the cover display (203), the other side parallel to the one side is a part of the display (202), and the side includes a second-1 side member (221) and a second-2 side member (222).
[0082] According to one embodiment, a camera (293) (e.g., a cover display camera) may be disposed in a region of the second housing (220). The camera (293) (e.g., a cover display camera) may be configured to capture a scene in the direction in which the cover display (203) is facing. The camera (293) (e.g., a cover display camera) may be configured to capture a scene in the opposite direction to the direction in which the display (202) (e.g., a flexible display) is facing when the electronic device (200) is fully unfolded.
[0083] According to one embodiment, the third housing (230) may include a third-1 side member (231) and a third-2 side member (232). Each of the third-1 side member (231) and the third-2 side member (232) may form opposite sides of the third housing (230). The third-1 side member (231) may be coupled to the first housing (210). The third-2 side member (232) may form a side of the housing (201). The third-2 side member (232) may be named "edge". The third-1 side member (231) may be named "fifth side member". The third-2 side member (232) may be named "sixth side member".
[0084] According to one embodiment, a cover display may be disposed in the space formed by the third housing (230). For example, the cover display may be disposed between the third-1 side member (231) and the third-2 side member (232). The cover display may be a flat display. According to one embodiment, a camera may be disposed in one area of the cover display.
[0085] According to one embodiment, the electronic device (200) may include a first hinge (270) (e.g., a first hinge structure) and a second hinge (280) (e.g., a second hinge structure). The electronic device (200) may include a hinge structure (290) comprising the first hinge (270) and the second hinge (280). The first hinge (270) may be positioned between a first housing (210) and a second housing (220). The first hinge (270) may be positioned between a first-1 side member (211) and a second-1 side member (221). The first hinge (270) may rotatably connect the first housing (210) and the second housing (220). The second hinge (280) may be positioned between the first housing (210) and the third housing (230). The second hinge (280) may be positioned between the first-2 side member (212) and the third-1 side member (231). The second hinge (280) may rotatably connect the first housing (210) and the third housing (230). The first hinge (270) may be named the "first hinge member." The second hinge (280) may be named the "second hinge member."
[0086] FIG. 2c is a perspective view of a first type of electronic device (200) according to one embodiment in a completely folded state.
[0087] According to one embodiment, the second housing (220) can be rotated relative to the first housing (210). The first hinge (270) can provide a center of rotation to the second housing (220). The first hinge (270) can connect the first-1 side member (211) and the second-1 side member (221). The third housing (230) can be rotated relative to the first housing (210). The second hinge (280) can provide a center of rotation to the third housing (230). The second hinge (280) can connect the first-2 side member (212) and the third-1 side member (231).
[0088] According to one embodiment, when the electronic device (200) is in a fully folded state, each of the first, second, and third housings (210, 220, 230) may be arranged in one direction (e.g., +Z direction). For example, the third housing (230) may be placed above the first housing (210) (e.g., +Z direction), and the second housing (220) may be placed above the third housing (230) (e.g., +Z direction). For example, the third housing (230) may be placed between the first housing (210) and the second housing (220).
[0089] According to one embodiment, when the electronic device (200) is in a fully folded state, a cover display (203) may be disposed on the portion visible from the outside of the second housing (220). For example, the cover display (203) may be disposed between the second-1 side member (221) and the second-2 side member (222).
[0090] The width of the first hinge (270) may be greater than the width of the second hinge (280). For example, when the electronic device (200) is in a fully folded state, the length of the first hinge (270) extended in the +Z direction may be greater than the length of the second hinge (280) extended in the +Z direction.
[0091] FIG. 2d is a drawing of a first type of electronic device (200) according to one embodiment in a partially folded state. FIG. 2d may be a half-folded state in which the electronic device (200) has only one hinge (e.g., second hinge (280)) completely folded and the other hinge (e.g., first hinge (270)) completely unfolded.
[0092] According to one embodiment, the third housing (230) can be rotated relative to the first housing (210). The second hinge (280) can provide a center of rotation to the third housing (230). As shown in FIG. 2d, when the second hinge (280) is fully folded, the third housing (230) can be positioned on the upper side of the first housing (210).
[0093] According to one embodiment, the second housing (220) can be rotated relative to the first housing (210). The first hinge (270) can provide a center of rotation to the second housing (220). As shown in FIG. 2d, when the first hinge (270) is fully extended, the second housing (220) can be positioned side by side with the first housing (210).
[0094] According to one embodiment, a third housing (230) is positioned on the upper side of a first housing (210), and a second housing (220) is positioned alongside the first housing (210), so that only the second display area (202b) of the display (202) positioned in the second housing (220) is exposed to the outside, and the rear surface of the third housing (230) may face in the +Z-axis direction.
[0095] According to one embodiment, the electronic device (200) may be transformed into a half-folded state in which one hinge (e.g., second hinge (280)) is fully unfolded and the other hinge (e.g., first hinge (270)) is fully folded. According to one embodiment, in a half-folded state, the second housing (220) is positioned on the upper side of the first housing (210), and the third housing (230) is positioned alongside the first housing (210), so that only the third display area (202c) of the display (202) positioned in the third housing (230) is exposed to the outside, and the rear side of the third housing (230) may face in the -Z axis direction.
[0096] FIG. 2e is a drawing of a first type of electronic device (200) according to one embodiment in a partially folded state. FIG. 2e may show the electronic device (200) in a semi-folded state where a plurality of hinges (e.g., a first hinge (270) and a second hinge (280)) have angles within a specific range. For example, a state in which a plurality of hinges (e.g., a first hinge (270) and a second hinge (280)) have angles within a specific range may be referred to as a prism state or prism mode. According to one embodiment, as shown in FIG. 2e, when the longitudinal direction of a plurality of hinges of the electronic device in the prism state (or prism mode) is arranged parallel to the bottom surface so as to be horizontal to the bottom surface, it may be referred to as a prism flex. According to one embodiment, unlike FIG. 2e, when an electronic device is in an upright state and a plurality of hinges of the electronic device in a prism state are arranged perpendicular to the bottom surface such that their longitudinal directions are perpendicular to the bottom surface, it can be referred to as a prism stand.
[0097] As illustrated in FIG. 2e, when a first hinge (270) providing a center of rotation to the second housing (220) with respect to the first housing (210) is folded to have an angle within a specific range, and a second hinge (280) providing a center of rotation to the third housing (230) with respect to the first housing (210) is folded to have an angle within a specific range, the first housing (210), the second housing (220), and the third housing (230) can form a triangle in the +Y direction and / or -Y direction.
[0098] According to one embodiment, the display (202) is folded to have a space in the shape of a triangular prism, and the cover display (203) may be positioned facing the front. According to one embodiment, the side of the third housing (230) where the display (202) is not positioned may face the bottom surface.
[0099] FIGS. 3a, FIGS. 3b, and FIGS. 3c are drawings for illustrating an electronic device (300) that folds in a different way than the electronic device (200) of FIGS. 2a, FIGS. 2b, FIGS. 2c, FIGS. 2d, and FIGS. 2e.
[0100] FIG. 3a is a perspective view of a second type of electronic device (300) according to one embodiment in an unfolded state. FIG. 3b is a perspective view of a second type of electronic device (300) according to one embodiment in an unfolded state. FIG. 3c is a drawing illustrating the folded state of a second type of electronic device (300) according to one embodiment. FIG. 3a may be a drawing of one side (e.g., front) of the electronic device (300) viewed obliquely, and FIG. 3b may be a drawing of the other side (e.g., rear) of the electronic device (300) viewed obliquely. According to one embodiment, the electronic device (300) may be the electronic device (101) of FIG. 1a.
[0101] According to one embodiment, the electronic device (300) may include a housing (301). The electronic device (300) may include a display (302). The housing (301) may form a space in which the display (302) is placed. The display (302) may be a flexible display (302). At least a portion of the display (302) may be folded or unfolded.
[0102] According to one embodiment, the housing (301) may include a first housing (310). The housing (301) may include a second housing (320). The housing (301) may include a third housing (330). The first housing (310) may be positioned between the second housing (320) and the third housing (330). The second housing (320) may be rotatably coupled to the first housing (310). The third housing (330) may be rotatably coupled to the first housing (310). A display (302) may be visually exposed through a first portion of the first housing (310), a second portion of the second housing (320), and a third portion of the third housing (330). The display (302) may include a first display area (302a) corresponding to the first housing (310), a second display area (302b) corresponding to the second housing (320), and a third display area (302c) corresponding to the third housing (330). According to one embodiment, the first display area (302a) may include a portion of the foldable area (302d). According to one embodiment, the second display area (302b) may include a portion of the foldable area (302d). According to one embodiment, the first display area (302a) may be in contact with the second display area (302b). According to one embodiment, the first display area (302a) may include a portion of the foldable area (302e). According to one embodiment, the third display area (302c) may include a portion of the foldable area (302e). According to one embodiment, the first display area (302a) may be in contact with the third display area (302c).
[0103] According to one embodiment, a camera (391) (e.g., a front camera) may be placed in a region of the housing (301). The camera (391) (e.g., a front camera) may be configured to capture a scene in the direction facing the display (302) when the electronic device (300) is fully unfolded. For example, the camera (391) may be placed in a first display area (302a). For example, the camera (391) may be placed in a second display area (302b). For example, the camera (391) may be placed in a third display area (302c). In FIG. 3a, the camera (391) is shown placed in the third display area (302c), but this is exemplary.
[0104] According to one embodiment, referring to FIG. 3b, the electronic device (300) may include a camera (392) (e.g., a rear camera) exposed through the rear of the housing (301). The camera (392) (e.g., a rear camera) may be configured to capture a scene in a direction opposite to the direction in which the display (302) is facing when the electronic device (300) is fully unfolded. For example, the camera (392) may be exposed through the rear of the first housing (310). For example, the camera (392) may be exposed through the rear of the second housing (320). For example, the camera (392) may be exposed through the rear of the third housing (330). In FIG. 3b, the camera (392) is shown exposed through the rear of the third housing (330), but this is exemplary.
[0105] According to one embodiment, the electronic device (300) may include a cover display (303). The first housing (310) may form a space in which the cover display (303) is placed. The cover display (303) may be a flat display.
[0106] According to one embodiment, a camera (393) (e.g., cover display camera) may be placed in an area of the cover display (303). The camera (393) (e.g., cover display camera) may be configured to capture a scene in the direction in which the cover display (303) is facing. The camera (393) (e.g., cover display camera) may be configured to capture a scene in the opposite direction to the direction in which the display (302) (e.g., flexible display) is facing when the electronic device (300) is fully unfolded.
[0107] According to one embodiment, a cover display may be disposed in a space formed by the second housing (320). For example, the electronic device (300) may include a cover display (e.g., a flat display) disposed in the second housing (320). According to one embodiment, a camera (e.g., a cover display camera) may be disposed in a region of the cover display disposed in the second housing (320).
[0108] According to one embodiment, the electronic device (300) may include a first hinge (370) (e.g., a first hinge structure) and a second hinge (380) (e.g., a second hinge structure). The electronic device (300) may include a hinge structure (390) comprising the first hinge (370) and the second hinge (380). The first hinge (370) may be positioned between a first housing (310) and a second housing (320). The first hinge (370) may rotatably connect the first housing (310) and the second housing (320). The second hinge (380) may be positioned between the first housing (310) and a third housing (330). The second hinge (380) can rotatably connect the first housing (310) and the third housing (330). The first hinge (370) may be named "first hinge member". The second hinge (380) may be named "second hinge member".
[0109] Referring to FIG. 3c, the folded state or unfolded operation of an electronic device (300) according to one embodiment can be described.
[0110] According to one embodiment, the second housing (320) can be rotated relative to the first housing (310). The first hinge (370) can provide a center of rotation to the second housing (320). The third housing (330) can be rotated relative to the first housing (310). The second hinge (380) can provide a center of rotation to the third housing (330).
[0111] Referring to FIG. 3c, according to one embodiment, when the electronic device (300) is in a fully folded state, each of the first, second, and third housings (310, 320, 330) may be arranged in one direction. For example, the second housing (320) may be placed above the third housing (330) (e.g., in the +Z direction), and the first housing (310) may be placed above the second housing (320) (e.g., in the +Z direction). For example, the second housing (320) may be placed between the third housing (330) and the first housing (310).
[0112] Referring to FIG. 3c, according to one embodiment, when the electronic device (300) is in a completely folded state, a cover display (303) may be placed on the part visible from the outside of the first housing (310).
[0113] Referring to FIG. 3c, the width of the second hinge (380) may be greater than the width of the first hinge (370). For example, when the electronic device (300) is in a fully folded state, the extended length of the second hinge (380) may be greater than the extended length of the first hinge (370).
[0114] Referring to FIG. 3c, according to one embodiment, the electronic device (300) may be in a half-folded state in which only one hinge (e.g., first hinge (370)) is fully folded and the other hinge (e.g., second hinge (380)) is fully unfolded.
[0115] Referring to FIG. 3c, according to one embodiment, the second housing (320) can be rotated relative to the first housing (310). The first hinge (370) can provide a center of rotation to the second housing (320). When the first hinge (370) is fully folded and the second hinge (380) is fully unfolded, the second housing (320) can be positioned on the upper side of the first housing (310).
[0116] Referring to FIG. 3c, according to one embodiment, a second housing (320) is positioned on the upper side of a first housing (310), and a third housing (330) is positioned alongside the first housing (310), so that only the third display area (302c) of the display (302) positioned in the third housing (330) is exposed to the outside, and the rear surface of the second housing (320) can be exposed to the outside.
[0117] According to one embodiment, the electronic device (300) may be transformed into a half-folded state in which one hinge (e.g., first hinge (370)) is fully unfolded and the other hinge (e.g., second hinge (380)) is fully folded. According to one embodiment, in the half-folded state of the electronic device (101), a third housing (330) is positioned on the upper side of the first housing (310), and a second housing (320) is positioned alongside the first housing (310), so that only the second display area (302b) of the display (302) positioned in the second housing (320) may be exposed to the outside.
[0118] According to one embodiment, the second housing (320) can be rotated relative to the first housing (310). The first hinge (370) can provide a center of rotation to the second housing (320). When the first hinge (370) is fully extended and the second hinge (380) is fully extended, the first housing (310), the second housing (320), and the third housing (330) can be arranged side by side.
[0119] FIG. 4a is a drawing illustrating types of electronic devices (101) according to one embodiment.
[0120] According to one embodiment, FIG. 4a is a drawing for illustrating various examples of an electronic device (e.g., 101 of FIG. 1a) comprising at least two housings and a flexible display (e.g., 162 of FIG. 1b).
[0121] According to one embodiment, an electronic device (e.g., 101 of FIG. 1a) may include two or more housings, hinges connecting the two or more housings so as to be foldable, and a flexible display.
[0122] According to one embodiment, the flexible display is disposed on two or more housings and can be bent according to the rotational state of the housings. One side of each of the two or more housings is connected to a hinge, and the two or more housings can be rotated around the hinge.
[0123] According to one embodiment, two or more housing structures and a flexible display are provided in an electronic device (e.g., 101 in FIG. 1a), and the electronic device (e.g., 101 in FIG. 1a) can be formed in various forms depending on the rotational state of the housing structures. For example, as illustrated in FIG. 4a, the various forms include a form that forms two regions in an electronic device (e.g., 101 in FIG. 1a) (e.g., flexible display) (half fold (Fig. 4a (c))), a form that forms three regions in an electronic device (e.g., 101 in FIG. 1a) (e.g., flexible display) (e.g., tri fold (Fig. 4a (a)), Z fold (Fig. 4a (b)), single open gate fold (Fig. 4a (f))), a form that forms four regions in an electronic device (e.g., 101 in FIG. 1a) (e.g., double parallel reverse fold (Fig. 4a (d)), double parallel fold (Fig. 4a (e)), double gate fold (Fig. 4a (g)), roll fold (Fig. 4a (h)), accordion fold (Fig. 4a (i)), half fold then half fold (Fig. 4a (j))), and An electronic device (e.g., 101 in FIG. 1a) (e.g., a flexible display) may include a shape that forms more than a number of regions (e.g., half fold then tri fold (k in FIG. 4a)). The electronic device (e.g., 101 in FIG. 1a) includes housing structures and a flexible display connected to each other so as to be rotatable, and the housing structures may be rotated in such a shape. According to one embodiment, in the case of an electronic device (e.g., 101 in FIG. 1a) comprising at least two housings and at least two displays disposed in each housing, each display of the electronic device (e.g., 101 in FIG. 1a) may form an angle with respect to each other depending on the rotational state of the housings.
[0124] Hereinafter, an electronic device (e.g., 101 of FIG. 1a) comprising two housings and a flexible display is described as an example, and an electronic device (e.g., 101 of FIG. 1a) according to one embodiment and a method of operation thereof will be described. However, the operation of displaying modified content of the electronic device (e.g., 101 of FIG. 1a) described below may also be applied to the description of an electronic device (e.g., 101 of FIG. 1a) comprising three or more housings and a flexible display. Accordingly, modified content displayed by the electronic device (e.g., 101 of FIG. 1a) comprising three or more housings and a flexible display can be seen by a user on a virtual plane.
[0125] Meanwhile, although the above electronic devices (e.g., 101 in FIG. 1a) are described as having one display disposed on a plurality of housings, they may also have different displays for each of the plurality of housings. Accordingly, the description of the electronic device (e.g., 101 in FIG. 1a) and the method of operation thereof according to the various embodiments described below may also be applied to the description of an electronic device (e.g., 101 in FIG. 1a) comprising at least two housings and at least two displays disposed in each housing. For example, the description below regarding the area of the flexible display corresponding to one housing may be applied to the description of the display corresponding to one housing among the plurality of displays provided in the electronic device (e.g., 101 in FIG. 1a).
[0126] FIG. 4b is a front view of a third type electronic device in an unfolded state according to one embodiment. FIG. 4c is a rear view of a third type electronic device in an unfolded state according to one embodiment. FIG. 4d is a perspective view of a third type electronic device in a folded state according to one embodiment. FIG. 4e is a front perspective view of a third type electronic device in a single-stage folded state according to one embodiment. FIG. 4f is a rear perspective view of a third type electronic device in a single-stage folded state according to one embodiment. FIG. 4g is a front view of a third type electronic device in a folded state according to one embodiment. FIG. 4h is a rear view of a third type electronic device in a folded state according to one embodiment.
[0127] With reference to FIGS. 4b to 4h, the structure of a third type electronic device (400) can be described. The electronic device (400) may be a foldable or bendable device (400) as an example of the electronic device (101) shown in FIG. 1. The configuration of the electronic device (400) in FIGS. 4b to 4h may be partly or wholly identical to the configuration of the electronic device (101) in FIG. 1.
[0128] For convenience of explanation, a spatial coordinate system (or orthogonal coordinate system) including an X-axis, a Y-axis, or a Z-axis may be illustrated in the drawings below.
[0129] According to one embodiment, the electronic device (400) may include a housing (401) and a flexible display (403) (e.g., the display module (160) of FIG. 1) disposed in the space formed by the housing (401).
[0130] According to one embodiment, the housing (401) of the electronic device (400) may be defined and / or referred to as a foldable housing (401) or a deformable housing (401).
[0131] According to one embodiment, when the electronic device (400) is unfolded (e.g., FIG. 4b), the side on which the flexible display (403) is placed (or the side on which the flexible display (403) is visible from the outside of the electronic device (400)) may be defined as the front (401a) of the electronic device (400). When the electronic device (400) is unfolded (e.g., FIG. 4c), the side opposite to the front (401a) may be defined as the rear (401b) of the electronic device (400). Additionally, the side surrounding the space between the front (401a) and the rear (401b) may be defined as the side of the electronic device (400).
[0132] According to one embodiment, the housing (401) of the electronic device (400) may include a first housing (410), a second housing (420), and a third housing (430). The electronic device (400) may include a first hinge (440) (e.g., a first hinge structure) and a second hinge (450) (e.g., a second hinge structure). The first hinge (440) may be defined and / or referred to as a first hinge assembly. The second hinge (450) may be defined and / or referred to as a second hinge assembly.
[0133] According to one embodiment, the first hinge (440) may be connected to the first housing (410) or the second housing (420). The second housing (420) may be rotatably connected to the first housing (410) using the first hinge (440). According to one embodiment, the second hinge (450) may be connected to the second housing (420) or the third housing (430). The third housing (430) may be rotatably connected to the second housing (420) using the second hinge (450).
[0134] According to one embodiment, the first housing (410) may be connected to the first hinge (440). The first housing (410) may include a first front facing a first direction (e.g., the +Z direction in FIG. 4b) and a first rear facing a second direction opposite to the first direction (e.g., the -Z direction in FIG. 4c). The second housing (420) may be connected to the first hinge (440). The second housing (420) may include a second front facing a first direction (e.g., the +Z direction in FIG. 4b) and a second rear facing a second direction opposite to the first direction (e.g., the -Z direction in FIG. 4c).
[0135] According to one embodiment, the first housing (410) can rotate about the second housing (420) around the first hinge (440). The first housing (410) and the second housing (420) can be provided in a folded state (e.g., FIG. 4d, FIG. 4e, and FIG. 4f) or an unfolded state (e.g., FIG. 4b, and FIG. 4c). When the first housing (410) and the second housing (420) are in a folded state, the first rear surface of the first housing (410) may face the second rear surface of the second housing (420). When the first housing (410) and the second housing (420) are in a folded state, the first front surface of the first housing (410) may face in the opposite direction to the second front surface of the second housing (420). When the first housing (410) and the second housing (420) are in an unfolded state, the first front surface of the first housing (410) may face the same direction as the second front surface of the second housing (420). When the first housing (410) and the second housing (420) are in an unfolded state, the first rear surface of the first housing (410) may face the same direction as the second rear surface of the second housing (420).
[0136] According to one embodiment, the second housing (420) may be connected to the second hinge (450). The third housing (430) may be connected to the second hinge (450). The third housing (430) may include a third front facing a first direction (e.g., the +Z direction in FIG. 4b) and a third rear facing a second direction opposite to the first direction (e.g., the -Z direction in FIG. 4c).
[0137] According to one embodiment, the second housing (420) can rotate relative to the third housing (430) around the second hinge (450). The second housing (420) and the third housing (430) may be provided in a folded state (e.g., FIG. 4d) or an unfolded state (e.g., FIG. 4b, FIG. 4c, FIG. 4e, and FIG. 4f). When the second housing (420) and the third housing (430) are in a folded state, the second front of the second housing (420) may face the third front of the third housing (430). When the second housing (420) and the third housing (430) are in a folded state, the second rear of the second housing (420) may face in the opposite direction to the third rear of the third housing (430). When the second housing (420) and the third housing (430) are in an unfolded state, the second front of the second housing (420) may face the same direction as the third front of the third housing (430). When the second housing (420) and the third housing (430) are in an unfolded state, the second rear of the second housing (420) may face the same direction as the third rear of the third housing (430).
[0138] According to one embodiment, the state of the electronic device (400) being fully folded can be defined as the state of the first housing (410) and the second housing (420) being folded, and at the same time, the state of the second housing (420) and the third housing (430) being folded. The state of the electronic device (400) being fully unfolded can be defined as the state of the first housing (410) and the second housing (420) being unfolded, and at the same time, the state of the second housing (420) and the third housing (430) being unfolded.
[0139] According to one embodiment, when the first housing (410) and the second housing (420) are completely folded, the first rear surface and the second rear surface may face each other. According to one embodiment, the first housing (410) and the second housing (420) are arranged on both sides centered on the first hinge (440) and may have a shape that is symmetrical overall with respect to the first hinge (440). However, the first housing (410) and the second housing (420) do not necessarily have a symmetrical shape. Depending on whether the state of the first housing (410) and the second housing (420) is an unfolded state, a folded state, or an intermediate state that is partially unfolded (or partially folded), the angle or distance formed between the first housing (410) and the second housing (420) may vary.
[0140] According to one embodiment, when the second housing (420) and the third housing (430) are completely folded, the second front and the third front may face each other. According to one embodiment, the second housing (420) and the third housing (430) are arranged on both sides centered on the second hinge (450) and may have a shape that is symmetrical overall with respect to the second hinge (450). However, the second housing (420) and the third housing (430) do not necessarily have a symmetrical shape. Depending on whether the state of the second housing (420) and the third housing (430) is an unfolded state, a folded state, or an intermediate state that is partially unfolded (or partially folded), the angle or distance formed between the second housing (420) and the third housing (430) may vary.
[0141] According to one embodiment, the first housing (410) may include a first rear cover (415). The first rear cover (415) may be positioned on one side of the first hinge (440) at the rear (401b) of the electronic device (400) and may have, for example, substantially rectangular edges. The edges of the first rear cover (415) may be wrapped by the sides of the first housing (410).
[0142] According to one embodiment, the second housing (420) may include a second rear cover (425). The second rear cover (425) may be positioned on the other side of the first hinge (440) or on one side of the second hinge (450) at the rear (401b) of the electronic device (400), and may have, for example, substantially rectangular edges. The edges of the second rear cover (425) may be wrapped by the sides of the second housing (420).
[0143] According to one embodiment, the third housing (430) may include a third rear cover (435). The third rear cover (435) may be positioned on the other side of the second hinge (450) at the rear (401b) of the electronic device (400) and may have, for example, substantially rectangular edges. The edges of the third rear cover (435) may be wrapped by the sides of the third housing (430).
[0144] According to one embodiment, the first rear cover (415) and the second rear cover (425) may have a substantially symmetrical shape with respect to the first hinge (440). The second rear cover (425) and the third rear cover (435) may have a substantially symmetrical shape with respect to the second hinge (450). However, the first rear cover (415), the second rear cover (425), and the third rear cover (435) do not necessarily have mutually symmetrical shapes, and in one embodiment, the electronic device (400) may include the first rear cover (415), the second rear cover (425), and the third rear cover (435) of various shapes. In one embodiment, the first rear cover (415) may be formed integrally with the first housing (410). The second rear cover (425) may be formed integrally with the second housing (420). The third rear cover (435) can be formed integrally with the third housing (430).
[0145] According to one embodiment, the first rear cover (415), the second rear cover (425), the third rear cover (435), the first housing (410), the second housing (420), and the third housing (430) may form a space in which various components of the electronic device (400) (e.g., a printed circuit board or a battery) may be placed. According to one embodiment, one or more components may be placed or visually exposed on the rear (401b) of the electronic device (400). One or more components or sensors (e.g., a camera (405)) may be visually exposed through the third rear cover (435).
[0146] According to one embodiment, the flexible display (403) may mean a display in which at least a portion of the flexible display (403) can be deformed into a flat or curved surface. For example, the flexible display (403) may be configured to be at least partially folded or at least partially unfolded.
[0147] According to one embodiment, the flexible display (403) may include a first display area (A1), a second display area (A2), a third display area (A3), a first folding area (A4), or a second folding area (A5). The first display area (A1) may be positioned on one side of the first folding area (A4), and the second display area (A2) may be positioned on the other side of the first folding area (A4). The second display area (A2) may be positioned on one side of the second folding area (A5), and the third display area (A3) may be positioned on the other side of the second folding area (A5).
[0148] According to one embodiment, a first display area (A1) may be placed on a first housing (410). A second display area (A2) may be placed on a second housing (420). A third display area (A3) may be placed on a third housing (430). According to one embodiment, a first folding area (A4) may be placed on a first hinge (440) connecting the first display area (A1) and the second display area (A2). A second folding area (A5) may be placed on a second hinge (450) connecting the second display area (A2) and the third display area (A3). The division of the areas of the flexible display (403) illustrated in FIG. 4b is exemplary, and the display may be divided into a plurality of areas (e.g., six or more or three) depending on the structure or function.
[0149] According to one embodiment, the first display area (A1) and the second display area (A2) may have a shape that is symmetrical overall with respect to the first folding area (A4). The second display area (A2) and the third display area (A3) may have a shape that is symmetrical overall with respect to the second folding area (A5). According to one embodiment, the first display area (A1) may include a portion of the first folding area (A4). According to one embodiment, the second display area (A2) may include a portion of the first folding area (A4). According to one embodiment, the first display area (A1) may be in contact with the second display area (A2). According to one embodiment, the second display area (A2) may include a portion of the second folding area (A5). According to one embodiment, the third display area (A3) may include a portion of the second folding area (A5). According to one embodiment, the second display area (A2) can be in contact with the third display area (A3).
[0150] According to one embodiment, when the electronic device (400) is in a fully folded state (e.g., FIG. 4d), a first folding region (A4) located on the first hinge (440) may be exposed to the outside of the electronic device (400), and a second folding region (A5) located on the second hinge (450) may be placed inside the electronic device (400) and not exposed to the outside. In one embodiment, the first hinge (440) may be defined and / or referred to as an out-folding hinge that exposes a portion of the flexible display (403) to the outside of the electronic device (400) when folded. The second hinge (450) may be defined and / or referred to as an in-folding hinge that does not expose a portion of the flexible display (403) to the outside when folded. In one embodiment, the first hinge (440) may be provided as an in-folding hinge, and the second hinge (450) may be provided as an out-folding hinge.
[0151] The operations of an electronic device (e.g., the electronic device (101) of FIG. 1a, the electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, the electronic device (e.g., 101 of FIG. 1a), or the electronic device (400) of FIG. 4b) may be described in detail with reference to the aforementioned embodiments (e.g., embodiments of FIG. 1a, FIG. 1b, FIG. 2a, FIG. 2b, FIG. 2c, FIG. 2d, FIG. 2e, FIG. 3a, FIG. 3b, FIG. 3c, FIG. 4a, FIG. 4b) and the embodiments described below (e.g., embodiments of FIG. 5 to 16). Each of the embodiments is disclosed in separate drawings and separate paragraphs, but this is for convenience of explanation only, and at least some of the aforementioned embodiments and at least some of the embodiments described below may be applied together. At least some of the aforementioned embodiments and at least some of the embodiments described below may be omitted.
[0152] In the following embodiments, the electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, the electronic device (101) of FIG. 4a, or the electronic device (400) of FIG. 4b may be the electronic device (101) of FIG. 1a. In the following embodiments, the components of the electronic device (e.g., the electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, the electronic device (101) of FIG. 4a, or the electronic device (400) of FIG. 4b) may be understood by reference to FIG. 2a, FIG. 2b, FIG. 2c, FIG. 2d, and FIG. 2e, or by reference to FIG. 3a, FIG. 3b, and FIG. 3c, or by reference to FIG. 4a, or by reference to FIG. 4b, FIG. 4c, FIG. 4d, FIG. 4e, FIG. 4f, FIG. 4g, and FIG. 4h. The electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, the electronic device (101) of FIG. 4a, or the electronic device (400) of FIG. 4b may differ only in the folding method, and the following embodiments may all be applicable to the electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, the electronic device of FIG. 4a (e.g., 101 of FIG. 1), and / or the electronic device (400) of FIG. 4b. Accordingly, in the following, "electronic device (101)" may be the electronic device (101) of FIG. 1a, the electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, the electronic device of FIG. 4a (e.g., 101), or the electronic device (400) of FIG. 4b. For example, the electronic device (101) (e.g., 200 in FIG. 2a, 300 in FIG. 3a, or 400 in FIG. 4b) may include a housing (e.g., 201 in FIG. 2a, 301 in FIG. 3a, or 401 in FIG. 4b) comprising a first housing (e.g., 230 in FIG. 2a, 320 in FIG. 3a, or 410 in FIG. 4b), a second housing (e.g., 210 in FIG. 2a, 310 in FIG. 2a, or 420 in FIG. 4b), and a third housing (e.g., 220 in FIG. 2a, 330 in FIG. 3a, or 430 in FIG. 4b).For example, the electronic device (101) (e.g., 200 in FIG. 2a, 300 in FIG. 3a, or 400 in FIG. 4b) may include a first hinge (e.g., 280 in FIG. 2b, 370 in FIG. 3a, or 440 in FIG. 4b) (e.g., a first hinge structure) configured to rotatably connect a first housing (e.g., 230 in FIG. 2a, 320 in FIG. 3a, or 410 in FIG. 4b) and a second housing (e.g., 210 in FIG. 2a, 310 in FIG. 2a, or 420 in FIG. 4b). For example, the electronic device (101) (e.g., 200 in FIG. 2a, 300 in FIG. 3a, or 400 in FIG. 4b) may include a second hinge (e.g., 270 in FIG. 2b, 380 in FIG. 3a, or 450 in FIG. 4b) (e.g., a second hinge structure) configured to rotatably connect a second housing (e.g., 210 in FIG. 2a, 310 in FIG. 2a, or 420 in FIG. 4b) and a third housing (e.g., 220 in FIG. 2a, 330 in FIG. 3a, or 430 in FIG. 4b). For example, an electronic device (101) (e.g., 200 in FIG. 2a, 300 in FIG. 3a, or 400 in FIG. 4b) comprises a first display area (e.g., 202c in FIG. 2a, 302b in FIG. 3a, or A1 in FIG. 4b) corresponding to a first housing (e.g., 230 in FIG. 2a, 320 in FIG. 3a, or 410 in FIG. 4b), a second display area (e.g., 202a in FIG. 2a, 302a in FIG. 3a, or A2 in FIG. 4b) corresponding to a second housing (e.g., 210 in FIG. 2a, 310 in FIG. 2a, or 420 in FIG. 4b), and a third display corresponding to a third housing (e.g., 220 in FIG. 2a, 330 in FIG. 3a, or 430 in FIG. 4b). It may include a flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, or 403 in FIG. 4b) including an area (e.g., 202b in FIG. 2a, 302c in FIG. 3a, or A3 in FIG. 4b).For example, an electronic device (101) (e.g., 200 in FIG. 2a, 300 in FIG. 3a, or 400 in FIG. 4b) may include a cover display (161) (e.g., 203 in FIG. 2b, 303 in FIG. 3b) configured to face in the opposite direction to the direction in which the flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, or 403 in FIG. 4b) faces when the electronic device (101) (e.g., 200 in FIG. 2a, 300 in FIG. 3a, or 400 in FIG. 4b) faces when the electronic device (101) (e.g., 200 in FIG. 2a, 300 in FIG. 3a, or 403 in FIG. 4b) is unfolded.
[0153] According to one embodiment, the folding state of the electronic device (101) is described as follows.
[0154] According to one embodiment, the folding state of the electronic device (101) may include a fully folded state, an intermediate folded state (e.g., a partially folded state), and a fully unfolded state. However, this is merely an example, and there are no limitations on the folding state of the electronic device (101). The intermediate folded state may be a partially folded state. According to one embodiment, the electronic device (101) uses at least one sensor (e.g., sensor module (176) of FIG. 1) to determine a first folding angle (e.g., first folding state) between a first housing (e.g., 230 of FIG. 2a, 320 of FIG. 3a, or 410 of FIG. 4b) corresponding to a first hinge (e.g., 280 of FIG. 2b, 370 of FIG. 3a, or 440 of FIG. 4b) (e.g., first hinge structure) and a second housing (e.g., 210 of FIG. 2a, 310 of FIG. 2a, or 420 of FIG. 4b) corresponding to a second hinge (e.g., 270 of FIG. 2b, 380 of FIG. 3a, or 450 of FIG. 4b) (e.g., second hinge structure) (e.g., FIG. 2a By checking the second folding angle (e.g., second folding state) between 210 (310 in FIG. 2a, or 420 in FIG. 4b) and the third housing (e.g., 220 in FIG. 2a, 330 in FIG. 3a, or 430 in FIG. 4b), the folding state of the electronic device (101) can be checked.
[0155] According to one embodiment, the fully folded state of the electronic device (101) may be a fully folded state of the electronic device (101) depending on the rotation of the hinges of the electronic device (101) (e.g., 270, 280 in FIG. 2b; 370, 380 in FIG. 3b; the hinge in FIG. 4a; or 440, 450 in FIG. 4b). For example, the fully folded state may be a fully folded state of the electronic device (101) in which a first folding angle (e.g., a first folding state) and a second folding angle (e.g., a second folding state) are included in a folded angle range. For example, the folded angle range may be an angle range including about 0 degrees. For example, the folded angle range may be an angle range from about -5 degrees to about 10 degrees. There is no limitation on the folded angle range. For example, the fully folded state is a folded state (e.g., the state of FIG. 2c, the first of FIG. 4c) in which, among a plurality of regions of the flexible display (162), the region corresponding to the first hinge (e.g., 280 in FIG. 2b, 370 in FIG. 3a, or 440 in FIG. 4b) (e.g., the first hinge structure) of the electronic device (101) (e.g., 202e in FIG. 2a, 302d in FIG. 3a, or A4 in FIG. 4b) and the region corresponding to the second hinge (e.g., 270 in FIG. 2b, 380 in FIG. 3a, or 450 in FIG. 4b) (e.g., the second hinge structure) (e.g., the second foldable region (e.g., 202d in FIG. 2a, 302e in FIG. 3a, or A5 in FIG. 4b)) are folded (e.g., the state of FIG. 2c, the first of FIG. 3c). It may be the (left) state, or the state of FIG. 4d). For example, the fully folded state of the electronic device (200; 300) may be a state in which the first display area (e.g., 202c in FIG. 2a, 302b in FIG. 3a), the second display area (e.g., 202a in FIG. 2a, 302a in FIG. 3a), and the third display area (e.g., 202b in FIG. 2a, 302c in FIG. 3a) are all not visually exposed.
[0156] According to one embodiment, the intermediate folded state (e.g., partially folded state) may be a single-sided open state (e.g., half open state, half folded state, partially folded state) of the electronic device (101) depending on the rotation of the hinge of the electronic device (101) (e.g., 270, 280 in FIG. 2b, 370, 380 in FIG. 3b, the hinge of FIG. 4a, or 440, 450 in FIG. 4b). For example, the intermediate folded state (e.g., partially folded state) may be an intermediate folded state (or partially folded state) of the electronic device (101) in which one of the first folding angle (e.g., first folding state) or the second folding angle (e.g., second folding state) is included in the folded angle range and the other of the first folding angle (e.g., first folding state) or the second folding angle (e.g., second folding state) is included in the unfolded angle range. For example, the extended angle range may be an angle range including approximately 180 degrees. For example, the extended angle range may be an angle range from approximately 170 degrees to approximately 185 degrees. There is no limit to the extended angle range. For example, an intermediate folded state (e.g., a partially folded state) is a state in which one of the regions among the plurality of regions of the flexible display (162) is folded (e.g., a first foldable region (e.g., 202e in Fig. 2a, 302d in Fig. 3a, or A4 in Fig. 4b)) corresponding to the first hinge (e.g., 280 in Fig. 2b, 370 in Fig. 3a, or 440 in Fig. 4b)) of the electronic device (101) (e.g., a first hinge structure) or a region corresponding to the second hinge (e.g., 270 in Fig. 2b, 380 in Fig. 3a, or 450 in Fig. 4b) (e.g., a second foldable region (e.g., 202d in Fig. 2a, 302e in Fig. 3a, or A5 in Fig. 4b)) (e.g., Fig. It may be the state of 2d, the second (middle) state of Fig. 3c, or the state of Fig. 4e (or Fig. 4f).For example, the intermediate folded state (e.g., partially folded state) of the electronic device (200; 300) may be a state in which one of the first display area (e.g., 202c in FIG. 2a, 302b in FIG. 3a), the second display area (e.g., 202a in FIG. 2a, 302a in FIG. 3a), or the third display area (e.g., 202b in FIG. 2a, 302c in FIG. 3a) is visually exposed.
[0157] According to one embodiment, the fully unfolded state may be a fully unfolded state of the electronic device (101) depending on the rotation of the hinges of the electronic device (101) (e.g., 270, 280 in FIG. 2b, 370, 380 in FIG. 3b, the hinges of FIG. 4a, or 440, 450 in FIG. 4b). For example, the fully unfolded state may be a fully unfolded state of the electronic device (101) in which a first folding angle (e.g., a first folding state) and a second folding angle (e.g., a second folding state) are included in the unfolded angle range. For example, the fully unfolded state is a state in which, among a plurality of regions of the flexible display (162), the region corresponding to the first hinge (e.g., 280 in FIG. 2b, 370 in FIG. 3a, or 440 in FIG. 4b) (e.g., first hinge structure) of the electronic device (101) (e.g., 202e in FIG. 2a, 302d in FIG. 3a, or A4 in FIG. 4b)) and the region corresponding to the second hinge (e.g., 270 in FIG. 2b, 380 in FIG. 3a, or 450 in FIG. 4b) (e.g., second hinge structure) (e.g., second foldable region (e.g., 202d in FIG. 2a, 302e in FIG. 3a, or A5 in FIG. 4b)) are unfolded (e.g., the state of FIG. 2a, FIG. 3a It may be a state, or the state of FIG. 4b (or FIG. 4c). For example, the fully unfolded state of the electronic device (200; 300) may be a state in which the first display area (e.g., 202c in FIG. 2a, 302b in FIG. 3a), the second display area (e.g., 202a in FIG. 2a, 302a in FIG. 3a), and the third display area (e.g., 202b in FIG. 2a, 302c in FIG. 3a) are all visually exposed.
[0158] In this document, when an electronic device (e.g., the electronic device (101) of FIG. 1a, the electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, or the electronic devices of FIG. 4a (e.g., 101, or the electronic device (400) of FIG. 4b)) performs a specific operation, it may mean that a processor (120), such as a micro controlling unit (MCU), a field programmable gate array (FPGA), an application specific integrated circuit (ASIC), a microprocessor, or an application processor (AP), which is included in the electronic device (e.g., the electronic device (101) of FIG. 1a, the electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, or the electronic device (400) of FIG. 4b), performs a specific operation. According to one embodiment, the processor (120) may include a processing circuit. The electronic device (e.g., the electronic device of FIG. 1a) For the device (101), the electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, and the electronic devices of FIG. 4a (e.g., 101, or the electronic device (400) of FIG. 4b) to perform a specific operation, it may mean that the processor (120) controls other hardware to perform a specific operation.For an electronic device (e.g., electronic device (101) of FIG. 1a, electronic device (200) of FIG. 2a, electronic device (300) of FIG. 3a, electronic devices of FIG. 4a (e.g., 101, or electronic device (400) of FIG. 4b)) to perform a specific operation may mean that a processor (120) or other hardware is caused to perform a specific operation as at least one instruction for performing a specific operation, which was stored in a storage circuit (e.g., memory (130)) of the electronic device (e.g., electronic device (101) of FIG. 1a, electronic device (200) of FIG. 2a, electronic device (300) of FIG. 3a, electronic devices of FIG. 4b (e.g., electronic device (400) of FIG. 4a), is executed. At least one instruction stored in the memory (130) of the electronic devices (e.g., 101, or the electronic device (400) of FIG. 4b) may cause the electronic devices (e.g., the electronic device (101) of FIG. 1a, the electronic device (200) of FIG. 2a, the electronic device (300) of FIG. 3a, and the electronic devices (e.g., 101, or the electronic device (400) of FIG. 4b)) to perform at least one operation, either individually or collectively, when executed by the processor (120).
[0159] Functions related to artificial intelligence according to the present disclosure may be operated through a processor (120) and a memory (130). The processor (120) may be composed of one or more processors (120). In this case, the one or more processors (120) may be general-purpose processors such as a CPU, AP, or DSP (digital signal processor), graphics-dedicated processors such as a GPU or VPU (vision processing unit), or artificial intelligence-dedicated processors such as an NPU. The one or more processors (120) control input data to be processed according to predefined operation rules or artificial intelligence models stored in the memory (130). Alternatively, if the one or more processors (120) are artificial intelligence-dedicated processors, the artificial intelligence-dedicated processors may be designed with a hardware structure specialized for processing a specific artificial intelligence model.
[0160] The predefined operating rules or artificial intelligence model are characterized by being created through learning. Here, being created through learning means that the artificial intelligence model is trained using multiple learning data by a learning algorithm, thereby creating a predefined operating rule or artificial intelligence model configured to perform a desired characteristic (or purpose). The artificial intelligence model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values and performs neural network operations through operations between the results of operations of the previous layer and the multiple weights. Such learning may be performed on the device itself where the artificial intelligence according to the present disclosure is performed, or it may be performed through a separate server (e.g., server (108) of FIG. 1) and / or system. Examples of learning algorithms include supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but are not limited to the examples described above.
[0161] An artificial intelligence model may be composed of multiple neural network layers. Each of the multiple neural network layers has multiple weight values and performs neural network operations through operations between the results of previous layers and the multiple weights. The multiple weights possessed by the multiple neural network layers can be optimized based on the learning results of the artificial intelligence model. For example, the multiple weights may be updated so that the loss value or cost value obtained from the artificial intelligence model during the learning process is reduced or minimized. The artificial neural network may include a deep neural network (DNN), such as a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), or deep Q-networks, but is not limited to the examples mentioned above.
[0162] In the method of operation of an electronic device (101) according to the present disclosure, the electronic device (101) can recognize voice. According to one embodiment, the electronic device (101) can recognize a user's voice by receiving an analog voice signal through an input module (150) (e.g., a microphone) and can interpret the intent of the utterance included in the recognized voice. According to one embodiment, the electronic device (101) can recognize audio included in a video and interpret the intent of the voice included in the recognized audio. The electronic device (101) can convert a voice portion into computer-readable text using an automatic speech recognition (ASR) model. It can obtain the intent of the utterance by interpreting the converted text using a natural language understanding (NLU) model. Here, the ASR model or the NLU model may be an artificial intelligence model. The artificial intelligence model may be processed by a processor (120) (e.g., an artificial intelligence dedicated processor) designed with a hardware structure specialized for processing the artificial intelligence model. The artificial intelligence model may be created through learning. Linguistic understanding is a technology that recognizes, applies, and processes human language / characters, and includes natural language processing, machine translation, dialogue systems, question answering, and speech recognition / synthesis.
[0163] In the method of operation of an electronic device (101) according to the present disclosure, the electronic device (101) can recognize an image. According to one embodiment, the electronic device (101) can obtain output data that recognizes an image by using image data as input data for an artificial intelligence model. The artificial intelligence model can be created through learning. Visual understanding is a technology that recognizes and processes objects like human vision, and includes object recognition, object tracking, image retrieval, human reconnition, scene recognition, spatial understanding (3D reconstruction / localization), and image enhancement.
[0164] In the following description of the electronic device (300) of FIG. 3a, the operation of the electronic device (200) of FIG. 2a, the electronic device (101) of FIG. 4a, and the electronic device (400) of FIG. 4b can be understood based on the description of the electronic device (300) of FIG. 3a as an example.
[0165] FIG. 5 is a flowchart of a method of operation of an electronic device according to one embodiment. FIG. 5 can be explained with reference to the embodiments described above and the embodiments described below.
[0166] Referring to Fig. 5, the operation of checking the folding angle, the unfolding operation, the folding operation, and the folding AI function can be explained.
[0167] At least some of the operations of FIG. 5 may be omitted. The order of the operations of FIG. 5 may be changed. Operations other than the operations of FIG. 5 may be performed before, during, or after the operations of FIG. 5.
[0168] Referring to FIG. 5, in operation 501, according to one embodiment, the electronic device (101) can display a screen through a cover display (161). For example, the electronic device (101) can display a screen through the cover display (161) (e.g., 203 in FIG. 2c, 303 in FIG. 3c, and A1 in 403 in FIG. 4d) when fully folded. According to one embodiment, the electronic device (101) uses at least one sensor (e.g., sensor module (176) of FIG. 1) to provide a first folding angle (e.g., first folding state) between a first housing (e.g., 230 of FIG. 2a, 320 of FIG. 3a, or 410 of FIG. 4b) corresponding to a first hinge (e.g., 280 of FIG. 2b, 370 of FIG. 3a, or 440 of FIG. 4b) (e.g., first hinge structure) and a second housing (e.g., 210 of FIG. 2a, 310 of FIG. 2a, or 420 of FIG. 4b) corresponding to a second hinge (e.g., 270 of FIG. 2b, 380 of FIG. 3a, or 450 of FIG. 4b) (e.g., second hinge structure) and a second housing (e.g., FIG. 2a) corresponding to a second hinge (e.g., 270 of FIG. 2b, 380 of FIG. 3a, or 450 of FIG. 4b) (e.g., second hinge structure). By checking the second folding angle (e.g., second folding state) between 210 (310 in FIG. 2a, or 420 in FIG. 4b) and the third housing (e.g., 220 in FIG. 2a, 330 in FIG. 3a, or 430 in FIG. 4b), the folding state of the electronic device (101) can be checked. The folding state may include a fully folded state, a partially folded state (or a half folded state), and a fully unfolded state.According to one embodiment, the electronic device (101) can display a first screen of a first application (e.g., camera application, note application, gallery application, call application, video application, social network service (SNS) application, internet application, game application) containing a first content through a cover display (161) when fully folded. For example, the electronic device (101) can display a first screen of a first application (e.g., camera application, note application, gallery application, call application, video application, social network service (SNS) application, internet application, game application) through a cover display (161) when fully folded. Content displayed on the screen (e.g., information, data, media, text, image, video, object, layout) may be referred to as content, and there is no limitation on the type of content. For example, an image displayed on the screen of FIG. 8 described later (e.g., the camera preview screen (810) of FIG. 8 (a)), or an object included in the image (e.g., 811, 812, 813 of FIG. 8 (a)) can be referred to as content. For example, text displayed on the screen of FIG. 10 described later (e.g., the note screen (1010) of FIG. 10 (a)) or a layout containing the text can be referred to as content. For example, an image displayed on the screen of FIG. 11 described later (e.g., the gallery screen (1110) of FIG. 11 (a)), or an object included in the image, can be referred to as content. For example, an object displayed on the screen of FIG. 12 described later (e.g., the call screen (1210) of FIG. 12 (a)) can be referred to as content. For example, an image displayed on the screen of FIG. 13 (e.g., the video screen (1210) of FIG. 13 (a)) described later, or a layout containing the image, can be referred to as content.
[0169] In operation 503, according to one embodiment, the electronic device (101) can identify an unfolding operation. The unfolding operation may include a first unfolding operation and a second unfolding operation. For example, the first unfolding operation may be an unfolding operation from a fully folded state to a partially folded state (e.g., a partially folded state). For example, the electronic device (101) may identify a first change from a fully folded state to a partially folded state (e.g., a first unfolding operation). For example, the second unfolding operation may be an unfolding operation from a partially folded state (e.g., a partially folded state) to a fully unfolded state. For example, the electronic device (101) may identify a second change from a partially folded state to a fully unfolded state (e.g., a second unfolding operation). The folding operation may include a first folding operation and a second folding operation. For example, the first folding operation may be a folding operation from a partially folded state (e.g., a partially folded state) to a fully folded state. For example, the electronic device (101) may identify a third change (e.g., the first folding operation) from a partially folded state to a fully folded state. For example, the second folding operation may be a folding operation from a fully unfolded state to a partially folded state (e.g., a partially folded state). For example, the electronic device (101) may identify a fourth change (e.g., the second folding operation) from a fully unfolded state to a partially folded state.According to one embodiment, the electronic device (101) can determine an unfolding operation (e.g., a first unfolding operation, or a second unfolding operation) or a folding operation (e.g., a first folding operation, or a second folding operation) by using at least one sensor (e.g., a sensor module (176) of FIG. 1) to determine a first folding angle (e.g., a first folding state) of a first foldable area corresponding to a first hinge (e.g., 280 in FIG. 2b, 370 in FIG. 3a, or 440 in FIG. 4b) (e.g., a first hinge structure) and a second folding angle (e.g., a second folding state) of a second foldable area corresponding to a second hinge (e.g., 270 in FIG. 2b, 380 in FIG. 3a, or 450 in FIG. 4b) (e.g., a second hinge structure) among a plurality of areas of a flexible display (162). For example, the electronic device (101) uses at least one sensor (e.g., sensor module (176) of FIG. 1) to determine a first folding angle (e.g., a first folding state) between a first housing (e.g., 230 of FIG. 2a, 320 of FIG. 3a, or 410 of FIG. 4b) and a second housing (e.g., 210 of FIG. 2a, 310 of FIG. 2a, or 420 of FIG. 4b) and a second folding angle (e.g., a second folding state) between a second housing (e.g., 210 of FIG. 2a, 310 of FIG. 2a, or 420 of FIG. 4b) and a third housing (e.g., 220 of FIG. 2a, 330 of FIG. 3a, or 430 of FIG. 4b), thereby determining an unfolding operation (e.g., a first unfolding operation, or a second unfolding operation) or a folding You can verify the operation (e.g., the first folding operation, or the second folding operation).
[0170] For example, an electronic device (101) that displays a screen in a fully folded state in operation 501 can confirm an unfolding operation (e.g., first unfolding operation) (e.g., first change) from a fully folded state to a partially folded state (e.g., intermediate folded state).
[0171] In operation 505, according to one embodiment, the electronic device (101) may determine whether a folding AI function is activated based on confirming an unfolding operation (e.g., a first unfolding operation) from a fully folded state to a partially folded state (e.g., an intermediate folded state). According to one embodiment, the folding AI function may include an operation to execute an AI function based on confirming an unfolding operation as a trigger event. There are no limitations on the AI function executed through the folding AI function. For example, the folding AI function may be a function that provides at least one AI function to be applied to content (e.g., a first content) displayed on a screen (e.g., a first screen) among a plurality of AI functions assigned to an application (e.g., a first application) of operation 501 based on confirming an unfolding operation as a trigger event. For example, the folding AI function may be a function that determines at least one AI function based on identifying a first change from a fully folded state to a partially folded state. This will be explained in detail in operation 515. First, we will first describe an embodiment to which the folding AI function is not applied (e.g., an embodiment of operation 507 to operation 513).
[0172] In operation 507, according to one embodiment, the electronic device (101) may provide a default UI (user interface) upon confirming an unfolding operation (e.g., a first unfolding operation) (e.g., a first change) based on the disabling of the folding AI function. For example, providing a default UI in a partially folded state (e.g., a middle folded state) based on an unfolding operation (e.g., a first unfolding operation) may be understood as not displaying a screen. Displaying a screen with the default UI applied in a partially folded state (e.g., a middle folded state) based on an unfolding operation (e.g., a first unfolding operation) may be understood as not displaying a screen. For example, providing a default UI in a partially folded state (e.g., a middle folded state) based on an unfolding operation (e.g., a first unfolding operation) may be displaying a default screen. Displaying a screen with a default UI applied in a partially folded state (e.g., intermediate folded state) based on an unfolding action (e.g., first unfolding action) may be considered displaying a default screen. A screen that does not have folding AI features applied can be referred to as a default screen. There are no restrictions on the type of default screen. For example, the default screen may be determined based on a previously displayed screen. For example, the default screen may be determined independently of a previously displayed screen. For example, the default screen may be a screen with features applied other than folding AI features. According to one embodiment, the electronic device (101) may provide a default UI to a third display area of the flexible display (162) (e.g., a display area exposed to the outside in the partially folded state (e.g., a middle folded state) (e.g., 202b in FIG. 2d, 302c in FIG. 3c, A1 in 403 in FIG. 4f, or A2 and / or A3 in 403 in FIG. 4e) in the partially folded state (e.g., a middle folded state) as it confirms an unfolding operation (e.g., a first unfolding operation) based on the deactivation of the folding AI function.
[0173] In operation 509, according to one embodiment, the electronic device (101) may check a folding operation (e.g., a first folding operation) or an unfolding operation (e.g., a second unfolding operation). According to one embodiment, the electronic device (101) may perform operation 501 based on checking a folding operation (e.g., a first folding operation) after providing a default UI to a third display area of the flexible display (162) (e.g., a display area exposed to the outside in a partially folded state (e.g., a middle folded state)) (e.g., 202b in FIG. 2d, 302c in FIG. 3c, A1 of 403 in FIG. 4f, or A2 and / or A3 of 403 in FIG. 4e). For example, the electronic device (101) can display a first screen through the cover display (161) (e.g., 203 in FIG. 2c, 303 in FIG. 3c, A1 in 403 in FIG. 4d) in a fully folded state in operation 501, and then display a screen with a default UI applied in a partially folded state (e.g., intermediate folded state) based on an unfolding operation in operation 507, and then display the first screen again through the cover display (161) (e.g., 203 in FIG. 2c, 303 in FIG. 3c, A1 in 403 in FIG. 4d) in a fully folded state based on a folding operation (e.g., first folding operation).
[0174] In operation 511, according to one embodiment, the electronic device (101) may provide a default UI based on confirming an unfolding operation (e.g., a second unfolding operation) after providing a default UI to a third display area of the flexible display (162) (e.g., a display area exposed to the outside in the partially folded state (e.g., a partially folded state) (e.g., 202b in FIG. 2d, 302c in FIG. 3c, A1 of 403 in FIG. 4f, or A2 and / or A3 of 403 in FIG. 4e) in a partially folded state (e.g., a middle folded state). For example, providing a default UI in a fully unfolded state may display a screen unrelated to the folding AI function. There are no limitations on the default UI provided in the fully unfolded state. For example, the electronic device (101) can display the screen of the first application on the flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, A1 in FIG. 4d) by changing the layout of the screen of the first application that was displayed on the cover display (161) (e.g., 203 in FIG. 2c, 303 in FIG. 3c, 403 in FIG. 4d) in operation 501 so as to provide a default UI in a fully unfolded state.
[0175] In operation 513, according to one embodiment, the electronic device (101) may detect a folding operation (e.g., a second folding operation). According to one embodiment, the electronic device (101) may provide a default UI in a partially folded state (e.g., a middle folded state) based on detecting a folding operation (e.g., a second folding operation) after providing a default UI to the flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, the flexible display in FIG. 4a, or 403 in FIG. 4b) in a fully unfolded state. For example, providing a default UI in a partially folded state (e.g., a middle folded state) based on a folding operation (e.g., a second folding operation) may be understood as not displaying a screen. Displaying a screen with the default UI applied in a partially folded state (e.g., a middle folded state) based on a folding operation (e.g., a second folding operation) may be understood as not displaying a screen. For example, providing a default UI in a partially folded state (e.g., a mid-folded state) based on a folding action (e.g., a second folding action) may be displaying a default screen. Displaying a screen with the default UI applied in a partially folded state (e.g., a mid-folded state) based on a folding action (e.g., a second folding action) may be displaying a default screen. There are no restrictions on the type of default screen. For example, the default screen may be determined based on a previously displayed screen. For example, the default screen may be determined independently of a previously displayed screen. For example, the default screen may be a screen with features applied other than the folding AI function.
[0176] In operation 515, according to one embodiment, the electronic device (101) may provide a folding AI function. The electronic device (101) may provide a folding AI function in a partially folded state (e.g., a partially folded state). The electronic device (101) may provide a folding AI function by confirming an unfolding operation (e.g., a first unfolding operation) based on the activation of the folding AI function. The electronic device (101) may execute a folding AI function by confirming an unfolding operation (e.g., a first unfolding operation) based on the activation of the folding AI function. For example, the electronic device (101) may determine at least one AI function to be applied to content displayed on the screen among a plurality of AI functions assigned to the application based on confirming an unfolding operation (e.g., a first unfolding operation) as a trigger event. For example, the assigned AI functions may vary depending on the application (e.g., camera application, note application, gallery application, call application, video application, social media application, internet application, game application). For example, multiple AI functions or a single AI function may be assigned to an application (e.g., camera application, note application, gallery application, call application, video application, social media application, internet application, game application). For example, AI functions may be assigned to the content displayed on the screen of an application (e.g., camera application, note application, gallery application, call application, video application, social media application, internet application, game application). If the content displayed on the screen changes, the assigned AI function may also change. The AI function may be determined depending on what content is displayed on the screen of a particular application.According to one embodiment, the electronic device (101) may provide the folding AI function in a partially folded state (e.g., intermediate folded state) by confirming an unfolding operation (e.g., a first unfolding operation) based on the activation of the folding AI function. For example, the electronic device (101) may provide the folding AI function through a third display area of the flexible display (162) (e.g., a display area exposed to the outside in a partially folded state (e.g., intermediate folded state)) (e.g., 202b in FIG. 2d, 302c in FIG. 3c, A1 of 403 in FIG. 4f, or A2 and / or A3 of 403 in FIG. 4e) in a partially folded state (e.g., intermediate folded state) by confirming an unfolding operation (e.g., a first unfolding operation) based on the activation of the folding AI function. For example, the electronic device (101) can provide a UI corresponding to an AI function to be applied to the first content in a partially folded state (e.g., intermediate folded state) based on confirming an unfolding operation (e.g., first unfolding operation) after displaying a first screen of a first application containing the first content through a cover display (161) in a fully folded state. This will be explained in detail with reference to FIG. 6 (e.g., operations 615 to 623 of FIG. 6) and embodiments described below.
[0177] In operation 517, according to one embodiment, the electronic device (101) may identify a folding operation (e.g., a first folding operation) or an unfolding operation (e.g., a second unfolding operation). According to one embodiment, the electronic device (101) may perform operation 501 based on identifying a folding operation (e.g., a first folding operation) after providing a folding AI function through a third display area of the flexible display (162) in a partially folded state (e.g., a display area exposed to the outside in a partially folded state (e.g., a middle folded state) (e.g., 202b in FIG. 2d, 302c in FIG. 3c, A1 in 403 in FIG. 4f, or A2 and / or A3 in 403 in FIG. 4e). For example, the electronic device (101) can display a first screen through the cover display (161) (e.g., 203 in FIG. 2c, 303 in FIG. 3c, A1 in 403 in FIG. 4d) in a fully folded state in operation 501, and after providing a folding AI function in a partially folded state (e.g., intermediate folded state) based on an unfolding operation in operation 515, it can again display the first screen through the cover display (161) (e.g., 203 in FIG. 2c, 303 in FIG. 3c, A1 in 403 in FIG. 4d) in a fully folded state based on a folding operation (e.g., first folding operation).
[0178] In operation 519, according to one embodiment, the electronic device (101) may provide extended AI functions. For example, the electronic device (101) may provide extended AI functions in a fully unfolded state based on confirming an unfolding operation (e.g., a second unfolding operation) after providing folding AI functions through a third display area of the flexible display (162) in a partially folded state (e.g., a middle folded state) (e.g., a display area exposed to the outside in a partially folded state (e.g., a middle folded state) (e.g., 202b in FIG. 2d, 302c in FIG. 3c, A1 in 403 in FIG. 4f, or A2 and / or A3 in 403 in FIG. 4e). The extended AI function may include an operation in which, in a fully unfolded state, a screen with an AI function applied and / or a screen including a UI corresponding to the AI function is displayed through a flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, the flexible display in FIG. 4a, or 403 in FIG. 4b). For example, the area of the screen with the extended AI function applied in operation 519 may be larger than the area of the screen with the AI function applied in operation 515. The extended AI function will be described in detail with reference to FIG. 6 (e.g., operation 627 in FIG. 6) and the embodiments described below.
[0179] In operation 521, according to one embodiment, the electronic device (101) may confirm a folding operation (e.g., a second folding operation). According to one embodiment, the electronic device (101) may perform operation 515 in a partially folded state (e.g., an intermediate folded state) based on confirming the folding operation (e.g., a second folding operation) after providing extended AI functions through the flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, the flexible display in FIG. 4a, or 403 in FIG. 4b) in a fully unfolded state. For example, the electronic device (101) can provide AI functions through a narrow area of the flexible display (162) in a partially folded state (e.g., intermediate folded state) based on confirming a folding action (e.g., second folding action) after providing AI functions through a wide area of the flexible display (162) in a fully unfolded state.
[0180] With reference to FIG. 6 and the embodiments described below, the folding AI function and the extended AI function will be explained.
[0181] FIG. 6 is a flowchart of a method of operation of an electronic device according to one embodiment. FIG. 6 can be explained with reference to the previously described embodiments, the embodiments of FIG. 5, the embodiments of FIG. 7 to 9, and the embodiments described below. FIG. 7 is a diagram illustrating the operation of an electronic device according to one embodiment. FIG. 8 is a diagram illustrating the operation of an electronic device according to one embodiment. FIG. 9 is a diagram illustrating the operation of an electronic device according to one embodiment.
[0182] The embodiments of FIGS. 7 through 9 are illustrated with the electronic device (300) of FIG. 3a as an example. By referring to the embodiments of FIGS. 7 through 9, the operations of the electronic device (200) of FIG. 2a, the electronic device (101) of FIG. 4a, and the electronic device (400) of FIG. 4b can be understood.
[0183] At least some of the operations of FIG. 6 may be omitted. The order of the operations of FIG. 6 may be changed. Operations other than those of FIG. 6 may be performed before, during, or after the operations of FIG. 6.
[0184] Referring to FIG. 6, in operation 601, according to one embodiment, the electronic device (101) can display a screen through a cover display (161). The description of operation 601 can be understood by referring to the description of operation 501 of FIG. 5. For example, the electronic device (101) can display a first screen of a first application (e.g., camera application, note application, gallery application, call application, video application, SNS application, internet application, game application) containing first content through the cover display (161) (e.g., 203 in FIG. 2c, 303 in FIG. 3c, and A1 in 403 in FIG. 4d) when fully folded. For example, the electronic device (101) can display a first screen of a first application (e.g., camera application, note application, gallery application, call application, video application, social network service (SNS) application, internet application, game application) through a cover display (161) (e.g., 203 in FIG. 2c, 303 in FIG. 3c, A1 in 403 in FIG. 4d) when fully folded. For example, in FIG. 8 (a), the electronic device (300) can display a first screen (810) including a preview screen of a camera application through a cover display (303) when fully folded. The preview screen may be a screen that displays an image in real time obtained through a camera (e.g., camera of the camera module (180) in FIG. 1) (e.g., 392 or 393 in FIG. 3b) while the camera application is running. In FIG. 8(a), the first screen (810) may include first content (e.g., an image displayed on a preview screen, or an object (811, 812, 813) included in the image).The objects (811, 812, 813) of the first screen (810) may be objects corresponding to objects (e.g., animals) located around the electronic device (101) that are acquired through a camera (e.g., the camera of the camera module (180) of FIG. 1) (e.g., 392 or 393 of FIG. 3b).
[0185] In operation 603, according to one embodiment, the electronic device (101) can confirm an unfolding operation. The description of operation 603 can be understood by referring to the description of operation 503 of FIG. 5. For example, in operation 601, the electronic device (101) that was displaying a screen in a fully folded state can confirm an unfolding operation (e.g., first unfolding operation) (e.g., first change) from a fully folded state to a partially folded state (e.g., intermediate folded state). For example, in FIG. 8 (a) and (b), the electronic device (300) can confirm an unfolding operation (e.g., first unfolding operation) (e.g., first change) from a fully folded state to a partially folded state (e.g., intermediate folded state) after displaying the first screen (810).
[0186] In operation 605, according to one embodiment, the electronic device (101) can determine whether the folding AI function is activated based on confirming an unfolding operation (e.g., a first unfolding operation) from a fully folded state to a partially folded state (e.g., an intermediate folded state). The description of operation 605 can be understood by referring to the description of operation 505 in FIG. 5. According to one embodiment, whether the folding AI function is activated can be determined based on a setting. For example, in FIG. 7, the electronic device (101) can activate the folding AI function based on a selection of an icon (710) corresponding to the folding AI function displayed on the screen (700). For example, in FIG. 7, the electronic device (101) can deactivate the folding AI function based on the deactivation of an icon (710) corresponding to the folding AI function displayed on the screen (700).
[0187] In operations 607 through 613, according to one embodiment, the electronic device (101) may provide a default UI by confirming an unfolding operation (e.g., a first unfolding operation) based on the deactivation of the folding AI function. The description of operations 607 through 613 can be understood by referring to the description of operations 507 through 513 of FIG. 5.
[0188] According to one embodiment, the electronic device (101) may provide an AI function (e.g., operation 515 of FIG. 5) according to an unfolding operation (e.g., a first unfolding operation) based on confirming the activation of the folding AI function in operation 605. The provision of the AI function (e.g., operation 515 of FIG. 5) will be described in detail with reference to operations 615 through 623.
[0189] In operation 615, according to one embodiment, the electronic device (101) can determine an AI function to be applied to the first content. According to one embodiment, the electronic device (101) can determine an AI function to be applied to the first content according to an unfolding operation (e.g., a first unfolding operation) based on confirming the activation of a folding AI function in operation 605, after displaying a first screen of a first application containing the first content in operation 601. For example, the electronic device (101) can determine at least one AI (artificial intelligence) function related to the execution of the first application according to a first change from a fully folded state to a partially folded state based on confirming the activation of a folding AI function in operation 605, after displaying a first screen of the first application in operation 601. For example, the electronic device (101) can determine at least one AI function to be applied to the first content displayed on the screen among a plurality of AI functions assigned to the first application. For example, in FIG. 8 (a) and (b), the electronic device (300) can determine an AI function to be applied to the first content according to an unfolding operation (e.g., a first unfolding operation) based on confirming the activation of a folding AI function after displaying a first screen (810) of a camera application containing the first content (e.g., objects (811, 812, 813)). For example, the electronic device (101) can determine an AI function to be applied to the first content (e.g., objects (811, 812, 813)) among a plurality of AI functions assigned to the camera application. For example, the AI function to be applied to the first content (e.g., objects (811, 812, 813)) may be a search function for the first content (e.g., objects (811, 812, 813)), but there is no limitation on the type of AI function.
[0190] In operation 617, according to one embodiment, the electronic device (101) may display a second screen so that a UI corresponding to the AI function determined in operation 615 is displayed on the first content. For example, the electronic device (101) may display the second screen so that a UI corresponding to the AI function determined in operation 615 is displayed on the first content in a third display area of the flexible display (162) (e.g., a display area exposed to the outside in a partially folded state (e.g., a partially folded state)) (e.g., 202b in FIG. 2d, 302c in FIG. 3c, A1 of 403 in FIG. 4f, or A2 and / or A3 of 403 in FIG. 4e) in a partially folded state (e.g., a medium folded state). For example, the electronic device (101) may display a second screen, which includes a user interface (UI) representing at least one AI function related to the execution of a first application, in a display area that is visually exposed while partially folded on a flexible display (202; 302). According to one embodiment, the electronic device (101) may display the second screen so that a UI corresponding to the AI function is displayed on the first content before applying the AI function. For example, in FIG. 8(b), a second screen (820) may be displayed so that a UI corresponding to the AI function is displayed on the first content. For example, in FIG. 8(b), the second screen (820) may include at least one UI (e.g., a first UI (821), a second UI (822), or a third UI (823)). For example, the first UI (821) may include an object indicating that a first AI function (e.g., a vision search function) can be applied to a first object (811). For example, the vision search function may be a search function for objects included in an image acquired in real time through a camera and displayed on a preview screen.For example, the second UI (822) may include an object indicating that the second AI function can be applied to the second object (812). For example, the third UI (823) may include an object indicating that the third AI function can be applied to the third object (813). At this time, the first AI function, the second AI function, and the third AI function may be the same or different. As previously stated, there are no restrictions on the types of AI functions. If there is no AI function to be applied to the third object (813), the third UI (823) may not be displayed, unlike in FIG. 8 (b). According to one embodiment, the electronic device (101) may provide a sound effect indicating the execution of the folding AI function while displaying a second screen of the 617 operation. A user who hears the sound effect may recognize that the folding AI function has been executed based on the unfolding operation (e.g., the first unfolding operation). According to one embodiment, the electronic device (101) may not provide any sound effects while performing the 607 operation. A user who has not heard the sound effects may recognize that the folding AI function has not been executed based on the unfolding operation (e.g., the first unfolding operation).
[0191] In operation 619, according to one embodiment, the electronic device (101) can confirm a user's selection of a UI displayed on a screen in a partially folded state (e.g., a partially folded state). For example, the user can select one of the UIs corresponding to the AI function on a second screen in which the UI corresponding to the AI function is displayed on the first content before applying the AI function. For example, the electronic device (101) can confirm a user's selection of one of the UIs displayed on the second screen. For example, the electronic device (101) can confirm a first user input for selecting a first AI function among at least one AI function. For example, in FIG. 8(b), the electronic device (300) can confirm a selection of one of the first UI (821), the second UI (822), or the third UI (823) on the second screen (820).
[0192] In operation 621, according to one embodiment, the electronic device (101) can verify the second content by applying an AI function corresponding to the selected UI to the first content. For example, the electronic device (101) can apply the selected first AI function to the first application based on a first user input for selecting the first AI function among at least one AI function. For example, in FIG. 8 (b) and (c), the electronic device (300) can verify the second content (e.g., search result) by applying an AI function corresponding to the second UI (822) (e.g., vision search function) to the first content (e.g., second object (812) in the first content) as the second UI (822) is selected.
[0193] In operation 623, according to one embodiment, the electronic device (101) may display a third screen containing second content. For example, the electronic device (101) may display a third screen of a first application to which a first AI function is applied. For example, the electronic device (101) may display the third screen containing second content in a third display area of the flexible display (162) in a partially folded state (e.g., a mid-folded state) (e.g., a display area exposed to the outside in a partially folded state (e.g., a mid-folded state)) (e.g., 202b in FIG. 2d, 302c in FIG. 3c, A1 in 403 in FIG. 4f, or A2 and / or A3 in 403 in FIG. 4e). For example, the electronic device (101) may display a third screen of the first application to which the first AI function is applied, instead of the second screen of the 617 operation, based on applying the first AI function to the first application while in a partially folded state. For example, in (c) of FIG. 8, the electronic device (300) may display a third screen (830) containing second content (e.g., search result) that is identified by applying an AI function (e.g., vision search function) corresponding to the second UI (822) to the first content (e.g., second object (812) among the first content).
[0194] In operation 625, according to one embodiment, the electronic device (101) may check a folding operation (e.g., a first folding operation) or an unfolding operation (e.g., a second unfolding operation). The description of operation 625 can be understood by referring to the description of operation 517 of FIG. 5. For example, the electronic device (101) may check a folding operation (e.g., a first folding operation) or an unfolding operation (e.g., a second unfolding operation) after displaying a third screen (e.g., 830 of FIG. 8 (c)) containing second content (e.g., a search result). According to one embodiment, if the UI is not selected in operation 619, the second screen of operation 617 may continue to be displayed. In this case, the electronic device (101) may check a folding operation (e.g., a first folding operation) or an unfolding operation (e.g., a second unfolding operation) after displaying a second screen (e.g., 820 in FIG. 8(b)) that displays a UI corresponding to the AI function on the first content before applying the AI function. According to one embodiment, the electronic device (101) may perform the 601 operation based on checking the folding operation (e.g., a first folding operation) after displaying the second screen (e.g., 820 in FIG. 8(b)) or a third screen (e.g., 830 in FIG. 8(c)). For example, the electronic device (101) may display a first screen of a first application containing the first content that was previously displayed, based on confirming a folding operation (e.g., a first folding operation) after displaying a second screen (e.g., 820 in FIG. 8 (b)) or a third screen (e.g., 830 in FIG. 8 (c)), through a cover display (161) (e.g., 203 in FIG. 2c, 303 in FIG. 3c, A1 in FIG. 4d 403).For example, the electronic device (101) displays a first screen (910) (e.g., camera preview screen) containing first content (e.g., first object (911), second object (912), and third object (913)) on a cover display (303) in a fully folded state in FIG. 9 (a), displays a second screen (920) containing a UI (e.g., 921, 922, 923) corresponding to an AI function on a third display area (e.g., a display area exposed to the outside in a partially folded state (e.g., a mid-folded state)) of a flexible display (302) (e.g., 302c in FIG. 3c) in a partially folded state (e.g., a mid-folded state) in FIG. 9 (b), and displays the first content (e.g., first object (911), second object (912), and third A third screen (930) (e.g., camera preview screen) including an object (913)) may be displayed. The third screen (930) may correspond to the first screen (910). According to one embodiment, the electronic device (101) may perform an operation 627 based on confirming an unfolding operation (e.g., a second unfolding operation) after displaying a second screen (e.g., 820 in FIG. 8 (b)) or a third screen (e.g., 830 in FIG. 8 (c)).
[0195] In operation 627, according to one embodiment, the electronic device (101) may provide extended AI functions. The description of operation 627 may be understood by referring to the description of operation 519 in FIG. 5. For example, the electronic device (101) may provide extended AI functions in a fully unfolded state based on confirming an unfolding operation (e.g., a second unfolding operation) after providing folding AI functions through a third display area of the flexible display (162) in a partially folded state (e.g., a middle folded state) (e.g., a display area exposed to the outside in a partially folded state (e.g., a middle folded state) (e.g., 202b in FIG. 2d, 302c in FIG. 3c, A1 in 403 in FIG. 4f, or A2 and / or A3 in 403 in FIG. 4e). The method of providing extended AI functions may vary depending on the application. For example, in FIG. 8(d), the electronic device (300) may display a second screen (e.g., 820 in FIG. 8(b)) or a third screen (e.g., 830 in FIG. 8(c)) of a camera application, and then, based on confirming an unfolding operation (e.g., a second unfolding operation) (e.g., a second change from a partially folded state to a fully unfolded state), display a second screen (843) (e.g., a screen corresponding to 820 in FIG. 8(b)) and a third screen (842) (e.g., a screen corresponding to 830 in FIG. 8(c)) in a fully unfolded state on a flexible display (302). In FIG. 8(d), the second screen (843) may be a screen corresponding to the second screen (820) of FIG. 8(b). For example, in FIG. 8 (d), the second screen (843) may include a UI corresponding to an AI function (e.g., 844, 845, 846). The UI of the second screen (843) in FIG. 8 (d) (e.g., 844, 845, 846) may correspond to the UI of the second screen (820) in FIG. 8 (b) (e.g., 821, 822, 823).In FIG. 8 (d), the third screen (842) may be a screen corresponding to the third screen (830) in FIG. 8 (c). For example, in FIG. 8 (d), the third screen (842) may include a second content (e.g., a search result) that is identified by applying an AI function (e.g., a vision search function) to the first content (e.g., a second object (812) among the first content). According to one embodiment, in (d) of FIG. 8, the electronic device (300) can identify a third content (e.g., a product search result related to a search result for a second object (812)) based on an unfolding operation (e.g., a second unfolding operation) from a partially folded state (e.g., an intermediate folded state) to a fully unfolded state, and can display a fourth screen (841) containing the third content on the flexible display (302) while displaying the second screen (843) and the third screen (842) in the fully unfolded state. For example, the electronic device (300) can display a fourth screen (841) related to the third screen (842) on the flexible display (302) based on an analysis of the third screen (842). For example, the electronic device (300) may determine a second application for displaying a fourth screen (841) based on an analysis of the third screen (842). For example, the electronic device (300) may display a fourth screen (841) of a second application related to the third screen (842) while displaying the third screen (842). According to one embodiment, the electronic device (300) may determine a second application for displaying the fourth screen (841) based on an analysis of the second content (e.g., search results for the second object (812)).For example, the electronic device (300) may select an application capable of providing product search results to provide product search results related to the search results for the second object (812) based on an analysis of the second content (e.g., search results for the second object (812)). For example, the electronic device (300) may use the selected application to check third content related to the second content (e.g., search results for the second object (812)) (e.g., product search results related to the search results for the second object (812)). For example, the electronic device (300) may display a fourth screen (841) of the second application containing the third content (e.g., product search results related to the search results for the second object (812)) on a flexible display (302). Referring to FIG. 8(d), the extended AI function provided by the camera application may include an operation to provide product search results related to vision search results, but this is exemplary and there are no limitations on the types of operations provided by the extended AI function. According to one embodiment, in FIG. 8(d), the electronic device (300) can detect user input for selecting a third UI (845) on the second screen (843) while displaying the second screen (843) and the third screen (842) in a fully unfolded state. Accordingly, the electronic device (300) can verify the fourth content (e.g., search result) by applying an AI function (e.g., vision search function) corresponding to the third UI (845) to the first content (e.g., third object (813)), and display a screen containing the fourth content (e.g., search result for the third object (813)) instead of the third screen (842) (e.g., a screen containing search results for the second object (812)). However, this is merely an example, and other extended AI functions will be described later with reference to other drawings.
[0196] In operation 629, according to one embodiment, the electronic device (101) may confirm a folding operation (e.g., a second folding operation). According to one embodiment, the electronic device (101) may perform operation 631 based on confirming the folding operation (e.g., a second folding operation) after providing an extended AI function through a flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, the flexible display in FIG. 4a, or 403 in FIG. 4b) in a fully unfolded state. According to one embodiment, the electronic device (101) may display a screen (e.g., the second screen of operation 617, or the third screen of operation 623) in a partially folded state (e.g., an intermediate folded state) after providing an extended AI function through a flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, the flexible display in FIG. 4a, or 403 in FIG. 4b) in a fully unfolded state without performing operation 631, based on confirming a folding operation (e.g., a second folding operation).
[0197] In operation 631, according to one embodiment, the electronic device (101) may display different screens depending on the setting. According to one embodiment, the electronic device (101) may display a third screen containing second content in operation 623 according to a first setting, based on confirming a folding operation (e.g., a second folding operation) after providing extended AI functions through a flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, the flexible display in FIG. 4a, or 403 in FIG. 4b) in a fully unfolded state. For example, the first setting may cause the existing screen (e.g., the second screen) to be displayed with the AI functions applied. According to one embodiment, the electronic device (101) may display a second screen such that a UI corresponding to the AI function in the 617 operation is displayed on the first content according to a second setting, based on confirming a folding operation (e.g., a second folding operation) after providing an extended AI function through a flexible display (162) (e.g., 202 in FIG. 2a, 302 in FIG. 3a, the flexible display in FIG. 4a, or 403 in FIG. 4b) in a fully unfolded state. For example, the second setting may cause an existing screen (e.g., a third screen) in which a UI corresponding to the AI function is displayed before applying the AI function.
[0198] FIG. 10 is a drawing illustrating the operation of an electronic device according to one embodiment. FIG. 10 can be explained with reference to the embodiments described above, the embodiments of FIG. 5 and FIG. 6, and the embodiments described below.
[0199] Referring to FIG. 10, an embodiment of a note application can be described.
[0200] The embodiments of FIG. 10 are illustrated with the electronic device (300) of FIG. 3a as an example. By referring to the embodiments of FIG. 10, the operations of the electronic device (200) of FIG. 2a, the electronic device (101) of FIG. 4a, and the electronic device (400) of FIG. 4b can be understood.
[0201] In FIG. 10 (a), the electronic device (300) can display a first screen (1010) of a first application (e.g., a note application) containing first content (e.g., text and a layout including text) through a cover display (303) when fully folded.
[0202] After displaying the first screen (1010), the electronic device (300) can confirm an unfolding operation (e.g., a first unfolding operation) from a fully folded state to a partially folded state (e.g., an intermediate folded state). Based on confirming the unfolding operation (e.g., the first unfolding operation), the electronic device (300) can determine whether the folding AI function is activated. Based on confirming the activation of the folding AI function, the electronic device (300) can determine, according to the unfolding operation (e.g., the first unfolding operation), among a plurality of AI functions assigned to the first application (e.g., a note application), the AI function to be applied to the first content (e.g., text and a layout containing text).
[0203] In FIG. 10(b), the electronic device (300) may display a second screen (1020) so that a UI corresponding to a determined AI function is displayed on the first content while in a partially folded state (e.g., a partially folded state). For example, the electronic device (300) may display a second screen (1020) so that a UI corresponding to an AI function is displayed on the first content before applying the AI function. The second screen (1020) may include a first UI (1021) corresponding to a first AI function (e.g., an automatic formatting function), a second UI (1022) corresponding to a second AI function (e.g., a translation function), and a third UI (1023) corresponding to a third AI function (e.g., a summary function). The electronic device (300) may confirm a selection for the third UI (1023) among the UIs included in the second screen (1020). The electronic device (300) can verify the second content by applying a third AI function (e.g., a summary function) corresponding to the selected third UI (1023) to the first content.
[0204] In FIG. 10 (c), the electronic device (300) may display a third screen (1030) containing second content to which a third AI function (e.g., a summary function) is applied while in a partially folded state (e.g., a partially folded state). For example, the third screen (1030) may be a screen generated by summarizing text included in the first screen (1010). After displaying the third screen (1030), the electronic device (300) may check an unfolding operation (e.g., a second unfolding operation).
[0205] The electronic device (300) can provide an extended AI function based on confirming an unfolding operation (e.g., a second unfolding operation). In (d) of FIG. 10, in a fully unfolded state, the electronic device (300) can display a screen (1043) corresponding to a second screen (1020) so that a UI corresponding to the AI function is displayed on the first content, and a screen (1042) corresponding to a third screen (1030) containing the second content to which a third AI function (e.g., a summary function) is applied. According to one embodiment, the electronic device (300) may display a screen (1041) corresponding to a first screen (1010) containing first content (e.g., text and a layout including text) while displaying a screen (1043) corresponding to a second screen (1020) and a screen (1042) corresponding to a third screen (1030) containing second content to which a third AI function (e.g., a summary function) is applied, so that a UI corresponding to an AI function is displayed on the first content.
[0206] In (d) of FIG. 10, the electronic device (300) may display a screen with a different AI function applied instead of the screen (1042) based on a selection for another UI (e.g., 1044, 1045) corresponding to a different AI function on the screen (1043) corresponding to the second screen (1020) so that a UI corresponding to an AI function is displayed on the first content.
[0207] FIG. 11 is a drawing illustrating the operation of an electronic device according to one embodiment. FIG. 11 can be explained with reference to the embodiments described above, the embodiments of FIG. 5 and FIG. 6, and the embodiments described below.
[0208] Referring to FIG. 11, an embodiment of a gallery application can be described.
[0209] The embodiments of FIG. 11 are illustrated with the electronic device (300) of FIG. 3a as an example. By referring to the embodiments of FIG. 11, the operations of the electronic device (200) of FIG. 2a, the electronic device (101) of FIG. 4a, and the electronic device (400) of FIG. 4b can be understood.
[0210] In FIG. 11 (a), the electronic device (300) can display a first screen (1110) of a first application (e.g., a gallery application) containing a first content (e.g., an image) through a cover display (303) when fully folded.
[0211] After displaying the first screen (1110), the electronic device (300) can confirm an unfolding operation (e.g., a first unfolding operation) from a fully folded state to a partially folded state (e.g., an intermediate folded state). Based on confirming the unfolding operation (e.g., the first unfolding operation), the electronic device (300) can determine whether the folding AI function is activated. Based on confirming the activation of the folding AI function, the electronic device (300) can determine, according to the unfolding operation (e.g., the first unfolding operation), the AI function to be applied to the first content (e.g., an image) among a plurality of AI functions assigned to the first application (e.g., a gallery application).
[0212] In FIG. 11(b), the electronic device (300) may display a second screen (1120) so that a UI corresponding to a determined AI function is displayed on the first content while in a partially folded state (e.g., a partially folded state). For example, the electronic device (300) may display the second screen (1120) so that a UI corresponding to an AI function is displayed on the first content before applying the AI function. The second screen (1120) may include a first UI (1121) corresponding to a first AI function (e.g., a drawing generation function), a second UI (1122) corresponding to a second AI function (e.g., a background composite function after object removal), and a third UI (1123) corresponding to a third AI function (e.g., a style conversion function). The electronic device (300) may confirm a selection for the second UI (1122) among the UIs included in the second screen (1120). The electronic device (300) can verify the second content by applying a second AI function (e.g., background composite function after object removal) corresponding to the selected second UI (1122) to the first content (e.g., image).
[0213] In FIG. 11 (c), the electronic device (300) can display a third screen (1130) containing second content to which a second AI function (e.g., background composite function after object removal) is applied while in a partially folded state (e.g., a partially folded state). For example, the third screen (1130) may be a screen containing an image created by removing objects (e.g., objects other than the central dog) from an image included in the first screen (1110) and then compositing a background onto the removed area. After displaying the third screen (1130), the electronic device (300) can check an unfolding operation (e.g., a second unfolding operation).
[0214] The electronic device (300) can provide an extended AI function based on confirming an unfolding operation (e.g., a second unfolding operation). In (d) of FIG. 11, in a fully unfolded state, the electronic device (300) can display a screen (1143) corresponding to a second screen (1120) so that a UI corresponding to the AI function is displayed on the first content, and a screen (1142) corresponding to a third screen (1130) containing the second content to which the second AI function (e.g., a background composite function after object removal) is applied. According to one embodiment, the electronic device (300) may display a screen (1141) corresponding to a first screen (1110) containing first content (e.g., original image) while displaying a screen (1143) corresponding to a second screen (1120) and a screen (1432) corresponding to a third screen (1130) containing second content to which a second AI function (e.g., background composite function after object removal) is applied, so that a UI corresponding to an AI function is displayed on the first content.
[0215] In (d) of FIG. 11, the electronic device (300) may display a screen with a different AI function applied instead of the screen (1142) based on a selection for another UI (e.g., 1144, 1145, 1146) corresponding to another AI function on the screen (1143) corresponding to the second screen (1120) so that a UI corresponding to the AI function is displayed on the first content.
[0216] FIG. 12 is a drawing illustrating the operation of an electronic device according to one embodiment. FIG. 12 can be explained with reference to the embodiments described above, the embodiments of FIG. 5 and FIG. 6, and the embodiments described below.
[0217] Referring to FIG. 12, an embodiment of a call application can be described.
[0218] The embodiments of FIG. 12 are illustrated with the electronic device (300) of FIG. 3a as an example. By referring to the embodiments of FIG. 12, the operations of the electronic device (200) of FIG. 2a, the electronic device (101) of FIG. 4a, and the electronic device (400) of FIG. 4b can be understood.
[0219] In FIG. 12 (a), the electronic device (300) can display a first screen (1210) of a first application (e.g., a call application) containing first content (e.g., an icon corresponding to an action related to a call) through a cover display (303) when fully folded.
[0220] After displaying the first screen (1210), the electronic device (300) can confirm an unfolding operation (e.g., a first unfolding operation) from a fully folded state to a partially folded state (e.g., a middle folded state). Based on confirming the unfolding operation (e.g., the first unfolding operation), the electronic device (300) can determine whether the folding AI function is activated. Based on confirming the activation of the folding AI function, the electronic device (300) can determine, according to the unfolding operation (e.g., the first unfolding operation), among a plurality of AI functions assigned to the first application (e.g., a call application), the AI function to be applied to the first content (e.g., an icon corresponding to a call-related action). In the call application, the AI function to be applied to the icon corresponding to a call-related action may be an AI function for a call-related action.
[0221] In FIG. 12(b), the electronic device (300) may display a second screen (1220) so that a UI corresponding to a determined AI function is displayed in a partially folded state (e.g., a partially folded state). For example, the electronic device (300) may display the second screen (1220) so that a UI corresponding to an AI function is displayed before applying the AI function. The second screen (1220) may include a first UI (1221) corresponding to a first AI function (e.g., a real-time interpretation function) and a second UI (1222) corresponding to a second AI function (e.g., a necessary information search function). The electronic device (300) may confirm a selection for the first UI (1221) among the UIs included in the second screen (1220). The electronic device (300) can check the second content (e.g., real-time interpretation result) by applying a first AI function (e.g., real-time interpretation function) corresponding to the selected first UI (1221).
[0222] In FIG. 12 (c), the electronic device (300) can display a third screen (1230) containing second content (e.g., real-time interpretation result (1231)) to which a first AI function (e.g., real-time interpretation function) is applied while in a partially folded state (e.g., intermediate folded state). After displaying the third screen (1230), the electronic device (300) can confirm an unfolding operation (e.g., a second unfolding operation).
[0223] The electronic device (300) can provide extended AI functions based on confirming an unfolding operation (e.g., a second unfolding operation). In (d) of FIG. 12, in a fully unfolded state, the electronic device (300) can display a screen (1243) (e.g., a call screen) corresponding to a first screen (1210) of a first application (e.g., a call application) containing first content (e.g., an icon corresponding to an action related to a call) and a screen (1242) corresponding to a third screen (1230) containing second content (e.g., a real-time interpretation result (1231)) to which a first AI function (e.g., a real-time interpretation function) is applied. According to one embodiment, while displaying a screen (1243) (e.g., a call screen) corresponding to a first screen (1210) of a first application (e.g., a call application) that includes first content (e.g., an icon corresponding to an action related to a call) and a screen (1242) corresponding to a third screen (1230) that includes second content (e.g., a real-time interpretation result (1231)) to which a first AI function (e.g., a real-time interpretation function) is applied, the electronic device (300) may display a screen (1241) that includes third content (e.g., a result of a map search function determined to be necessary based on the real-time interpretation result) to which a second AI function (e.g., a necessary information search function) is applied.
[0224] FIG. 13 is a drawing illustrating the operation of an electronic device according to one embodiment. FIG. 13 can be explained with reference to the embodiments described above, the embodiments of FIG. 5 and FIG. 6, and the embodiments described below.
[0225] Referring to FIG. 13, an embodiment of a video application can be described.
[0226] The embodiments of FIG. 13 are illustrated with the electronic device (300) of FIG. 3a as an example. By referring to the embodiments of FIG. 13, the operations of the electronic device (200) of FIG. 2a, the electronic device (101) of FIG. 4a, and the electronic device (400) of FIG. 4b can be understood.
[0227] In FIG. 13 (a), the electronic device (300) can display a first screen (1310) of a first application (e.g., a video application) containing a first content (e.g., a video) through a cover display (303) when fully folded.
[0228] After displaying the first screen (1310), the electronic device (300) can confirm an unfolding operation (e.g., a first unfolding operation) from a fully folded state to a partially folded state (e.g., an intermediate folded state). Based on confirming the unfolding operation (e.g., the first unfolding operation), the electronic device (300) can determine whether the folding AI function is activated. Based on confirming the activation of the folding AI function, the electronic device (300) can determine, according to the unfolding operation (e.g., the first unfolding operation), the AI function to be applied to the first content (e.g., a video) among a plurality of AI functions assigned to the first application (e.g., a video application).
[0229] In FIG. 13(b), the electronic device (300) may display a second screen (1320) so that a UI corresponding to a determined AI function is displayed on the first content while in a partially folded state (e.g., a partially folded state). For example, the electronic device (300) may display a second screen (1320) so that a UI corresponding to an AI function is displayed on the first content before applying the AI function. The second screen (1320) may include a first UI (1321) corresponding to a first AI function (e.g., a video content summary function), a second UI (1322) corresponding to a second AI function (e.g., an automatic translation function), and a third UI (1323) corresponding to a third AI function (e.g., a video-related information search function). The electronic device (300) may confirm a selection for the first UI (1321) among the UIs included in the second screen (1320). The electronic device (300) can verify the second content by applying a first AI function (e.g., video content summary function) corresponding to the selected first UI (1321) to the first content (e.g., video).
[0230] In FIG. 13 (c), the electronic device (300) can display a third screen (1330) containing second content to which a first AI function (e.g., video content summary function) is applied while in a partially folded state (e.g., a partially folded state). For example, the third screen (1330) may be a screen containing video and video content summary information included in the first screen (1310). After displaying the third screen (1330), the electronic device (300) can confirm an unfolding operation (e.g., a second unfolding operation).
[0231] The electronic device (300) can provide an extended AI function based on confirming an unfolding operation (e.g., a second unfolding operation). In (d) of FIG. 13, in a fully unfolded state, the electronic device (300) can display a screen (1342) corresponding to a second screen (1320) and a wide image screen (1341) so that a UI corresponding to the AI function is displayed on the first content.
[0232] In (d) of FIG. 13, the electronic device (300) may display a screen (1341) containing content with other AI functions applied instead of video content summary information, based on a selection of other UIs (e.g., 1343, 1344, 1345) corresponding to other AI functions on a screen (1342) corresponding to a second screen (1320) so that a UI corresponding to an AI function is displayed on the first content.
[0233] FIG. 14 is a drawing illustrating the operation of an electronic device according to one embodiment. FIG. 14 can be explained with reference to the embodiments described above, the embodiments of FIG. 5 and FIG. 6, and the embodiments described below.
[0234] The electronic device (1400) of FIG. 14 may be the electronic device (101) of FIG. 1. For example, the electronic device (1400) of FIG. 14 may be a device that folds once. For example, the electronic device (1400) may include a first housing (1401), a second housing (1402), and a hinge (1403) that rotatably connects the first housing (1401) and the second housing (1402). As the electronic device (1400) folds, a foldable area corresponding to the hinge (1403) in the flexible display (1405) of the electronic device (1400) may be folded. The electronic device (1400) may include a cover display (1404) that faces in the opposite direction to the direction in which the flexible display (1405) faces when unfolded.
[0235] In FIG. 14, the electronic device (1400) can display a first screen (1410) of a first application (e.g., a camera application) containing first content (e.g., an image displayed on a preview screen, or an object (1411, 1412, 1413) included in the image) through a cover display (1404) while in a folded state.
[0236] After displaying the first screen (1410), the electronic device (1400) can confirm the unfolding operation from the folded state to the unfolded state. Based on confirming the unfolding operation, the electronic device (1400) can confirm whether the folding AI function is activated. Based on confirming the activation of the folding AI function, the electronic device (1400) can determine the AI function to be applied to the first content (e.g., an image displayed on the preview screen, or an object (1411, 1412, 1413)) among a plurality of AI functions assigned to the first application (e.g., a camera application) according to the unfolding operation.
[0237] In FIG. 14, the electronic device (1400) may display a second screen (1422) so that a UI corresponding to a determined AI function is displayed on the first content when unfolded. For example, the electronic device (1400) may display the second screen (1422) so that a UI corresponding to an AI function is displayed on the first content before applying the AI function. The second screen (1422) may include a first UI (1423) corresponding to a first AI function (e.g., a vision search function) to be applied to the first object (1411), a second UI (1424) corresponding to a second AI function to be applied to the second object (1412), and a third UI (1425) corresponding to a third AI function to be applied to the third object (1413). The electronic device (1400) may confirm a selection for the second UI (1424) among the UIs included in the second screen (1422). The electronic device (1400) can verify the second content by applying a second AI function (e.g., a vision search function) corresponding to the selected second UI (1424) to the first content (e.g., a second object (1412)).
[0238] In FIG. 14, the electronic device (300) can display a third screen (1421) containing second content (e.g., search results for a second object (1412)) to which a second AI function (e.g., vision search function) is applied while in an unfolded state. After displaying the third screen (1421), the electronic device (300) can confirm a folding operation.
[0239] The electronic device (300) can display the previously displayed screen (1410) on the cover display (1404) based on confirming the folding operation.
[0240] FIG. 15 is a drawing illustrating the operation of an electronic device according to one embodiment. FIG. 15 can be explained with reference to the embodiments described above, the embodiments of FIG. 5 and FIG. 6, and the embodiments described below.
[0241] The electronic device (400) of FIG. 15 may be the electronic device (400) of FIG. 4b.
[0242] In FIG. 15 (a), the electronic device (400) can display a first screen (1510) of a first application (e.g., a camera application) containing first content (e.g., an image displayed on a preview screen, or an object (1511, 1512, 1513) included in the image) through a portion of the flexible display (e.g., A1 in FIG. 4d) when fully folded.
[0243] After displaying the first screen (1510), the electronic device (400) can confirm an unfolding operation from a fully folded state to a partially folded state (e.g., a partially folded state). Based on confirming the unfolding operation, the electronic device (1400) can determine whether the folding AI function is activated. Based on confirming the activation of the folding AI function, the electronic device (1400) can determine, according to the unfolding operation, which AI function to be applied to the first content (e.g., an image displayed on a preview screen, or an object (1511, 1512, 1513)) among a plurality of AI functions assigned to the first application (e.g., a camera application).
[0244] In FIG. 15(b), the electronic device (400) may display a second screen (1522) so that a UI corresponding to a determined AI function is displayed on the first content through a portion of the flexible display (403) (e.g., A3 in FIG. 4e) in a partially folded state (e.g., intermediate folded state). For example, the electronic device (400) may display the second screen (1522) so that a UI corresponding to an AI function is displayed on the first content before applying the AI function. The second screen (1522) may include a first UI (1523) corresponding to a first AI function (e.g., vision search function) to be applied to the first object (1511), a second UI (1524) corresponding to a second AI function to be applied to the second object (1512), and a third UI (1525) corresponding to a third AI function to be applied to the third object (1513). The electronic device (400) can confirm the selection of the second UI (1524) among the UIs included in the second screen (1522). The electronic device (1400) can confirm the second content by applying a second AI function (e.g., a vision search function) corresponding to the selected second UI (1524) to the first content (e.g., a second object (1512)).
[0245] In FIG. 15(b), the electronic device (400) can display a third screen (1521) containing second content (e.g., search results for a second object (1512)) to which a second AI function (e.g., vision search function) is applied, through a portion of the flexible display (403) (e.g., A4 in FIG. 4e) while in a partially folded state (e.g., intermediate folded state). After displaying the third screen (1521), the electronic device (400) can confirm an unfolding operation from the partially folded state (e.g., intermediate folded state) to a fully unfolded state. Based on confirming the unfolding operation from the partially folded state (e.g., intermediate folded state) to a fully unfolded state, the electronic device (400) can provide an extended AI function.
[0246] In (c) of FIG. 15, the electronic device (400) can display a screen (1531) containing the third content (e.g., product search results related to the second object (1512)) by means of a part area (e.g., A1 in FIG. 4a) of the flexible display (403) that includes the third content (e.g., product search results related to the second object (1512)) and a screen (1533) containing a UI (e.g., 1534, 1535, 1536) corresponding to the AI function, and a screen (1532) containing the second content (e.g., search results for the second object (1512)) to which the AI function is applied, while checking the second content (e.g., product search results related to the second object (1512)) and displaying the screen (1531) containing the third content (e.g., product search results related to the second object (1512)) by means of a screen (1533) containing a UI (e.g., 1534, 1535, 1536) corresponding to the AI function.
[0247] FIG. 16 is a drawing illustrating the operation of an electronic device according to one embodiment. FIG. 16 can be explained with reference to the embodiments described above, the embodiments of FIG. 5 and FIG. 6, and the embodiments described below.
[0248] The electronic device (1600) of FIG. 16 may be the electronic device (101) of FIG. 1. For example, the electronic device (1600) of FIG. 16 may be a device including a rollable display (1603). For example, the electronic device (1600) may include a first housing (1601) and a second housing (1602) movable relative to the first housing (1601). As the second housing (1602) moves, the area of the rollable display (1603) exposed to the outside may be expanded. A state in which the area of the rollable display (1603) exposed to the outside is at its minimum may be called a minimum state. A state in which the area of the rollable display (1603) exposed to the outside is at its maximum may be called a maximum state. An intermediate state in which the transition from the minimum state to the maximum state may be called an intermediate state. FIG. 16 illustrates the minimum state, the intermediate state, and the maximum state from left to right.
[0249] In FIG. 16, the electronic device (1600) can display a first screen (1610) of a first application (e.g., a gallery application) containing a first content (e.g., an image) in a minimum state.
[0250] The electronic device (1600) can check the rolling motion to an intermediate state after displaying the first screen (1610). Based on checking the rolling motion, the electronic device (1600) can check whether a rolling AI function (e.g., a function corresponding to the aforementioned folding AI function) is activated. Based on checking the activation of the rolling AI function, the electronic device (1600) can determine, according to the rolling motion, an AI function to be applied to the first content (e.g., an image) among a plurality of AI functions assigned to the first application (e.g., a gallery application).
[0251] In FIG. 16, the electronic device (1600) may display a second screen (1622) so that a UI corresponding to a determined AI function is displayed on the first content in an intermediate state. For example, the electronic device (1600) may display a second screen (1622) so that a UI corresponding to an AI function is displayed on the first content before applying the AI function. The second screen (1622) may include a first UI (1623) corresponding to a first AI function (e.g., object removal function) and a second UI (1624) corresponding to a second AI function (e.g., tilt correction function). The electronic device (1600) may confirm a selection for the first UI (1623) among the UIs included in the second screen (1622). The electronic device (1600) can verify the second content by applying a first AI function (e.g., object removal function) corresponding to the selected first UI (1623) to the first content (e.g., image).
[0252] In FIG. 16, the electronic device (1600) may display a third screen (1621) containing second content to which a first AI function (e.g., an object removal function) is applied in an intermediate state. For example, the third screen (1621) may be a screen containing an image created by removing objects (e.g., objects other than the central dog) from an image included in the first screen (1610) and then compositing a background onto the removed area. After displaying the third screen (1621), the electronic device (1600) may confirm a continuing rolling motion.
[0253] The electronic device (1600) may provide an extended AI function based on confirming a continuous rolling motion. In FIG. 16, in the maximum state, the electronic device (1600) may display a screen (1633) corresponding to a second screen (1622) so that a UI corresponding to the AI function is displayed on the first content, and a screen (1631) corresponding to a third screen (1621) containing the second content to which the first AI function (e.g., object removal function) is applied. According to one embodiment, while displaying the screen (1633) corresponding to the second screen (1622) so that a UI corresponding to the AI function is displayed on the first content and the screen (1631) corresponding to the third screen (1621) containing the second content to which the first AI function (e.g., object removal function) is applied, the electronic device (1600) may display a screen (1632) corresponding to a first screen (1610) containing the first content (e.g., original image).
[0254] In FIG. 16, the electronic device (300) may display a screen with a different AI function applied instead of the screen (1631), based on a selection for another UI (e.g., 1634, 1635, 1636) corresponding to another AI function, on a screen (1633) corresponding to a second screen (1622) so that a UI corresponding to an AI function is displayed on the first content.
[0255] Those skilled in the art will understand that the embodiments described herein may be applied interchangeably to the extent applicable. For example, those skilled in the art will understand that at least some operations of an embodiment described herein may be omitted, and at least some operations of the embodiments may be applied interchangeably.
[0256] The present disclosure is not limited to the foregoing, and other unmentioned variations will be apparent to those skilled in the art from the present disclosure.
[0257] The effects obtainable from the present disclosure are not limited to those mentioned above, and other unmentioned effects will be clearly understood by those skilled in the art to which the present disclosure belongs from the description below.
[0258] According to one embodiment, an electronic device (101; 200; 300) that can be arranged in a folded state including a fully folded state, a partially folded state, and a fully unfolded state comprises: a housing (201; 301) including a first housing (230; 320), a second housing (210; 310), and a third housing (220; 330); a first hinge structure (280; 370) configured to rotatably connect the first housing (230; 320) and the second housing (210; 310); a second hinge structure (270; 380) configured to rotatably connect the second housing (210; 310) and the third housing (220; 330); and a corresponding to the first housing (230; 320). It may include a first display (202; 302) comprising a first display area, a second display area corresponding to the second housing (210; 310), and a third display area corresponding to the third housing (220; 330); a second display (203; 303) configured such that the electronic device (101; 200; 300) faces in a direction opposite to the direction in which the first display (202; 302) faces when fully unfolded; at least one sensor (176) comprising a sensing circuit; at least one processor (120) comprising a processing circuit; and a memory (130) for storing instructions. When the above instructions are executed individually or collectively by at least one processor (120), they may cause the electronic device (101; 200; 300) to check the folded state of the electronic device (101; 200; 300).When the above instructions are executed individually or collectively by at least one processor (120), they may cause the electronic device (101; 200; 300) to display a first screen of a first application through the second display (203; 303) in the fully folded state. When the above instructions are executed individually or collectively by at least one processor (120), they may cause the electronic device (101; 200; 300) to identify at least one artificial intelligence (AI) function related to the execution of the first application based on identifying a first change from the fully folded state to the partially folded state, and to display a second screen including a user interface (UI) representing the at least one AI function on the first display (202; 302) in a display area that is visually exposed in the partially folded state. When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may cause the selected first AI function to be applied to the first application based on a first user input for selecting the first AI function among the at least one AI function.
[0259] According to one embodiment, when the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may cause the first application to display a third screen of the first application to which the first AI function is applied, instead of the second screen, based on applying the first AI function to the first application in the partially folded state. When the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may cause the second screen and the third screen to be displayed on the first display (202; 302) based on identifying a second change from the partially folded state to the fully unfolded state.
[0260] According to one embodiment, when the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may cause to determine AI function(s) to be applied to a first object and a second object included in the first screen based on identifying the first change from the fully folded state to the partially folded state. When the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may cause to display a first UI corresponding to the first object and a second UI corresponding to the second object while displaying the second screen in the partially folded state. When the above instructions are executed individually or collectively by at least one processor (120), they may cause the electronic device (101; 200; 300) to apply a second AI function corresponding to the second UI to the first application based on a second user input for selecting the second UI on the second screen while displaying the second screen and the third screen in the fully unfolded state. When the above instructions are executed individually or collectively by at least one processor (120), they may cause the electronic device (101; 200; 300) to display a fourth screen of the first application with the second AI function applied to the area where the third screen was displayed, instead of the third screen, in the fully unfolded state.
[0261] According to one embodiment, when the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may cause the first screen to be displayed on the first display (202; 302) while displaying the second screen and the third screen in the fully unfolded state.
[0262] According to one embodiment, when the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may cause the second screen and the third screen to be displayed on the first display (202; 302) while displaying the third screen, based on identifying the second change from the partially folded state to the fully unfolded state.
[0263] According to one embodiment, when the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may cause a second application to determine the fifth screen based on an analysis of the third screen. When the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may cause the fifth screen of the second application associated with the third screen.
[0264] According to one embodiment, when the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may be caused to determine whether a folding AI function is activated based on identifying the first change from the fully folded state to the partially folded state. The folding AI function may be a function that determines the at least one AI function based on identifying the first change from the fully folded state to the partially folded state. When the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may be caused to determine the at least one AI function based on confirming the activation of the folding AI function and to display the second screen in the partially folded state. When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may be caused to display a screen with a default UI applied in the partially folded state based on confirming the deactivation of the folding AI function.
[0265] According to one embodiment, when the instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) may be caused to provide a sound effect indicating the execution of the folding AI function while displaying the second screen.
[0266] According to one embodiment, when the electronic device (101; 200; 300) is unfolded, the second housing (210; 310) may be positioned between the first housing (230; 320) and the third housing (220; 330).
[0267] According to one embodiment, the fully folded state may be a state in which the first display area, the second display area, and the third display area are all not visually exposed. The partially folded state may be a state in which one of the first display area, the second display area, or the third display area is visually exposed. The fully unfolded state may be a state in which the first display area, the second display area, and the third display area are all visually exposed.
[0268] According to one embodiment, a method of operating an electronic device (101; 200; 300) may be provided. In the above method, the electronic device (101; 200; 300) comprises: a housing (201; 301) including a first housing (230; 320), a second housing (210; 310), and a third housing (220; 330); a first hinge structure (280; 370) configured to rotatably connect the first housing (230; 320) and the second housing (210; 310); a second hinge structure (270; 380) configured to rotatably connect the second housing (210; 310) and the third housing (220; 330); a first display area corresponding to the first housing (230; 320); a second display area corresponding to the second housing (210; 310); and a third display area corresponding to the third housing (220; 330). The method may include a first display (202; 302), a second display (203; 303) configured to face in a direction opposite to the direction in which the first display (202; 302) faces when the electronic device (101; 200; 300) is unfolded, at least one sensor (176) including a sensing circuit, at least one processor (120) including a processing circuit, and a memory (130) for storing instructions. The method may include an operation of using the at least one sensor (176) to determine a first folding angle (e.g., a first folding state) between the first housing (230; 320) and the second housing (210; 310) and a second folding angle (e.g., a second folding state) between the second housing (210; 310) and the third housing (220; 330). The above method may include an operation to check the folded state of the electronic device (101; 200; 300).The above folding state may include a fully folded state, a partially folded state, and a fully unfolded state. The method may include an operation of displaying a first screen of a first application through the second display (203; 303) in the fully folded state. The method may include an operation of identifying at least one artificial intelligence (AI) function related to the execution of the first application based on identifying a first change from the fully folded state to the partially folded state, and displaying a second screen including a user interface (UI) representing the at least one AI function in a display area visually exposed in the partially folded state on the first display (202; 302). The method may include an operation of applying the selected first AI function to the first application based on a first user input for selecting a first AI function among the at least one AI function.
[0269] According to one embodiment, the method may include an operation of displaying a third screen of the first application to which the first AI function is applied, instead of the second screen, based on applying the first AI function to the first application in the partially folded state. The method may include an operation of displaying the second screen and the third screen on the first display (202; 302) based on identifying a second change from the partially folded state to the fully unfolded state.
[0270] According to one embodiment, the method may include an operation of determining AI function(s) to be applied to a first object and a second object included in the first screen based on identifying the first change from the fully folded state to the partially folded state. The method may include an operation of displaying a first UI corresponding to the first object and a second UI corresponding to the second object while displaying the second screen in the partially folded state. The method may include an operation of applying a second AI function corresponding to the second UI to the first application based on a second user input for selecting the second UI on the second screen while displaying the second screen and the third screen in the fully unfolded state. The method may include an operation of displaying a fourth screen of the first application with the second AI function applied to the area where the third screen was displayed, in place of the third screen in the fully unfolded state.
[0271] According to one embodiment, the method may include the operation of displaying the first screen on the first display (202; 302) while displaying the second screen and the third screen in the fully unfolded state.
[0272] According to one embodiment, the method may include an operation of displaying a fifth screen associated with the third screen on the first display (202; 302) while displaying the second screen and the third screen in the fully unfolded state, based on identifying the second change from the partially folded state to the fully unfolded state.
[0273] According to one embodiment, the method may include an operation of determining a second application for displaying the fifth screen based on an analysis of the third screen. The method may include an operation of displaying the fifth screen of the second application associated with the third screen.
[0274] According to one embodiment, the method may include an operation of checking whether a folding AI function is activated based on identifying the first change from the fully folded state to the partially folded state. The folding AI function may be a function that determines the at least one AI function based on identifying the first change from the fully folded state to the partially folded state. The method may include an operation of determining the at least one AI function based on confirming the activation of the folding AI function and displaying the second screen in the partially folded state. The method may include an operation of displaying a screen with a default UI applied in the partially folded state based on confirming the deactivation of the folding AI function.
[0275] According to one embodiment, the method may include an operation of providing a sound effect indicating the execution of the folding AI function while displaying the second screen.
[0276] According to one embodiment, in the method, when the electronic device (101; 200; 300) is in an unfolded state, the second housing (210; 310) may be placed between the first housing (230; 320) and the third housing (220; 330).
[0277] According to one embodiment, in the method, the fully folded state may be a state in which the first display area, the second display area, and the third display area are all not visually exposed. The partially folded state may be a state in which one of the first display area, the second display area, or the third display area is visually exposed. The fully unfolded state may be a state in which the first display area, the second display area, and the third display area are all visually exposed.
[0278] According to one embodiment, in a non-transitory computer-readable storage medium for storing instructions, the instructions may cause the electronic device (101; 200; 300) to perform at least one operation when executed individually or collectively by at least one processor (120) of the electronic device (101; 200; 300). In the above storage medium, the electronic device (101; 200; 300) comprises a housing (201; 301) including a first housing (230; 320), a second housing (210; 310), and a third housing (220; 330); a first hinge structure (280; 370) configured to rotatably connect the first housing (230; 320) and the second housing (210; 310); a second hinge structure (270; 380) configured to rotatably connect the second housing (210; 310) and the third housing (220; 330); a first display area corresponding to the first housing (230; 320); a second display area corresponding to the second housing (210; 310); and a third display corresponding to the third housing (220; 330). It may include a first display (202; 302) including an area, a second display (203; 303) configured to face in the opposite direction to the direction in which the first display (202; 302) faces when the electronic device (101; 200; 300) is unfolded, at least one sensor (176) including a sensing circuit, at least one processor (120) including a processing circuit, and a memory (130) for storing instructions.The at least one operation may include an operation of checking a first folding angle (e.g., a first folding state) between the first housing (230; 320) and the second housing (210; 310) and a second folding angle (e.g., a second folding state) between the second housing (210; 310) and the third housing (220; 330) using the at least one sensor (176). The at least one operation may include an operation of checking the folded state of the electronic device (101; 200; 300). The folded state may include a fully folded state, a partially folded state, and a fully unfolded state. The at least one operation may include an operation of displaying a first screen of a first application through the second display (203; 303) in the fully folded state. The above at least one operation may include identifying at least one artificial intelligence (AI) function related to the execution of the first application based on identifying a first change from the fully folded state to the partially folded state, and displaying a second screen including a user interface (UI) representing the at least one AI function in a display area visually exposed in the partially folded state on the first display (202; 302). The above at least one operation may include applying the selected first AI function to the first application based on a first user input for selecting a first AI function among the at least one AI function.
[0279] According to one embodiment, in the storage medium, the at least one operation may include an operation of displaying a third screen of the first application to which the first AI function is applied, instead of the second screen, based on applying the first AI function to the first application in the partially folded state. The at least one operation may include an operation of displaying the second screen and the third screen on the first display (202; 302), based on identifying a second change from the partially folded state to the fully unfolded state.
[0280] According to one embodiment, in the storage medium, the at least one operation may include an operation of determining AI function(s) to be applied to a first object and a second object included in the first screen based on identifying the first change from the fully folded state to the partially folded state. The at least one operation may include an operation of displaying a first UI corresponding to the first object and a second UI corresponding to the second object while displaying the second screen in the partially folded state. The at least one operation may include an operation of applying a second AI function corresponding to the second UI to the first application based on a second user input for selecting the second UI on the second screen while displaying the second screen and the third screen in the fully unfolded state. The at least one operation may include an operation of displaying a fourth screen of the first application with the second AI function applied to the area where the third screen was displayed, in place of the third screen in the fully unfolded state.
[0281] According to one embodiment, in the storage medium, the at least one operation may include displaying the first screen on the first display (202; 302) while displaying the second screen and the third screen in the fully unfolded state.
[0282] According to one embodiment, in the storage medium, the at least one operation may include an operation of displaying a fifth screen associated with the third screen on the first display (202; 302) while displaying the second screen and the third screen in the fully unfolded state, based on identifying the second change from the partially folded state to the fully unfolded state.
[0283] According to one embodiment, in the storage medium, the at least one operation may include an operation of determining a second application for displaying the fifth screen based on an analysis of the third screen. The at least one operation may include an operation of displaying the fifth screen of the second application associated with the third screen.
[0284] According to one embodiment, in the storage medium, the at least one operation may include an operation of checking whether a folding AI function is activated based on identifying the first change from the fully folded state to the partially folded state. The folding AI function may be a function of determining the at least one AI function based on identifying the first change from the fully folded state to the partially folded state. The at least one operation may include an operation of determining the at least one AI function based on confirming the activation of the folding AI function and displaying the second screen in the partially folded state. The at least one operation may include an operation of displaying a screen with a default UI applied in the partially folded state based on confirming the deactivation of the folding AI function.
[0285] According to one embodiment, in the storage medium, the at least one operation may include an operation of providing a sound effect indicating the execution of the folding AI function while displaying the second screen.
[0286] According to one embodiment, in the storage medium, when the electronic device (101; 200; 300) is unfolded, the second housing (210; 310) may be positioned between the first housing (230; 320) and the third housing (220; 330).
[0287] According to one embodiment, in the storage medium, the fully folded state may be a state in which the first display area, the second display area, and the third display area are all not visually exposed. The partially folded state may be a state in which one of the first display area, the second display area, or the third display area is visually exposed. The fully unfolded state may be a state in which the first display area, the second display area, and the third display area are all visually exposed.
[0288] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0289] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0290] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0291] Various embodiments of this document may be implemented as software (e.g., a program) comprising one or more instructions stored on a storage medium readable by a machine (e.g., an electronic device). For example, a processor (e.g., a controller) of the machine may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, "non-transitory" simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and this term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily in the storage medium.
[0292] According to one embodiment, the method according to the various embodiments disclosed herein may be provided as included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0293] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
In an electronic device (101; 200; 300) that can be arranged in a folded state including a fully folded state, a partially folded state, and a fully unfolded state, Housing (201; 301) including a first housing (230; 320), a second housing (210; 310) and a third housing (220; 330); A first hinge structure (280; 370) configured to rotatably connect the first housing (230; 320) and the second housing (210; 310); A second hinge structure (270; 380) configured to rotatably connect the second housing (210; 310) and the third housing (220; 330); A first display (202; 302) comprising a first display area corresponding to the first housing (230; 320), a second display area corresponding to the second housing (210; 310), and a third display area corresponding to the third housing (220; 330); A second display (203; 303) configured to face in the opposite direction to the direction in which the first display (202; 302) faces in the fully unfolded state of the electronic device (101; 200; 300); At least one sensor (176) including a sensing circuit; At least one processor (120) including a processing circuit; and It includes a memory (130) for storing instructions, When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) causes, Checking the folding state of the above electronic device (101; 200; 300), and In the above completely folded state, the first screen of the first application is displayed through the second display (203; 303), and Based on identifying a first change from the fully folded state to the partially folded state, at least one artificial intelligence (AI) function related to the execution of the first application is identified, and a second screen including a user interface (UI) representing the at least one AI function is displayed in a display area visually exposed in the partially folded state on the first display (202; 302). Based on a first user input for selecting a first AI function among the above at least one AI function, the selected first AI function is applied to the first application. Electronic device. In Article 1, When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) causes, Based on applying the first AI function to the first application in the partially folded state above, a third screen of the first application to which the first AI function is applied is displayed instead of the second screen, and Based on identifying a second change from the partially folded state to the fully unfolded state, the second screen and the third screen are caused to be displayed on the first display (202; 302), and Electronic device (101; 200; 300). In Article 2, When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) causes, Based on identifying the first change from the fully folded state to the partially folded state, determine the AI function(s) to be applied to the first object and the second object included in the first screen, and While displaying the second screen in the partially folded state, a first UI corresponding to the first object and a second UI corresponding to the second object are displayed, While displaying the second screen and the third screen in the fully unfolded state, based on a second user input for selecting the second UI on the second screen, a second AI function corresponding to the second UI is applied to the first application, and In the above fully unfolded state, causing the fourth screen of the first application to which the second AI function is applied to be displayed in the area where the third screen was displayed, instead of the third screen, Electronic device (101; 200; 300). In Article 2 or Article 3, When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) causes, While displaying the second screen and the third screen in the fully unfolded state, causing the first screen to be displayed on the first display (202; 302), Electronic device (101; 200; 300). In any one of paragraphs 2 through 4, When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) causes, Based on identifying the second change from the partially folded state to the fully unfolded state, causing the second screen and the third screen to be displayed on the first display (202; 302) while displaying the second screen and the third screen in the fully unfolded state, Electronic device (101; 200; 300). In Article 5, When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) causes, Based on the analysis of the third screen above, a second application for displaying the fifth screen is determined, and Causing to display the fifth screen of the second application associated with the third screen, Electronic device (101; 200; 300). In any one of paragraphs 1 to 6, When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) causes, Based on identifying the first change from the fully folded state to the partially folded state, the activation status of the folding AI function is determined, wherein the folding AI function is a function that determines at least one AI function based on identifying the first change from the fully folded state to the partially folded state. Based on confirming the activation of the above folding AI function, the at least one AI function is determined, and the second screen is displayed in the partially folded state. Based on confirming the deactivation of the above folding AI function, causing the screen with the default UI applied to be displayed in the above partially folded state, Electronic device (101; 200; 300). In any one of paragraphs 1 through 7, When the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101; 200; 300) causes, While displaying the second screen above, causing to provide a sound effect indicating the execution of the folding AI function, Electronic device (101; 200; 300). In any one of paragraphs 1 through 8, When the electronic device (101; 200; 300) is in an unfolded state, the second housing (210; 310) is positioned between the first housing (230; 320) and the third housing (220; 330). Electronic device (101; 200; 300). In any one of paragraphs 1 through 9, The above completely folded state is a state in which the first display area, the second display area, and the third display area are all not visually exposed, and The above partially folded state is a state in which one of the first display area, the second display area, or the third display area is visually exposed, and The above fully unfolded state is a state in which the first display area, the second display area, and the third display area are all visually exposed. Electronic device (101; 200; 300). In a method of operating an electronic device (101; 200; 300), An operation to check the folding state of the electronic device (101; 200; 300), wherein the folding state includes a fully folded state, a partially folded state, and a fully unfolded state. In the above completely folded state, the operation of displaying a first screen of a first application through a second display (203; 303) of the electronic device (101; 200; 300), and Based on identifying a first change from the fully folded state to the partially folded state, identifying at least one artificial intelligence (AI) function related to the execution of the first application, and displaying a second screen including a user interface (UI) representing the at least one AI function on a first display (202; 302) of the electronic device (101; 200; 300) in a display area visually exposed in the partially folded state, and Based on a first user input for selecting a first AI function among the above at least one AI function, the operation of applying the selected first AI function to the first application, method. In Article 11, An operation of displaying a third screen of the first application to which the first AI function is applied, instead of the second screen, based on applying the first AI function to the first application in the partially folded state above; and Based on identifying a second change from the partially folded state to the fully unfolded state, the operation of displaying the second screen and the third screen on the first display (202; 302). method. In Article 12, An operation to determine AI function(s) to be applied to a first object and a second object included in the first screen based on identifying the first change from the fully folded state to the partially folded state, and While displaying the second screen in the partially folded state, the operation of displaying a first UI corresponding to the first object and a second UI corresponding to the second object, and While displaying the second screen and the third screen in the fully unfolded state, an operation of applying a second AI function corresponding to the second UI to the first application based on a second user input for selecting the second UI on the second screen, and In the above fully unfolded state, the operation of displaying the fourth screen of the first application to which the second AI function is applied in the area where the third screen was displayed, instead of the third screen, method. In Article 12 or Article 13, The operation of displaying the first screen on the first display (202; 302) while displaying the second screen and the third screen in the fully unfolded state, method. In a non-transitory computer-readable storage medium for storing instructions, said instructions cause said electronic device (101; 200; 300) to perform at least one operation when executed individually or collectively by at least one processor (120) of the electronic device (101; 200; 300), and The above at least one operation is, An operation to check the folding state of the electronic device (101; 200; 300), wherein the folding state includes a fully folded state, a partially folded state, and a fully unfolded state. In the above completely folded state, the operation of displaying a first screen of a first application through a second display (203; 303) of the electronic device (101; 200; 300), and Based on identifying a first change from the fully folded state to the partially folded state, identifying at least one artificial intelligence (AI) function related to the execution of the first application, and displaying a second screen including a user interface (UI) representing the at least one AI function on a first display (202; 302) of the electronic device (101; 200; 300) in a display area visually exposed in the partially folded state, and Based on a first user input for selecting a first AI function among the above at least one AI function, the operation of applying the selected first AI function to the first application, Storage medium.