Foldable electronic device for providing user interface according to change in form of foldable electronic device, operation method thereof, and storage medium
The foldable electronic device with a flexible display and adaptive user interface addresses the challenge of seamless transitions by using sensors and processors to optimize display and application execution across various shapes, enhancing usability.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-11-28
- Publication Date
- 2026-07-02
AI Technical Summary
Existing foldable electronic devices face challenges in providing a seamless and intuitive user interface as they transition between different shapes, affecting usability and user experience.
A foldable electronic device with a flexible display and multiple housings that can rotate, along with sensors and processors to detect shape changes, allowing for adaptive display adjustments and user interface optimizations based on the device's form factor.
Enhances user experience by providing a continuous and natural interface as the device changes shape, allowing for optimized application execution and display across different states.
Smart Images

Figure KR2025020159_02072026_PF_FP_ABST
Abstract
Description
Foldable electronic device for providing a user interface according to a change in the shape of a foldable electronic device, method of operation thereof, and storage medium
[0001] One embodiment disclosed in this document relates to a foldable electronic device for providing a user interface according to a change in the shape of the foldable electronic device, a method of operation thereof, and a storage medium.
[0002] As the variety of services and additional functions provided through electronic devices such as smartphones gradually increases, various applications executable on these devices are being developed. Furthermore, the hardware and / or software aspects of electronic devices are also continuously evolving.
[0003] Recently, in line with consumer trends that prioritize design, the convenience of use of electronic devices is being given significant consideration alongside their external design in the development of electronic devices.
[0004] For example, an electronic device may have a new form factor such as a dual display electronic device (e.g., a foldable electronic device). A foldable electronic device is equipped with a foldable (or bendable) display (e.g., a flexible display) and can be used by folding or unfolding. Accordingly, the foldable electronic device can adaptively operate the display in response to the folded state (or folding state) or the unfolded state (or unfolding state).
[0005] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. No claim or determination is made as to whether any of the foregoing may be applied as prior art related to the present disclosure.
[0006] According to one embodiment, the foldable electronic device may include a foldable housing, a flexible display, an external display, at least one processor including a processing circuit, and a memory for storing instructions.
[0007] According to one embodiment, the foldable housing comprises a first housing, a second housing, and a third housing, wherein the second housing is disposed between the first housing and the third housing and can be rotatably connected to the first housing and the third housing.
[0008] According to one embodiment, the flexible display may include a first display area supported by the first housing, a second housing, and a third housing, and a third display area supported by the second housing.
[0009] According to one embodiment, the external display may be disposed on one side of the foldable housing opposite to the flexible display.
[0010] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to display a first screen on the external display in a first form of the foldable electronic device.
[0011] According to one embodiment, the instructions may be configured to confirm that, when executed individually or collectively by the at least one processor, the foldable electronic device is changed from the first form to the second form of the foldable electronic device for displaying a screen in the third display area.
[0012] According to one embodiment, the instructions may be configured to identify a plurality of applications operable in a third form of the foldable electronic device for displaying a screen in the first display area, the second display area, and the third display area, based on confirming that the foldable electronic device changes from the first form to the second form when executed individually or collectively by the at least one processor.
[0013] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to display a plurality of objects representing each of the plurality of applications and a plurality of indicators indicating that one of the plurality of applications is an application operable in the third form in the third display area.
[0014] According to one embodiment, the instructions may be configured to confirm that the foldable electronic device selects a first object corresponding to a first application among the plurality of objects when executed individually or collectively by the at least one processor.
[0015] According to one embodiment, the instructions may be configured to confirm that the foldable electronic device changes from the second form to the third form when executed individually or collectively by the at least one processor.
[0016] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to display a screen of the first application in the first display area, the second display area, and the third display area based on confirming that the first object is selected and confirming that it is changed from the second form to the third form.
[0017] According to one embodiment, a method for providing a user interface according to a change in the shape of a foldable electronic device may include an operation of displaying a first screen on an external display in a first shape of the foldable electronic device.
[0018] According to one embodiment, the method may include an operation of confirming that the foldable electronic device is changed from the first form to a second form for displaying a screen on the third display area of a flexible display including a first display area, a second display area, and a third display area.
[0019] According to one embodiment, the method may include the operation of identifying a plurality of applications operable in a third form of the foldable electronic device for displaying a screen in the first display area, the second display area, and the third display area, based on confirming a change from the first form to the second form.
[0020] According to one embodiment, the method may include the operation of displaying a plurality of objects representing each of the plurality of applications and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application capable of operating in the third form, in the third display area.
[0021] According to one embodiment, the method may include an operation of confirming that a first object corresponding to a first application is selected among the plurality of objects.
[0022] According to one embodiment, the method may include an operation of confirming that the second form is changed to the third form.
[0023] According to one embodiment, the method may include an operation of displaying a screen of the first application in the first display area, the second display area, and the third display area based on confirming that the first object is selected and confirming that it is changed from the second form to the third form.
[0024] According to one embodiment, in a non-transient storage medium storing instructions, the instructions are configured to cause the foldable electronic device to perform at least one operation when executed by at least one processor of the foldable electronic device, wherein the at least one operation may include an operation of displaying a first screen on an external display in a first form of the foldable electronic device.
[0025] According to one embodiment, the at least one operation may include an operation of confirming that the foldable electronic device is changed from the first form to a second form for displaying a screen on the third display area of a flexible display including a first display area, a second display area, and a third display area.
[0026] According to one embodiment, the at least one operation may include an operation of identifying a plurality of applications operable in a third form of the foldable electronic device for displaying a screen in the first display area, the second display area, and the third display area, based on confirming that the first form is changed to the second form.
[0027] According to one embodiment, the at least one operation may include displaying a plurality of objects representing each of the plurality of applications and a plurality of indicators indicating that one of the plurality of applications is an application capable of operating in the third form in the third display area.
[0028] According to one embodiment, the at least one operation may include an operation of confirming that a first object corresponding to a first application is selected among the plurality of objects.
[0029] According to one embodiment, the at least one operation may include an operation of confirming that the change is made from the second form to the third form.
[0030] According to one embodiment, the at least one operation may include an operation of displaying the screen of the first application in the first display area, the second display area, and the third display area based on confirming that the first object is selected and confirming that it is changed from the second form to the third form.
[0031] FIG. 1 is a block diagram of an electronic device in a network environment according to one embodiment.
[0032] FIG. 2 is an internal block diagram of a foldable electronic device according to one embodiment.
[0033] FIG. 3a is a drawing illustrating the unfolded state on the front of a first type of foldable electronic device according to one embodiment.
[0034] FIG. 3b is a drawing illustrating the unfolded state on the rear of a first type of foldable electronic device according to one embodiment.
[0035] FIG. 3c is a drawing illustrating the folding state of a first type of foldable electronic device according to one embodiment.
[0036] FIG. 3d is a drawing for explaining the folding sequence of a first type of foldable electronic device according to one embodiment.
[0037] FIG. 4 is an operation flowchart of a foldable electronic device for providing a user interface according to a shape change of the foldable electronic device according to one embodiment.
[0038] FIG. 5 is an example of a screen when changing from a fully folded state to a partially folded state in which a home screen is displayed according to one embodiment.
[0039] FIG. 6 is an example of a screen when changing from a fully folded state to a partially folded state in which an app screen is displayed according to one embodiment.
[0040] FIG. 7 is a drawing showing a user interface that can be provided in a partially folded state according to one embodiment.
[0041] FIG. 8 is a drawing showing a user interface according to user selection in a partially folded state according to one embodiment.
[0042] FIG. 9 is a detailed operation flowchart of a foldable electronic device according to one embodiment.
[0043] FIG. 10 is an example of a screen when changing from a folded state to a partially folded state and an unfolded state in which a home screen according to one embodiment is displayed.
[0044] FIG. 11 is an example of a screen when changing to an unfolded state after selecting a resizable app in a partially folded state according to one embodiment.
[0045] FIG. 12 is an example of a screen when changing to an unfolded state after selecting an app in a partially folded state where resizing is restricted, according to one embodiment.
[0046] FIG. 13 is an example of a screen when a resizable app is executed in a folded state and then changed to an unfolded state according to one embodiment.
[0047] FIG. 14a is an example of a screen when changing to an expanded state according to the execution of a plurality of apps in one embodiment.
[0048] FIG. 14b is an example of a screen when the selected app is changed to an expanded state depending on whether it is resized according to one embodiment.
[0049] FIG. 15 is an example of a screen when the image is changed to an expanded state according to a user selection for resizing in one embodiment.
[0050] FIG. 16 is an example of a screen when changing from a landscape view mode to an expanded state according to one embodiment.
[0051] FIG. 17a is a drawing showing a user interface that can be provided when changing from an expanded state to a partially folded state in which a screen of a resizable app according to one embodiment is displayed.
[0052] FIG. 17b is a drawing showing a user interface that can be provided when changing from an expanded state to a partially folded state in which a screen of an app with restricted resizing is displayed according to one embodiment.
[0053] FIG. 18 is an example of a screen when changing from a folded state, where a home screen is displayed in a second type of foldable electronic device according to one embodiment, to a partially folded state and an unfolded state.
[0054] FIG. 19 is an example of a screen in an unfolded state according to whether an app is resized in a second type of foldable electronic device according to one embodiment.
[0055] FIG. 20a is a drawing illustrating the unfolded state of the front of a second type of foldable electronic device.
[0056] FIG. 20b is a drawing illustrating the unfolded state on the rear of a second type of foldable electronic device according to one embodiment.
[0057] FIG. 20c is a drawing illustrating the folded state of a second type of foldable electronic device according to one embodiment.
[0058] FIG. 21a is a side view of a third type of foldable electronic device according to one embodiment.
[0059] FIG. 21b is a side view of a third type of foldable electronic device according to one embodiment.
[0060] FIG. 22 is a perspective view of a third type of foldable electronic device according to one embodiment.
[0061] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0062] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to one embodiment. Referring to FIG. 1, in the network environment (100), the electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or may communicate with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through the server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0063] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0064] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0065] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0066] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0067] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0068] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0069] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by said touch.
[0070] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0071] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0072] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0073] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0074] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that the user can perceive through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0075] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0076] The power management module (188) can manage the power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0077] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0078] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0079] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) can support a Peak data rate (e.g., 20 Gbps or more) for realizing eMBB, loss coverage (e.g., 164 dB or less) for realizing mMTC, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for realizing URLLC.
[0080] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0081] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0082] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0083] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In one embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0084] In the following detailed description, reference numbers in the drawings may be assigned identically or omitted for configurations that can be easily understood through prior embodiments, and detailed descriptions thereof may also be omitted. An electronic device (101) according to one embodiment disclosed in this document may be implemented by selectively combining configurations of different embodiments, and a configuration of one embodiment may be replaced by a configuration of another embodiment. For example, it should be noted that the present invention is not limited to specific drawings or embodiments.
[0085] The electronic device may have a deformable structure capable of adjusting the size of the display to satisfy the portability and usability of the electronic device. The electronic device having a deformable structure may include a foldable electronic device in which at least two housings operate by folding or unfolding relative to each other.
[0086] In a foldable electronic device, the display portion that is visually seen (or exposed) to the user may change depending on the transition (or change) of the folding state. For example, in the case of a multi-foldable electronic device having two or more hinge structures, various states may be defined depending on the folding or unfolding of the hinge structures.
[0087] For example, a foldable electronic device can be placed in various states (e.g., folded state, half-folded state, unfolded state) depending on user control, and the size and ratio of the available flexible display area may change as the state of at least one housing of the foldable electronic device changes. Therefore, in the case of a foldable electronic device capable of multiple folds, the device can be used in a folded state and then the form of the foldable electronic device can be changed to an unfolded state; in this case, it may be important to provide the user with a continuous and natural experience when displaying a screen from one area through another exposed area. Therefore, if various user interfaces can be provided to reflect the user's intention according to the transition of the folding state in a foldable electronic device including a flexible display, the usability of the foldable electronic device can be enhanced.
[0088] In one embodiment, a foldable electronic device, a method of operation thereof, and a storage medium may be provided for providing a user interface according to a change in the shape of the foldable electronic device.
[0089] According to one embodiment, information related to an application that can be operated in the unfolded state can be provided to the user before changing the shape of the foldable electronic device from a folded state to an unfolded state while using the foldable electronic device.
[0090] According to one embodiment, a user interface can be provided to select an application that can be resized to fit a large screen, and in response to receiving a user selection through the user interface, an optimized application execution screen in a fully expanded state can be provided.
[0091] FIG. 2 is an internal block diagram (200) of a foldable electronic device according to one embodiment. In describing FIG. 2, reference will be made to FIG. 3a to 3d. FIG. 3a is a diagram illustrating the unfolded state on the front of a first type of foldable electronic device according to one embodiment, FIG. 3b is a diagram illustrating the unfolded state on the back of a first type of foldable electronic device according to one embodiment, FIG. 3c is a diagram illustrating the folded state of a first type of foldable electronic device according to one embodiment, and FIG. 3d is a diagram for explaining the folding sequence of a first type of foldable electronic device according to one embodiment. According to one embodiment, FIG. 3a to 3d illustrate a first type (e.g., G type) foldable electronic device.
[0092] Referring to FIG. 2, a foldable electronic device (201) (e.g., the electronic device (101) of FIG. 1) may include at least one processor (220) (e.g., the processor (120) of FIG. 1) and a memory (230) (e.g., the memory (130) of FIG. 1). An electronic device (201) according to one embodiment may further include at least one sensor (e.g., the sensor module (176) of FIG. 1) including a first sensor (276) and a second sensor (277) and a display (260) (e.g., the display module (160) of FIG. 1). The at least one processor (220) may include processing circuitry. Here, not all components shown in FIG. 2 are essential components of the foldable electronic device (201), and the foldable electronic device (201) may be implemented by more or fewer components than those shown in FIG. 2.
[0093] According to one embodiment, the memory (230) may store at least one instruction (or command) that causes at least one operation of the electronic device (201). When executed by the processor (220), the at least one instruction may cause the foldable electronic device (201) to perform the corresponding operation.
[0094] According to one embodiment, the processor (220) can detect a transition of the folding state of the foldable electronic device (201) using the first sensor (276) and the second sensor (277). For example, the processor (220) can detect a transition of the foldable electronic device (201) from an unfolded state (e.g., the unfolded state of FIG. 3a) to a folded state by at least one folding axis. Based on detecting the transition of the folding state, the processor (220) can identify one area of the display that is activated (or visually exposed or visible to the user) (e.g., a main display area) and another area of the display that is deactivated (or not visually exposed or invisible) (a sub-display area).
[0095] According to one embodiment, the processor (220) can obtain data related to the orientation of the first housing (303), the second housing (305), and the third housing (307) of FIG. 3a through the first sensor (276). For example, the first sensor (276) can obtain data related to the angle between the first housing (303) and the second housing (305), and the angle between the second housing (305) and the third housing (307).
[0096] According to one embodiment, the first sensor (276) may include at least one of a proximity sensor, an accelerometer, or a gyroscope. The processor (220) may obtain data related to the distance between the first housing (303), the second housing (305), and the third housing (307), the folded angle, and / or orientation through the first sensor (276). In addition to the above, the first sensor (276) may include a strain sensor that outputs a strain value used to indirectly measure the folded angle of the foldable electronic device (201).
[0097] According to one embodiment, the processor (220) can obtain data to determine the operating state (e.g., unfolded state, folded state, and / or partially folded state) of the foldable electronic device (201) through the second sensor (277). According to one embodiment, the second sensor (277) may include a Hall IC.
[0098] According to one embodiment, the foldable electronic device (201) may further include a magnet (278). There may be one or more magnets (278) and they may be placed within the third housing (307). The magnet (278) may be placed in a position facing the second sensor (277) included in the first housing (303) when the third housing (307) is folded along the folding axis. For example, the processor (220) may detect proximity between the first housing (303) and the third housing (307) by using the second sensor (277) to sense the magnetic field generated by the magnet (278) included in the third housing (307).
[0099] A Hall sensor (or Hall IC) according to one embodiment can sense a magnetic field generated by one or more magnets (278), and one or more Hall sensors and one or more magnets can be placed at different locations within a foldable electronic device (201).
[0100] The positional relationship of the one or more Hall sensors and / or one or more magnets within the foldable electronic device (201) may change according to the shape of the foldable electronic device (201). The foldable electronic device (201) may measure the change in the positional relationship through the one or more Hall sensors. The change in the positional relationship may cause a change in the magnetic field formed by the one or more magnets. The foldable electronic device (201) may obtain a power signal indicating the change in the magnetic field using the Hall sensors. For example, the foldable electronic device (201) may distinguish the shape of the foldable electronic device (201) (e.g., unfolded state, folded state, and / or partially folded state) using the power signal obtained from the Hall sensors. For example, the Hall sensors may output data indicating the folding state of the display (260), and the foldable electronic device (201) may receive data indicating the state of the foldable electronic device (201) from the Hall sensors.
[0101] According to one embodiment, the first sensor (276) and the second sensor (277) can acquire data related to a detected change in distance, angle, orientation, and / or magnetic field. Based on the change in distance, angle, orientation, and / or magnetic field, the processor (220) can identify first information (or sensing value) related to a first angle between the first housing (303) and the second housing (305), and second information (or sensing value) related to a second angle between the second housing (305) and the third housing (307). Based on the first information related to the first angle and the second information related to the second angle, the processor (220) can identify the operating state (or form, mode) (e.g., unfolded state, folded state, and / or partially folded state) of the foldable electronic device (201).
[0102] For example, the processor (220) can determine a first acceleration difference representing the movement of the first housing (303) relative to the second housing (305) and a second acceleration difference representing the movement of the third housing (307) relative to the second housing (305) by using at least one sensor, such as a first sensor (276). Based on the first acceleration difference and the second acceleration difference, the processor (220) can estimate a first angle between the first housing (303) and the second housing (305) and a second angle between the second housing (305) and the third housing (307).
[0103] For example, the processor (220) can determine the angle of the second hinge (320) structure (e.g., a first angle between the first housing (303) and the second housing (305)) and the angle of the first hinge (310) structure (e.g., a second angle between the second housing (305) and the third housing (307)) using sensing data (e.g., acceleration data) obtained through at least one sensor (e.g., a first sensor (276), a second sensor (277)).
[0104] For example, if the operating state (or form, mode) of the foldable electronic device (201) is a first form (or first state) (or folded state, folded mode) (e.g., phone mode), in the first form, the first angle between the first housing (303) and the second housing (305) may be smaller than the first critical angle (e.g., 10 degrees), and the second angle between the second housing (305) and the third housing (307) may be smaller than the first critical angle. For example, in the first form (or mode) of the foldable electronic device (201), the size of the folded state of the foldable electronic device (201) may be in the same ratio as the size of the external display (264) (e.g., cover screen).
[0105] For example, when the shape of the foldable electronic device (201) is a second shape (or second state) (or a half-folded state, intermediate mode), in the second shape, the first angle between the first housing (303) and the second housing (305) may be smaller than the first critical angle (e.g., 10 degrees), and the second angle between the second housing (305) and the third housing (307) may be larger than the second critical angle (e.g., 160 degrees). There are no limitations on the first critical angle and the second critical angle. For example, when the shape of the foldable electronic device (201) is a second shape, only one of the first display area (261), the second display area (262), and the third display area (263) included in the flexible display (260) may be exposed.
[0106] For example, if the shape of the foldable electronic device (201) is a third shape (or third state) (or unfolded state, fully unfolded state, unfolded mode) (e.g., tablet mode), in the third shape, the first angle between the first housing (303) and the second housing (305) may be greater than the second critical angle (e.g., 160 degrees), and the second angle between the second housing (305) and the third housing (307) may also be greater than the second critical angle (e.g., 160 degrees). For example, in the third shape (or mode) of the foldable electronic device (201), the size of the unfolded state of the foldable electronic device (201) may be in the same ratio as the size of the flexible display (260) including the first display area (261), the second display area (262), and the third display area (263).
[0107] According to one embodiment, the display (260) may be a flexible display comprising a first display area (or first part) (261), a second display area (or second part) (262), and a third display area (or third part) (263). The display (260) is a display area on which an application screen is displayed, and as illustrated in FIG. 3a, it may be divided into a first display area (261), a second display area (262), and a third display area (263) by being partially folded along a folding axis (e.g., the B and C axes in FIG. 3a). FIG. 3a illustrates a case where the number of display areas is three, but the number is not limited thereto and may vary depending on the type of flexible display. For example, the number of areas in the flexible display may increase to a fourth display area or a fifth display area, or decrease to a first display area or a second display area.
[0108] The shape of the display (260) may change as it is folded or unfolded along a folding axis (e.g., axes B and C in FIG. 3a). For example, a Hall sensor may output different data indicating the folding state of the display (260). The data indicating the folding state of the display (260) may include the angle of the display (260) folded along the folding axis.
[0109] FIG. 3a is a drawing showing the front of a foldable electronic device (201) according to one embodiment, and FIG. 3b is a drawing showing the rear of a foldable electronic device (201) according to one embodiment, wherein the foldable electronic device (201) may include a first housing (303), a second housing (305), a third housing (307), and a display (260). The foldable electronic device (201) may include at least some of the structure and / or function of the electronic device (101) of FIG. 1.
[0110] In one embodiment, the first housing (303) and the second housing (305) may be positioned on both sides of a folding axis (e.g., C-axis) and may have a shape symmetrical with respect to the folding axis (e.g., C-axis). The second housing (305) and the third housing (307) may be positioned on both sides of a folding axis (e.g., B-axis) and may have a shape symmetrical with respect to the folding axis (e.g., B-axis). The first housing (303) and the second housing (305), and the second housing (305) and the third housing (307) may be configured to fold relative to each other. The first housing (303), the second housing (305), and the third housing (307) may be folded and overlapped with respect to the folding axis (e.g., B-axis, C-axis) through at least one hinge device (e.g., first hinge (310), second hinge (320)).
[0111] In one embodiment, referring to FIG. 3c, the first housing (303) and the second housing (305) may operate in an in-folding manner, rotating relative to each other with respect to the C-axis. The second housing (305) and the third housing (307) may operate in an in-folding manner, rotating relative to each other with respect to the B-axis. For example, the case where the first housing (303) and the second housing (305) operate in an in-folding manner and the second housing (305) and the third housing (307) operate in an in-folding manner may be referred to as a G-type or e-type foldable. For example, the case where the first housing (303) and the second housing (305) operate in an out-folding manner and the second housing (305) and the third housing (307) operate in an in-folding manner may be referred to as a z-type foldable.
[0112] In one embodiment, the first housing (303) may include a first surface (321) and a second surface (322) facing in the opposite direction of the first surface (321), the second housing (305) may include a third surface (323) and a fourth surface (324) facing in the opposite direction of the third surface (323), and the third housing (307) may include a fifth surface (325) and a sixth surface (326) facing in the opposite direction of the fifth surface (325). For example, referring to FIG. 3c, when the display (260) of the first type (e.g., G-type) foldable electronic device (201) is folded (e.g., in-folding) with respect to the C-axis, the first surface (321) of the first housing (303) may be facing the third surface (323) of the second housing (305). When the display (260) is folded (e.g., in-folding) along the B-axis, the fifth side (325) of the third housing (307) and the third side (323) of the second housing (305) may face each other.
[0113] In one embodiment, when folding in a designated folding order, the third housing (307) may be folded to face the second housing (305), and then the first housing (303) may be folded to face the third housing (307). For example, the fifth side (325) of the third housing (307) and the third side (323) of the second housing (305) may be folded to face each other, and the first side (321) of the first housing (303) may be folded to face the sixth side (326) of the third housing (307).
[0114] According to one embodiment, a first form (e.g., a folded state) of the foldable electronic device (201) (or display (260)) is a state in which the foldable electronic device (201) is completely folded along the B-axis and C-axis, and can be referred to as the fully folded state of the foldable electronic device (201). For example, when the form of the foldable electronic device (201) is the first form, an external display (or cover display) (264) (e.g., a cover screen) may be exposed in the state in which it is completely folded along the B-axis and C-axis. The external display (264) may be placed on one side of the foldable housing opposite to the flexible display (260). For example, when a foldable electronic device (201) of the first type (e.g., G type) is folded along the C-axis and then folded along the B-axis according to a specified folding sequence, the external display (264) may be placed on the sixth side (326) opposite to the fifth side (325) of the third housing (307). Thus, when the foldable electronic device (201) is in a folded state, the user can view the screen displayed through the external display (264) that is exposed toward the user.
[0115] For example, a foldable electronic device (201) of the second type (e.g., type e) may further include an external display (e.g., 2003 of FIG. 22b) on a fourth side (324) opposite to a third side (323) of the second housing (305). Thus, in the case where the shape of the foldable electronic device (201) of the second type is the second shape, the external display placed on the fourth side (324) of the second housing (305) may be exposed when the device is fully folded along the B-axis and C-axis.
[0116] According to one embodiment, a second form (e.g., a partially folded state) of a foldable electronic device (201) (or display (260)) may include a state in which the foldable electronic device (201) is folded along the B-axis and not folded along the C-axis, or a state in which it is not folded along the B-axis and is folded along the C-axis. For example, when the form of the foldable electronic device (201) is the second form, only the first display area (261) included in the flexible display (260) may be exposed in the state in which it is folded along the B-axis and not folded along the C-axis. Additionally, in the state in which it is not folded along the B-axis and is folded along the C-axis, only the third display area (263) included in the flexible display (260) may be exposed.
[0117] According to one embodiment, a third form (or unfolded state) of the foldable electronic device (201) (or display (260)) may include a state in which the foldable electronic device (201) is fully unfolded with the first housing (303), the second housing (305), and the third housing (307) arranged side by side.
[0118] According to one embodiment, a display (or flexible display) (260) is disposed within a first housing (303), a second housing (305), and a third housing (307), and may include a first display area (261) supported by the first housing (303), a second display area (262) supported by the second housing (305), and a third display area (263) supported by the third housing (307). For example, the first display area (261) may be disposed on a first surface (or first part) (321) of the first housing (303), the second display area (262) on a third surface (or second part) (323) of the second housing (305), and the third display area (263) on a fifth surface (or third part) (325) of the third housing (307).
[0119] Referring to FIG. 3c and FIG. 3d, the foldable electronic device (201) may include a second hinge (320) that can foldably connect one side of the first housing (303) to one side of the second housing (305), and a first hinge (310) that can foldably connect the other side of the second housing (305) to one side of the third housing (307). The second hinge (320) may have a wider width than the first hinge (310). Here, the first hinge (310) rotatably connects the third housing (307) to the second housing (305), and the second hinge (320) rotatably connects the first housing (303) to the second housing (305). Since the width of the second hinge (320) is wider than the width of the first hinge (310), the third housing (307) can be folded to face the second housing (305), and then the first housing (303) can be folded to face the third housing (307).
[0120] Additionally, if the first hinge (310) has a wider width than the second hinge (320), the first housing (303) can be folded to face the second housing (305), and then the third housing (307) can be folded to face the first housing (303).
[0121] As shown in FIG. 3c, the first hinge (310) is an in-foldable hinge, and the second hinge (320) can also be an in-foldable hinge.
[0122] According to one embodiment, the in-folding may indicate that the display (260) of the foldable electronic device (201) is folded inward from the front of the completely unfolded display (260) so that a portion of the display (260) is not exposed to the outside. Accordingly, when the first hinge (310) is in-folded, the third display area (263) placed in the third housing (307) connected to the first hinge (310) and the second display area (262) placed in the second housing (305) that is not folded face each other, so that the second display area (262) and the third display area (263) may not be exposed.
[0123] According to one embodiment, the first display area (261) placed in the first housing (303) connected to the second hinge (320) by the in-folding of the second hinge (320) can be repositioned to correspond to the in-folding angle of the second hinge (320).
[0124] According to one embodiment, a third display area (263) disposed in a third housing (307) connected to the first hinge (310) by the in-folding of the first hinge (310) may be repositioned to correspond to the in-folding angle of the first hinge (310), and the third housing (307), which is repositioned according to the in-folding of the first hinge (310), may cover a second display area (262) disposed in a second housing (305). As described above, the folding ratio of the foldable electronic device (201) (or display (260)) may be made to fold at an equal ratio with respect to the axis, but the folding ratio with respect to the axis may be implemented differently. Although FIGS. 3a to 3c are illustrated as folding at an equal ratio with respect to the axis, those skilled in the art will easily understand that there is no limitation on the position of the axis.
[0125] FIG. 3d is a drawing for explaining the folding sequence of a foldable electronic device according to one embodiment.
[0126] Referring to FIG. 3d, when the foldable electronic device (201) is folded in a specified folding order, the first housing (303) may be folded first so that it faces the second housing (305) in the unfolded state, and then the third housing (307) may be folded second so that it faces the first housing (303). For example, after the first folding, the first housing (303) and the second housing (305) may face each other, and after the second folding, the first housing (303) and the third housing (307) may be folded so that they face each other.
[0127] In FIGS. 3a to 3d, a foldable electronic device (201) of a first type (e.g., G type) is described as an example, and various types of foldable electronic devices will be described later in the description of FIGS. 20a to 22. For example, FIGS. 20a to 20c are drawings for describing a foldable electronic device of a second type (e.g., e type), and FIGS. 21a to 22 are drawings for describing a foldable electronic device of a third type (e.g., z type).
[0128] Hereinafter, a foldable electronic device and a method of operation according to one embodiment are described using a foldable electronic device (e.g., the electronic device (101) of FIG. 1) including two housings and a flexible display as an example. However, the operation for providing a user interface according to the shape change of the foldable electronic device described below may also be applied to a description of a foldable electronic device including three or more housings and a flexible display.
[0129] Meanwhile, although the foldable electronic device has been described as having a display disposed on a plurality of housings, it may also have different displays for each of the plurality of housings. Accordingly, the foldable electronic device and the method of operation thereof according to the various embodiments described below may also be applied to the description of a foldable electronic device comprising at least two housings and at least two displays disposed in each housing. For example, the description below regarding the region of the flexible display corresponding to one housing may be applied to the description regarding the display corresponding to one housing among the plurality of displays provided in the foldable electronic device.
[0130] According to one embodiment, the processor (220) can recognize the form (or mode) of the foldable electronic device (201) as, for example, a first form (e.g., folded state), a second form (e.g., half-folded state), or a third form (e.g., unfolded state) based on data (or information) received from the first sensor (276) and the second sensor (277).
[0131] According to one embodiment, the processor (220) can display a first screen on an external display (264) in a first form (e.g., folded state) of the foldable electronic device (201). For example, the first screen may include a home screen or an application execution screen. The processor (220) can use at least one sensor (e.g., first sensor (276), second sensor (277)) to confirm that the form of the foldable electronic device (201) changes from the first form to a second form (e.g., partially folded state). In the second form, only one of the first display area (261), the second display area (262), and the third display area (263) of the flexible display (260) may be exposed.
[0132] In one embodiment, a guide screen is provided in advance so that the screen displayed in one area in a first form can be displayed across all display areas (e.g., first display area (261), second display area (262), and third display area (263)) in a third form as the shape of the foldable electronic device (201) changes, thereby providing a continuous and natural experience to the user.
[0133] In one embodiment, when changing from a first form to a second form immediately before changing to a third form, the processor (220) may display a guide screen on a part exposed in the second form (e.g., any one of the first display area (261), the second display area (262), and the third display area (263). Additionally, the processor (220) may display a guide screen according to a designated input (e.g., swipe input) on a part exposed in the first form before changing to the third form (e.g., external display (264)). For example, the guide screen may include information about a plurality of applications available in the third form. The guide screen may be a dedicated screen provided through a part exposed when changing from the first form to the second form, but it may also be displayed through a part exposed in the first form before changing to the third form according to a user request.
[0134] According to one embodiment, the processor (220) can identify a plurality of applications that can be displayed (or operated) on the large screen of the flexible display (260). For example, the processor (220) can identify applications that can be displayed on the large screen without separate user input to re-execute applications to fit the large screen size, in response to the confirmation that the shape of the foldable electronic device (201) changes from a first shape to a second shape. Additionally, the processor (220) can identify applications that can be displayed on the large screen size in advance before the change from the first shape to the second shape, and the timing of identifying said applications is not limited thereto. For example, the large screen may include a first display area (261), a second display area (262), and a third display area (263). Additionally, an application optimized for a large screen may be an application in which, when changed to a third form, the execution screen of the application can be displayed across the entire first display area (261), second display area (262), and third display area (263) of the third form without any separate input requiring the selected application to be re-executed due to a change in display resolution, rather than the execution screen being displayed at the same ratio (or size) as displayed on the external display (264) in the first form.
[0135] According to one embodiment, the processor (220) may generate a plurality of first objects representing each of a plurality of applications operable in a third form, and a plurality of indicators for indicating that among the plurality of applications, the corresponding application is an application that can be displayed (or operated) in the third form. The processor (220) may display a guide screen including the plurality of first objects and the plurality of indicators in a third display area (263) exposed in the second form.
[0136] According to one embodiment, the guide screen displayed in the second form may further include information on various applications based on the context of the foldable electronic device (201), in addition to information on the optimized application in the third form.
[0137] According to one embodiment, the processor (220) can identify applications that are frequently used or recently executed applications. The processor (220) can display a guide screen in the third display area (263) that includes a plurality of second objects representing each of the applications that are frequently used or recently executed applications. At least some of the applications that are frequently used or recently executed applications may include applications that are displayable in the third form but not in the third form. For example, an application that is displayable in the third form is an application optimized for a large screen, and the execution screen of the application may be displayed across the entire first display area (261), the second display area (262), and the third display area (263). On the other hand, an application that is not displayable in the third form may include, for example, an application in which the screen size displayed in the first form is maintained even when the form of the foldable electronic device (201) changes from the first form to the third form.
[0138] According to one embodiment, when the processor (220) displays a guide screen including a plurality of second objects representing applications with high usage frequency or recently executed applications, it displays an indicator indicating that the application is an application that can be displayed in a third form and an indicator indicating that the application is an application that cannot be displayed in a third form together with the plurality of second objects, thereby allowing the user to check in advance which of the plurality of applications is an application that can be displayed in a third form. Additionally, the user can select a desired application among the plurality of applications displayed on the guide screen in the second form, and when changing from the second form to the third form, the user can view an application execution screen optimized for the large screen of the third form.
[0139] According to one embodiment, the processor (220) may receive user input selecting a first object corresponding to a first application among a plurality of first objects on a guide screen. Additionally, the processor (220) may receive user input selecting one of a plurality of second objects.
[0140] According to one embodiment, the processor (220) can confirm that the shape of the foldable electronic device (201) changes from a second shape to a third shape. For example, if the processor (220) confirms that the shape changes from the second shape to the third shape after receiving user input, it can execute a first application corresponding to the user input. The processor (220) can display the execution screen of the first application across the entire large screen, such as a first display area (261), a second display area (262), and a third display area (263).
[0141] According to one embodiment, the user may change the shape of the foldable electronic device (201) after selecting an application on an external display (264) (e.g., a cover screen) in the first form, or change the shape of the foldable electronic device (201) while the application has already been executed in the first form and the execution screen of the application is displayed on the external display (264).
[0142] According to one embodiment, the processor (220) may display a guide screen including the screen of the second application in one area (e.g., a third display area (263)) together with a plurality of objects (e.g., a plurality of first objects, a plurality of second objects) and a plurality of indicators, based on confirming that the screen displayed on the external display (264) in the first form includes the screen of the second application. For example, when changing from the second form to the third form, the guide screen may include an application available in the third form, an app picker screen that allows selecting a frequently used application or a recently executed application, and a screen of the application selected on the external display (264) (e.g., a cover screen). For example, if the user has an application selected on the cover screen (e.g., the external display (264)), the selected application may need to be re-executed due to a change in display resolution caused by folding / unfolding switching. In one embodiment, a button to re-run the selected application may be provided on the guide screen.
[0143] According to one embodiment, the processor (220) may receive an input selecting one of a plurality of second objects representing each of applications with high usage frequency or recently executed applications while displaying a guide screen in a second form. The processor (220) may receive an input selecting one of the plurality of second objects and, in response to confirming a change from the second form to the third form, determine whether the application corresponding to the selected object is an application that can be operated (or displayed) in the third form. In response to confirming that the application corresponding to the selected object is not an application that can be operated in the third form, the processor (220) may execute the application corresponding to the selected object and display the execution screen of the application in one of the first display area (261), the second display area (262), and the third display area (263) without changing the resolution and size. Additionally, the processor (220) may display an app picker screen in the remaining two areas, excluding the area where the execution screen of the application is displayed, which allows selecting an application available in the third form, an application with high usage frequency, or a recently executed application.
[0144] According to one embodiment, the processor (220) may receive user input for a button to display the screen of the second application on the large screen while displaying the guide screen in the second form. When the processor (220) receives user input for the button, it may re-execute the second application when changing from the second form to the third form, and display the screen of the re-executed second application on the first display area (261), the second display area (262), and the third display area (263). Here, the re-execution of the second application may include an operation to change the resolution and size of the screen of the second application on the guide screen to correspond to the resolution and size of the large screen.
[0145] According to one embodiment, when the guide screen in the second form includes the screen of the second application, the area where a plurality of objects and a plurality of indicators representing an application that can be displayed in the third form is displayed may be displayed in the form of a taskbar due to the screen of the second application. For example, in response to a user selecting one of the objects displayed in the taskbar, the processor (220) confirms that the second form is changed to the third form and can execute the third application corresponding to the selected object when the second form is changed to the third form. The processor (220) can display the screen of the third application executed in the third form and the screen of the second application on a large screen, such as a first display area (261), a second display area (262), and a third display area (263). For example, if an application is selected in the folded state and another application is additionally selected in the guide screen in the partially folded state, the processor (220) can simultaneously display the screens of the two applications in the form of a split view in the unfolded state.
[0146] For example, when displaying the screens of two applications simultaneously in a split view state, the aspect ratio of the two applications may be 2:1. For example, the screen of the application selected later (e.g., the screen of the third application) may be displayed in two of the first display area (261), the second display area (262), and the third display area (263), and the screen of the application selected first (e.g., the screen of the second application) may be displayed in the remaining area different from the two display areas.
[0147] According to one embodiment, the user can change the shape of the foldable electronic device (201) from a partially folded state to an unfolded state, but conversely, the user can change the shape of the foldable electronic device (201). For example, while displaying the execution screen of an application optimized for a large screen in the first display area (261), the second display area (262), and the third display area (263), the user can change the shape of the foldable electronic device (201) from the third form through the second form to the first form. For example, the operation of changing the shape of the foldable electronic device (201) from the third form through the second form to the first form may be referred to as a "re-unfolding operation." According to one embodiment, the operation of changing from the second form to the first form before changing to the third form may be a "re-unfolding operation."
[0148] According to one embodiment, the processor (220) can confirm a change from the third form to the second form while displaying an execution screen of an application optimized for a large screen in the first display area (261), the second display area (262), and the third display area (263), and based on confirming the change from the third form to the second form, can identify applications that are operable (or displayable) in the first form. For example, the processor (220) can identify applications for a cover screen. The processor (220) can reduce the screen of a specific application displayed on the large screen and display it in one area of the second form (e.g., the third display area (263)) along with objects representing each of the plurality of applications operable in the first form and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application operable in the first form. Here, a screen of a specific application is displayed in one area of the second form (e.g., the third display area (263)), and a button to re-execute the specific application can be provided on the guide screen so that the screen of the specific application can also be displayed in the first form. In response to receiving user input for the button, the processor (220) can re-execute the specific application when the form change of the foldable electronic device (201) is completed and provide the re-executed screen through an external display (264) (e.g., a cover screen)).
[0149] As described above, according to one embodiment, as the shape of the foldable electronic device (201) changes, a guide screen can be displayed across all display areas (e.g., first display area (261), second display area (262), and third display area (263)) in the third shape, and is provided in advance through an area exposed in the second shape before the change to the third shape is completed, so that the user can know in advance the large screen optimized application, thereby providing a continuous and natural experience according to the user's choice.
[0150] According to one embodiment, the foldable electronic device may include a foldable housing, a flexible display, an external display, at least one processor including a processing circuit, and a memory for storing instructions.
[0151] According to one embodiment, the foldable housing comprises a first housing, a second housing, and a third housing, wherein the second housing is disposed between the first housing and the third housing and can be rotatably connected to the first housing and the third housing.
[0152] According to one embodiment, the flexible display may include a first display area supported by the first housing, a second housing, and a third housing, and a third display area supported by the second housing.
[0153] According to one embodiment, the external display may be disposed on one side of the foldable housing opposite to the flexible display.
[0154] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to display a first screen on the external display in a first form of the foldable electronic device.
[0155] According to one embodiment, the instructions may be configured to confirm that, when executed individually or collectively by the at least one processor, the foldable electronic device is changed from the first form to the second form of the foldable electronic device for displaying a screen in the third display area.
[0156] According to one embodiment, the instructions may be configured to identify a plurality of applications operable in a third form of the foldable electronic device for displaying a screen in the first display area, the second display area, and the third display area, based on confirming that the foldable electronic device changes from the first form to the second form when executed individually or collectively by the at least one processor.
[0157] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to display a plurality of objects representing each of the plurality of applications and a plurality of indicators indicating that one of the plurality of applications is an application operable in the third form in the third display area.
[0158] According to one embodiment, the instructions may be configured to confirm that the foldable electronic device selects a first object corresponding to a first application among the plurality of objects when executed individually or collectively by the at least one processor.
[0159] According to one embodiment, the instructions may be configured to confirm that the foldable electronic device changes from the second form to the third form when executed individually or collectively by the at least one processor.
[0160] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to display a screen of the first application in the first display area, the second display area, and the third display area based on confirming that the first object is selected and confirming that it is changed from the second form to the third form.
[0161] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to display the screen of the second application, together with the plurality of objects and the plurality of indicators, in the third display area, based on confirming that the first screen is changed from the first form to the second form when the first screen includes the screen of the second application.
[0162] According to one embodiment, the instructions may be configured such that, when executed individually or collectively by the at least one processor, the foldable electronic device receives an input to display the screen of the second application in the first display area, the second display area, and the third display area while displaying the screen of the second application together with the plurality of objects and the plurality of indicators in the third display area, and based on the reception of the input and confirmation of a change from the second form to the third form, the second application is re-executed and the screen of the re-executed second application is displayed in the first display area, the second display area, and the third display area.
[0163] According to one embodiment, the instructions may be configured to display the screen of the second application and the screen of the third application in the first display area, the second display area, and the third display area, based on confirming that a third object corresponding to the third application among the plurality of objects is selected, confirming that the third object is changed from the second form to the third form, and confirming that the third object is selected and confirming that the screen of the second application is changed from the second form to the third form, while the foldable electronic device displays the screen of the second application together with the plurality of objects and the plurality of indicators in the third display area when the instructions are executed individually or collectively by the at least one processor.
[0164] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to display the screen of the third application in two of the first display area, the second display area, and the third display area, and display the screen of the second application in the remaining display area different from the two display areas, based on confirming that the third object is selected and that it is changed from the second form to the third form.
[0165] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to identify applications that are frequently used or recently executed on the foldable electronic device based on confirming that the first screen includes a home screen and changes from the first form to the second form, and to display objects representing each of the applications that are frequently used or recently executed on the third display area.
[0166] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to display the screen of the third application in two of the first display area, the second display area, and the third display area, and display the screen of the second application in the remaining display area different from the two display areas, based on confirming that the third object is selected and that it is changed from the second form to the third form.
[0167] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to identify applications that are frequently used or recently executed on the foldable electronic device based on confirming that the first screen includes a home screen and changes from the first form to the second form, and to display objects representing each of the applications that are frequently used or recently executed on the third display area.
[0168] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to confirm that a fourth object corresponding to a fourth application is selected among objects representing each of the frequently used applications or the recently executed applications, confirm that the device changes from the second form to the third form, and based on confirming that the fourth object is selected and confirming that the device changes from the second form to the third form, confirm whether the fourth application is an application operable in the third form, and if the fourth application is not an application operable in the third form, display the screen of the fourth application together with the plurality of objects and the plurality of indicators in the first display area, the second display area, and the third display area.
[0169] According to one embodiment, the instructions may be configured such that, when executed individually or collectively by the at least one processor, the foldable electronic device identifies a change from the third form to the second form while displaying the screen of the first application in the first display area, the second display area, and the third display area, and based on the identification of the change from the third form to the second form, identifies a plurality of applications operable in the first form, and displays the screen of the first application in the third display area together with objects representing each of the plurality of applications operable in the first form and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application operable in the first form.
[0170] According to one embodiment, the foldable electronic device further includes at least one sensor (276), and the at least one sensor may include at least one of a proximity sensor, an accelerometer, or a gyroscope.
[0171] According to one embodiment, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device may be configured to acquire data related to the distance, angle, and / or orientation between the first housing, the second housing, and the third housing through the at least one sensor, and based on the acquired data, to confirm a change from the first form to the second form, to confirm a change from the second form to the third form, or to confirm a change from the third form to the second form.
[0172] FIG. 4 is a flowchart of the operation of a foldable electronic device for providing a user interface according to a shape change of the foldable electronic device according to one embodiment. Referring to FIG. 4, the operation method may include operations 405 to 435. Each operation of the operation method of FIG. 4 may be performed by a foldable electronic device (e.g., the electronic device (101) of FIG. 1 and the foldable electronic device (201) of FIG. 2 to 3d)) and at least one processor of the electronic device (e.g., the processor (120) of FIG. 1 and the processor (220) of FIG. 2). In one embodiment, at least one of operations 405 to 435 may be omitted, the order of some operations may be changed, or other operations may be added. To aid in understanding the description of FIG. 4, the description will be explained with reference to FIG. 5 to 8. FIG. 5 is an example of a screen when changing from a fully folded state to a partially folded state in which a home screen is displayed according to one embodiment, FIG. 6 is an example of a screen when changing from a fully folded state in which an app screen is displayed according to one embodiment to a partially folded state, FIG. 7 is a drawing showing a user interface that can be provided in a partially folded state according to one embodiment, and FIG. 8 is a drawing showing a user interface according to a user selection in a partially folded state according to one embodiment.
[0173] Referring to FIG. 4, in operation 405, the foldable electronic device (201) can display a first screen on an external display (264) in a first form of the foldable electronic device. For example, the first form is a folded state as shown in FIG. 5 500a and FIG. 6 600a, and in the first form, the first angle between the first housing (303) and the second housing (305) may be smaller than the first critical angle (e.g., 10 degrees), and the second angle between the second housing (305) and the third housing (307) may be smaller than the first critical angle. For example, in the first form, the external display (264) may be on, and the main display (e.g., the first display area (261), the second display area (262), and the third display area (263)) may be off. For example, a first form (or mode) of the foldable electronic device (201) may have a size in the folded state of the foldable electronic device (201) that is proportional to the size of the external display (264) (e.g., cover screen).
[0174] In operation 410, it can be seen that the foldable electronic device (201) is changed from the first form to a second form of the foldable electronic device (201) for displaying a screen on the third display area of a flexible display (260) including a first display area (261), a second display area (262), and a third display area (263). For example, when changing from the first form to the second form, one of the display areas that was not visible (or hidden) in the folded state (e.g., the third display area (263)) may be exposed. For example, in the second form, the external display (264) may be off, and the main display (e.g., the first display area (261), the second display area (262), and the third display area (263)) may be on. Additionally, in the second form, the external display (264) may be off, and a part of the main display (e.g., the third display area (263)) may be on. Additionally, in the second form, the external display (264) may be off, and the entire main display (e.g., the first display area (261), the second display area (262), and the third display area (263)) may be on.
[0175] According to one embodiment, when the operating state (or form, mode) of the foldable electronic device (201) is a first form (or folded state, folded mode) (e.g., phone mode), in the first form, the first angle between the first housing (303) and the second housing (305) may be smaller than the first critical angle (e.g., 10 degrees), and the second angle between the second housing (305) and the third housing (307) may be smaller than the first critical angle.
[0176] According to one embodiment, when the shape of the foldable electronic device (201) is a second shape (or a half-folded state, intermediate mode), in the second shape, the first angle between the first housing (303) and the second housing (305) may be smaller than the first critical angle (e.g., 10 degrees), and the second angle between the second housing (305) and the third housing (307) may be larger than the second critical angle (e.g., 160 degrees). For example, when the shape of the foldable electronic device (201) is a second shape, only one of the first display area (261), the second display area (262), and the third display area (263) included in the flexible display (260) may be exposed.
[0177] In operation 415, the foldable electronic device (201) can identify a plurality of applications that can be operated in a third form of the foldable electronic device (201) for displaying a screen in a first display area (261), a second display area (262), and a third display area (263).
[0178] According to one embodiment, the foldable electronic device (201) can identify a plurality of applications that are operable in a third form of the foldable electronic device (201) for displaying a screen in a first display area (261), a second display area (262), and a third display area (263) in response to user input (e.g., swipe input) in a first form of the foldable electronic device (201). For example, the foldable electronic device (201) can identify applications that are displayable (or available) in a third form (e.g., tablet mode) according to user input through an external display (264) even in a first form (e.g., phone mode). For example, applications that are displayable (or available) in a third form (e.g., tablet mode) may be applications that are displayable in a third form without separate user input to re-execute the application to fit the screen size of the third form.
[0179] According to one embodiment, the foldable electronic device (201) can identify a plurality of applications operable in a third form of the foldable electronic device (201) for displaying a screen in a first display area (261), a second display area (262), and a third display area (263), based on confirming that the form of the foldable electronic device (201) changes from a first form to a second form. For example, the operation of identifying applications operable in the third form (e.g., tablet mode) may be performed in response to a trigger caused by a half-folding operation, but may also be performed in advance in the folded state prior to the half-folding operation, for example, and the timing of the identification operation may vary.
[0180] For example, a plurality of applications capable of operating in the third form may include applications optimized for the large screen. For example, an application optimized for the third form should be understood as an application whose execution screen can be extended and displayed across the entire display area (e.g., the first display area (261), the second display area (262), and the third display area (263)) to fit the screen size of the third form. Additionally, an application not optimized for the third form may refer to an application whose execution screen is displayed on the large screen of the third form at the same ratio (or size) as displayed on the external display (264), even if the form of the foldable electronic device (201) changes to the third form.
[0181] According to one embodiment, when the shape of the foldable electronic device (201) is a third shape (or unfolded state, fully unfolded state, unfolded mode) (e.g., tablet mode), in the third shape, the first angle between the first housing (303) and the second housing (305) is greater than the second critical angle (e.g., 160 degrees), and the second angle between the second housing (305) and the third housing (307) may also be greater than the second critical angle (e.g., 160 degrees). In one embodiment, the first angle (e.g., hinge angle) between the first housing (303) and the second housing (305) and the second angle (e.g., hinge angle) between the second housing (305) and the third housing (307) are compared with the same critical angle (e.g., 160 degrees), but each of the hinge angles may be compared with different critical angles within a critical angle range (e.g., 160 degrees to 175 degrees), and the critical angle range may be determined differently depending on the manufacturer, and there is no limit to the critical angle range.
[0182] For example, a third form (or mode) of the foldable electronic device (201) may have a size in the unfolded state of the foldable electronic device (201) that is equal in proportion to the size of the flexible display (260) including the first display area (261), the second display area (262), and the third display area (263).
[0183] In operation 420, the foldable electronic device (201) may display a plurality of objects representing each of the plurality of applications and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application that can be operated in the third form in the third display area. According to one embodiment, an application that can be operated in the third form may be an application that can be displayed across the entire display area in the third form to correspond to the resolution and size of the large screen without requiring separate user input to re-execute the application to fit the screen size of the third form when switching to the third form (e.g., tablet mode).
[0184] For example, as the shape of the foldable electronic device (201) changes from a first shape to a second shape, one of the first display area (261), the second display area (262), and the third display area (263) (e.g., the third display area (263)) may be exposed. In one embodiment, when changing from the first shape to the second shape before changing to the third shape, the foldable electronic device (201) may display a guide screen on one of the areas exposed in the second shape (e.g., any one of the first display area (261), the second display area (262), and the third display area (263)). For example, the guide screen may be a dedicated screen provided in the second shape and may include information about a plurality of applications available in the third shape.
[0185] According to one embodiment, the foldable electronic device (201) can display the screen of the second application in the third display area (263) together with the plurality of objects and the plurality of indicators, based on confirming that the first screen includes the screen of the second application and changes from the first form to the second form.
[0186] According to one embodiment, the foldable electronic device (201) may receive input for displaying the screen of the second application in the first display area (261), the second display area (262), and the third display area (263) while displaying the screen of the second application together with the plurality of objects and the plurality of indicators in the third display area (263). For example, the foldable electronic device (201) may display a button on a guide screen for displaying the screen of the second application so as to correspond to the resolution and size of a large screen, and may receive user input for the said button.
[0187] According to one embodiment, the foldable electronic device (201) may re-execute the second application based on receiving the input and confirming that it has changed from the second form to the third form, and display the screen of the re-executed second application in the first display area (261), the second display area (262), and the third display area (263). For example, the foldable electronic device (201) may re-execute the second application and change the resolution and size of the screen of the second application to correspond to the resolution and size of the large screen.
[0188] In operation 425, the foldable electronic device (201) can confirm that it selects a first object corresponding to a first application among the plurality of objects. For example, the user can check an app optimized for a large screen through a guide screen displayed in a second form and select the object to run the desired app.
[0189] According to one embodiment, the foldable electronic device (201) can identify applications that are frequently used or recently executed on the foldable electronic device (201) based on confirming that the first screen is changed from the first form to the second form when the first screen includes a home screen. The foldable electronic device (201) can display objects representing each of the applications that are frequently used or recently executed on the third display area (263).
[0190] According to one embodiment, the guide screen in the second form may include a plurality of first objects representing a plurality of applications operable in the third form, and a plurality of second objects representing applications with high usage frequency or recently executed applications, respectively. Additionally, the guide screen in the second form may further include indicators indicating whether the application is an application capable of changing its resolution and size so as to be displayed in the third form, and the indicators may be positioned adjacent to each application so that the user can recognize whether the application is for a large screen.
[0191] In operation 430, it can be seen that the foldable electronic device (201) changes from the second form to the third form.
[0192] In operation 435, the foldable electronic device (201) can display the screen of the first application in the first display area (261), the second display area (262), and the third display area (263) based on confirming that the first object is selected and confirming that it is changed from the second form to the third form. For example, the foldable electronic device (201) can receive a user selection for an app to be executed in the third form through a guide screen of the second form, and when the change from the second form to the third form is completed, execute the app corresponding to the user selection and display the executed app screen on the large screen (e.g., the first display area (261), the second display area (262), and the third display area (263)).
[0193] For example, referring to FIG. 5, as illustrated in 500a, a home screen may be displayed on a cover screen (e.g., external display (264)) in the first form. When the form of the foldable electronic device (201) changes from the first form to the second form, a guide screen may be displayed in one of the first display area (261), the second display area (262), and the third display area (263) (e.g., the third display area (263)), as illustrated in 500b, which includes an object representing a large screen-only app and indicators indicating that the app is a large screen app. When the form of the foldable electronic device (201) changes from the second form to the third form, as illustrated in 500c, an execution screen of the app selected in the guide screen may be displayed in the first display area (261), the second display area (262), and the third display area (263).
[0194] For example, referring to FIG. 6, in the first form as illustrated in 600a, an application execution screen may be displayed on a cover screen (e.g., external display (264)). When the form of the foldable electronic device (201) changes from the first form to the second form, as illustrated in 600b, a taskbar may be displayed along with an application execution screen on the cover screen (e.g., external display (264)) in one of the first display area (261), the second display area (262), and the third display area (263) (e.g., the third display area (263)). The taskbar may include objects for large-screen dedicated apps and indicators indicating that the app is a large-screen app. According to one embodiment, a large-screen app may refer to an application that is operable in the third form. For example, an app for a large screen may be an application that can be displayed across the entire display area of a third form (e.g., tablet mode) to correspond to the resolution and size of the large screen, even without separate user input to re-execute the application to fit the screen size of the third form when switching to the third form.
[0195] On the other hand, if an indicator indicating an app for the large screen is not selected, and a separate button (e.g., a re-run button) (605) provided on the guide screen as shown in 600b of FIG. 6 is selected, and then the change to a third form as in 600c is completed, the foldable electronic device (201) can display the re-run application screen through the large screen.
[0196] In the case of an app for a large screen, when the change to a third form is completed without separate user input (e.g., button (605)), the application screen is displayed to correspond to the resolution and size of the large screen without restarting the application. However, in the case of an app not for a large screen, when the change to a third form is completed as in 600c, the application is restarted and the application screen is displayed to correspond to the resolution and size of the large screen.
[0197] For example, referring to FIG. 7, a foldable electronic device (201) may display a guide screen comprising a plurality of first objects (700) representing a plurality of applications (e.g., large screen apps) that are operable in a third form, and a plurality of second objects (710) representing each of applications that are frequently used or recently executed, and may receive a user selection for any one of the plurality of second objects. For example, in the case of a large screen app, it may include an image (702) representing the application, and an indicator (e.g., a rectangle with a horizontal length longer than a vertical length) (704) indicating that the application is a large screen app may be placed adjacently. In the case of the most recently executed app, an image (722) representing the application may be placed adjacently with an indicator (e.g., a rectangle with a vertical length longer than a horizontal length) (724) indicating that the application is not a large screen app. According to one embodiment, FIG. 7 illustrates a case where an indicator (724) indicating that it is not a large screen app is displayed, but only an indicator (704) indicating a large screen app is displayed and an indicator (724) for an app that is not a large screen app may not be displayed.
[0198] Additionally, the user may change the shape of the foldable electronic device (201) from the first shape to the second shape, and then change it back to the first shape instead of changing it to the third shape. For example, the guide screen may further include a plurality of third objects (720) representing a plurality of applications (e.g., apps for the cover screen) that are operable in the first shape.
[0199] According to one embodiment, if a user wishes to use an application on the cover screen on the large screen through the guide screen, the user selects a separate button (e.g., a re-run button) (605) provided on the guide screen as shown in 600b of FIG. 6, and then completes the change to a third form as in 600c, the user can view the re-run application screen through the large screen.
[0200] According to one embodiment, in the case of an application for a large screen, such as an application capable of real-time resizing to a large screen, when the foldable electronic device (201) is unfolded, for example, when the shape of the foldable electronic device (201) is changed from a first shape through a second shape to a third shape, the layout of the application can be changed in real-time without restarting the application. That is, the size of the execution screen of the application displayed on the cover screen can be changed to correspond to the size of the large screen without restarting the application.
[0201] In the case of an application that cannot be resized in real time, when the foldable electronic device (201) is unfolded, the application execution screen is displayed at the same size as the cover screen, and in response to user input on a separate button (e.g., a re-execution button), the application is re-executed and the size of the application execution screen can be changed to fit the large screen size.
[0202] Accordingly, as shown in 600b of FIG. 6, the provision of a guide screen and a separate button (605) may be determined based on whether the app is capable of real-time resizing. For example, a guide screen and a separate button (605) (e.g., a re-run button) as shown in 600b of FIG. 6 may be provided in the case of an application that is not capable of real-time resizing.
[0203] For example, referring to FIG. 8, as illustrated in 800a, a taskbar may be displayed in one of the first display area (261), the second display area (262), and the third display area (263) along with an application execution screen (810) on the cover screen (e.g., external display (264)). In response to user input for a button (820) for full view on the taskbar, the foldable electronic device (201) may display a guide screen in one of the first display area (261), the second display area (262), and the third display area (263) (e.g., the third display area (263)) after removing the application execution screen as illustrated in 800b, which includes an object representing a large screen-only app and indicators indicating that the app is a large screen-only app. Additionally, when selecting (830) a large screen-only app displayed on the taskbar, the execution screen (850) of the large screen-only app can be displayed on the large screen as shown in 800c. Additionally, the foldable electronic device (201) may display the execution screen of the large screen-only app in a divided ratio along with the execution screen (810) of the application on the cover screen (e.g., external display (264)).
[0204] According to one embodiment, the foldable electronic device (201) can confirm that a third object corresponding to the third application is selected among the plurality of objects while displaying the screen of the second application along with a plurality of objects and a plurality of indicators on the third display area (263). The foldable electronic device (201) can display the screen of the second application and the screen of the third application on a large screen (e.g., a first display area (261), a second display area (262), and a third display area (263)) based on confirming that the second form is changed to the third form, confirming that the third object is selected, and confirming that the second form is changed to the third form.
[0205] According to one embodiment, the foldable electronic device (201) can display the screen of the third application in two of the first display area (261), the second display area (262), and the third display area (263), based on confirming that the third object is selected and that it is changed from the second form to the third form, and display the screen of the second application in the remaining display area different from the two display areas.
[0206] According to one embodiment, the foldable electronic device (201) can confirm that it selects a fourth object corresponding to a fourth application among objects representing applications with high usage frequency or recently executed applications. The foldable electronic device (201) can confirm whether the fourth application is an application that can operate in the third form based on confirming that the fourth object is selected and confirming that the fourth application is an application that can operate in the third form. If the foldable electronic device (201) determines that the fourth application is not an application that can operate in the third form, it can display the screen of the fourth application in the first display area (261), the second display area (262), and the third display area (263) together with the plurality of objects and the plurality of indicators.
[0207] According to one embodiment, the foldable electronic device (201) can confirm that the screen of the first application changes from the third form to the second form while displaying the screen of the first application in the first display area (261), the second display area (262), and the third display area (263). Based on confirming the change from the third form to the second form, the foldable electronic device (201) can confirm a plurality of applications that are operable in the first form. The foldable electronic device (201) can display the screen of the first application in the third display area (263) along with objects representing each of the plurality of applications operable in the first form and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application operable in the first form.
[0208] FIG. 9 is a detailed operation flowchart of a foldable electronic device according to one embodiment. To aid in understanding the description of FIG. 9, the explanation will be described with reference to FIG. 10 to FIG. 15.
[0209] Referring to FIG. 9, in operation 905, the foldable electronic device (201) can display a first screen in folded mode. After the first unfolding, the foldable electronic device (201) can check in operation 910 whether the first app was launched in folded mode. Alternatively, the foldable electronic device (201) can check whether there is a user selection for the first app in folded mode. If there is no app launched in folded mode or no app selected, the first screen may include a home screen. Therefore, if there is no app launched in folded mode or no app selected, in operation 915, the foldable electronic device (201) can display a home screen dedicated to half-folded mode (e.g., a guide screen). After the second unfolding, the foldable electronic device (201) can display a home screen dedicated to unfolded mode in operation 920.
[0210] FIG. 10 is an example of a screen when changing from a folded state to a partially folded state and an unfolded state in which a home screen according to one embodiment is displayed.
[0211] Referring to FIG. 10, as illustrated in 1000a, the foldable electronic device (201) can display a first screen including a home screen on a cover screen in a folded mode. After first unfolding, the foldable electronic device (201) can display a guide screen on a part exposed in a partial folded mode as illustrated in 1000b. The guide screen displayed in the partial folded mode may include information on various applications based on the context of the foldable electronic device (201), in addition to information on an optimized application in the unfolded mode. After second unfolding, the foldable electronic device (201) can display a home screen on a large screen (e.g., a first display area (261), a second display area (262), and a third display area (263)) in an unfolded mode as illustrated in 1000c.
[0212] FIG. 11 is an example of a screen when changing to an unfolded state after selecting a resizable app in a partially folded state according to one embodiment.
[0213] Referring to FIG. 11, when a user selects an app while a guide screen is displayed as shown in 1100a, the foldable electronic device (201) can display a taskbar along with the execution screen of the selected app as shown in 1100b. If the selected app is an app for a large screen, for example, an app that can be resized to correspond to the resolution and size of the large screen, the foldable electronic device (201) can display the execution screen of the selected app on the large screen as shown in 1100c when the change from a partially folded mode to an unfolded mode is completed.
[0214] According to one embodiment, after the first unfolding, if the first app is executed in folding mode or the first app is selected by the user in folding mode in operation 910, the foldable electronic device (201) may display the screen of the first app and a taskbar dedicated to some folding mode in operation 925. After the second unfolding, in operation 930, the foldable electronic device (201) may check whether the first app is a large screen optimized app. If the first app is not a large screen optimized app, in operation 935, an app selection (or app picker) screen may be displayed together, allowing the app to be selected while maintaining the screen of the first app on the large screen in unfolding mode.
[0215] FIG. 12 is an example of a screen when changing to an unfolded state after selecting an app in a partially folded state where resizing is restricted, according to one embodiment.
[0216] Referring to FIG. 12, when one app is selected by the user on the guide screen (1210) as shown in 1200a, a taskbar may be displayed along with the execution screen (1220) of the selected app as shown in 1200b. Here, if the selected app is not an app for the large screen but an app for the cover screen, such as an app with limited resizing, when the change from some folded mode to unfolded mode is completed, the foldable electronic device (201) may display an app picker screen (1230) along with the execution screen (1220) of the selected app on the large screen as shown in 1200c.
[0217] According to one embodiment, if the first app is a large screen optimized app, in operation 940, the foldable electronic device (201) can display the screen of the first app in full view in unfolded mode. For example, in unfolded mode, the foldable electronic device (201) can re-run the first app to correspond to the resolution and size of the large screen and display the screen of the re-runned first app.
[0218] FIG. 13 is an example of a screen when a resizable app is executed in a folded state and then changed to an unfolded state according to one embodiment.
[0219] Referring to FIG. 13, when a first app is selected in folding mode as shown in 1300a, the foldable electronic device (201) can display the execution screen of the selected app on the cover screen (1310) as shown in 1300b. After the first unfolding, the foldable electronic device (201) can display the screen (1320) of the first app and a taskbar dedicated to some folding mode as shown in 1300c. After the second unfolding, if the first app is a large screen optimized app, the first app is not re-executed when changing from some folding mode to unfolding mode, and the foldable electronic device (201) can display the execution screen (1330) of the re-executed first app on the large screen as shown in 1300d.
[0220] According to one embodiment, while displaying the screen of the first app and a taskbar dedicated to a partial folding mode, when the second app is selected and the second app is unfolded, in operation 945, the foldable electronic device (201) can check whether there is a large screen optimized app. For example, it can check whether there is a large screen optimized app among the first app and the second app. If neither the first app nor the second app is a large screen optimized app, for example, if both the first app and the second app are apps whose resolution and size changes are restricted to correspond to the resolution and size of the large screen, in operation 950, the foldable electronic device (201) can divide the first app and the second app in a certain ratio in unfold mode and display the app selection (or app picker) screen together. For example, the foldable electronic device (201) can display the screen of the first app, the screen of the second app, and the app selection screen on the large screen in a 1:1:1 ratio.
[0221] FIG. 14a is an example of a screen when changing to an expanded state according to the execution of a plurality of apps in one embodiment.
[0222] Referring to FIG. 14a, when a first app is launched (or selected) in folding mode as illustrated in 1400a, after the first unfolding, the foldable electronic device (201) may display the screen (1410) of the first app and a taskbar dedicated to some folding mode. Upon selection of the full view button (1420), the foldable electronic device (201) may also display a guide screen (1440) as illustrated in 1400b. The user may select a second app through the taskbar or the guide screen (1440). After selecting the second app, the shape of the foldable electronic device (201) may be changed from some folding mode to unfolding mode as illustrated in 1400c. If a third app is additionally selected by the user, the foldable electronic device (201), as illustrated in 1400d, can display the screen of the first app (1450), the screen of the second app (1460), and the screen of the third app (1470) on the large screen in a 1:1:1 ratio.
[0223] According to one embodiment, in operation 945, the foldable electronic device (201) checks whether there is a large screen optimized app, and in operation 955, checks whether all are large screen optimized apps. For example, if neither the first app nor the second app is a large screen optimized app, that is, if only one app is a large screen optimized app, the foldable electronic device (201) can display the apps that can be optimized and the apps that cannot be optimized in a 2:1 ratio in operation 960. For example, since the apps that can be optimized for the large screen are apps that can change resolution and size, they can be displayed in a 2:1 ratio so that the apps that can be optimized are displayed preferentially over the apps that cannot be optimized.
[0224] Additionally, if both the first app and the second app are large screen optimized apps, the foldable electronic device (201) can display the first app and the second app in a 2:1 ratio in operation 965. For example, the first app in folded mode can be displayed in a 2:1 ratio so as to be displayed preferentially over the second app in some folded modes.
[0225] FIG. 14b is an example of a screen when the selected app is changed to an expanded state depending on whether it is resized according to one embodiment.
[0226] Referring to FIG. 14b, when a first app is selected and then a second app is selected as in FIG. 14a, the shape of the foldable electronic device (201) can be changed from a partial folding mode to an unfolding mode. If the second app is a resizable app, the foldable electronic device (201) can display the ratio of the screen (1450) of the first app and the screen (1465) of the second app as 1:2, as shown in FIG. 1400e. For example, since the first app is a non-resizable app, the resolution and size of the screen (1450) of the first app may correspond to the resolution and size in the partial unfolding mode. On the other hand, since the second app is a resizable app, the screen (1465) of the second app may be resized to correspond to the size of the remaining two areas excluding the screen (1450) of the first app. Additionally, if both the first app and the second app are apps that cannot be resized, the foldable electronic device (201) can display the app picker screen (1480) together with the screen (1450) of the first app and the screen (1490) of the second app in a ratio of 1:1:1, as shown in 1400f.
[0227] FIG. 15 is an example of a screen when the image is changed to an expanded state according to a user selection for resizing in one embodiment.
[0228] Referring to FIG. 15, as illustrated in 1500a, after a first unfolding while displaying the execution screen (1510) of the first app on the cover screen in folding mode, the foldable electronic device (201) can display the execution screen (1520) of the first app on one area (e.g., a third display area (263)) as illustrated in 1500b. According to one embodiment, if the first app is an app that cannot be resized in real time, information (1527) indicating that the first app cannot be resized in real time and that a separate input is required to display it on a large screen, and a button (1525) for displaying the screen of the first app on a large screen may be displayed on at least a part of the execution screen (1520) of the first app. While displaying a guide screen including the execution screen (1520) of the first app and a taskbar in some folded mode, the foldable electronic device (201) may receive user input for a button (1525) for displaying the screen of the first app on a large screen. In response to user input for a button (e.g., a full view toggle button) (1525) for displaying the screen of the first app on a large screen, the foldable electronic device (201) may display guide information (1529) to induce the user to change the shape of the foldable electronic device (201) to unfolded mode.
[0229] The foldable electronic device (201) may, upon receiving user input for the button (1525), re-run the first app as shown in 1500d when changing from a partial fold mode to an unfold mode, and display the screen (1530) of the re-running first app as shown in 1500e on a large screen (e.g., a first display area (261), a second display area (262), and a third display area (263)). For example, if there is no user selection for the button to display the screen of the first app on the large screen, or if the user selects the Cancel button for guide information to induce the foldable electronic device (201) to change its shape to an unfold mode, the size of the screen (1520) of the first app may be maintained as shown in 1500c when changing from a partial fold mode to an unfold mode.
[0230] FIG. 16 is an example of a screen when changing from a landscape view mode to an expanded state according to one embodiment.
[0231] Referring to FIG. 16, the foldable electronic device (201) can display a guide screen (1600) in landscape view mode as illustrated in 1600a. The guide screen (1600) is a dedicated screen provided in some folding modes and may include information (1610) about a plurality of applications available in unfolding mode. Additionally, the guide screen (1600) may include information (1617) indicating that the first app is not resized in real-time and that the first app is re-executed when switching to unfolding mode.
[0232] While displaying a guide screen (1600) including a screen (1605) of a first app, the foldable electronic device (201) may display guide information (1620) to induce the user to change the shape of the foldable electronic device (201) to unfold mode, as shown in 1600b, in response to user input for a button (e.g., full view switch button) (1615) for displaying the screen (1605) of the first app on a large screen. When the change from some folded mode to unfolded mode is completed, the foldable electronic device (201) may display the re-executed screen (1630) of the first app on a large screen (e.g., first display area (261), second display area (262), and third display area (263)), as shown in 1600c.
[0233] FIG. 17a is a drawing showing a user interface that can be provided when changing from an expanded state to a partially folded state in which a screen of a resizable app according to one embodiment is displayed, and FIG. 17b is a drawing showing a user interface that can be provided when changing from an expanded state to a partially folded state in which a screen of an app with restricted resizing according to one embodiment is displayed.
[0234] Referring to FIG. 17a, while displaying the execution screen (1710) of a first app optimized for a large screen in the first display area (261), the second display area (262), and the third display area (263) as illustrated in 1700a, the foldable electronic device (201) can identify applications that are operable (or displayable) in the folded mode based on confirming that the mode is changed from unfolded mode to partially folded mode. For example, the foldable electronic device (201) can identify applications for the cover screen. The foldable electronic device (201) can display a guide screen (1725) including the screen (1715) of the first app and a taskbar (1720) in the partially folded mode as illustrated in 1700b. The foldable electronic device (201) can reduce the screen of the first app that was displayed on the large screen and display the reduced screen of the first app (1715) in a partial fold mode area (e.g., a third display area (263)). When selecting the full view (1730), the foldable electronic device (201) can see apps optimized for the fold mode (1740). As illustrated in 1700c, in the partial fold mode, the foldable electronic device (201) can display a guide screen (1760) that includes apps for the large screen (1750) and context-based apps, such as frequently used apps or recently executed apps (1745), along with apps optimized for the fold mode (1740).
[0235] Referring to FIG. 17b, while displaying the execution screen (1770) of the first app optimized for a large screen in the first display area (261), the second display area (262), and the third display area (263) as shown in FIG. 1700d, the foldable electronic device (201) can display a guide screen (1787) including a taskbar (1780) along with the execution screen (1775) of the first app as shown in FIG. 1700e when changing to a partially folded mode. For example, if the first app is an app that does not support real-time resizing, the foldable electronic device (201) may provide a button (1785) for re-executing the first app to display the execution screen of the first app corresponding to the size of the cover screen, and may display the screen of the first app (1775) corresponding to a part of the screen of the first app (1770) that was displayed on the large screen in a partial folded mode (e.g., the third display area (263)). For example, if the first app is an app that does not support real-time resizing, the foldable electronic device (201) may display the screen of the first app (1775) corresponding to 1 / 3 of the screen of the first app (1770) without reducing the screen of the first app (1770) that was displayed on the large screen. The foldable electronic device (201) may provide a re-execution button (e.g., cover screen view display button) (1785) on a guide screen (1787) so that the execution screen of the first app can be displayed even in fold mode. In response to receiving user input for the button (1785), the foldable electronic device (201) may display a screen containing information (1790) that induces a change in the shape of the foldable electronic device (201) as illustrated in 1700f. For example, the information (1790) may be guide information that induces the user to change to fold mode.When the foldable electronic device (201) completes the change from some folding mode to folding mode, it can re-run the first app and provide the screen of the re-running first app through an external display (264) (e.g., cover screen)).
[0236] According to one embodiment, the method of providing information about an application optimized for a shape according to a shape change of a foldable electronic device (201) through a guide screen before the shape change is completed was described using a first type (e.g., G-type) foldable electronic device (201) as an example, but can be applied in the same way to other types of foldable electronic devices (201). For example, it may be possible to provide a guide screen according to the shape change to a second type (Z-type) foldable electronic device (201), and to explain this in detail, refer to FIG. 18 and FIG. 19.
[0237] FIG. 18 is an example of a screen when changing from a folded state in which a home screen is displayed to a partially folded state and an unfolded state in a second type of foldable electronic device according to one embodiment, and FIG. 19 is an example of a screen in an unfolded state according to whether an app is resized in a second type of foldable electronic device according to one embodiment.
[0238] Referring to FIG. 18, when a home screen (1810) is displayed through a cover screen in a first form (e.g., folded state) as illustrated in 1800a, a second type of foldable electronic device (201) may display a guide screen (1815) as illustrated in 1800d in a second form (e.g., half-folded state) before changing from the first form (e.g., folded state) to a third form (e.g., unfolded state). Additionally, the second type of foldable electronic device (201) may display a dedicated home screen in the second form instead of the guide screen (1815) in the second form (e.g., half-folded state). The guide screen (1815) may include information about applications that can be displayed in the third form (e.g., unfolded state), as well as information about frequently used applications or recently executed applications based on context information.
[0239] According to one embodiment, when the shape of the foldable electronic device (201) changes from a second form to a third form, the foldable electronic device (201) of the second type can display a home screen (1820) in the third form (e.g., unfolded state) as shown in 1800c. For example, the foldable electronic device (201) of the second type can display a home screen (1820) in the third form when there is no app selected by the user in the guide screen (1815) in the second form. On the other hand, if there is an app selected in the guide screen (1815), for example, if an app for a large screen is selected, the foldable electronic device (201) of the second type can execute the selected app and display the screen (1910) of the executed app as shown in 1900a of FIG. 19.
[0240] According to one embodiment, when the full view button (1830) on the home screen (1820) is selected in the third form (e.g., unfolded state), the guide screen is called, and the second type of foldable electronic device (201) can display the guide screen (1840) on the home screen (1820) as illustrated in 1800d. The guide screen (1840) may include information about applications that can be displayed in the third form (e.g., unfolded state), as well as information about frequently used applications or recently executed applications based on context information. For example, through the guide screen (1840), the user can select an object (1842) representing an app for the large screen or an object (1844) representing an app for the cover screen.
[0241] According to one embodiment, when a second type of foldable electronic device (201) receives a selection for an object (1842) representing an app for a large screen through a guide screen (1840) (or receives a selection for an app for a large screen from a guide screen (1815)), it can execute an app corresponding to the selected object (1842) on the large screen and display a screen (1910) of the executed app, as shown in 1900a of FIG. 19. Additionally, when a second type of foldable electronic device receives a selection for an object (1844) representing an app for a cover screen through a guide screen (1840) (or receives a selection for an app for a cover screen from a guide screen (1815)), it can execute a cover screen-only app corresponding to the selected object (1844) on the large screen and display a screen (1920) of the executed app on a part of the large screen, as shown in 1900b of FIG. 19. For example, since a cover screen-only app is an app with limited resolution and size changes, the size of the app's execution screen can correspond to the aspect ratio of the cover screen. Therefore, an app picker screen (1930) can be displayed in the remaining area excluding the screen (1920) of the executed app.
[0242] FIG. 20a is a drawing illustrating the unfolded state of a second type of foldable electronic device on the front, FIG. 20b is a drawing illustrating the unfolded state of a second type of foldable electronic device on the rear according to one embodiment, and FIG. 20c is a drawing explaining the folded state of a second type of foldable electronic device according to one embodiment. FIG. 20a may be a drawing of one side (e.g., front) of a foldable electronic device (hereinafter, electronic device) (2000) viewed obliquely, and FIG. 20b may be a drawing of the other side (e.g., rear) of a foldable electronic device (2000) viewed obliquely. According to one embodiment, FIG. 20a to FIG. 20c illustrate a second type (e.g., type e) foldable electronic device. According to one embodiment, the foldable electronic device (2000) may be the electronic device (101) of FIG. 1.
[0243] According to one embodiment, a foldable electronic device (2000) may include a housing (2001). The foldable electronic device (2000) may include a display (2002). The housing (2001) may form a space in which the display (2002) is placed. The display (2002) may include a flexible display (2002). At least a portion of the display (2002) may be folded or unfolded.
[0244] According to one embodiment, the housing (2001) may include a first housing (2010). The housing (2001) may include a second housing (2020). The housing (2001) may include a third housing (2030). The first housing (2010) may be positioned between the second housing (2020) and the third housing (2030). The second housing (2020) may be rotatably coupled to the first housing (2010). The third housing (2030) may be rotatably coupled to the first housing (2010). A display (2002) may be visually exposed through a first part of the first housing (2010), a second part of the second housing (2020), and a third part of the third housing (2030). The display (2002) may include a first display area (2002a) corresponding to a first housing (2010), a second display area (2002b) corresponding to a second housing (2020), and a third display area (2002c) corresponding to a third housing (2030). According to one embodiment, the first display area (2002a) may include a portion of a foldable area (2002d). According to one embodiment, the second display area (2002b) may include a portion of a foldable area (2002d). According to one embodiment, the first display area (2002a) may be in contact with the second display area (2002b). According to one embodiment, the first display area (2002a) may include a portion of a foldable area (2002e). According to one embodiment, the third display area (2002c) may include a portion of the foldable area (2002e). According to one embodiment, the first display area (2002a) may be in contact with the third display area (2002c).
[0245] According to one embodiment, a camera (2091) (e.g., a front camera) may be disposed in a portion of the housing (2001). The camera (2091) (e.g., a front camera) may be configured to capture a scene in the direction facing the display (2002) when the foldable electronic device (2000) is fully unfolded. For example, the camera (2091) may be disposed in a first display area (2002a). For example, the camera (2091) may be disposed in a second display area (2002b). For example, the camera (2091) may be disposed in a third display area (2002c). In FIG. 20a, the camera (2091) is shown disposed in the third display area (2002c), but this is exemplary.
[0246] According to one embodiment, referring to FIG. 20b, the foldable electronic device (2000) may include a camera (2092) (e.g., a rear camera) exposed through the rear of a housing (2001). The camera (2092) (e.g., a rear camera) may be configured to capture a scene in a direction opposite to the direction in which the display (2002) is facing when the foldable electronic device (2000) is fully unfolded. For example, the camera (2092) may be exposed through the rear of a first housing (2010). For example, the camera (2092) may be exposed through the rear of a second housing (2020). For example, the camera (2092) may be exposed through the rear of a third housing (2030). In FIG. 20b, the camera (2092) is shown exposed through the rear of the third housing (2030), but this is exemplary.
[0247] According to one embodiment, the foldable electronic device (2000) may include an external display (or cover display) (2003). A first housing (2010) may form a space in which the cover display (2003) is placed. The cover display (2003) may be a flat display. According to one embodiment, a camera (2093) (e.g., a cover display camera) may be placed in a region of the cover display (2003). The camera (2093) (e.g., a cover display camera) may be configured to capture a scene in the direction in which the cover display (2003) is facing. The camera (2093) (e.g., a cover display camera) may be configured to capture a scene in the opposite direction to the direction in which the display (2002) (e.g., a flexible display) is facing when the foldable electronic device (2000) is fully unfolded.
[0248] According to one embodiment, a cover display may be disposed in a space formed by the second housing (2020). For example, the foldable electronic device (2000) may include a cover display (e.g., a flat display) disposed in the second housing (2020). According to one embodiment, a camera (e.g., a cover display camera) may be disposed in a region of the cover display disposed in the second housing (2020).
[0249] According to one embodiment, the foldable electronic device (2000) may include a first hinge (2070) and a second hinge (2080). The foldable electronic device (2000) may include a hinge structure (2090) including the first hinge (2070) and the second hinge (2080). The first hinge (2070) may be positioned between a first housing (2010) and a second housing (2020). The first hinge (2070) may rotatably connect the first housing (2010) and the second housing (2020). The second hinge (2080) may be positioned between the first housing (2010) and a third housing (2030). The second hinge (2080) can rotatably connect the first housing (2010) and the third housing (2030). The first hinge (2070) may be named "first hinge member". The second hinge (2080) may be named "second hinge member".
[0250] With reference to FIG. 20c, the folded state or unfolded operation of a foldable electronic device (2000) according to one embodiment can be described.
[0251] According to one embodiment, the second housing (2020) can be rotated relative to the first housing (2010). The first hinge (2070) can provide a center of rotation to the second housing (2020). The third housing (2030) can be rotated relative to the first housing (2010). The second hinge (2080) can provide a center of rotation to the third housing (2030).
[0252] Referring to FIG. 20c, according to one embodiment, when the foldable electronic device (2000) is in a fully folded state, each of the first, second, and third housings (2010, 2020, 2030) may be arranged in one direction. For example, the second housing (2020) may be placed on the upper side (e.g., in the +Z direction) of the third housing (2030), and the first housing (2010) may be placed on the upper side (e.g., in the +Z direction) of the second housing (2020). For example, the second housing (2020) may be placed between the third housing (2030) and the first housing (2010).
[0253] Referring to FIG. 20c, according to one embodiment, when the foldable electronic device (2000) is in a fully folded state, a cover display (2003) may be disposed on a portion visible from the outside of the first housing (2010). Referring to FIG. 20c, the width of the second hinge (2080) may be greater than the width of the first hinge (2070). For example, when the foldable electronic device (2000) is in a fully folded state, the extended length of the second hinge (2080) may be greater than the extended length of the first hinge (2070).
[0254] Referring to FIG. 20c, according to one embodiment, the foldable electronic device (2000) may be in a half-folded state where only one hinge (e.g., first hinge (2070)) is fully folded and the other hinge (e.g., second hinge (2080)) is fully unfolded. Referring to FIG. 20c, according to one embodiment, the second housing (2020) may be rotated relative to the first housing (2010). The first hinge (2070) may provide a center of rotation to the second housing (2020). When the first hinge (2070) is fully folded and the second hinge (2080) is fully unfolded, the second housing (2020) may be positioned on the upper side of the first housing (2010). Referring to FIG. 20c, according to one embodiment, a second housing (2020) is positioned on the upper side of a first housing (2010), and a third housing (2030) is positioned alongside the first housing (2010), so that only the third display area (2002c) of the display (2002) positioned in the third housing (2030) is exposed to the outside, and the rear surface of the second housing (2020) can be exposed to the outside.
[0255] According to one embodiment, the foldable electronic device (2000) may be transformed into a half-folded state in which one hinge (e.g., first hinge (2070)) is fully unfolded and the other hinge (e.g., second hinge (2080)) is fully folded. According to one embodiment, in the half-folded state of the foldable electronic device (2000), a third housing (2030) is disposed on the upper side of the first housing (2010), and a second housing (2020) is disposed alongside the first housing (2010), so that only the second display area (2002b) of the display (2002) disposed in the second housing (2020) may be exposed to the outside. According to one embodiment, the second housing (2020) may be rotated relative to the first housing (2010). The first hinge (2070) can provide a center of rotation to the second housing (2020). When the first hinge (2070) is fully extended and the second hinge (2080) is fully extended, the first housing (2010), the second housing (2020), and the third housing (2030) can be arranged side by side.
[0256] FIG. 21a is a side view of a third type of foldable electronic device according to one embodiment, FIG. 21b is a side view of a third type of foldable electronic device according to one embodiment, and FIG. 22 is a perspective view of a third type of foldable electronic device according to one embodiment. According to one embodiment, FIG. 21a to FIG. 22 illustrate a third type (e.g., z-type) foldable electronic device.
[0257] Referring to FIG. 21a and FIG. 21b, according to one embodiment, a foldable electronic device (2100) can be switched from a first form (or first state) (or folded state, folded mode) (e.g., phone mode) to a second form (or second state) (or half-folded state, intermediate mode), and from the second form to a third form (or third state) (or unfolded state, fully unfolded state, unfolded mode) (e.g., tablet mode). For example, the foldable electronic device (2100) can have a second hinge positioned between a first housing (2110) and a second housing (2120), and a first hinge positioned between a second housing (2120) and a third housing (2130) unfolded simultaneously.
[0258] Referring to FIG. 22, the first housing (2210) and the second housing (2220) can be folded outward by the second hinge, and the second housing (2220) and the third housing (2230) can be folded inward by the first hinge.
[0259] According to one embodiment, when the first housing (2210), the second housing (2220), and the third housing (2230) of the foldable electronic device (2100) are in a folded state by the in-folding and out-folding, a first page placed on the first surface (2211) of the first housing (2210) may be exposed to the outside. According to one embodiment, when the first housing (2210) and the second housing (2220) of the foldable electronic device (2100) are in a folded state and the second housing (2220) and the third housing (2230) are in an unfolded state, a second page placed on the second surface (2221) of the second housing (2220) and a third page placed on the third surface (2231) of the third housing (2230) may be exposed to the outside. According to one embodiment, when the foldable electronic device (2100) is in a half-folding state where the first housing (2210) and the second housing (2220) are in an unfolded state and the second housing (2220) and the third housing (2230) are in a folded state, only the first page placed on the first surface (2211) of the first housing (2210) can be exposed to the outside. According to one embodiment, when the first housing (2210) and the second housing (2220) of the foldable electronic device (2100) are in an unfolded state and the second housing (2220) and the third housing (2230) are in an unfolded state, the first page disposed on the first surface (2211) of the first housing (2210), the second page disposed on the second surface (2221) of the second housing (2220), and the third page disposed on the third surface (2231) of the third housing (2230) can all be exposed to the outside.
[0260] According to one embodiment, the foldable electronic device (201) of FIG. 2 may be a foldable electronic device (201) of the first type (e.g., G type) of FIG. 3a to 3d. The foldable electronic device (201) of FIG. 2 may be a foldable electronic device (2000) of the second type (e.g., e type) of FIG. 20a to 20c. The foldable electronic device (201) of FIG. 2 may be a foldable electronic device (2100) of the third type (e.g., z type) of FIG. 21a to 22.
[0261] According to one embodiment, by providing the user with information regarding applications that can be operated in the unfolded state before changing the shape of the foldable electronic device from a folded state to an unfolded state, the user can check in advance which applications can be used in the unfolded state.
[0262] The electronic device according to the various embodiments disclosed in this document may be of various forms. The electronic device may include, for example, a portable communication device (e.g., a smartphone), a computer device, a portable multimedia device, a portable medical device, a camera, a wearable device, or a consumer electronics device. The electronic device according to the embodiments of this document is not limited to the devices described above.
[0263] The various embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0264] The term “module” as used in the various embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0265] Various embodiments of the present document may be implemented as software (e.g., program (140)) comprising one or more instructions stored in a storage medium (e.g., internal memory (136) or external memory (138)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (120)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0266] According to one embodiment, the method according to the various embodiments disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or an application store (e.g., Play Store). TM It can be distributed online (e.g., downloaded or uploaded) through ) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0267] According to various embodiments, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to various embodiments, one or more of the components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to various embodiments, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
[0268] According to one embodiment, in a non-transient storage medium storing instructions, the instructions are configured to cause the foldable electronic device to perform at least one operation when executed by at least one processor (120, 220) of the foldable electronic device (101, 201), wherein the at least one operation comprises: an operation of displaying a first screen on an external display in a first form of the foldable electronic device; an operation of confirming a change from the first form to a second form of the foldable electronic device for displaying a screen in the third display area of a flexible display including a first display area, a second display area, and a third display area; an operation of confirming a plurality of applications operable in the third form of the foldable electronic device for displaying a screen in the first display area, the second display area, and the third display area based on confirming the change from the first form to the second form; and displaying a plurality of objects representing each of the plurality of applications and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application operable in the third form in the third display area. The method may include an operation confirming that a first object corresponding to a first application among the plurality of objects is selected, an operation confirming that a change is made from the second form to the third form, and an operation displaying the screen of the first application in the first display area, the second display area, and the third display area based on confirming that the first object is selected and confirming that a change is made from the second form to the third form.
Claims
1. In a foldable electronic device (101, 201), A foldable housing, wherein the foldable housing comprises a first housing (303), a second housing (305), and a third housing (307), wherein the second housing is disposed between the first housing and the third housing and is rotatably connected to the first housing and the third housing; A flexible display (260) disposed in the first housing, the second housing, and the third housing, wherein the flexible display includes a first display area supported by the first housing, a second display area supported by the second housing, and a third display area supported by the third housing; An external display disposed on one side of the foldable housing opposite to the flexible display; At least one processor (220) including a processing circuit; and It includes a memory (230) for storing instructions, When the above instructions are executed individually or collectively by the at least one processor, the foldable electronic device, In the first form of the above-described foldable electronic device, a first screen is displayed on the external display, and Confirming that the foldable electronic device is changed from the first form to the second form for displaying a screen in the third display area, Based on confirming a change from the first form to the second form, a plurality of applications operable in the third form of the foldable electronic device for displaying a screen in the first display area, the second display area, and the third display area are identified, and A plurality of objects representing each of the plurality of applications and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application capable of operating in the third form are displayed in the third display area, and Confirm that a first object corresponding to the first application is selected among the plurality of objects above, and Confirming that the change is made from the above second form to the above third form, and A foldable electronic device configured to display a screen of the first application in the first display area, the second display area, and the third display area based on confirming that the first object is selected and confirming that it is changed from the second form to the third form.
2. In paragraph 1, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device, A foldable electronic device configured to display the screen of the second application in the third display area together with the plurality of objects and the plurality of indicators, based on confirming that the first screen includes the screen of the second application and changes from the first form to the second form.
3. In claim 1 or 2, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device, While displaying the screen of the second application in the third display area together with the plurality of objects and the plurality of indicators, receiving an input for displaying the screen of the second application in the first display area, the second display area, and the third display area, Based on the reception of the above input and confirmation of a change from the second form to the third form, the second application is re-executed, and A foldable electronic device configured to display the screen of the re-executed second application in the first display area, the second display area, and the third display area.
4. In any one of claims 1 to 3, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device, While displaying the screen of the second application in the third display area together with the plurality of objects and the plurality of indicators, confirming that a third object corresponding to the third application among the plurality of objects is selected, Confirming that the change is made from the above second form to the above third form, and A foldable electronic device configured to display the screen of the second application and the screen of the third application in the first display area, the second display area, and the third display area, based on confirming that the third object is selected and confirming that it is changed from the second form to the third form.
5. In any one of claims 1 to 4, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device, A foldable electronic device configured to display the screen of the third application in two of the first display area, the second display area, and the third display area, and to display the screen of the second application in the remaining display area different from the two display areas, based on confirming that the third object is selected and confirming that it is changed from the second form to the third form.
6. In any one of claims 1 to 5, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device, If the first screen includes a home screen, based on confirming that it changes from the first form to the second form, applications that are frequently used or recently executed on the foldable electronic device are identified, and A foldable electronic device configured to display objects representing each of the above-mentioned frequently used applications or the above-mentioned recently executed applications in the third display area.
7. In any one of claims 1 to 6, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device, Confirming that a fourth object corresponding to the fourth application is selected from among the objects representing each of the above-mentioned applications with high usage frequency or the above-mentioned recently executed applications, Confirming that the change is made from the above second form to the above third form, and Based on confirming that the above-mentioned fourth object is selected and confirming that it is changed from the above-mentioned second form to the above-mentioned third form, it is determined whether the above-mentioned fourth application is an application that can operate in the above-mentioned third form, and A foldable electronic device configured to display the screen of the fourth application, together with the plurality of objects and the plurality of indicators, in the first display area, the second display area, and the third display area when the fourth application is not an application operable in the third form.
8. In any one of claims 1 to 7, when the instructions are executed individually or collectively by the at least one processor, the foldable electronic device, While displaying the screen of the first application in the first display area, the second display area, and the third display area, confirming that it changes from the third form to the second form, Based on confirming that the change is made from the third form to the second form, a plurality of applications operable in the first form are identified, and A foldable electronic device configured to display the screen of a first application in a third display area, together with objects representing each of a plurality of applications operable in the first form and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application operable in the first form.
9. In any one of claims 1 to 8, at least one sensor (276) is further included, and said at least one sensor includes at least one of a proximity sensor, an accelerometer, or a gyroscope. When the above instructions are executed individually or collectively by the at least one processor, the foldable electronic device, Data related to the distance, angle, and / or attitude between the first housing, the second housing, and the third housing is obtained through the above at least one sensor, and A foldable electronic device configured to confirm, based on the acquired data, that a change is made from the first form to the second form, that a change is made from the second form to the third form, or that a change is made from the third form to the second form.
10. In any one of paragraphs 1 through 9, The first embodiment is such that the first angle between the first housing and the second housing is smaller than the first critical angle, and the second angle between the third housing and the second housing is smaller than the first critical angle. The second embodiment is such that the first angle between the first housing and the second housing is smaller than the first critical angle, and the second angle between the third housing and the second housing is larger than the second critical angle. The above third embodiment is a foldable electronic device in which a first angle between the first housing and the second housing is greater than the second critical angle, and a second angle between the third housing and the second housing is greater than the second critical angle.
11. A method for providing a user interface according to a change in the form of a foldable electronic device, In the first form of the above-described foldable electronic device, the operation of displaying a first screen on an external display; An operation of confirming that the foldable electronic device is changed from the first form to a second form for displaying a screen in the third display area of a flexible display including a first display area, a second display area, and a third display area; An operation of identifying a plurality of applications operable in a third form of the foldable electronic device for displaying a screen in the first display area, the second display area, and the third display area, based on confirming a change from the first form to the second form; An operation of displaying a plurality of objects representing each of the plurality of applications and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application capable of operating in the third form, in the third display area; An operation to confirm the selection of a first object corresponding to a first application among the plurality of objects above; An operation to confirm that the change is made from the second form to the third form; and A method for providing a user interface, comprising the operation of displaying a screen of the first application in the first display area, the second display area, and the third display area based on confirming that the first object is selected and confirming that it is changed from the second form to the third form.
12. In Clause 11, the operation of displaying in the third display area is, A method for providing a user interface, comprising the operation of displaying the screen of the second application in the third display area together with the plurality of objects and the plurality of indicators, based on confirming that the first screen includes the screen of the second application and changes from the first form to the second form.
13. In Paragraph 11 or 12, While displaying the screen of the second application in the third display area together with the plurality of objects and the plurality of indicators, an operation of receiving an input for displaying the screen of the second application in the first display area, the second display area, and the third display area; An operation to re-execute the second application based on receiving the above input and confirming that it has been changed from the second form to the third form; and A method for providing a user interface, further comprising the operation of displaying the screen of the re-executed second application in the first display area, the second display area, and the third display area.
14. In any one of paragraphs 11 through 13, An operation of confirming that a third object corresponding to the third application is selected among the plurality of objects while displaying the screen of the second application together with the plurality of objects and the plurality of indicators in the third display area; An operation to confirm that the change is made from the second form to the third form; A method for providing a user interface, further comprising the operation of displaying the screen of the second application and the screen of the third application in the first display area, the second display area, and the third display area, based on confirming that the third object is selected and confirming that it is changed from the second form to the third form.
15. In a non-transient storage medium storing instructions, said instructions are configured to cause said foldable electronic device to perform at least one operation when executed by at least one processor (120, 220) of said foldable electronic device (101, 201), said at least one operation being, In the first form of the above-described foldable electronic device, the operation of displaying a first screen on an external display; An operation of confirming that the foldable electronic device is changed from the first form to a second form for displaying a screen in the third display area of a flexible display including a first display area, a second display area, and a third display area; An operation of identifying a plurality of applications operable in a third form of the foldable electronic device for displaying a screen in the first display area, the second display area, and the third display area, based on confirming a change from the first form to the second form; An operation of displaying a plurality of objects representing each of the plurality of applications and a plurality of indicators indicating that among the plurality of applications, the corresponding application is an application capable of operating in the third form, in the third display area; An operation to confirm the selection of a first object corresponding to a first application among the plurality of objects above; An operation to confirm that the change is made from the second form to the third form; and A storage medium comprising an operation of displaying a screen of the first application in the first display area, the second display area, and the third display area based on confirming that the first object is selected and confirming that it is changed from the second form to the third form.