Electronic device comprising flexible display, and control method therefor

Abstract

A foldable electronic device is disclosed. The foldable electronic device of the present disclosure may comprise: a foldable housing including a first housing part, a second housing part and a third housing part; a first display disposed in a first area of the foldable housing; a second display disposed in a second area of the foldable housing; a sensor including at least one sensing circuitry for sensing a folded state or an unfolded state of the foldable housing; at least one processor; and a memory for storing instructions, wherein, when executed individually or collectively by the at least one processor, the instructions can instruct the foldable electronic device to: check whether an application supporting a first execution screen of a first aspect ratio supports a second execution screen of a second aspect ratio that differs from the first aspect ratio; display, through the second display, the first execution screen of the first aspect ratio of the application in a first state in which the foldable electronic device is in the folded state; detect, on the basis of a sensing value of the sensor while the first execution screen is displayed through the second display, that the state of the foldable electronic device has changed from the first state to a second state, which is the unfolded state; generate, on the basis that the application does not support the second execution screen of the second aspect ratio, the second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen; and display the generated second execution screen on at least a part of an area of the first display.

Description

Electronic device including a flexible display and method for controlling the same

[0001] Embodiments of the present disclosure relate to an electronic device including a flexible display and a method for controlling the same.

[0002] The variety of services and additional features offered through electronic devices, such as smartphones, is steadily increasing. To enhance the utility of these devices and satisfy the diverse needs of users, telecommunications service providers and electronic device manufacturers are competitively developing electronic devices to offer a variety of features and differentiate themselves from competitors. Consequently, the various functions offered through electronic devices are also becoming increasingly sophisticated.

[0003] Recently, various types of electronic devices have been developed that provide expanded screens through multi-display technology. For example, devices equipped with multiple displays provide an expanded screen through multi-display technology.

[0004] Electronic devices may adopt new form factors, such as multi-display (e.g., dual-display) devices (e.g., foldable devices). Foldable devices feature displays that can be folded (or bent) (e.g., foldable displays or flexible displays) and can be used in a folded or unfolded state. Furthermore, with the implementation of multi-displays, the need for developing user interfaces (UIs) and their operation is increasing.

[0005] The above information may be provided as background art to aid in understanding the present disclosure. No claim or determination is made as to whether any of the above is applicable as prior art related to the present disclosure.

[0006] According to one embodiment, a foldable electronic device may include a foldable housing including a first housing part, a second housing part, and a third housing part, a first display disposed in a first area of ​​the foldable housing, a second display disposed in a second area of ​​the foldable housing, a sensor including at least one sensing circuitry for sensing a folded state or an unfolded state of the foldable housing, at least one processor, and a memory storing instructions.

[0007] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to determine whether an application supporting a first execution screen of a first aspect ratio supports a second execution screen of a second aspect ratio different from the first aspect ratio.

[0008] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to display the first execution screen of the application at the first aspect ratio through the second display when the foldable electronic device is in the first state in the folded state.

[0009] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to detect, based on a sensing value of the sensor while displaying the first execution screen through the second display, that the state of the foldable electronic device has changed from the first state to the second state, which is the unfolded state.

[0010] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to generate the second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen based on the application not supporting the second execution screen of the second aspect ratio.

[0011] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to display the generated second execution screen on at least a portion of the first display.

[0012] According to one embodiment, a control method for a foldable electronic device including a foldable housing, a first display disposed on a first surface of the foldable housing, a second display disposed on a second surface of the foldable housing, and a sensor including at least one sensing circuitry for sensing a folded state or an unfolded state of the foldable housing may include an operation of checking whether an application supporting a first execution screen of a first aspect ratio supports a second execution screen of a second aspect ratio different from the first aspect ratio.

[0013] According to one embodiment, the control method of the foldable electronic device may include an operation of displaying the first execution screen of the application with the first aspect ratio through the second display of the foldable electronic device in a first state in which the foldable electronic device is in a folded state.

[0014] According to one embodiment, the control method of the foldable electronic device may include an operation of detecting that the state of the foldable electronic device has changed from the first state to the second state, which is the unfolded state, based on a sensing value of a sensor that senses the folded state or unfolded state of the foldable housing while displaying the first execution screen of the application through the second display.

[0015] According to one embodiment, the control method of the foldable electronic device may include an operation of generating the second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen based on the application not supporting the second execution screen of the second aspect ratio.

[0016] According to one embodiment, the control method of the foldable electronic device may include an operation of displaying the generated second execution screen on at least a portion of the first display.

[0017] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions that cause a foldable electronic device including a foldable housing, a first display disposed on a first surface of the foldable housing, and a second display disposed on a second surface of the foldable housing to determine whether an application supporting a first execution screen of a first aspect ratio supports a second execution screen having a second aspect ratio that is longer in width than in height and different from the first aspect ratio.

[0018] According to one embodiment, the one or more programs may include instructions that cause the foldable electronic device to display the first execution screen of the application having the first aspect ratio through the second display of the foldable electronic device in a first state in which the foldable electronic device is in a folded state.

[0019] According to one embodiment, the one or more programs may include instructions that cause the foldable electronic device to detect a change in a state of the foldable electronic device from the first state to a second state in which the electronic device is in the unfolded state, based on a sensing value of a sensor that senses a folded state or an unfolded state of the foldable housing while the foldable electronic device displays the first execution screen of the application through the second display.

[0020] In one embodiment, the one or more programs may include instructions that cause the foldable electronic device to generate the second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen based on the application not supporting the second execution screen of the second aspect ratio.

[0021] According to one embodiment, the one or more programs may include instructions causing the foldable electronic device to display the generated second execution screen on at least a portion of the first display.

[0022] FIG. 1 is a block diagram of an electronic device within a network environment according to one embodiment.

[0023] FIG. 2A is a perspective view of an electronic device in an unfolded state according to one embodiment.

[0024] FIG. 2b is a perspective view of an electronic device in an unfolded state according to one embodiment.

[0025] FIG. 3 is a perspective view of an electronic device in a folded state according to one embodiment.

[0026] FIG. 4A is a drawing of an electronic device according to one embodiment in a partially folded state.

[0027] FIG. 4b is a drawing of an electronic device according to one embodiment in a partially folded state.

[0028] FIG. 5 is a drawing for explaining an electronic device that folds in a different manner from FIGS. 3 and 4a.

[0029] FIG. 6 is a flowchart for explaining an operation of displaying an application execution screen in portrait mode displayed on a display of an electronic device according to one embodiment of the present invention as an application execution screen in landscape mode.

[0030] FIG. 7 is a drawing for explaining an operation of displaying an application execution screen in portrait mode displayed on a display of an electronic device according to one embodiment of the present invention as an application execution screen in landscape mode.

[0031] FIG. 8 is a flowchart illustrating an operation of displaying an application execution screen in landscape mode according to whether or not the application supports a landscape mode execution screen in an electronic device according to one embodiment.

[0032] FIG. 9 is a drawing illustrating an operation of generating an execution screen of an application in landscape mode by reflecting a screen transition history performed through an execution screen of an application in portrait mode in an electronic device according to one embodiment.

[0033] FIG. 10 is a drawing for explaining an operation of displaying an application execution screen in landscape mode by applying an animation effect in an electronic device according to one embodiment.

[0034] FIG. 11 is a drawing for explaining an operation of obtaining an execution screen of an application in landscape mode using an artificial intelligence model of an electronic device according to one embodiment.

[0035] Figure 12 is a diagram for explaining learning data used to learn the artificial intelligence model of Figure 11.

[0036] Figure 13 is a drawing for explaining objects included in the execution screen of the application.

[0037] Figure 14a is a drawing for explaining objects included in the execution screen of an application in portrait mode.

[0038] FIG. 14b is a drawing for explaining objects included in the execution screen of the application in landscape mode corresponding to the execution screen of the application in portrait mode of FIG. 14a.

[0039] FIG. 15A is a drawing for explaining an operation of rearranging objects included in an execution screen of an electronic device according to one embodiment.

[0040] FIG. 15b is a drawing for explaining an operation of rearranging objects included in an execution screen of an electronic device according to one embodiment.

[0041] FIG. 15c is a drawing for explaining an operation of rearranging objects included in an execution screen of an electronic device according to one embodiment.

[0042] FIG. 15d is a drawing for explaining an operation of rearranging objects included in an execution screen of an electronic device according to one embodiment.

[0043] FIG. 16 is a drawing for explaining an operation of switching a screen based on a user input received through an execution screen of an application in landscape mode of an electronic device according to one embodiment.

[0044] FIG. 17a is a drawing for explaining an operation of generating an execution screen of an application in landscape mode of an electronic device when the electronic device is a foldable device.

[0045] FIG. 17b is a drawing for explaining an operation of generating an execution screen of an application in landscape mode of an electronic device when the electronic device is a multi-foldable device.

[0046] FIG. 17c is a drawing for explaining an operation of generating an execution screen of an application in landscape mode of an electronic device when the electronic device is a multi-foldable device.

[0047] FIG. 18 is a drawing for explaining an operation of generating an execution screen of an application in a landscape mode of an electronic device according to an unfolding operation of an electronic device according to one embodiment.

[0048] FIG. 19A is a drawing for explaining an operation of displaying an external area of ​​an application execution screen in landscape mode of an electronic device according to one embodiment.

[0049] FIG. 19b is a drawing for explaining a scroll operation when receiving a user input through an external area of ​​an application execution screen in a landscape mode of an electronic device according to one embodiment.

[0050] FIG. 19c is a drawing for explaining a scroll operation when receiving a user input through an internal area of ​​an application execution screen in a landscape mode of an electronic device according to one embodiment.

[0051] FIG. 20 is a drawing for explaining an operation of generating an application screen based on the shape of a display of an external electronic device in an electronic device according to one embodiment.

[0052] FIG. 1 is a block diagram of an electronic device (101) within a network environment (100), according to one embodiment. Referring to FIG. 1 , in the network environment (100), the electronic device (101) may communicate with the electronic device (102) via a first network (198) (e.g., a short-range wireless communication network), or may communicate with at least one of the electronic device (104) or the server (108) via a second network (199) (e.g., a long-range wireless communication network). In one embodiment, the electronic device (101) may communicate with the electronic device (104) via the server (108). According to one embodiment, the electronic device (101) may include a processor (120), a memory (130), an input module (150), an audio output module (155), a display module (160), an audio module (170), a sensor module (176), an interface (177), a connection terminal (178), a haptic module (179), a camera module (180), a power management module (188), a battery (189), a communication module (190), a subscriber identification module (196), or an antenna module (197). In some embodiments, the electronic device (101) may omit at least one of these components (e.g., the connection terminal (178)), or may have one or more other components added. In some embodiments, some of these components (e.g., the sensor module (176), the camera module (180), or the antenna module (197)) may be integrated into one component (e.g., the display module (160)).

[0053] The processor (120) may, for example, execute software (e.g., a program (140)) to control at least one other component (e.g., a hardware or software component) of the electronic device (101) connected to the processor (120) and perform various data processing or operations. According to one embodiment, as at least a part of the data processing or operations, the processor (120) may store commands or data received from other components (e.g., a sensor module (176) or a communication module (190)) in a volatile memory (132), process the commands or data stored in the volatile memory (132), and store result data in a non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., a central processing unit or an application processor) or an auxiliary processor (123) (e.g., a graphics processing unit, a neural processing unit (NPU), an image signal processor, a sensor hub processor, or a communication processor) that can operate independently or together with the main processor (121). For example, when the electronic device (101) includes the main processor (121) and the auxiliary processor (123), the auxiliary processor (123) may be configured to use less power than the main processor (121) or to be specialized for a given function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as a part thereof.

[0054] The auxiliary processor (123) may control at least a portion of functions or states associated with at least one component (e.g., a display module (160), a sensor module (176), or a communication module (190)) of the electronic device (101), for example, on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. In one embodiment, the auxiliary processor (123) (e.g., an image signal processor or a communication processor) may be implemented as a part of another functionally related component (e.g., a camera module (180) or a communication module (190)). In one embodiment, the auxiliary processor (123) (e.g., a neural network processing unit) may include a hardware structure specialized for processing artificial intelligence models. The artificial intelligence models may be generated through machine learning. This learning can be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or can be performed through a separate server (e.g., server (108)). The learning algorithm can include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model can include multiple artificial neural network layers.The artificial neural network may be one of a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to, or alternatively to, a hardware structure, an artificial intelligence model may include a software structure.

[0055] The memory (130) can store various data used by at least one component (e.g., processor (120) or sensor module (176)) of the electronic device (101). The data can include, for example, software (e.g., program (140)) and input data or output data for commands related thereto. The memory (130) can include volatile memory (132) or non-volatile memory (134).

[0056] The program (140) may be stored as software in the memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).

[0057] The input module (150) can receive commands or data to be used in a component of the electronic device (101) (e.g., a processor (120)) from an external source (e.g., a user) of the electronic device (101). The input module (150) can include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).

[0058] The audio output module (155) can output audio signals to the outside of the electronic device (101). The audio output module (155) can include, for example, a speaker or a receiver. The speaker can be used for general purposes, such as multimedia playback or recording playback. The receiver can be used to receive incoming calls. In one embodiment, the receiver can be implemented separately from the speaker or as part of the speaker.

[0059] The display module (160) can visually provide information to an external party (e.g., a user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling the device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of a force generated by the touch.

[0060] The audio module (170) can convert sound into an electrical signal, or vice versa, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150), output sound through the sound output module (155), or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphone) directly or wirelessly connected to the electronic device (101).

[0061] The sensor module (176) can detect the operating status (e.g., power or temperature) of the electronic device (101) or the external environmental status (e.g., user status) and generate an electrical signal or data value corresponding to the detected status. According to one embodiment, the sensor module (176) can include, for example, a gesture sensor, a gyro sensor, a barometric pressure sensor, a magnetic sensor, an acceleration sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biometric sensor, a temperature sensor, a humidity sensor, or an illuminance sensor.

[0062] The interface (177) may support one or more designated protocols that may be used to directly or wirelessly connect the electronic device (101) with an external electronic device (e.g., the electronic device (102)). In one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.

[0063] The connection terminal (178) may include a connector through which the electronic device (101) may be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).

[0064] The haptic module (179) can convert electrical signals into mechanical stimuli (e.g., vibration or movement) or electrical stimuli that a user can perceive through tactile or kinesthetic sensations. According to one embodiment, the haptic module (179) can include, for example, a motor, a piezoelectric element, or an electrical stimulation device.

[0065] The camera module (180) can capture still images and videos. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.

[0066] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented as, for example, at least a part of a power management integrated circuit (PMIC).

[0067] A battery (189) may power at least one component of the electronic device (101). In one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.

[0068] The communication module (190) may support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between the electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may operate independently from the processor (120) (e.g., application processor) and may include one or more communication processors that support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., a cellular communication module, a short-range wireless communication module, or a global navigation satellite system (GNSS) communication module) or a wired communication module (194) (e.g., a local area network (LAN) communication module, or a power line communication module). Among these communication modules, the corresponding communication module can communicate with an external electronic device (104) via a first network (198) (e.g., a short-range communication network such as Bluetooth, wireless fidelity (WiFi) direct, or infrared data association (IrDA)) or a second network (199) (e.g., a long-range communication network such as a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules can be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can verify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) by using subscriber information (e.g., an international mobile subscriber identity (IMSI)) stored in the subscriber identification module (196).

[0069] The wireless communication module (192) can support 5G networks and next-generation communication technologies following the 4G network, such as NR access technology (new radio access technology). The NR access technology can support high-speed transmission of high-capacity data (eMBB (enhanced mobile broadband)), minimization of terminal power and connection of multiple terminals (mMTC (massive machine type communications)), or high reliability and low latency (URLLC (ultra-reliable and low-latency communications)). The wireless communication module (192) can support, for example, a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate. The wireless communication module (192) can support various technologies for securing performance in a high-frequency band, such as beamforming, massive multiple-input and multiple-output (MIMO), full dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), an external electronic device (e.g., the electronic device (104)), or a network system (e.g., the second network (199)). According to one embodiment, the wireless communication module (192) can support a peak data rate (e.g., 20 Gbps or more) for eMBB realization, a loss coverage (e.g., 164 dB or less) for mMTC realization, or a U-plane latency (e.g., 0.5 ms or less for downlink (DL) and uplink (UL), or 1 ms or less for round trip) for URLLC realization.

[0070] The antenna module (197) can transmit or receive signals or power to or from an external device (e.g., an external electronic device). In one embodiment, the antenna module (197) may include an antenna including a radiator formed of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). In one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as the first network (198) or the second network (199), may be selected from the plurality of antennas, for example, by the communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device via the at least one selected antenna. In some embodiments, in addition to the radiator, another component (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as a part of the antenna module (197).

[0071] In one embodiment, the antenna module (197) may form a mmWave antenna module. In one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent a first side (e.g., a bottom side) of the printed circuit board and capable of supporting a designated high-frequency band (e.g., a mmWave band), and a plurality of antennas (e.g., an array antenna) disposed on or adjacent a second side (e.g., a top side or a side side) of the printed circuit board and capable of transmitting or receiving signals in the designated high-frequency band.

[0072] At least some of the above components can be interconnected and exchange signals (e.g., commands or data) with each other via a communication method between peripheral devices (e.g., a bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)).

[0073] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) via a server (108) connected to a second network (199). Each of the external electronic devices (102 or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations executed in the electronic device (101) may be executed in one or more of the external electronic devices (102, 104, or 108). For example, when the electronic device (101) is to perform a certain function or service automatically or in response to a request from a user or another device, the electronic device (101) may, instead of or in addition to executing the function or service itself, request one or more external electronic devices to perform the function or at least a part of the service. One or more external electronic devices that receive the request may execute at least a portion of the requested function or service, or an additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may process the result as is or additionally and provide it as at least a portion of a response to the request. For this purpose, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used, for example. The electronic device (101) may provide an ultra-low latency service by using distributed computing or mobile edge computing, for example. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server utilizing machine learning and / or a neural network. According to one embodiment, the external electronic device (104) or the server (108) may be included in the second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.

[0074] FIG. 2A is a perspective view of an electronic device (200) in an unfolded state according to an embodiment of the present disclosure. FIG. 2B is a perspective view of an electronic device (200) in an unfolded state according to an embodiment of the present disclosure. FIG. 2A may be a view looking obliquely at one side (e.g., front) of the electronic device (200), and FIG. 2B may be a view looking obliquely at the other side (e.g., rear) of the electronic device (200). Some or all of the components described with reference to FIGS. 2A and 2B may be the same as some or all of the components described with reference to FIG. 1. Some or all of the components described with reference to FIGS. 2A and 2B may be the same as some or all of the components described with reference to FIGS. 3 to 26.

[0075] According to one embodiment, the electronic device (200) may include a housing (201). The electronic device (200) may include a display (202). The housing (201) may form a space in which the display (202) is placed. The display (202) may be a flexible display. At least a portion of the display (202) may be foldable or unfoldable.

[0076] According to one embodiment, the housing (201) may include a first housing (210). The housing (201) may include a second housing (220). The housing (201) may include a third housing (230). The first housing (210) may be disposed between the second housing (220) and the third housing (230). The second housing (220) may be rotatably coupled to the first housing (210). The third housing (230) may be rotatably coupled to the first housing (210). The display (202) may be exposed through a first portion of the first housing (210), a second portion of the second housing (220), and a third portion of the third housing (230). The display (202) may include a first display area (202a) corresponding to the first housing (210), a second display area (202b) corresponding to the second housing (220), and a third display area (202c) corresponding to the third housing (230).

[0077] According to one embodiment, the electronic device (200) may include a support (240, 250, 260). The support (240, 250, 260) may be disposed between the housing (201) and the display (202). The support (240, 250, 260) may be coupled to the housing (201) and may support the display (202). The support (240, 250, 260) may be disposed to surround an edge of the display (202). The support (240, 250, 260) may extend along the perimeter of the housing (201). The supports (240, 250, 260) may include a first support (240) disposed in the first housing (210), a second support (250) disposed in the second housing (220), and a third support (260) disposed in the third housing (230). The supports (240, 250, 260) may be referred to as a “body”. The supports (240, 250, 260) may be referred to as a “frame”. The supports (240, 250, 260) may be referred to as a “sealing member”. The supports (240, 250, 260) may be referred to as a “peripheral part”. The supports (240, 250, 260) may be referred to as a "circumferential part". The supports (240, 250, 260) may be referred to as a "peripheral structure". The supports (240, 250, 260) may be referred to as a "circumferential structure".

[0078] According to one embodiment, the support (240, 250, 260) may include a first support (240). The first support (240) may be disposed between the first housing (210) and the display (202). The first support (240) may be disposed along an edge of the first housing (210). The first support (240) may include a first-first support (241) and a first-second support (242). At least a portion of the display (202) may be disposed between the first-first support (241) and the first-second support (242). The first-first support (241) may be disposed at one end of the first housing (210), and the first-second support (242) may be disposed at the other end of the first housing (210). The support (240, 250, 260) may include a non-conductive member. The support (240, 250, 260) may be referred to as a “deco” or “finishing member” or “non-conductive member”.

[0079] According to one embodiment, the support (240, 250, 260) may include a second support (250). The second support (250) may be disposed between the second housing (220) and the display (202). The second support (250) may be disposed along an edge of the second housing (220). The second support (250) may include a second-first support (251), a second-second support (252), and a second-third support (253). At least a portion of the display (202) may be disposed between the second-second support (252) and the second-third support (253). The second-first support (251) may connect the second-second support (252) and the second-third support (253). The second-first support (251) may extend along an edge of the second housing (220) (e.g., an edge (222) of FIG. 2B). The second-first support (251) may be positioned between the edge (222) of the second housing (220) and the display (202). The second-first support (251) may be referred to as a “support frame” or a “first support frame.” Each of the second-second support (252) and the second-third support (253) may be referred to as a “second support frame.”

[0080] According to one embodiment, the supports (240, 250, 260) may include a third support (260). The third support (260) may be disposed between the third housing (230) and the display (202). The third support (260) may be disposed along an edge of the third housing (230). The third support (260) may include a third-first support (261), a third-second support (262), and a third-third support (263). At least a portion of the display (202) may be disposed between the third-second support (262) and the third-third support (263). The third-first support (261) may connect the third-second support (262) and the third-third support (263). The third-first support (261) may extend along an edge of the third housing (230) (e.g., edge (232) of FIG. 2B). The third-first support (261) may be positioned between the edge (232) of the third housing (230) and the display (202). The third-first support (261) may be referred to as a “support frame” or a “first support frame.” Each of the third-second support (262) and the third-third support (263) may be referred to as a “second support frame.”

[0081] According to one embodiment, the first housing (210) may include a first-first side portion (211) and a first-second side portion (212). The side portions may be referred to as “edges.” The first-first side portion (211) and the first-second side portion (212) may each form opposite sides of the first housing (210). The second housing (220) may be coupled with the first-first side portion (211). The third housing (230) may be coupled with the first-second side portion (212). The first-first side portion (211) may be referred to as a “first coupling portion.” The first-second side portion (212) may be referred to as a “second coupling portion.” The first-first side portion (211) may be referred to as a “first side portion.” The first-second side portion (212) may be named “second side portion”.

[0082] According to one embodiment, the second housing (220) may include a second-first side portion (221) and a second-second side portion (222). The second-first side portion (221) and the second-second side portion (222) may each form opposite sides of the second housing (220). The second-first side portion (221) may be coupled to the first housing (210). The second-second side portion (222) may form a side of the housing (201). The second-first side portion (221) may be referred to as a “third side portion.” The second-second side portion (222) may be referred to as a “fourth side portion.”

[0083] According to one embodiment, the electronic device (200) may include a cover display (203). The second housing (220) may form a space in which the cover display (203) is placed. For example, the cover display (203) may be placed between the second-first side portion (221) and the second-second side portion (222). The cover display (203) may be a flat display.

[0084] According to one embodiment, the second housing (220) may be arranged so that one side surrounds an edge of a portion of the display (202) and the other side surrounds an edge of the cover display (203). The electronic device (200) may include an internal space of the second housing (220) formed by surrounding the second housing (220) with one side being the cover display (203), the other side parallel to the one side being a portion of the display (202), and the side including a second-first side portion (221) and a second-second side portion (222).

[0085] According to one embodiment, a camera may be placed in one area of ​​the cover display (203).

[0086] According to one embodiment, the third housing (230) may include a third-first side portion (231) and a third-second side portion (232). The third-first side portion (231) and the third-second side portion (232) may each form opposite sides of the third housing (230). The third-first side portion (231) may be coupled to the first housing (210). The third-second side portion (232) may form a side of the housing (201). The third-second side portion (232) may be referred to as an “edge.” The third-first side portion (231) may be referred to as a “fifth side portion.” The third-second side portion (232) may be referred to as a “sixth side portion.”

[0087] According to one embodiment, a cover display may be further arranged in the space formed by the third housing (230). For example, the cover display may be arranged between the third-first side portion (231) and the third-second side portion (232). The cover display may be a flat display.

[0088] According to one embodiment, the electronic device (200) may include a first hinge (e.g., the first hinge (270) of FIG. 3) and a second hinge (e.g., the second hinge (280) of FIG. 3). The first hinge (270) may be disposed between the first housing (210) and the second housing (220). The first hinge (270) may be disposed between the first-first side portion (211) and the second-first side portion (221). The first hinge (270) may rotatably connect the first housing (210) and the second housing (220). The second hinge (280) may be disposed between the first housing (210) and the third housing (230). The second hinge (280) may be positioned between the first-second side portion (212) and the third-first side portion (231). The second hinge (280) may rotatably connect the first housing (210) and the third housing (230). The first hinge (270) may be referred to as a “first hinge member.” The second hinge (280) may be referred to as a “second hinge member.”

[0089] FIG. 3 is a perspective view of an electronic device (200) in a folded state according to an embodiment of the present disclosure. The components described with reference to FIG. 3 may be partially or entirely identical to the components described with reference to FIGS. 1 to 2B. The components described with reference to FIG. 3 may be partially or entirely identical to the components described with reference to FIGS. 4A to 26.

[0090] According to one embodiment, the second housing (220) can be rotated with respect to the first housing (210). The first hinge (270) can provide a center of rotation to the second housing (220). The first hinge (270) can connect the first-first side portion (211) and the second-first side portion (221). The third housing (230) can be rotated with respect to the first housing (210). The second hinge (280) can provide a center of rotation to the third housing (230). The second hinge (280) can connect the first-second side portion (212) and the third-first side portion (231).

[0091] According to one embodiment, when the electronic device (200) is folded, each of the first, second, and third housings (210, 220, 230) may be arranged in one direction (e.g., the +Z direction). For example, the third housing (230) may be arranged on the upper side of the first housing (210), and the second housing (220) may be arranged on the upper side of the third housing (230). For example, the third housing (230) may be arranged between the first housing (210) and the second housing (220).

[0092] According to one embodiment, the edge (222) of the second housing (220) may be an area of ​​the second housing (220) where the screen of the flexible display (202) overlaps with a portion that is not visible from the outside of the housing (e.g., the second housing (220)) when the flexible display (202) is viewed in a screen display direction (e.g., +Z direction). For example, the edge (222) of the second housing (220) may include a bezel portion of the second housing (220).

[0093] According to one embodiment, the externally visible portion of the second housing (220) may further include a cover display (203). For example, the cover display (203) may be positioned between the 2-1 side portion (221) and the 2-2 side portion (222). The cover display (203) may be a flat display.

[0094] The width of the first hinge (270) may be greater than the width of the second hinge (280). For example, the length of the first hinge (270) extended in the +Z direction may be greater than the length of the second hinge (280) extended in the +Z direction.

[0095] FIG. 4A is a drawing of an electronic device according to an embodiment in a partially folded state. The components described with reference to FIG. 4A may be partially or entirely the same as the components described with reference to FIGS. 1 to 3. The components described with reference to FIG. 4A may be partially or entirely the same as the components described with reference to FIGS. 5 to 26. FIG. 4A illustrates a half-folded state in which only one hinge (e.g., a second hinge (280)) is completely folded and the other hinge (e.g., a first hinge (270)) is completely unfolded.

[0096] According to one embodiment, the third housing (230) can be rotated relative to the first housing (210). The second hinge (280) can provide a center of rotation to the third housing (230). As illustrated in FIG. 4A, when the second hinge (280) is fully folded, the third housing (230) can be positioned on the upper side of the first housing (210).

[0097] According to one embodiment, the second housing (220) can be rotated relative to the first housing (210). The first hinge (270) can provide a center of rotation to the second housing (220). As illustrated in FIG. 4A, when the first hinge (270) is fully extended, the second housing (220) can be arranged parallel to the first housing (210). For example, the first housing (210) can be arranged parallel to the +X direction of the second housing (220).

[0098] According to one embodiment, a third housing (230) is disposed on the upper side of the first housing (210), and a second housing (220) is disposed parallel to the first housing (210), so that only the second display area (202b) disposed in the second housing among the displays (202) is exposed to the outside, and the rear side of the third housing (230) where the display (202) is not disposed can be exposed to the outside.

[0099] FIG. 4B is a drawing of an electronic device according to an embodiment in a partially folded state. The components described with reference to FIG. 4B may be partially or entirely the same as the components described with reference to FIGS. 1 to 4A. The components described with reference to FIG. 4B may be partially or entirely the same as the components described with reference to FIGS. 5 to 26. FIG. 4B illustrates an electronic device (200) that may be in a semi-folded state in which a plurality of hinges (e.g., a first hinge (270) and a second hinge (280)) have angles within a specific range. For example, a state in which a plurality of hinges are folded to have angles within a specific range may be referred to as a prism state. According to an embodiment, as illustrated in FIG. 4B, when a plurality of hinges of an electronic device in a prism state are all arranged parallel to the X-axis or parallel to the Y-axis, the state may be referred to as a prism flex. In one embodiment, if a plurality of hinges of an electronic device in a prism state are all arranged parallel to the Z-axis, the device may be referred to as a prism stand. For example, if a plurality of hinges of an electronic device in a prism state are all arranged parallel to the Z-axis, the device may be referred to as a prism stand.

[0100] As illustrated in FIG. 4b, when the first hinge (270) providing a center of rotation to the second housing (220) with respect to the first housing (210) is folded to have an angle within a specific range, and the second hinge (280) providing a center of rotation to the third housing (230) with respect to the first housing (210) is folded to have an angle within a specific range, the first housing (210), the second housing (220), and the third housing (230) can form a triangle in the +Y direction and / or the -Y direction.

[0101] In one embodiment, the display (202) can be folded to have a triangular prism-shaped space, and the cover display (203) can be positioned facing the front (e.g., +Y direction). In one embodiment, one side of the third housing (230) where the display (202) is not positioned can be in contact with the floor surface.

[0102] FIG. 5 is a drawing for explaining an electronic device that folds in a different manner from FIGS. 3 and 4a.

[0103] Referring to FIG. 5, when the electronic device (e.g., the electronic device (101) of FIG. 1, the electronic device (200) of FIG. 2A, or the electronic device (200) of FIG. 2B) is folded, each of the first, second, and third housings (210, 220, 230) may be arranged in one direction. For example, the second housing (220) may be arranged on the upper side of the third housing (230), and the first housing (210) may be arranged on the upper side of the second housing (220). For example, the second housing (220) may be arranged between the first housing (210) and the third housing (230).

[0104] According to one embodiment, the externally visible portion of the first housing (210) may further include a cover display (203). For example, the cover display (203) may be a flat display.

[0105] In one embodiment, the width of the second hinge (280) (e.g., the second hinge (280) of FIG. 2b) may be greater than the width of the first hinge (270) (e.g., the first hinge (270) of FIG. 2b).

[0106] In one embodiment, the electronic device may be in a half-folded state, where only one hinge (e.g., the first hinge (270)) is fully folded and the other hinge (e.g., the second hinge (280)) is fully unfolded, based on the first unfolding. For example, the first unfolding may be unfolding the second hinge.

[0107] According to one embodiment, the second housing (220) can be rotated relative to the first housing (210). The first hinge (270) can provide a center of rotation to the second housing (220). As illustrated in FIG. 5, when the first hinge (270) is fully folded, the second housing (220) can be positioned on the upper side of the first housing (210).

[0108] According to one embodiment, the third housing (230) can be rotated relative to the first housing (210). The second hinge (280) can provide a center of rotation to the third housing (230). As illustrated in FIG. 5, when the second hinge (280) is fully extended, the third housing (230) can be positioned parallel to the first housing (210).

[0109] According to one embodiment, the second housing (220) is disposed on the upper side of the first housing (210), and the third housing (230) is disposed parallel to the first housing (210), so that only the third display area (202c) disposed in the third housing among the displays (202) is exposed to the outside, and the rear side of the first housing (210) where the display (202) is not disposed can be exposed to the outside.

[0110] According to one embodiment, the electronic device may be in a fully-unfolded state with two hinges (e.g., a first hinge (270) and a second hinge (280)) based on secondary unfolding. For example, the secondary unfolding may be unfolding the folded first hinge while the second hinge is in an unfolded state.

[0111] In one embodiment, when the electronic device is fully unfolded, the first housing (210), the second housing (220), and the third housing (230) are arranged side by side, and the entire display (202) can be exposed to the outside.

[0112] FIG. 6 is a flowchart for explaining an operation of displaying an application execution screen in portrait mode displayed on a display of an electronic device according to one embodiment of the present invention as an application execution screen in landscape mode.

[0113] Referring to FIG. 6, in operation 610, a foldable electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, the electronic device (200) of FIG. 2A, or the electronic device (200) of FIG. 2B) (hereinafter referred to as the “electronic device”) may determine whether an application supporting a first execution screen of a first aspect ratio greater than the horizontal length supports a second execution screen of a second aspect ratio different from the first aspect ratio. According to an embodiment, the execution screen of the first aspect ratio may be a portrait mode screen in which the vertical length is longer than the horizontal length, and the execution screen of the second aspect ratio may be a portrait mode screen of a different ratio from the first aspect ratio or a landscape mode screen in which the horizontal length is longer than the vertical length.

[0114] According to one embodiment, the application's execution screen may include a plurality of objects, and the plurality of objects may be associated with at least one content. For example, the plurality of objects may include a first object corresponding to a first content, and a second object corresponding to a second content.

[0115] In one embodiment, the execution screen of the second aspect ratio may differ from the execution screen of the first aspect ratio in the number and / or layout of the plurality of objects.

[0116] In one embodiment, the electronic device can determine whether the application can process a transition from a screen with a first aspect ratio to a screen with a second aspect ratio. In one embodiment, the electronic device can determine whether an application that supports a screen with a first aspect ratio also supports a screen with a second aspect ratio based on the application's installation on the electronic device. For example, the electronic device can determine whether the application can process a transition from a screen with a first aspect ratio to a screen with a second aspect ratio based on application information received during application installation.

[0117] According to one embodiment, the electronic device may determine at least one of whether the application is fixed to a screen with a first aspect ratio, whether the application can detect changes in the orientation of the display due to rotation of the electronic device or changes in the screen layout, screen size, content density, or screen orientation due to changes in an activated display among multiple displays, or whether the application's screen resizable function is limited, based on information about the application (e.g., AndroidManifest). According to one embodiment, if it is determined that the application is fixed to the first aspect ratio, cannot detect changes in the screen, or has limited screen resizable function, the electronic device may determine that the application does not support a screen with a second aspect ratio. According to one embodiment, if it is determined that the application is not fixed to the first aspect ratio, can detect changes in the screen, and has not limited screen resizable function, the electronic device may determine that the application supports a screen with a second aspect ratio.

[0118] In one embodiment, if the electronic device is bar-shaped, the electronic device can check whether the application supports switching between a portrait mode screen and a landscape mode screen by rotating the electronic device.

[0119] According to one embodiment, when the electronic device is a foldable device including one hinge structure or a multi-foldable device including a plurality of hinge structures, the electronic device can check whether switching between a screen in portrait mode and a screen in landscape mode by rotation of the electronic device is supported and whether switching between a screen in portrait mode and a screen in landscape mode is supported by changing between a second display (or cover display) (e.g., a display module (160) of FIG. 1 or a cover display (203) of FIG. 2B) and a first display (or a flexible display) (e.g., a display module (160) of FIG. 1 or a display (202) of FIG. 2A) that is activated depending on a folding state of the electronic device.

[0120] In one embodiment, when the electronic device is a foldable device, the electronic device may include a foldable housing including a first housing part having a first side and a second side opposite the first side, and a second housing part having a third side and a fourth side opposite the third side. In one embodiment, the electronic device may include a hinge structure rotatably connecting the first housing and the second housing. In one embodiment, the electronic device may include a first display including a first display area disposed on the first side of the first housing part and a second display area disposed on the third side of the second housing part. In one embodiment, the electronic device may include a second display disposed on the second side of the first housing part.

[0121] In one embodiment, the first state may be a folded state of the electronic device. In one embodiment, the second state may be an unfolded state of the electronic device.

[0122] In one embodiment, when the electronic device is a multi-foldable device, the electronic device may include a foldable housing including a first housing part having a first surface and a second surface opposite the first surface, a second housing part having a third surface and a fourth surface opposite the third surface, and a third housing part having a fifth surface and a sixth surface opposite the fifth surface. In one embodiment, the electronic device may include a first hinge structure rotatably connecting the first housing and the second housing, and a second hinge structure rotatably connecting the first housing and the third housing. According to one embodiment, the electronic device may include a first display including a first display area disposed on the first surface of the first housing part, a second display area disposed on the third surface of the second housing part, and a third display area disposed on the fifth surface of the third housing part. According to one embodiment, the electronic device may include a second display disposed on at least one of the second surface of the first housing part or the fourth surface of the second housing part.

[0123] In one embodiment, the first state may be a folded state of the electronic device. In one embodiment, the second state may be an unfolded state of the electronic device.

[0124] According to one embodiment, in operation 620, the electronic device may display a first execution screen of an application through a second display (e.g., the display module (160) of FIG. 1, the display (202) of FIG. 2A, or the cover display (203) of FIG. 2B) in a first state in which the electronic device is in a folded state (or a folded state).

[0125] In one embodiment, as part of the operation of displaying the first execution screen, the electronic device may, in a first state, display the first execution screen of the application through the second display (or cover display). In one embodiment, the first state is a state in which the electronic device is folded, and the electronic device may display the first execution screen in portrait mode.

[0126] In one embodiment, the electronic device may display a first execution screen of an application on the second display based on a user input when the folding state of the electronic device is in a first state in which the second display is activated.

[0127] According to one embodiment, the first state in which the second display is activated may be a fully folded state of the electronic device as illustrated in FIG. 3 or FIG. 5, or a prism state in which multiple hinges are folded at a specific angle as illustrated in FIG. 4b.

[0128] In one embodiment, the electronic device may display a first execution screen of an application on the second display based on a user input while the second display is in a first state in which the second display is activated. For example, the electronic device may display an execution screen of a message application, a camera application, a photo album application, a note application, or a browser application on the second display based on a user input selecting an icon displayed on the second display.

[0129] According to one embodiment, the electronic device may display a first execution screen including a first portion of the first content on a second display based on the electronic device being in a first state.

[0130] According to one embodiment, the electronic device may display a first execution screen including second content on a second display based on the electronic device being in a first state.

[0131] In one embodiment, if the electronic device is bar-shaped, the first state is a state in which the long side of the electronic device is upright, and the electronic device can display a first execution screen in portrait mode. In one embodiment, if the electronic device includes a single display, the first display and the second display may be the same display but with different aspect ratios depending on the rotation.

[0132] According to one embodiment, in operation 630, while the electronic device displays the first execution screen of the application through the second display, the electronic device may detect that the state of the electronic device has changed from the first state to the second state, which is the unfolded state, based on a sensing value of a sensor (e.g., the sensor module (176) of FIG. 1).

[0133] According to one embodiment, the electronic device can determine the folding state of the electronic device based on the sensing value of the sensor.

[0134] In one embodiment, the sensor is disposed on at least one of the housing parts and may include an inertial sensor, an acceleration sensor, and / or a Hall sensor capable of detecting orientation, rotation, and / or folding of the housing parts.

[0135] According to one embodiment, the electronic device can obtain an angle between the housing parts based on the orientation and / or degree of rotation of the housing parts. According to one embodiment, the electronic device can determine a folding state of the electronic device based on the angle between the housing parts.

[0136] In one embodiment, the sensor may include a Hall sensor and / or a proximity sensor capable of detecting the distance between the housing parts. In one embodiment, the electronic device may determine the folding state of the electronic device based on the distance between the housing parts.

[0137] In one embodiment, when the electronic device is a foldable device or a multi-foldable device, the electronic device may determine, based on a sensing value of a sensor, that the electronic device has changed from a first state, in which the electronic device is folded, to a second state, in which the electronic device is unfolded. In one embodiment, the second state may be a state in which the second display is deactivated and the first display is activated, upon unfolding of the electronic device.

[0138] In one embodiment, when the electronic device is in the form of a bar, the electronic device can determine, based on the sensing value of the sensor, that the electronic device changes from a first state in which the long side of the electronic device is upright to a second state in which the short side of the electronic device is upright by rotation.

[0139] In one embodiment, in operation 640, the electronic device may generate a second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen based on the application not supporting a second execution screen of the second aspect ratio.

[0140] In one embodiment, the electronic device may generate a second execution screen without transmitting state change information of the electronic device to the application based on the application not supporting the second execution screen.

[0141] According to one embodiment, an electronic device may store an artificial intelligence model trained to obtain, as input data, a screen of a first aspect ratio including a plurality of objects and a screen of a second aspect ratio in which the positions of the plurality of objects included in the screen of the first aspect ratio are different, in a memory (e.g., memory (130) of FIG. 1).

[0142] According to one embodiment, the electronic device can use a first execution screen as input data of an artificial intelligence model and obtain a second execution screen generated as output data of the artificial intelligence model.

[0143] According to one embodiment, the operation of training an artificial intelligence model to obtain a second execution screen based on a first execution screen will be described in more detail with reference to FIGS. 11 and 12 below.

[0144] According to one embodiment, the electronic device may generate a second execution screen by checking the attributes of each of a plurality of objects included in a first execution screen and rearranging the plurality of objects based on the attributes. For example, the attributes of an object may include at least one of the object's classification (e.g., text, image, or a combination of text and image), the object's location, or the object's identification information (ID).

[0145] According to one embodiment, the electronic device may analyze the layout of a first execution screen corresponding to a first state and reconfigure the layout to generate a second execution screen corresponding to a second state.

[0146] According to one embodiment, the operation of generating a second execution screen based on the properties of objects included in the first execution screen will be described in more detail with reference to FIGS. 13, 14a, 14b, 15a, 15b, 15c, and 15d.

[0147] In one embodiment, the electronic device may transmit state change information of the electronic device to the application based on whether the application supports a second execution screen. In one embodiment, the application may generate a second execution screen based on receiving the state change information.

[0148] In one embodiment, in operation 650, the electronic device may display the generated second execution screen on at least a portion of the first display.

[0149] In one embodiment, the electronic device may display the second execution screen on at least a portion of the first display by maintaining the execution of the application as part of the operation of displaying the second execution screen. In one embodiment, the electronic device may display the second execution screen on at least a portion of the first display without re-executing the application as the second display switches to the first display.

[0150] By performing display switching without re-executing the application in this way, the problem of having to re-receive user input due to the application being re-executed when the display is switched can be reduced.

[0151] According to one embodiment, when the first execution screen includes the first content, the electronic device may, based on the second state, display a second execution screen including a first portion and a second portion of the first content on at least a portion of the first display. According to one embodiment, when the first execution screen includes the second content, the electronic device may, based on the second state, display the second content and a control button related to the second content on at least a portion of the first display. In this way, in the second state, the electronic device may display a second execution screen including more content than the first execution screen.

[0152] In one embodiment, when the electronic device is a multi-foldable device, the second execution screen may be displayed on at least two display areas among the first display area, the second display area, and the third display area based on the folding state of the electronic device.

[0153] For example, the electronic device can detect a first angle between the first housing part and the second housing part in the second state and a second angle between the first housing part and the third housing part.

[0154] According to one embodiment, based on one of the first angle and the second angle being within a first range corresponding to an unfolded state and the other being within a second range corresponding to a semi-folded state, a second execution screen can be displayed on two display areas corresponding to two housing parts having angles within the first range among the first display area, the second display area, and the third display area.

[0155] In one embodiment, based on the angle of two housing parts having an angle within a second range being changed to be included within a first range, the electronic device can rearrange a plurality of objects included in the second execution screen to generate a third execution screen having a longer horizontal length than the second execution screen, and display the third execution screen in the first display area, the second display area, and the third display area.

[0156] According to one embodiment, an operation of gradually displaying a second execution screen, which is a screen in landscape mode, and a third execution screen, which has a longer horizontal length than the second execution screen, based on the stepwise unfolding of the electronic device will be described in more detail with reference to FIGS. 17a, 17b, 17c, and 18 below.

[0157] According to one embodiment, the electronic device can display a second execution screen in the first display area, the second display area, and the third display area based on the first angle and the second angle being within a first range corresponding to an unfolded state.

[0158] Hereinafter, it is described that a first execution screen, which is a screen in portrait mode, is displayed on a second display of an electronic device, and a second execution screen, which is a screen in landscape mode, is displayed on the first display of the electronic device based on unfolding of the electronic device. However, this is not limited thereto, and the operations described below may also be applied to an operation in which a screen in portrait mode is displayed on an electronic device and then switched to a screen in landscape mode according to the rotation of the electronic device.

[0159] FIG. 7 is a drawing for explaining an operation of displaying an application execution screen in portrait mode displayed on a display of an electronic device according to one embodiment of the present invention as an application execution screen in landscape mode.

[0160] Referring to FIG. 7, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, the electronic device (200) of FIG. 2A, or the electronic device (200) of FIG. 2B) may display a first execution screen (710) of an application on a second display (or cover display) (e.g., the display module (160) of FIG. 1 or the cover display (203) of FIG. 2B) in a first state in which the electronic device is folded. According to one embodiment, the first execution screen (710) may be a screen in portrait mode.

[0161] According to one embodiment, when the folding state of the electronic device changes from a first state to an unfolded second state, the electronic device may display a second execution screen (720) of an application on a first display (or flexible display) (e.g., the display module (160) of FIG. 1 or the display (202) of FIG. 2A). According to one embodiment, the second execution screen (720) may be a screen in landscape mode.

[0162] According to one embodiment, the second execution screen (720) may be generated by the application or may be generated by the electronic device. According to one embodiment, the operation of switching from the first execution screen (710) in portrait mode of the electronic device to the second execution screen (720) in landscape mode will be described in more detail below with reference to FIG. 8.

[0163] FIG. 8 is a flowchart illustrating an operation of displaying an application execution screen in landscape mode according to whether or not the application supports a landscape mode execution screen in an electronic device according to one embodiment.

[0164] Referring to FIG. 8, in operation 810, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, the electronic device (200) of FIG. 2A, or the electronic device (200) of FIG. 2B) may detect a change in a folding state. According to one embodiment, the electronic device may detect a change in a folding state, such as when the electronic device is unfolded, while the electronic device is displaying a first execution screen of an application on a second display (or cover display) (e.g., the display module (160) of FIG. 1 or the cover display (203) of FIG. 2B) activated in a first state in which the electronic device is folded.

[0165] According to one embodiment, the electronic device may deactivate the second display and activate the first display (or flexible display) (e.g., the display module (160) of FIG. 1 or the display (202) of FIG. 2A) based on a change in the folding state of the electronic device. According to one embodiment, the electronic device may determine that a long landscape mode execution screen is required based on the activation of the first display.

[0166] In one embodiment, in operation 820, the electronic device may determine whether the application supports landscape mode.

[0167] According to one embodiment, the electronic device may determine at least one of whether the application is fixed to a portrait mode screen, whether the application can detect changes in the display orientation due to the rotation of the electronic device or changes in the screen layout, screen size, content density, or screen orientation due to changes in the active display among multiple displays, or whether the application's screen resizable function is limited, based on information about the application (e.g., AndroidManifest). According to one embodiment, if it is determined that the application is fixed to a portrait mode screen, cannot detect changes in the screen, or has limited resizable function, the electronic device may determine that the application does not support a landscape mode screen. According to one embodiment, if it is determined that the application is not fixed to a portrait mode screen, can detect changes in the screen, and has not limited resizable function, the electronic device may determine that the application supports a landscape mode screen.

[0168] In one embodiment, if the electronic device is bar-shaped, the electronic device can check whether the application supports switching between a portrait mode screen and a landscape mode screen by rotating the electronic device.

[0169] In one embodiment, if the application supports landscape mode (operation 820 - yes), in operation 830, the electronic device may transmit folding state change information to the application.

[0170] According to one embodiment, the electronic device may transmit information about at least a portion of an activated first display area to an application based on a change in the folding state of the electronic device. For example, if at least two display areas among the first display area, the second display area, and the third display area of ​​the first display of the electronic device are activated, the electronic device may transmit information about the at least two activated display areas to the application.

[0171] In one embodiment, in operation 840, the electronic device may receive a landscape mode screen from the application. In one embodiment, the electronic device may receive a second landscape mode execution screen generated by the application from the application. In one embodiment, the second execution screen may be generated based on information about at least two activated display areas.

[0172] In one embodiment, if the application does not support landscape mode (action 820 - No), then in action 850, the electronic device can generate a screen in landscape mode.

[0173] In one embodiment, the electronic device may not transmit information about the change in folding state to the application if the application does not support a landscape mode screen. In one embodiment, the electronic device may analyze a plurality of objects included in the first execution screen and generate a second execution screen by rearranging the plurality of objects.

[0174] In one embodiment, in operation 860, the electronic device may display a screen in landscape mode. In one embodiment, the electronic device may display a screen in landscape mode that it has generated or a screen in landscape mode received from an application on at least a portion of the first display.

[0175] FIG. 9 is a drawing illustrating an operation of generating an execution screen of an application in landscape mode by reflecting a screen transition history performed through an execution screen of an application in portrait mode in an electronic device according to one embodiment.

[0176] Referring to FIG. 9, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, an electronic device (200) of FIG. 2A, or an electronic device (200) of FIG. 2B) can display an initial screen (910) of an application on a second display (or cover display) (e.g., a display module (160) of FIG. 1 or a cover display (203) of FIG. 2B).

[0177] According to one embodiment, the electronic device may display the first execution screen (930) after performing at least one screen transition process (920) through a user input. For example, the electronic device may display the first execution screen (930) on the second display after performing at least one screen transition process (920) through the second display through a touch input and / or text input for displaying additional information, security authentication, and / or searching.

[0178] According to one embodiment, when the first display (or flexible display) (e.g., the display module (160) of FIG. 1 or the display (202) of FIG. 2A) is activated based on unfolding of the electronic device while the first execution screen (930) is displayed on the second display, the electronic device may display a second execution screen (940) generated based on the first execution screen (930) on the first display.

[0179] For example, the electronic device may display a second execution screen (940) generated by rearranging and / or resizing a plurality of objects included in a first execution screen (930) to fit the size of the activated first display on the first display.

[0180] In this way, when the activated display changes to another display due to unfolding of the electronic device, the execution screen to be displayed after the display change is generated based on the execution screen last displayed before the display change, thereby reducing the inconvenience of having to re-perform the same screen change process due to the screen change process performed before the change not being reflected due to a malfunction in the processing logic for display change.

[0181] FIG. 10 is a drawing for explaining an operation of displaying an application execution screen in landscape mode by applying an animation effect in an electronic device according to one embodiment.

[0182] Referring to FIG. 10, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, an electronic device (200) of FIG. 2A, or an electronic device (200) of FIG. 2B) can display a first execution screen (1010) of an application on a second display (or cover display) (e.g., a display module (160) of FIG. 1 or a cover display (203) of FIG. 2B).

[0183] According to one embodiment, the electronic device can display a second execution screen (1020) identical to the first execution screen (1010) on a third display area (e.g., the third display area (202c) of FIG. 2A) of a first display (or flexible display) (e.g., the display module (160) of FIG. 1 or the display (202) of FIG. 2A) that is activated based on a first unfolding of the electronic device (e.g., unfolding of a third housing part (e.g., the third housing (230) of FIG. 2A or the third housing (230) of FIG. 2B)). According to one embodiment, when the third display area of ​​the first display of the electronic device is activated, the second display can be deactivated.

[0184] According to one embodiment, a first display area (e.g., the first display area (202a) of FIG. 2A) and a second display area (e.g., the second display area (202b) of FIG. 2A) of the first display can be additionally activated based on a secondary unfolding of the electronic device (e.g., unfolding of the second housing (220) of FIG. 2A or the second housing (220) of FIG. 2B).

[0185] According to one embodiment, the electronic device may display a second execution screen (1040) on the entire area of ​​the first display by applying an animation effect when the entire area of ​​the first display is activated. For example, the electronic device may display a screen (1030) including the second execution screen (1020) on a third display area among the entire area of ​​the first display that is activated based on secondary unfolding. According to one embodiment, the electronic device may apply an animation effect (1031) in which a plurality of objects included in the second execution screen (1020) move respectively, and then display a second execution screen (1040) in which a plurality of objects are rearranged on the entire area of ​​the first display.

[0186] This allows the electronic device to reconfigure objects on the running screen based on unfolding of the electronic device by applying animation effects to the movement of objects, and to provide information on where each object has been rearranged.

[0187] FIG. 11 is a drawing for explaining an operation of obtaining an execution screen of an application in landscape mode using an artificial intelligence model of an electronic device according to one embodiment.

[0188] Referring to FIG. 11, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, an electronic device (200) of FIG. 2A, or an electronic device (200) of FIG. 2B) may obtain a reconfigured screen by using a screen reconfiguration artificial intelligence (AI) model (1110) stored in a memory (e.g., a memory (130) of FIG. 1). According to one embodiment, the electronic device may use a sub-display screen (or a cover display screen, a screen in portrait mode, or a second display screen) (1111) as input data of the screen reconfiguration AI artificial intelligence model (1110) to obtain a main display reconfiguration screen (or a reconfiguration screen in landscape mode, a flexible display reconfiguration screen, or a first display reconfiguration screen) (1112) as output data.

[0189] According to one embodiment, the screen reconstruction artificial intelligence model (1110) may be pre-trained through the following process.

[0190] According to one embodiment, the learning process of the screen reconstruction artificial intelligence model may use a data set (1120) including a sub-display screen and a main display screen as input data of a prompt inference artificial intelligence (AI) model (1130), and use the prompt obtained as output data as input data of a screen reconstruction artificial intelligence (AI) model (1140). According to one embodiment, an example of the data set (1120) will be described in more detail below with reference to FIG. 12.

[0191] According to one embodiment, the learning process of the screen reconstruction artificial intelligence model may further use the layout information of the data set (1120) detected through the layout detection unit (1150) as input data of the screen reconstruction artificial intelligence model (1140).

[0192] According to one embodiment, the learning process of the screen reconstruction artificial intelligence model may evaluate the main display reconstruction screen obtained as output data of the screen reconstruction artificial intelligence model (1140) based on the main display screen used as input data through the discriminator (1160). According to one embodiment, the learning process of the screen reconstruction artificial intelligence model may update the parameters of the prompt inference artificial intelligence model (1130) in a direction to lower the loss value, and update the parameters of the screen reconstruction artificial intelligence model (1140) in a direction to lower the loss value, based on the evaluation result by the discriminator (1160).

[0193] According to one embodiment, the learning process of the screen reconstruction artificial intelligence model may be completed by repeating operations 1130 to 1160 using multiple data sets (1120), and when the learning of the screen reconstruction artificial intelligence model (1140) is completed, the final generated prompt may be stored as first metadata (1170).

[0194] According to one embodiment, the screen reconstruction process can obtain the main display reconstruction screen (1112) as output data by applying the first metadata finally stored in the screen reconstruction artificial intelligence model (1110) of the screen reconstruction process, using the sub display screen (1111) as input data.

[0195] Figure 12 is a diagram for explaining learning data used to learn the artificial intelligence model of Figure 11.

[0196] Referring to FIG. 12, a data set (e.g., data set (1120) of FIG. 11) may include screen data (1210, 1220) applicable to each application. For example, the data set may include screen data (1210) applicable to a first application and screen data (1220) applicable to a second application.

[0197] According to one embodiment, the screen data (1210) applied to the first application may include screen data (1211) in portrait mode and screen data (1212) in landscape mode. According to one embodiment, each of the screen data (1211) in portrait mode and the screen data (1212) in landscape mode may form a pair.

[0198] For example, screen data (1210) applied to the first application may include a pair of screen data, a cover display screen, which is a screen in portrait mode, and a main display screen, which is a screen in landscape mode, in the case where the electronic device is a foldable (or multi-foldable) device.

[0199] According to one embodiment, the screen data (1210) applied to the first application may include a pair of screen data of an electronic device (e.g., a smartphone) in a similar environment to a portrait mode and screen data of an electronic device (e.g., a tablet) in a similar environment to a landscape mode. For example, the screen data (1210) applied to the first application may include, as a pair of screen data, an S22 display screen in a portrait mode and a Tab S8 screen in a landscape mode. According to one embodiment, the screen data (1210) applied to the first application may include, as a pair of screen data, an S24 display screen in a portrait mode and a Tab S8 Ultra screen in a landscape mode.

[0200] Figure 13 is a drawing for explaining objects included in the execution screen of the application.

[0201] Referring to FIG. 13, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, an electronic device (200) of FIG. 2A, or an electronic device (200) of FIG. 2B) can analyze a plurality of objects (1311, 1312, 1313) included in an execution screen (1310) of an application. For example, the electronic device can analyze the properties and layout of a plurality of objects (1311, 1312, 1313) included in an execution screen (1310) of an application.

[0202] According to one embodiment, the properties of an object may include at least one of a classification of the object (e.g., text, an image, or a combination of text and an image), a location of the object, or an identification (id) of the object.

[0203] For example, the attributes of the first object (1311) included in the execution screen (1310) of an accommodation reservation application may include an image as classification information (class) and a thumbnail as identification information (id). This allows confirmation that the first object (1311) provides a hotel thumbnail.

[0204] According to one embodiment, the properties of the second object (1312) included in the execution screen (1310) of the accommodation reservation application may include text as classification information and the hotel name as identification information (ID). This confirms that the second object (1312) provides the hotel name.

[0205] According to one embodiment, the properties of the third object (1313) included in the execution screen (1310) of the accommodation reservation application may include text as classification information and a rating as identification information (ID). This confirms that the third object (1313) provides hotel ratings.

[0206] According to one embodiment, the electronic device may use analysis information of the properties and layout of a plurality of objects (1311, 1312, 1313) included in an execution screen (1310) of an application as learning data (e.g., data set (1120) of FIG. 11 or screen data (1210, 1220) of FIG. 12) of a screen reconstruction artificial intelligence model (e.g., screen reconstruction artificial intelligence model (1140) of FIG. 11).

[0207] Figure 14a is a drawing for explaining objects included in the execution screen of an application in portrait mode.

[0208] FIG. 14b is a drawing for explaining objects included in the execution screen of the application in landscape mode corresponding to the execution screen of the application in portrait mode of FIG. 14a.

[0209] According to one embodiment, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, the electronic device (200) of FIG. 2A, or the electronic device (200) of FIG. 2B) may use, during the learning process of a screen reconstruction artificial intelligence model (e.g., the screen reconstruction artificial intelligence model (1140) of FIG. 11), information about a display on which an application's execution screen is displayed, and how the positions of the analyzed layout and objects have changed.

[0210] According to one embodiment, as illustrated in FIG. 14A, the electronic device may acquire an attribute (1412) for a search button (1411), which is one of the objects included in a portrait mode execution screen (or, bar type display screen, cover display screen, sub display screen, or second display screen) (1410). According to one embodiment, the attribute (1412) for the search button (1411) may include identification information (1413) (e.g., search button) of the search button (1411), classification information (1414) (e.g., image), and location information (1415). According to one embodiment, the identification information may include information related to a function that the object is intended to provide. For example, the identification information may include a search bar, a search button, or a search element. According to one embodiment, the classification information may include information related to a type of the object. For example, the classification information may include an image, text, a list, a grid, or a configuration. According to one embodiment, the location information may include information related to the location of the boundary of an object within the execution screen. For example, the location information may include coordinate information of two vertices of the diagonal line of the object boundary (e.g., the lower left and upper right). According to one embodiment, the coordinate information may be acquired with the lower left of the execution screen as the origin.

[0211] According to one embodiment, the electronic device can learn how objects included in a portrait mode execution screen (1410) change when the landscape mode execution screen (or tablet type display screen, main display screen, flexible display screen, or first display screen) (1420) is changed as illustrated in FIG. 14B. According to one embodiment, the electronic device can confirm that a search button (1411) of the portrait mode execution screen (1410) and a search button (1421) included in the landscape mode execution screen (1420) are the same object by recognizing that they are the same image icon. According to one embodiment, the electronic device can determine that the two search buttons (1411, 1421) are the same object based on the attribute information (1412) of the search button (1411) included in the execution screen (1410) in the portrait mode and the attribute information (1422) of the search button (1421) included in the execution screen (1420) in the landscape mode. For example, the electronic device can determine that the two search buttons (1411, 1421) are the same object based on the classification information and / or identification information included in the attribute information (1412, 1422) of the two search buttons (1411, 1421).

[0212] According to one embodiment, the electronic device can learn the location to which the search button is moved based on the location information of the two search buttons (1411, 1421).

[0213] FIG. 15A is a drawing for explaining an operation of rearranging objects included in an execution screen of an electronic device according to one embodiment.

[0214] Referring to FIG. 15A, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, an electronic device (200) of FIG. 2A, or an electronic device (200) of FIG. 2B) can generate a landscape mode execution screen (or a tablet type display screen, a main display screen, a flexible display screen, or a first display screen) (1520) based on a portrait mode execution screen (or a bar type display screen, a cover display screen, a sub display screen, or a second display screen) (1510).

[0215] According to one embodiment, the execution screen (1510) in portrait mode may include a list or grid form in which multiple objects are arranged vertically.

[0216] According to one embodiment, the execution screen (1510) in portrait mode may display an image view (1511) above and include text views (1512) related to the image view (1511) positioned below the image view (1511). For example, if the execution screen (1510) in portrait mode is a execution screen of a news application, the image view (1511) may include a thumbnail of an article, and the text views (1512) may include the article title and article content. According to one embodiment, an image view of another article may be positioned below the text views (1512), and the text views of the other articles may not be visible.

[0217] According to one embodiment, the portrait mode launch screen (1510) may include a title at the top that includes the name of the application and / or a description of the current page, and a menu tab below the title that includes items for changing the main content.

[0218] According to one embodiment, when an electronic device generates a landscape mode execution screen (1520) based on a portrait mode execution screen (1510), if it is determined that more information can be provided when vertically arranged objects are arranged horizontally, the electronic device may generate a landscape mode execution screen (1520) in which objects included in the portrait mode execution screen (1510) are horizontally rearranged.

[0219] According to one embodiment, the execution screen (1520) in landscape mode may display an image view (1521) on the left side and include text views (1522) related to the image view (1521) arranged on the right side of the image view (1521). According to one embodiment, an image view of another article may be arranged below the image view (1521), and a text view of another article may be arranged on the right side of the image view of another article.

[0220] In one embodiment, the title included in the landscape mode launch screen (1520) may be expanded horizontally, and the menu tab may include more items than the portrait mode launch screen (1510).

[0221] In this way, as the electronic device rearranges objects in a horizontal form to create a landscape mode execution screen (1520), objects that are not displayed in the portrait mode execution screen (1510) may be displayed in the landscape mode execution screen (1520).

[0222] FIG. 15b is a drawing for explaining an operation of rearranging objects included in an execution screen of an electronic device according to one embodiment.

[0223] Referring to FIG. 15b, the electronic device can generate a landscape mode execution screen (1540) based on a portrait mode execution screen (1530).

[0224] According to one embodiment, the execution screen (1530) in portrait mode may include a list or grid form in which multiple objects are arranged vertically.

[0225] According to one embodiment, the execution screen (1530) in portrait mode may display an image view (1531) above and include items (1532) positioned below the image view (1531). For example, if the execution screen (1530) in portrait mode is a execution screen of a map application, the image view (1531) may include a map image, and the items (1532) may include items related to functions of the map application.

[0226] According to one embodiment, when the electronic device generates a landscape mode execution screen (1540) based on a portrait mode execution screen (1530), more information can be provided by displaying an object (e.g., a map image, a video, an image) as an image view (1531) in full screen, and when it is determined that enlargement of items (1532) is ineffective, the electronic device can generate a landscape mode execution screen (1540) including the image view (1531) included in the portrait mode execution screen (1530) as a full screen image view (1541) and including items (1542) rearranged on one side.

[0227] In this way, by displaying the image view (1541) in the entire area on the execution screen (1540) in landscape mode and rearranging the items (1542) to one side, images (e.g., maps, videos, or images) in the surrounding area that are not displayed on the execution screen (1530) in portrait mode can be displayed on the execution screen (1540) in landscape mode.

[0228] FIG. 15c is a drawing for explaining an operation of rearranging objects included in an execution screen of an electronic device according to one embodiment.

[0229] Referring to FIG. 15c, the electronic device can generate a landscape mode execution screen (1560) based on a portrait mode execution screen (1550).

[0230] According to one embodiment, the execution screen (1550) in portrait mode may include a list or grid form in which multiple objects are arranged vertically.

[0231] In one embodiment, the portrait mode execution screen (1550) may display important content (1551) (e.g., important content 1) above and include items (1552) arranged below the important content (1551). In one embodiment, the items (1552) may be a horizontally arranged list.

[0232] For example, if the execution screen (1550) in portrait mode is the execution screen of a content providing application (e.g., an OTT application), the electronic device can change the displayed important content among the horizontally arranged important contents by moving left and right. According to one embodiment, the items (1552) may include a plurality of contents included in the same category as the important content. According to one embodiment, only a limited number of items (1552) among the plurality of horizontally arranged items may be displayed based on the horizontal length of the execution screen (1550) in portrait mode. According to one embodiment, the electronic device can change the displayed items (1552) among the horizontally arranged items by moving left and right.

[0233] According to one embodiment, when the electronic device generates a landscape mode execution screen (1560) based on a portrait mode execution screen (1550), if it is determined that more information can be provided on the landscape mode screen among the horizontally arranged important contents (e.g., important contents 1 and important contents 1-2) and items, the electronic device may display a plurality of important contents (1561) including important contents that were not displayed due to the limitation of the horizontal length of the portrait mode execution screen (1550). According to one embodiment, if the electronic device determines that more information can be provided on the landscape mode screen, the electronic device may display a plurality of items (1562) including items that were not displayed due to the limitation of the horizontal length of the portrait mode execution screen (1550).

[0234] In this way, the electronic device can rearrange a plurality of objects to include objects that were hidden in the portrait mode execution screen (1550) when generating the landscape mode execution screen (1560), thereby providing more objects that were not displayed in the portrait mode execution screen (1550) in the landscape mode execution screen (1560).

[0235] FIG. 15d is a drawing for explaining an operation of rearranging objects included in an execution screen of an electronic device according to one embodiment.

[0236] Referring to FIG. 15d, the electronic device can generate a landscape mode execution screen (1580) based on a portrait mode execution screen (1570).

[0237] According to one embodiment, the execution screen (1570) in portrait mode may include a list or grid form in which multiple objects are arranged vertically.

[0238] According to one embodiment, the execution screen (1570) in portrait mode may display first items (1571) above. According to one embodiment, the first items (1571) may be a horizontally arranged list. For example, the electronic device may change the displayed recommended search terms among the horizontally arranged recommended search terms by moving the first items (1571) left and right.

[0239] According to one embodiment, the execution screen (1570) in portrait mode may display second items (1572) below. According to one embodiment, the second items (1572) may be a vertically arranged list. For example, the second items (1572) may include a plurality of search results corresponding to a search term (e.g., the first items (1571)). For example, the search results may include images and / or text. According to one embodiment, the electronic device may change the search results displayed among the vertically arranged search results by moving the second items (1572) up and down.

[0240] According to one embodiment, when the electronic device generates a landscape mode execution screen (1580) based on a portrait mode execution screen (1570), if it is determined that more information can be provided on the landscape mode screen (1580) among the horizontally arranged first items, the electronic device may display first items (1581) that further include items that were not displayed due to a limitation of the horizontal length of the portrait mode execution screen (1570). According to one embodiment, if the electronic device is determined that more information can be provided on the landscape mode screen, the electronic device may display second items (1582) that further include items that were not displayed due to a limitation of the vertical length of the portrait mode execution screen (1570) in a grid form.

[0241] In this way, the electronic device can rearrange a plurality of objects to include objects that were hidden in the portrait mode execution screen (1570) when generating the landscape mode execution screen (1580), thereby providing more objects that were not displayed in the portrait mode execution screen (1570) in the landscape mode execution screen (1580).

[0242] FIG. 16 is a drawing for explaining an operation of switching a screen based on a user input received through an execution screen of an application in landscape mode of an electronic device according to one embodiment.

[0243] Referring to FIG. 16, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, an electronic device (200) of FIG. 2A, or an electronic device (200) of FIG. 2B) may display a landscape mode execution screen (1610) generated on a first display (or a flexible display) (e.g., a display module (160) of FIG. 1 or a display (202) of FIG. 2A). According to one embodiment, the landscape mode execution screen (1610) may be generated by the electronic device rearranging objects included in a portrait mode execution screen (1620) provided by an application.

[0244] According to one embodiment, even if the electronic device displays a landscape mode execution screen (1610) on the first display, since the application is providing a portrait mode execution screen (1620), the portrait mode execution screen (1620) created by the application may be stored in the background memory.

[0245] According to one embodiment, when a user input (1601) for selecting an object (1601) is received through a landscape mode execution screen (1610), the electronic device may transmit (1602) information about the selected object to the application. According to one embodiment, the application may select an object (1603) included in a portrait mode execution screen (1620) based on the received object information. According to one embodiment, the application may change (1604) to a portrait mode execution screen (1621) including content corresponding to the selected object (1603).

[0246] According to one embodiment, the electronic device can generate (1605) a changed landscape mode execution screen (1611) by rearranging objects included in a changed portrait mode execution screen (1621), and display the generated landscape mode execution screen (1611) on the first display.

[0247] In this way, the electronic device can provide a changed landscape mode execution screen corresponding to a user input received through the generated landscape mode execution screen.

[0248] FIG. 17a is a drawing for explaining an operation of generating an execution screen of an application in landscape mode of an electronic device when the electronic device is a foldable device.

[0249] Referring to FIG. 17A, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, the electronic device (200) of FIG. 2A, or the electronic device (200) of FIG. 2B) may display a first execution screen (1710) of an application on a second display (or cover display) (e.g., the display module (160) of FIG. 1 or the cover display (203) of FIG. 2B) in a first state in which the electronic device is folded. According to one embodiment, the first execution screen (1710) may be a screen in a portrait mode.

[0250] According to one embodiment, when the folding state of the electronic device changes from a first state to an unfolded second state, the electronic device may display a second execution screen (1720) of an application on a first display (or flexible display) (e.g., the display module (160) of FIG. 1 or the display (202) of FIG. 2A). According to one embodiment, the second execution screen (1720) may be a screen in landscape mode.

[0251] In one embodiment, if the electronic device is a foldable device including a hinge structure, the electronic device may activate the entire area of ​​the first display upon unfolding. In one embodiment, the electronic device may display a second execution screen (1720) including an additional object (1721) on the entire area of ​​the activated first display on the first execution screen (1710).

[0252] According to one embodiment, when the electronic device is a multi-foldable device including two hinge structures, the electronic device may activate two display areas among three display areas included in the first display according to unfolding. For example, if it is confirmed that one display area is facing the opposite direction and not visible to the user as one hinge is folded out, or one display area is not visible to the user as one hinge is unfolded by a certain range of angles, the electronic device may activate two display areas excluding the one display area that is not visible. According to one embodiment, the electronic device may display a second execution screen (1720) including an additional object (1721) on the first execution screen (1710) on the two display areas of the activated first display.

[0253] In one embodiment, the second execution screen (1720) may be generated by the electronic device if the application supports only a portrait mode execution screen.

[0254] According to one embodiment, the second execution screen (1720) may be generated by rearranging a plurality of objects included in the first execution screen (1710) using a learned artificial intelligence model or algorithm. For example, the electronic device may generate the second execution screen (1720) by maintaining the first execution screen (1710) in one area based on the hinge and including an additional object (1721) in another area, or may generate the second execution screen (1720) by rearranging the objects included in the first execution screen (1710) regardless of the hinge.

[0255] In one embodiment, the electronic device may generate a second execution screen (1720) when unfolding of the electronic device is detected, or may generate and store landscape mode screens for each of the portrait mode screens supported by the application at the time of installation of the application or at a set time after installation of the application (e.g., late at night when the user does not use the electronic device).

[0256] In one embodiment, the electronic device may display a message to the user asking whether to reconfigure the screen to create a landscape mode screen before creating the landscape mode screen, and may also provide a progress bar for the landscape mode screen creation. In one embodiment, the electronic device may display a message asking whether to create an additional object (1721) using the artificial intelligence model.

[0257] According to one embodiment, when creating a landscape mode screen during installation of an application, the electronic device may designate and store only the area where additional objects are to be created, and upon unfolding, create additional objects (1721) based on the objects included in the first execution screen (1710).

[0258] In one embodiment, when the electronic device is a multi-foldable device including two hinge structures, the electronic device can activate all three display areas included in the first display through additional unfolding while two of the three display areas included in the first display are activated. In one embodiment, the operation when the entire first display is activated will be described in more detail with reference to FIGS. 17b and 17c below.

[0259] FIG. 17b is a drawing for explaining an operation of generating an execution screen of an application in landscape mode of an electronic device when the electronic device is a multi-foldable device.

[0260] Referring to FIG. 17B, the electronic device may maintain the second execution screen (1720) illustrated in FIG. 17A and generate a third execution screen (1730) including an additional object (1731) in an additional activated display area. According to one embodiment, the electronic device may display the third execution screen (1730) in the entire area of ​​the activated first display.

[0261] FIG. 17c is a drawing for explaining an operation of generating an execution screen of an application in landscape mode of an electronic device when the electronic device is a multi-foldable device.

[0262] Referring to FIG. 17c, the electronic device may generate a third execution screen (1740) that includes a plurality of objects included in the second execution screen (1720) illustrated in FIG. 17a, but reconstructs the entire area. According to one embodiment, the electronic device may display the third execution screen (1740) on the entire area of ​​the activated first display.

[0263] According to one embodiment, the electronic device may apply an animation effect of moving objects when transitioning from the second execution screen (1720) to the third execution screen (1740) illustrated in FIG. 17A. According to one embodiment, the moving objects may also have specific effects applied to them, such as translucency or blur.

[0264] FIG. 18 is a drawing for explaining an operation of generating an execution screen of an application in a landscape mode of an electronic device according to an unfolding operation of an electronic device according to one embodiment.

[0265] Referring to FIG. 18, an electronic device (e.g., an electronic device (101) of FIG. 1, a processor (120) of FIG. 1, an electronic device (200) of FIG. 2A, or an electronic device (200) of FIG. 2B) may display a first execution screen (1810) of an application on a second display (or cover display) (e.g., a display module (160) of FIG. 1 or a cover display (203) of FIG. 2B) in a first state in which the electronic device is folded. According to one embodiment, the first execution screen (1810) may be a screen in a portrait mode.

[0266] According to one embodiment, when the folding state of the electronic device changes from a first state to an unfolded second state, the electronic device may display a second execution screen (1820) of an application on a first display (or flexible display) (e.g., the display module (160) of FIG. 1 or the display (202) of FIG. 2A). According to one embodiment, the second execution screen (1820) may be a screen in landscape mode.

[0267] According to one embodiment, the second execution screen (1820) displays the same screen as the first execution screen (1810) on the first display, and an area other than the screen identical to the first execution screen (1810) may be blank. For example, the second execution screen (1820) may be a screen generated and provided by an application that provides the first execution screen (1810).

[0268] According to one embodiment, when a user input (1821) for screen reconfiguration is received while the electronic device is displaying the second execution screen (1820), the electronic device may generate a third execution screen (1830) that is a landscape mode screen reconfigured based on the portrait mode screen, and display the third execution screen (1830) on the first display.

[0269] In one embodiment, the third execution screen (1830) may maintain the first execution screen (1810) and further include additional objects (1831) that have been created.

[0270] According to one embodiment, when the electronic device displays a third execution screen (1830) on the first display and a user input for editing a plurality of objects included in the third execution screen (1830) is received, the electronic device may edit the third execution screen (1830) based on the user input. For example, when a user input for selecting and dragging one of the plurality of objects is received, the electronic device may move the selected object to a position where the drag is released and move an existing object displayed at that position to the original position of the selected object. According to one embodiment, when the third execution screen (1830) is edited by the user input, the electronic device may train an artificial intelligence model for screen reconfiguration based on the edited content. According to one embodiment, when the electronic device changes from portrait mode to landscape mode after training, the electronic device may generate an execution screen in which objects are rearranged using the trained artificial intelligence model based on the user input, and display the generated execution screen.

[0271] In one embodiment, the electronic device may generate a landscape mode execution screen that includes not only the objects included in the portrait mode execution screen when regenerating the screen, but also objects of other applications related to the application. For example, the electronic device may generate a landscape mode execution screen that includes an application screen selling items related to the object on one side of the screen, or a user-specified related application screen (e.g., a preview of a camera application).

[0272] In one embodiment, the electronic device may generate a portrait mode launch screen based on the landscape mode launch screen. For example, if an application only supports a landscape mode launch screen, the electronic device may rearrange objects included in the landscape mode launch screen to generate a portrait mode launch screen when it detects that the electronic device is folded.

[0273] FIG. 19A is a drawing for explaining an operation of displaying an external area of ​​an application execution screen in landscape mode of an electronic device according to one embodiment.

[0274] Referring to FIG. 19A, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, the electronic device (200) of FIG. 2A, or the electronic device (200) of FIG. 2B) may display a first execution screen (1910) of an application on a second display (or cover display) (e.g., the display module (160) of FIG. 1 or the cover display (203) of FIG. 2B) in a first state in which the electronic device is folded. According to one embodiment, the first execution screen (1910) may be a screen in a portrait mode.

[0275] According to one embodiment, when the folding state of the electronic device changes from a first state to an unfolded second state, the electronic device may display a second execution screen (1920) of an application on a first display (or flexible display) (e.g., the display module (160) of FIG. 1 or the display (202) of FIG. 2A). According to one embodiment, the second execution screen (1920) may be a screen in landscape mode.

[0276] According to one embodiment, the electronic device may display an outer area (1921) of a second execution screen (1920) and receive user input through the outer area (1921).

[0277] FIG. 19b is a drawing for explaining a scroll operation when receiving a user input through an external area of ​​an application execution screen in a landscape mode of an electronic device according to one embodiment.

[0278] Referring to FIG. 19b, when a scroll input (1930) is received through an external area (1921) while the second execution screen (1920) is displayed, the electronic device can display a screen (1940) that scrolls the entire area of ​​the second execution screen (1920).

[0279] According to one embodiment, the electronic device may display a scrolled screen (1940) based on the first execution screen (1910) of FIG. 19a without transmitting information about the scroll input to the application.

[0280] FIG. 19c is a drawing for explaining a scroll operation when receiving a user input through an internal area of ​​an application execution screen in a landscape mode of an electronic device according to one embodiment.

[0281] Referring to FIG. 19c, when a scroll input (1950) is received through the second execution screen (1920) while the second execution screen (1920) is displayed, the electronic device can display a screen (1960) that scrolls a portion of the second execution screen (1920).

[0282] In one embodiment, the electronic device may transmit information about a scroll input to an application and display a screen (1960) scrolled by the application. For example, the scrolled screen (1960) may maintain a title area (1961), and only the content area (1962) may be scrolled.

[0283] FIG. 20 is a drawing for explaining an operation of generating an application screen based on the shape of a display of an external electronic device in an electronic device according to one embodiment.

[0284] Referring to FIG. 20, an electronic device (e.g., the electronic device (101) of FIG. 1, the processor (120) of FIG. 1, the electronic device (200) of FIG. 2A, or the electronic device (200) of FIG. 2B) may display a first execution screen (2010) of an application on a second display (or cover display) (e.g., the display module (160) of FIG. 1 or the cover display (203) of FIG. 2B) in a first state in which the electronic device is folded. According to one embodiment, the first execution screen (2010) may be a screen in a portrait mode.

[0285] According to one embodiment, the electronic device may generate a second execution screen (2020) by reconfiguring the first execution screen (2010) to fit the form of a display of an external electronic device (e.g., the electronic device (104) of FIG. 1). For example, if the external electronic device is a wearable device, the electronic device may generate the second execution screen (2020) to correspond to the form of a display included in the wearable device.

[0286] According to one embodiment, when an electronic device receives a user input for sharing an execution screen with an external electronic device, the electronic device may obtain information about the display of the external electronic device. For example, the electronic device may receive information about the display of the external electronic device from the external electronic device, or may check information about the display of the external electronic device pre-stored in the electronic device. According to one embodiment, the electronic device may generate a second execution screen (2020) corresponding to the first execution screen (2010) based on the information about the display of the external electronic device. According to one embodiment, the electronic device may transmit the generated second execution screen (2020) to the external electronic device.

[0287] According to one embodiment, when the external electronic device is a VR device, a second execution screen (2020) corresponding to the VR environment can be generated based on the first execution screen (2010).

[0288] By creating an execution screen according to the display transition in this way, usability problems of the application that may occur due to the display transition can be reduced.

[0289] According to one embodiment, a foldable electronic device may include a foldable housing including a first housing part, a second housing part, and a third housing part, a first display disposed in a first area of ​​the foldable housing, a second display disposed in a second area of ​​the foldable housing, a sensor including at least one sensing circuitry for sensing a folded state or an unfolded state of the foldable housing, at least one processor, and a memory storing instructions.

[0290] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to determine whether an application supporting a first execution screen of a first aspect ratio supports a second execution screen of a second aspect ratio different from the first aspect ratio.

[0291] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to display the first execution screen of the application at the first aspect ratio through the second display when the foldable electronic device is in the first state in the folded state.

[0292] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to detect, based on a sensing value of the sensor while displaying the first execution screen through the second display, that the state of the foldable electronic device has changed from the first state to the second state, which is the unfolded state.

[0293] In one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to generate the second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen based on the application not supporting the second execution screen of the second aspect ratio.

[0294] According to one embodiment, the instructions, when individually or collectively executed by the at least one processor, may cause the foldable electronic device to display the generated second execution screen on at least a portion of the first display.

[0295] According to one embodiment, the first housing part may include a first surface and a second surface opposite the first surface.

[0296] In one embodiment, the second housing part may include a third surface and a fourth surface opposite the third surface.

[0297] In one embodiment, the third housing part may include a fifth surface and a sixth surface opposite the fifth surface.

[0298] According to one embodiment, the first display may include a first display area disposed on the first surface of the first housing part, a second display area disposed on the third surface of the second housing part, and a third display area disposed on the fifth surface of the third housing part.

[0299] According to one embodiment, the second display may be disposed in at least one area of ​​the second surface of the first housing part or the fourth surface of the second housing part.

[0300] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to display the second execution screen on at least a portion of the first display by maintaining execution of the application as part of the operation of displaying the second execution screen.

[0301] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to display the first execution screen including the first portion of the first content on the second display based on the foldable electronic device being in the first state.

[0302] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to display the second execution screen including the first portion and the second portion of the first content on the at least a portion of the first display based on the foldable electronic device being in the second state.

[0303] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to display the first execution screen including second content on the second display based on the foldable electronic device being in the first state.

[0304] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to display the second content and a control button associated with the second content on at least a portion of the first display based on the foldable electronic device being in the second state.

[0305] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to detect a first angle between the first housing part and the second housing part and a second angle between the first housing part and the third housing part in the second state.

[0306] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to display the second execution screen on two display areas corresponding to two housing parts having angles within the first range among the first display area, the second display area, and the third display area, based on one of the first angle and the second angle being within a first range corresponding to the unfolded state and the other being within a second range corresponding to the partially folded state.

[0307] In one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to generate a third execution screen having a third aspect ratio different from the first aspect ratio and the second aspect ratio by rearranging the plurality of objects included in the second execution screen based on a change in an angle of two housing parts having an angle within the second range to be included within the first range.

[0308] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to display the third execution screen in the first display area, the second display area, and the third display area.

[0309] In one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to detect a first angle between the first housing part and the second housing part and a second angle between the first housing part and the third housing part in the second state.

[0310] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to display the second execution screen in the first display area, the second display area, and the third display area based on the first angle and the second angle being within a first range corresponding to the unfolded state.

[0311] According to one embodiment, the memory may store an artificial intelligence model trained to obtain, as output data, a screen of the first aspect ratio including a plurality of objects, and a screen of the second aspect ratio in which the positions of the plurality of objects included in the screen of the first aspect ratio are different, using the screen of the first aspect ratio as input data.

[0312] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to use the first execution screen as input data of the artificial intelligence model and obtain the second execution screen generated as output data of the artificial intelligence model.

[0313] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to check attributes of each of the plurality of objects included in the first execution screen.

[0314] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to generate the second execution screen by rearranging the plurality of objects based on the attribute.

[0315] According to one embodiment, the instructions, when executed by the at least one processor, may cause the foldable electronic device to determine whether the application supports the second execution screen based on the application being installed on the foldable electronic device.

[0316] According to one embodiment, a control method for a foldable electronic device including a foldable housing, a first display disposed on a first surface of the foldable housing, a second display disposed on a second surface of the foldable housing, and a sensor including at least one sensing circuitry for sensing a folded state or an unfolded state of the foldable housing may include an operation of checking whether an application supporting a first execution screen of a first aspect ratio supports a second execution screen of a second aspect ratio different from the first aspect ratio.

[0317] According to one embodiment, the control method of the foldable electronic device may include an operation of displaying the first execution screen of the application with the first aspect ratio through the second display of the foldable electronic device in a first state in which the foldable electronic device is in a folded state.

[0318] According to one embodiment, the control method of the foldable electronic device may include an operation of detecting that the state of the foldable electronic device has changed from the first state to the second state, which is the unfolded state, based on a sensing value of a sensor that senses the folded state or unfolded state of the foldable housing while displaying the first execution screen of the application through the second display.

[0319] According to one embodiment, the control method of the foldable electronic device may include an operation of generating the second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen based on the application not supporting the second execution screen of the second aspect ratio.

[0320] According to one embodiment, the control method of the foldable electronic device may include an operation of displaying the generated second execution screen on at least a portion of the first display.

[0321] According to one embodiment, the first housing part included in the foldable housing may include a first surface and a second surface opposite the first surface.

[0322] According to one embodiment, the second housing part included in the foldable housing may include a third surface and a fourth surface opposite the third surface.

[0323] According to one embodiment, the third housing part included in the foldable housing may include a fifth surface and a sixth surface opposite the fifth surface.

[0324] According to one embodiment, the first display may include a first display area disposed on the first surface of the first housing part, a second display area disposed on the third surface of the second housing part, and a third display area disposed on the fifth surface of the third housing part.

[0325] According to one embodiment, the second display may be disposed in at least one area of ​​the second surface of the first housing part or the fourth surface of the second housing part.

[0326] According to one embodiment, the action of displaying the second execution screen may display the second execution screen on at least a portion of the first display by maintaining execution of the application.

[0327] According to one embodiment, the operation of displaying the first execution screen may display the first execution screen including the first portion of the first content on the second display based on the foldable electronic device being in the first state.

[0328] According to one embodiment, the operation of displaying the second execution screen may display the second execution screen including the first portion and the second portion of the first content on at least a portion of the first display based on the foldable electronic device being in the second state.

[0329] According to one embodiment, the operation of displaying the first execution screen may display the first execution screen including the second content on the second display based on the foldable electronic device being in the first state.

[0330] According to one embodiment, the operation of displaying the second execution screen may display the second content and a control button related to the second content on at least a portion of the first display based on the foldable electronic device being in the second state.

[0331] According to one embodiment, the control method of the electronic device may further include an operation of detecting a first angle between the first housing part and the second housing part and a second angle between the first housing part and the third housing part in the second state.

[0332] According to one embodiment, the operation of displaying the second execution screen may display the second execution screen in two display areas corresponding to two housing parts having angles within the first range among the first display area, the second display area, and the third display area, based on one of the first angle and the second angle being within a first range corresponding to the unfolded state and the other being within a second range corresponding to the partially unfolded state.

[0333] According to one embodiment, the control method of the electronic device may further include an operation of generating a third execution screen having a third aspect ratio different from the first aspect ratio and the second aspect ratio by rearranging the plurality of objects included in the second execution screen based on a change in an angle of two housing parts having an angle within the second range to be included within the first range.

[0334] According to one embodiment, the control method of the electronic device may further include an operation of displaying the third execution screen in the first display area, the second display area, and the third display area.

[0335] According to one embodiment, the control method of the electronic device may further include an operation of detecting a first angle between the first housing part and the second housing part and a second angle between the first housing part and the third housing part in the second state.

[0336] According to one embodiment, the operation of displaying the second execution screen may display the second execution screen in the first display area, the second display area, and the third display area based on the first angle and the second angle being within a first range corresponding to the unfolded state.

[0337] According to one embodiment, the memory may store an artificial intelligence model trained to obtain, as output data, a screen of the first aspect ratio including a plurality of objects, and a screen of the second aspect ratio having different positions of the plurality of objects included in the screen of the first aspect ratio, using the screen as input data.

[0338] According to one embodiment, the operation of generating the second execution screen may obtain the second execution screen generated as output data of the artificial intelligence model by using the first execution screen as input data of the artificial intelligence model.

[0339] According to one embodiment, the operation of generating the second execution screen may check the properties of each of the plurality of objects included in the first execution screen.

[0340] According to one embodiment, the operation of generating the second execution screen may generate the second execution screen by rearranging the plurality of objects based on the properties.

[0341] According to one embodiment, a non-transitory computer-readable recording medium storing one or more programs may include instructions that cause a foldable electronic device including a foldable housing, a first display disposed on a first surface of the foldable housing, and a second display disposed on a second surface of the foldable housing to determine whether an application supporting a first execution screen of a first aspect ratio supports a second execution screen having a second aspect ratio that is longer in width than in height and different from the first aspect ratio.

[0342] According to one embodiment, the one or more programs may include instructions that cause the foldable electronic device to display the first execution screen of the application having the first aspect ratio through the second display of the foldable electronic device in a first state in which the foldable electronic device is in a folded state.

[0343] According to one embodiment, the one or more programs may include instructions that cause the foldable electronic device to detect a change in a state of the foldable electronic device from the first state to a second state in which the electronic device is in the unfolded state, based on a sensing value of a sensor that senses a folded state or an unfolded state of the foldable housing while the foldable electronic device displays the first execution screen of the application through the second display.

[0344] In one embodiment, the one or more programs may include instructions that cause the foldable electronic device to generate the second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen based on the application not supporting the second execution screen of the second aspect ratio.

[0345] According to one embodiment, the one or more programs may include instructions causing the foldable electronic device to display the generated second execution screen on at least a portion of the first display.

[0346] According to one embodiment, the first housing part may include a first surface and a second surface opposite the first surface.

[0347] In one embodiment, the second housing part may include a third surface and a fourth surface opposite the third surface.

[0348] In one embodiment, the third housing part may include a fifth surface and a sixth surface opposite the fifth surface.

[0349] According to one embodiment, the first display may include a first display area disposed on the first surface of the first housing part, a second display area disposed on the third surface of the second housing part, and a third display area disposed on the fifth surface of the third housing part.

[0350] According to one embodiment, the second display may be disposed in at least one area of ​​the second surface of the first housing part or the fourth surface of the second housing part.

[0351] In one embodiment, the one or more programs may cause the foldable electronic device to display the second execution screen on at least a portion of the first display by maintaining execution of the application as part of the operation of displaying the second execution screen.

[0352] In one embodiment, the one or more programs may cause the foldable electronic device to display the first execution screen including the first portion of the first content on the second display based on the foldable electronic device being in the first state.

[0353] In one embodiment, the one or more programs may cause the foldable electronic device to display the second execution screen including the first portion and the second portion of the first content on at least a portion of the first display based on the foldable electronic device being in the second state.

[0354] In one embodiment, the one or more programs may cause the foldable electronic device to display the first execution screen including the second content on the second display based on the foldable electronic device being in the first state.

[0355] In one embodiment, the one or more programs may include instructions that cause the foldable electronic device to display the second content and a control button related to the second content on at least a portion of the first display based on the foldable electronic device being in the second state.

[0356] In one embodiment, the one or more programs may include instructions that cause the foldable electronic device to detect a first angle between the first housing part and the second housing part and a second angle between the first housing part and the third housing part in the second state.

[0357] In one embodiment, the instructions may include instructions that, when executed by the at least one processor, cause the foldable electronic device to display the second execution screen in two display areas corresponding to two housing parts having angles within the first range among the first display area, the second display area, and the third display area, based on one of the first angle and the second angle being within a first range corresponding to the unfolded state and the other being within a second range corresponding to a partially folded state.

[0358] In one embodiment, the one or more programs may include instructions that cause the foldable electronic device to generate a third execution screen having a third aspect ratio different from the first aspect ratio and the second aspect ratio by rearranging the plurality of objects included in the second execution screen based on a change in an angle of two housing parts having an angle within the second range to be included within the first range.

[0359] According to one embodiment, the one or more programs may include instructions that cause the foldable electronic device to display the third execution screen in the first display area, the second display area, and the third display area.

[0360] In one embodiment, the one or more programs may include instructions that cause the foldable electronic device to detect a first angle between the first housing part and the second housing part and a second angle between the first housing part and the third housing part in the second state.

[0361] According to one embodiment, the one or more programs may include instructions that cause the foldable electronic device to display the second execution screen in the first display area, the second display area, and the third display area based on the first angle and the second angle being within a first range corresponding to the unfolded state.

[0362] According to one embodiment, the memory may store an artificial intelligence model trained to obtain, as output data, a screen of the first aspect ratio including a plurality of objects, and a screen of the second aspect ratio in which the positions of the plurality of objects included in the screen of the first aspect ratio are different, using the screen of the first aspect ratio as input data.

[0363] According to one embodiment, the one or more programs may include instructions that cause the foldable electronic device to obtain the second execution screen generated as output data of the artificial intelligence model by using the first execution screen as input data of the artificial intelligence model.

[0364] According to one embodiment, the instructions may include instructions that, when executed by the at least one processor, cause the foldable electronic device to check attributes of each of the plurality of objects included in the first execution screen.

[0365] According to one embodiment, the one or more programs may include instructions that cause the foldable electronic device to generate the second execution screen by rearranging the plurality of objects based on the properties.

[0366] According to one embodiment, the one or more programs may include instructions that cause the foldable electronic device to determine whether the application supports the second execution screen based on the application being installed on the foldable electronic device.

[0367] Electronic devices according to the embodiments disclosed in this document may take various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or home appliances. Electronic devices according to the embodiments disclosed in this document are not limited to the aforementioned devices.

[0368] The embodiments of this document and the terminology used herein are not intended to limit the technical features described in this document to specific embodiments, but should be understood to include various modifications, equivalents, or substitutes of the embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of the items, unless the context clearly indicates otherwise. In this document, each of the phrases "A or B", "at least one of A and B", "at least one of A or B", "A, B, or C", "at least one of A, B, and C", and "at least one of A, B, or C" can include any one of the items listed together in the corresponding phrase among those phrases, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used merely to distinguish one component from another, and do not limit the components in any other respect (e.g., importance or order). When a component (e.g., a first component) is referred to as "coupled" or "connected" to another (e.g., a second component), with or without the terms "functionally" or "communicatively," it means that the component can be connected to the other component directly (e.g., wired), wirelessly, or through a third component.

[0369] The term "module" used in the embodiments of this document may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit. A module may be an integral component, or a minimum unit or part of such a component that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).

[0370] One embodiment of the present document may be implemented as software (e.g., a program (140)) including one or more instructions stored in a storage medium (e.g., an internal memory (136) or an external memory (138)) readable by a machine (e.g., an electronic device (101)). For example, a processor (e.g., a processor (120)) of the machine (e.g., an electronic device (101)) may call at least one instruction among the one or more instructions stored from the storage medium and execute it. This enables the machine to operate to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code executable by an interpreter. The machine-readable storage medium may be provided in the form of a non-transitory storage medium. Here, 'non-transitory' simply means that the storage medium is a tangible device and does not contain signals (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently or temporarily on the storage medium.

[0371] According to one embodiment, the method according to one embodiment disclosed in this document may be provided as a computer program product. The computer program product may be traded between sellers and buyers as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)) or may be provided through an application store (e.g., Play Store). TM ) or directly between two user devices (e.g., smart phones), online distribution (e.g., downloading or uploading). In the case of online distribution, at least a portion of the computer program product may be at least temporarily stored or temporarily created in a machine-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or an intermediary server.

[0372] According to one embodiment, each component (e.g., a module or a program) of the above-described components may include one or more entities, and some of the entities may be separated and placed in other components. According to one embodiment, one or more components or operations of the aforementioned components may be omitted, or one or more other components or operations may be added. Alternatively or additionally, a plurality of components (e.g., a module or a program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the plurality of components identically or similarly to those performed by the corresponding component among the plurality of components prior to the integration. According to one embodiment, the operations performed by a module, program, or other component may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.

Claims

1. In foldable electronic devices, A foldable housing comprising a first housing part, a second housing part, and a third housing part; A first display arranged in a first area of ​​the foldable housing; A second display arranged in a second area of ​​the foldable housing; A sensor including at least one sensing circuitry for sensing a folded state or an unfolded state of the foldable housing; at least one processor; and memory for storing instructions; The above instructions, when individually or collectively executed by the at least one processor, cause the foldable electronic device to: Check whether an application that supports a first execution screen of a first aspect ratio supports a second execution screen of a second aspect ratio different from the first aspect ratio, In the first state in which the foldable electronic device is in the folded state, the first execution screen of the application of the first aspect ratio is displayed through the second display, While displaying the first execution screen through the second display, based on the sensing value of the sensor, detecting that the state of the foldable electronic device has changed from the first state to the second state, which is the unfolded state, A foldable electronic device that generates the second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen based on the fact that the application does not support the second execution screen of the second aspect ratio, and displays the generated second execution screen in at least a portion of the first display.

2. In paragraph 1, The first housing part includes a first surface and a second surface opposite the first surface, The second housing part includes a third surface and a fourth surface opposite the third surface, The third housing part includes a fifth surface and a sixth surface opposite to the fifth surface, The first display includes a first display area disposed on the first surface of the first housing part, a second display area disposed on the third surface of the second housing part, and a third display area disposed on the fifth surface of the third housing part. The second display is arranged in at least one area of ​​the second surface of the first housing part or the fourth surface of the second housing part, The above instructions, when executed by the at least one processor, cause the foldable electronic device to: A foldable electronic device that, as part of an operation of displaying the second execution screen, displays the second execution screen on at least a portion of the first display by maintaining execution of the application.

3. In paragraph 1 or 2, The above instructions, when executed by the at least one processor, cause the foldable electronic device to: Based on the foldable electronic device being in the first state, displaying the first execution screen including the first part of the first content on the second display, A foldable electronic device that displays the second execution screen including the first part and the second part of the first content on at least a portion of the first display based on the foldable electronic device being in the second state.

4. In any one of paragraphs 1 to 3, The above instructions, when executed by the at least one processor, cause the foldable electronic device to: Based on the foldable electronic device being in the first state, displaying the first execution screen including the second content on the second display, A foldable electronic device that displays the second content and a control button related to the second content on at least a portion of the first display based on the foldable electronic device being in the second state.

5. In any one of paragraphs 2 to 4, The above instructions, when executed by the at least one processor, cause the foldable electronic device to: Detecting a first angle between the first housing part and the second housing part and a second angle between the first housing part and the third housing part in the second state, A foldable electronic device that displays the second execution screen in two display areas corresponding to two housing parts having angles within the first range among the first display area, the second display area, and the third display area, based on one of the first angle and the second angle being within a first range corresponding to the unfolded state and the other being within a second range corresponding to a partially folded state.

6. In paragraph 5, The above instructions, when executed by the at least one processor, cause the foldable electronic device to: Based on the angle of the two housing parts having an angle within the second range being changed to be included within the first range, a third execution screen having a third aspect ratio different from the first aspect ratio and the second aspect ratio is generated by rearranging the plurality of objects included in the second execution screen, A foldable electronic device that displays the third execution screen in the first display area, the second display area, and the third display area.

7. In any one of paragraphs 2 to 4, The above instructions, when executed by the at least one processor, cause the foldable electronic device to: Detecting a first angle between the first housing part and the second housing part and a second angle between the first housing part and the third housing part in the second state, A foldable electronic device that displays the second execution screen in the first display area, the second display area, and the third display area based on the first angle and the second angle being within a first range corresponding to the unfolded state.

8. In any one of paragraphs 1 to 7, The above memory is, An artificial intelligence model trained to obtain a screen of the second aspect ratio with different positions of the plurality of objects included in the screen of the first aspect ratio as output data using the screen of the first aspect ratio including a plurality of objects as input data is stored. The above instructions, when executed by the at least one processor, cause the foldable electronic device to: A foldable electronic device that uses the first execution screen as input data of the artificial intelligence model to obtain the second execution screen generated as output data of the artificial intelligence model.

9. In any one of paragraphs 1 to 8, The above instructions, when executed by the at least one processor, cause the foldable electronic device to: Check the properties of each of the plurality of objects included in the first execution screen, A foldable electronic device that generates the second execution screen by rearranging the plurality of objects based on the above properties.

10. In any one of paragraphs 1 to 9, The above instructions, when executed by the at least one processor, cause the foldable electronic device to: A foldable electronic device that determines whether the application supports the second execution screen based on the completion of installation of the application on the foldable electronic device.

11. A method for controlling a foldable electronic device, comprising a foldable housing, a first display disposed on a first surface of the foldable housing, a second display disposed on a second surface of the foldable housing, and a sensor including at least one sensing circuitry for sensing a folded state or an unfolded state of the foldable housing. An operation for checking whether an application supporting a first execution screen of a first aspect ratio supports a second execution screen of a second aspect ratio different from the first aspect ratio; An operation of displaying the first execution screen of the application with the first aspect ratio through the second display of the foldable electronic device in a first state in which the foldable electronic device is in a folded state; An operation of detecting that the state of the foldable electronic device has changed from the first state to the second state, which is the unfolded state, based on a sensing value of a sensor that senses the folded state or unfolded state of the foldable housing while displaying the first execution screen of the application through the second display; An operation of generating the second execution screen of the second aspect ratio by rearranging a plurality of objects included in the first execution screen based on the fact that the application does not support the second execution screen of the second aspect ratio; and A control method for a foldable electronic device, comprising: an operation of displaying the generated second execution screen in at least a portion of the first display.

12. In paragraph 11, The first housing part included in the above foldable housing includes a first surface and a second surface opposite the first surface, The second housing part included in the above foldable housing includes a third surface and a fourth surface opposite the third surface, The third housing part included in the above foldable housing includes a fifth surface and a sixth surface opposite to the fifth surface, The first display includes a first display area disposed on the first surface of the first housing part, a second display area disposed on the third surface of the second housing part, and a third display area disposed on the fifth surface of the third housing part. The second display is arranged in at least one area of ​​the second surface of the first housing part or the fourth surface of the second housing part, The action of displaying the above second execution screen is: A control method for a foldable electronic device that displays the second execution screen in at least a portion of the first display by maintaining execution of the application.

13. In paragraph 11, The action of displaying the above first execution screen is: Based on the foldable electronic device being in the first state, displaying the first execution screen including the first part of the first content on the second display, The action of displaying the above second execution screen is: A control method of a foldable electronic device, based on the foldable electronic device being in the second state, for displaying the second execution screen including the first part and the second part of the first content in at least a portion of the first display.

14. In any one of paragraphs 11 to 13, The action of displaying the above first execution screen is: Based on the foldable electronic device being in the first state, displaying the first execution screen including the second content on the second display, The action of displaying the above second execution screen is: A control method of a foldable electronic device, based on the foldable electronic device being in the second state, for displaying the second content and a control button related to the second content in at least a portion of the first display.

15. A non-transitory computer-readable recording medium storing one or more programs, wherein the one or more programs comprise a foldable electronic device including a foldable housing, a first display disposed on a first surface of the foldable housing, and a second display disposed on a second surface of the foldable housing: Check whether an application that supports a first execution screen of a first aspect ratio has a horizontal length longer than a vertical length and supports a second execution screen of a second aspect ratio different from the first aspect ratio, In a first state in which the foldable electronic device is in a folded state, the first execution screen of the application having the first aspect ratio is displayed through the second display of the foldable electronic device, While displaying the first execution screen of the application through the second display, based on the sensing value of a sensor that senses the folded state or unfolded state of the foldable housing, detecting that the state of the foldable electronic device has changed from the first state to the second state in which the electronic device is in the unfolded state, Based on the fact that the application does not support the second execution screen of the second aspect ratio, the second execution screen of the second aspect ratio is generated by rearranging a plurality of objects included in the first execution screen, A recording medium including instructions for causing the generated second execution screen to be displayed on at least a portion of the first display.

Images