Electronic device for outputting execution screen of application, operating method thereof, and recording medium
The device's processor manages screen reconfiguration to maintain application continuity by reallocating compatible display areas, addressing the challenge of screen transitions in flexible displays.
Patent Information
- Authority / Receiving Office
- WO · WO
- Patent Type
- Applications
- Current Assignee / Owner
- SAMSUNG ELECTRONICS CO LTD
- Filing Date
- 2025-11-04
- Publication Date
- 2026-06-25
AI Technical Summary
Electronic devices with flexible displays face challenges in maintaining continuity of application execution screens during size variations due to screen transitions.
The device includes a processor that determines if screen reconfiguration is needed and allocates a compatible display area with the same attributes to maintain continuity of the application execution screen during transitions between different display areas.
Ensures seamless continuity of application execution screens across varying display sizes by intelligently reallocating display areas, enhancing user experience.
Smart Images

Figure KR2025017903_25062026_PF_FP_ABST
Abstract
Description
Electronic device for outputting an application execution screen, method of operation thereof, and recording medium
[0001] The present disclosure relates to an electronic device for outputting an execution screen of an application, a method of operation thereof, and a recording medium.
[0002] With the advancement of digital and / or communication technologies, electronic devices such as home appliances, smartphones, tablet PCs, and navigation systems inherently include displays. In particular, portable devices such as smartphones or tablet PCs, which have size constraints to ensure portability, may face limitations in expanding the size of their displays. As a solution to overcome these size limitations, form factors that allow the display size to be varied—such as foldable, slidable, or rollable—by adopting flexible displays are being applied to portable devices.
[0003] Electronic devices equipped with a form factor that can expand or contract the display size must be able to provide an optimized screen according to the variable screen size while maintaining the continuity of functions in use.
[0004] The information described above may be provided as related art for the purpose of aiding understanding of the present disclosure. None of the foregoing is to be claimed as prior art related to the present disclosure, nor is it to be used to determine prior art.
[0005] The present disclosure may provide an electronic device that outputs an application execution screen while maintaining continuity based on the properties of a display according to a screen transition, a method of operation thereof, and a recording medium.
[0006] According to one embodiment, the electronic device may include a memory comprising one or more storage media for storing instructions. The electronic device may include at least one processor configured to include a processing circuit and to perform control for outputting a screen to at least one display among a plurality of displays. When the instructions are executed individually or collectively by the at least one processor, the electronic device may be caused to perform at least one operation. The at least one operation may include an operation of displaying a first execution screen of a specific application in a first display area. The at least one operation may include an operation of determining whether screen reconfiguration is required to maintain the use of the specific application in response to a request for a first screen transition from the first display area to a second display area. The at least one operation may include an operation of allocating a compatible display area having the same attributes as the first display area in the second display area when screen reconfiguration is required. The at least one operation may include an operation of displaying a second execution screen corresponding to the use of the specific application in the compatible display area. Here, the second execution screen can maintain continuity with the first execution screen.
[0007] According to one embodiment, a method of operation of an electronic device may include an operation of displaying a first execution screen of a specific application in a first display area. The method of operation may include an operation of determining whether screen reconfiguration is required to maintain the use of the specific application in response to a request for a first screen transition from the first display area to a second display area. If screen reconfiguration is required, the method of operation may include an operation of allocating a compatible display area having the same attributes as the first display area in the second display area. The method of operation may include an operation of displaying a second execution screen corresponding to the use of the specific application in the compatible display area. Here, the second execution screen may maintain continuity with the first execution screen.
[0008] According to one embodiment, the recording medium may store instructions that are readable by a computer. When executed by at least a part of at least one processor included in the electronic device, the instructions may cause the electronic device to perform at least one operation. The at least one operation may include an operation of displaying a first execution screen of a specific application in a first display area. The at least one operation may include an operation of determining whether screen reconfiguration is required to maintain the use of the specific application in response to a first screen transition request from the first display area to a second display area. The at least one operation may include an operation of allocating a compatible display area having the same attributes as the first display area in the second display area when screen reconfiguration is required. The at least one operation may include an operation of displaying a second execution screen corresponding to the use of the specific application in the compatible display area. Here, the second execution screen may maintain continuity with the first execution screen.
[0009] In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components.
[0010] FIG. 1 is a block diagram of an electronic device in a network environment according to various embodiments.
[0011] FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g are drawings for illustrating a form factor of a multi-foldable structure that can be applied to an electronic device according to one embodiment.
[0012] FIG. 5 is a block diagram of an electronic device according to one embodiment.
[0013] FIG. 6 is a control flowchart for outputting a screen based on the properties of a display in an electronic device according to one embodiment.
[0014] FIG. 7 is a diagram illustrating, in accordance with the control flow diagram of FIG. 6, an exemplary execution screen of a specific application output by an electronic device.
[0015] FIG. 8a or FIG. 8b is a drawing for explaining the allocation of a display area according to an operating state in an electronic device according to one embodiment.
[0016] FIG. 9 is a diagram illustrating a data structure for screen output in an electronic device according to one embodiment.
[0017] FIG. 10 is a control flowchart for outputting a screen in an electronic device according to one embodiment.
[0018] FIG. 11 is a diagram illustrating the allocation of a display area according to an operating state in an electronic device according to one embodiment.
[0019] FIG. 12 is a diagram illustrating a data structure for screen output in an electronic device according to one embodiment.
[0020] FIG. 13 is a drawing for illustrating an example of displaying an application execution screen in response to a screen transition in a multi-foldable electronic device according to one embodiment.
[0021] FIG. 14 is a control flow diagram for outputting an application execution screen in a foldable type electronic device according to one embodiment.
[0022] FIG. 15 is a diagram illustrating the operation of a multi-foldable electronic device according to one embodiment selectively outputting a screen in an unfolded state.
[0023] FIG. 16a or FIG. 16b is a drawing for explaining the operation of a multi-foldable electronic device according to one embodiment outputting a screen corresponding to a sequential state transition to an unfolded state, a half-folded state, or a folded state.
[0024] Hereinafter, embodiments of the present disclosure are described in detail with reference to the drawings so that those skilled in the art can easily practice them. However, the present disclosure may be embodied in various different forms and is not limited to the embodiments described herein. In relation to the description of the drawings, the same or similar reference numerals may be used for identical or similar components. Furthermore, in the drawings and related descriptions, descriptions of well-known functions and configurations may be omitted for clarity and brevity.
[0025] FIG. 1 is a block diagram of an electronic device (101) in a network environment (100) according to various embodiments.
[0026] Referring to FIG. 1, in a network environment (100), an electronic device (101) may communicate with an electronic device (102) through a first network (198) (e.g., a short-range wireless communication network) or with at least one of an electronic device (104) or a server (108) through a second network (199) (e.g., a long-range wireless communication network). According to one embodiment, the electronic device (101) may communicate with the electronic device (104) through a server (108). According to one embodiment, the electronic device (101) may include a processor (120), memory (130), input module (150), sound output module (155), display module (160), audio module (170), sensor module (176), interface (177), connection terminal (178), haptic module (179), camera module (180), power management module (188), battery (189), communication module (190), subscriber identification module (196), or antenna module (197). In some embodiments, at least one of these components (e.g., connection terminal (178)) may be omitted from the electronic device (101), or one or more other components may be added. In some embodiments, some of these components (e.g., sensor module (176), camera module (180), or antenna module (197)) may be integrated into a single component (e.g., display module (160)).
[0027] The processor (120) can control at least one other component (e.g., hardware or software component) of the electronic device (101) connected to the processor (120) by executing software (e.g., program (140)), for example, and can perform various data processing or operations. According to one embodiment, as at least part of the data processing or operations, the processor (120) can store commands or data received from other components (e.g., sensor module (176) or communication module (190)) in volatile memory (132), process the commands or data stored in volatile memory (132), and store the resulting data in non-volatile memory (134). According to one embodiment, the processor (120) may include a main processor (121) (e.g., central processing unit or application processor) or an auxiliary processor (123) that can operate independently or together with it (e.g., graphics processing unit, neural processing unit (NPU), image signal processor, sensor hub processor, or communication processor). For example, if the electronic device (101) includes a main processor (121) and an auxiliary processor (123), the auxiliary processor (123) may be configured to use lower power than the main processor (121) or to be specialized for a designated function. The auxiliary processor (123) may be implemented separately from the main processor (121) or as part thereof.
[0028] The auxiliary processor (123) may control at least some of the functions or states associated with at least one component of the electronic device (101) (e.g., display module (160), sensor module (176), or communication module (190)) on behalf of the main processor (121) while the main processor (121) is in an inactive (e.g., sleep) state, or together with the main processor (121) while the main processor (121) is in an active (e.g., application execution) state. According to one embodiment, the auxiliary processor (123) (e.g., image signal processor or communication processor) may be implemented as part of another functionally related component (e.g., camera module (180) or communication module (190)). According to one embodiment, the auxiliary processor (123) (e.g., neural network processing unit) may include a hardware structure specialized for processing an artificial intelligence model. The artificial intelligence model may be generated through machine learning. Such learning may be performed, for example, on the electronic device (101) itself where the artificial intelligence model is executed, or through a separate server (e.g., server (108)). The learning algorithm may include, for example, supervised learning, unsupervised learning, semi-supervised learning, or reinforcement learning, but is not limited to the examples described above. The artificial intelligence model may include a plurality of artificial neural network layers.An artificial neural network may be a deep neural network (DNN), a convolutional neural network (CNN), a recurrent neural network (RNN), a restricted Boltzmann machine (RBM), a deep belief network (DBN), a bidirectional recurrent deep neural network (BRDNN), a deep Q-network, or a combination of two or more of the above, but is not limited to the examples described above. In addition to the hardware structure, the artificial intelligence model may include a software structure, either additionally or substantially.
[0029] The memory (130) can store various data used by at least one component of the electronic device (101) (e.g., processor (120) or sensor module (176)). The data may include, for example, input data or output data for software (e.g., program (140)) and related commands. The memory (130) may include volatile memory (132) or non-volatile memory (134).
[0030] The program (140) may be stored as software in memory (130) and may include, for example, an operating system (142), middleware (144), or an application (146).
[0031] The input module (150) can receive commands or data to be used for a component of the electronic device (101) (e.g., processor (120)) from outside the electronic device (101) (e.g., user). The input module (150) may include, for example, a microphone, a mouse, a keyboard, a key (e.g., a button), or a digital pen (e.g., a stylus pen).
[0032] The sound output module (155) can output a sound signal to the outside of the electronic device (101). The sound output module (155) may include, for example, a speaker or a receiver. The speaker may be used for general purposes, such as multimedia playback or recording playback. The receiver may be used to receive incoming calls. According to one embodiment, the receiver may be implemented separately from the speaker or as part thereof.
[0033] The display module (160) can visually provide information to an external (e.g., user) of the electronic device (101). The display module (160) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. According to one embodiment, the display module (160) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by the touch.
[0034] The audio module (170) can convert sound into an electrical signal or, conversely, convert an electrical signal into sound. According to one embodiment, the audio module (170) can acquire sound through the input module (150) or output sound through the sound output module (155) or an external electronic device (e.g., electronic device (102)) (e.g., speaker or headphones) connected directly or wirelessly to the electronic device (101).
[0035] The sensor module (176) can detect the operating state of the electronic device (101) (e.g., power or temperature) or the external environmental state (e.g., user state) and generate an electrical signal or data value corresponding to the detected state. According to one embodiment, the sensor module (176) may include, for example, a gesture sensor, a gyroscope sensor, a barometric pressure sensor, a magnetic sensor, an accelerometer sensor, a grip sensor, a proximity sensor, a color sensor, an IR (infrared) sensor, a biosensor, a temperature sensor, a humidity sensor, or an illuminance sensor.
[0036] The interface (177) may support one or more specified protocols that can be used for the electronic device (101) to be connected directly or wirelessly to an external electronic device (e.g., electronic device (102)). According to one embodiment, the interface (177) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0037] The connection terminal (178) may include a connector through which the electronic device (101) can be physically connected to an external electronic device (e.g., electronic device (102)). According to one embodiment, the connection terminal (178) may include, for example, an HDMI connector, a USB connector, an SD card connector, or an audio connector (e.g., a headphone connector).
[0038] The haptic module (179) can convert an electrical signal into a mechanical stimulus (e.g., vibration or movement) or an electrical stimulus that can be perceived by the user through tactile or kinesthetic senses. According to one embodiment, the haptic module (179) may include, for example, a motor, a piezoelectric element, or an electric stimulation device.
[0039] The camera module (180) can capture still images and video. According to one embodiment, the camera module (180) may include one or more lenses, image sensors, image signal processors, or flashes.
[0040] The power management module (188) can manage power supplied to the electronic device (101). According to one embodiment, the power management module (188) can be implemented, for example, as at least part of a power management integrated circuit (PMIC).
[0041] The battery (189) can supply power to at least one component of the electronic device (101). According to one embodiment, the battery (189) may include, for example, a non-rechargeable primary battery, a rechargeable secondary battery, or a fuel cell.
[0042] The communication module (190) can support the establishment of a direct (e.g., wired) communication channel or a wireless communication channel between an electronic device (101) and an external electronic device (e.g., electronic device (102), electronic device (104), or server (108)), and the performance of communication through the established communication channel. The communication module (190) may include one or more communication processors that operate independently of the processor (120) (e.g., application processor) and support direct (e.g., wired) communication or wireless communication. According to one embodiment, the communication module (190) may include a wireless communication module (192) (e.g., cellular communication module, short-range wireless communication module, or GNSS (global navigation satellite system) communication module) or a wired communication module (194) (e.g., LAN (local area network) communication module, or power line communication module). The corresponding communication module among these communication modules can communicate with an external electronic device (104) through a first network (198) (e.g., a short-range communication network such as Bluetooth, WiFi (wireless fidelity) direct, or IrDA (infrared data association)) or a second network (199) (e.g., a legacy cellular network, a 5G network, a next-generation communication network, the Internet, or a computer network (e.g., a LAN or WAN)). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips). The wireless communication module (192) can identify or authenticate the electronic device (101) within a communication network such as the first network (198) or the second network (199) using subscriber information (e.g., International Mobile Subscriber Identifier (IMSI)) stored in the subscriber identification module (196).
[0043] The wireless communication module (192) can support 5G networks and next-generation communication technologies following 4G networks, for example, new radio access technology. NR access technology can support high-speed transmission of high-capacity data (enhanced mobile broadband (eMBB)), minimization of terminal power and connection of multiple terminals (massive machine type communications (mMTC)), or high reliability and low latency (ultra-reliable and low-latency communications (URLLC)). The wireless communication module (192) can support a high-frequency band (e.g., mmWave band) to achieve a high data transmission rate, for example. The wireless communication module (192) can support various technologies for securing performance in the high-frequency band, such as beamforming, massive MIMO (multiple-input and multiple-output), full-dimensional MIMO (FD-MIMO), array antenna, analog beam-forming, or large-scale antenna. The wireless communication module (192) can support various requirements specified in the electronic device (101), external electronic device (e.g., electronic device (104)), or network system (e.g., second network (199)). According to one embodiment, the wireless communication module (192) may support a Peak data rate (e.g., 20 Gbps or more) for eMBB realization, loss coverage (e.g., 164 dB or less) for mMTC realization, or U-plane latency (e.g., downlink (DL) and uplink (UL) each 0.5 ms or less, or round trip 1 ms or less) for URLLC realization.
[0044] An antenna module (197) can transmit a signal or power to or from an external source (e.g., an external electronic device). According to one embodiment, the antenna module (197) may include an antenna comprising a radiator made of a conductor or a conductive pattern formed on a substrate (e.g., a PCB). According to one embodiment, the antenna module (197) may include a plurality of antennas (e.g., an array antenna). In this case, at least one antenna suitable for a communication method used in a communication network, such as a first network (198) or a second network (199), may be selected from the plurality of antennas, for example, by a communication module (190). A signal or power may be transmitted or received between the communication module (190) and an external electronic device through the selected at least one antenna. According to some embodiments, in addition to the radiator, other components (e.g., a radio frequency integrated circuit (RFIC)) may be additionally formed as part of the antenna module (197).
[0045] According to various embodiments, the antenna module (197) may form a mmWave antenna module. According to one embodiment, the mmWave antenna module may include a printed circuit board, an RFIC disposed on or adjacent to a first surface (e.g., bottom surface) of the printed circuit board and capable of supporting a specified high frequency band (e.g., mmWave band), and a plurality of antennas (e.g., array antennas) disposed on or adjacent to a second surface (e.g., top surface or side surface) of the printed circuit board and capable of transmitting or receiving a signal of the specified high frequency band.
[0046] At least some of the above components can be connected to each other via a communication method between peripheral devices (e.g., bus, GPIO (general purpose input and output), SPI (serial peripheral interface), or MIPI (mobile industry processor interface)) and exchange signals (e.g., commands or data) with each other.
[0047] According to one embodiment, commands or data may be transmitted or received between the electronic device (101) and an external electronic device (104) through a server (108) connected to a second network (199). Each of the external electronic devices (102, or 104) may be the same or a different type of device as the electronic device (101). According to one embodiment, all or part of the operations performed on the electronic device (101) may be performed on one or more of the external electronic devices (102, 104, or 108). For example, if the electronic device (101) needs to perform a function or service automatically or in response to a request from a user or another device, the electronic device (101) may request one or more external electronic devices to perform at least part of the function or service instead of performing the function or service itself or additionally. One or more external electronic devices that receive the above request may execute at least part of the requested function or service, or additional function or service related to the request, and transmit the result of the execution to the electronic device (101). The electronic device (101) may provide the result as is or additionally processed as at least part of the response to the request. For this purpose, for example, cloud computing, distributed computing, mobile edge computing (MEC), or client-server computing technology may be used. The electronic device (101) may provide ultra-low latency services using, for example, distributed computing or mobile edge computing. In another embodiment, the external electronic device (104) may include an Internet of Things (IoT) device. The server (108) may be an intelligent server using machine learning and / or neural networks. According to one embodiment, the external electronic device (104) or the server (108) may be included within a second network (199).The electronic device (101) can be applied to intelligent services (e.g., smart home, smart city, smart car, or healthcare) based on 5G communication technology and IoT-related technology.
[0048] The electronic devices according to the various examples disclosed in this document may be of various forms. Electronic devices may include, for example, portable communication devices (e.g., smartphones), computer devices, portable multimedia devices, portable medical devices, cameras, wearable devices, or consumer electronics. The electronic devices according to the examples in this document are not limited to the devices described above.
[0049] FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g are drawings for illustrating a form factor of a multi-foldable structure that can be applied to an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1).
[0050] In FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g, it is assumed that the form factor of the electronic device (101) is multi-foldable, but this is merely an exemplary proposal, and the examples proposed in the present disclosure for electronic devices (101) of form factors such as foldable, slideable, or rollable may be applied identically or with variations predictable by what is disclosed.
[0051] FIGS. 2a to 2g are drawings for explaining the shape of an electronic device (e.g., the electronic device (101) of FIG. 1) having a form factor of a first type (e.g., type e) according to one example. The shape of the electronic device (101) having the shape of the operating state shown in FIGS. 2a to 2g has a bottom view shape that is the same as the lowercase letter 'e' in a fully folded state (see FIG. 2a).
[0052] FIGS. 3a to 3g are drawings for explaining the shape of an electronic device (101) having a form factor of a second type (e.g., G type) according to one example, according to an operating state. The shape of the electronic device (101) having the shape of the operating state shown in FIGS. 3a to 3g has a bottom view that is in the shape of the uppercase letter 'G' when fully folded (see FIG. 3a).
[0053] FIGS. 4a to 4g are drawings for explaining the shape of an electronic device (101) having a form factor of a third type (e.g., z type) according to one example, according to an operating state. The shape of the electronic device (101) having the shape of an operating state shown in FIGS. 4a to 4g has a bottom view shape that is the same as the lowercase (or uppercase) letter 'z' when fully folded (see FIG. 4a).
[0054] For example, assuming the form factor is multi-foldable, the operating state of the electronic device (101) may include a fully folded state (hereinafter referred to as 'folding state'), a half-folded state (hereinafter referred to as 'half-folding state'), and / or a fully unfolded state (hereinafter referred to as 'unfolding state'). For example, assuming the form factor is foldable, the operating state of the electronic device (101) may include a fully folded state and / or an unfolded state. For example, assuming the form factor is sliderable, the operating state of the electronic device (101) may include a fully extended state and / or a fully contracted state. For example, assuming the form factor is rollable, the operating state of the electronic device (101) may include a fully unfolded flat state and / or a fully rolled-up state.
[0055] FIG. 2a, 3a, or 4a is a bottom view of an electronic device (101) in a folded state, FIG. 2b, 3b, or 4b is a front view of an electronic device (101) in a folded state, FIG. 2c, 3c, or 4c is a rear view of an electronic device (101) in a folded state. FIG. 2d, 3d, or 4d is a front view of an electronic device (101) in a half-folded state, FIG. 2e, 3e, or 4e is a rear view of an electronic device (101) in a half-folded state. FIG. 2f, 3f, or 4f is a front view of an electronic device (101) in an unfolded state, FIG. 2g, 3g, or 4g is a rear view of an electronic device in an unfolded state.
[0056] Examples of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g may be combined with examples of FIG. 1 or FIGS. 5 to 15. The configuration of the electronic device (101) in FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g may be partly or wholly identical to the configuration of the electronic device (101) of FIG. 1.
[0057] The electronic device (101) of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g may be a foldable or bendable electronic device (101) as an example of the electronic device (101) illustrated in FIG. 1. For example, FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g assume that the electronic device (101) has a multi-foldable form factor capable of two folds, but this is merely illustrative. For example, the examples proposed in this disclosure may be applied to an electronic device having a foldable form factor capable of one fold and / or an electronic device having a form factor capable of three or more folds, either in the same way or with slight modifications. The examples proposed in this disclosure may be applied in the same way or with slight modifications to electronic devices having a sliderable and / or rollable form factor, in addition to electronic devices (101) having a foldable form factor in which the display area is varied as it is folded or unfolded. As an example, the examples in this disclosure may be proposed so that in an electronic device in which the display can be changed or the display area can be expanded / contracted by a structural mechanism, the execution screen of an application to be switched in response to the change in the display and / or change in the size of the display area can maintain a correlation with the execution screen of the application displayed in the previous state. Here, the correlation of the execution screen may mean that the state in which the user was using the application in the previous execution screen can be maintained identically in the subsequent execution screen. In the following disclosure, the term electronic device (101) may be understood to collectively refer to electronic devices capable of changing the display to be used or capable of varying the display area to output the execution screen of an application, in addition to the foldable electronic devices illustrated in FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g.
[0058] For convenience of explanation below, the electronic device (101) of the form shown in FIGS. 2a to 2g may be referred to as an 'e-type electronic device (101e)', the electronic device (101) of the form shown in FIGS. 3a to 3g may be referred to as a 'G-type electronic device (101G)', and the electronic device (101) of the form shown in FIGS. 4a to 4g may be referred to as a 'z-type electronic device (101z)'. Additionally, the 'electronic device (101)' may be referred to as an 'e-type electronic device (101e)', and the electronic device (101) of the form shown in FIGS. 3a to 3g may be referred to collectively as an 'e-type electronic device (101e)', a 'G-type electronic device (101G)', or a 'z-type electronic device (101z)'. The above distinction is intended to explain the difference based on the folded shape, and the examples proposed in this disclosure do not require the configuration or function of the electronic device (101) to be limited due to the type of form factor.
[0059] Hereinafter, for convenience of explanation, a spatial coordinate system (or an orthogonal coordinate system) including an X-axis, a Y-axis, or a Z-axis is illustrated in FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g. The housing serving as the reference for the X-axis direction, Y-axis direction, or Z-axis direction may differ for each description of the drawings. For example, in FIG. 2a, the Z-axis direction may be the front of the first housing part (210) with respect to the first housing part (210), and the Z-axis direction may be the rear of the first housing part (210).
[0060] Referring to FIGS. 2a through 2g, FIGS. 3a through 3g, or FIGS. 4a through 4g, the electronic device (101) may include a foldable housing (201) comprising a first housing portion (210), a second housing portion (220), and a third housing portion (230). According to one example, the foldable housing (201) may be defined and / or referred to as a foldable housing (201) or a deformable housing (201). The foldable housing (201) may include a first hinge structure (240) or a second hinge structure (250). The first hinge structure (240) may rotatably connect the first housing portion (210) and the second housing portion (220). The first hinge structure (240) may be defined and / or referred to as a first hinge assembly. The first hinge structure (240) may be, for example, an in-folding structure that folds inward. The first hinge structure (240) may be, for example, an out-folding structure that folds outward. The second hinge structure (250) may rotatably connect the second housing portion (220) and the third housing portion (230). The second hinge structure (250) may be defined and / or referred to as a second hinge assembly. The second hinge structure (250) may be, for example, an in-folding structure that folds inward. The second hinge structure (250) may be, for example, an out-folding structure that folds outward.
[0061] The electronic device (101) may include a flexible display (203) positioned on the front (e.g., + Z direction) of the foldable housing (201). The flexible display (203) may include a second display area (209). The entire area of the second display area (209) may be exposed to the outside in the unfolded state. In the half-folded state, only a portion of the entire area of the second display area (209) may be exposed to the outside. As an example, the second display area (209) may include a first display area (A1), a second display area (A2), a third display area (A3), a first folding area (A4), or a second folding area (A5). The first display area (A1) may be positioned on the front (e.g., + Z direction) of the first housing portion (210). The second display area (A2) may be positioned on the front (e.g., + Z direction) of the second housing portion (220). The third display area (A3) may be positioned on the front (e.g., + Z direction) of the third housing portion (230). The first folding area (A4) may be positioned on the front (e.g., + Z direction) of the first hinge structure (240). The second folding area (A5) may be positioned on the front (e.g., + Z direction) of the second hinge structure (250).
[0062] The electronic device (101) may include a display (204) (hereinafter referred to as 'cover display (204)') positioned on the rear (e.g., -Z direction) of a specific housing portion included in the foldable housing (201). The cover display (204) may include a first display area (208) on which a screen can be displayed in a folded state. The electronic device (101) may include a front camera (206) positioned on the front (e.g., +Z direction) of a specific housing portion included in the foldable housing (201). The electronic device (101) may include a rear camera (205) positioned on the rear (e.g., -Z direction) of a specific housing portion included in the foldable housing (201). For the electronic device (101) of a specific form factor (e.g., Z-type form factor shown in FIGS. 4a to 4g), a specific display area (e.g., A1) included in the flexible display (203) may be used as the cover display (204). In this case, the electronic device (101) may be positioned so that the front camera (206) and the rear camera (205) face in the same direction (e.g., - Z direction) in different housing parts (e.g., second housing part (220) or third housing (230)) in a half-folded or unfolded state.
[0063] According to one example, the first housing portion (210) may be connected to the first hinge structure (240). The first housing portion (210) may include a first front surface facing a first direction (e.g., the +Z direction in FIG. 2f) or a first rear surface facing a second direction opposite to the first direction (e.g., the -Z direction in FIG. 2g). The second housing portion (220) may be connected to the first hinge structure (240) or the second hinge structure (250). The second housing portion (220) may include a second front surface facing the first direction (e.g., the +Z direction in FIG. 2f) or a second rear surface facing a second direction opposite to the first direction (e.g., the -Z direction in FIG. 2g). The first housing portion (210) may be connected to the second hinge structure (250). The third housing portion (230) may include a third front surface facing the first direction (e.g., the +Z direction in FIG. 2f) or a third rear surface facing the second direction opposite to the first direction (e.g., the -Z direction in FIG. 2g).
[0064] For example, in an e-type electronic device (101e) or a G-type electronic device (101G), the foldable housing (201) may have both the first housing portion (210) and the third housing portion (230) folded inward with respect to the second housing portion (220). In this case, the first hinge structure (240) and the second hinge structure (250) may both be in-folding structures. For example, in a z-type electronic device (101z), the foldable housing (201) may have a structure in which the first housing portion (210) folds outward and the third housing portion (230) folds inward with respect to the second housing portion (220). In this case, the first hinge structure (240) may be an out-folding structure and the second hinge structure (250) may be an in-folding structure.
[0065] Referring to FIGS. 2a to 2g, the e-type electronic device (101e) can be folded in such a way that the first front surface of the first housing portion (210) and the second front surface of the second housing portion (220) come into contact with each other by rotating the second housing portion (220) relative to the first housing portion (210) by means of a first hinge structure (240) which is an in-folding structure (see folding state of FIGS. 2a to 2c, half-folding state of FIG. 2d or FIG. 2e). The e-type electronic device (101e) can be unfolded so that the first front of the first housing part (210) and the second front of the second housing part (220) face in the same direction by rotating the second housing part (220) with respect to the first housing part (210) by means of the first hinge structure (240) which is an in-folding structure (see unfolded state of FIG. 2f or FIG. 2g). The e-type electronic device (101e) can be folded so that the second front of the second housing part (220) and the third front of the third housing part (230) face each other by rotating the third housing part (230) with respect to the second housing part (220) by means of the second hinge structure (250) which is an in-folding structure (see folded state of FIG. 2a to 2c). The e-type electronic device (101e) can be unfolded by rotating the third housing part (230) relative to the second housing part (220) by means of a second hinge structure (250) which is an in-folding structure, so that the second front of the second housing part (220) and the third front of the third housing part (230) face in the same direction (see the half-folded state of FIG. 2d or 2e, and the unfolded state of FIG. 2f or 2g).
[0066] According to one example, when the first housing portion (210) and the second housing portion (220) are folded by the first hinge structure (240) (e.g., the folded state of FIG. 2a to 2c, the half-folded state of FIG. 2d or FIG. 2e), the first front surface of the first housing portion (210) may face the second front surface of the second housing portion (220). When the first housing portion (210) and the second housing portion (220) are folded by the first hinge structure (240) (e.g., the folded state of FIG. 2a to 2c, the half-folded state of FIG. 2d or FIG. 2e), parts of the flexible display (203) placed on the front of the first housing portion (210) and the second housing portion (220) (e.g., A1, A2, A4) may not be exposed to the outside. When the first housing portion (210) and the second housing portion (220) are folded by the first hinge structure (240) (e.g., the folded state of FIG. 2a to 2c, the half-folded state of FIG. 2d or FIG. 2e), the first rear surface of the first housing portion (210) and the second rear surface of the second housing portion (220) may face in opposite directions.
[0067] According to one example, in an e-type electronic device (101e), when the first housing portion (210) and the second housing portion (220) are unfolded by the first hinge structure (240) (e.g., the unfolded state of FIG. 2f or FIG. 2g), the first front surface of the first housing portion (210) and the second front surface of the second housing portion (220) may face in the same direction. When the first housing portion (210) and the second housing portion (220) are unfolded by the first hinge structure (240) (e.g., the unfolded state of FIG. 2f or FIG. 2g), parts (e.g., A1, A2, A4) of the flexible display (203) placed on the front surface of the first housing portion (210) and the second housing portion (220) may be exposed to the outside. When the first housing portion (210) and the second housing portion (220) are unfolded by the first hinge structure (240), the first rear surface of the first housing portion (210) and the second rear surface of the second housing portion (220) may face in the same direction.
[0068] According to one example, when the second housing portion (220) and the third housing portion (230) are folded by the second hinge structure (250) (e.g., the folding state of FIGS. 2a to 2c), the second front surface of the second housing portion (220) may face the direction in which the third front surface of the third housing portion (230) faces. When the second housing portion (220) and the third housing portion (230) are folded by the second hinge structure (250) (e.g., the folding state of FIGS. 2a to 2c), parts of the flexible display (203) (e.g., A2, A3, A5) placed on the front of the second housing portion (220) and the third housing portion (230) may not be exposed to the outside. When the second housing portion (220) and the third housing portion (230) are folded by the second hinge structure (250) (e.g., the folded state of FIGS. 2a to 2c), the second rear surface of the second housing portion (220) and the third rear surface of the third housing portion (230) may face in opposite directions.
[0069] According to one example, in an e-type electronic device (101e), when the second housing portion (220) and the third housing portion (230) are unfolded by the second hinge structure (250) (e.g., the half-folded state of FIG. 2d or FIG. 2e, the unfolded state of FIG. 2f or FIG. 2g), the second front of the second housing portion (220) and the third front of the third housing portion (230) may face in the same direction. When the second housing portion (220) and the third housing portion (230) are unfolded by the second hinge structure (250) (e.g., the half-folded state of FIG. 2d or FIG. 2e, the unfolded state of FIG. 2f or FIG. 2g), parts of the flexible display (203) placed on the front of the second housing portion (220) and the third housing portion (230) (e.g., A2, A3, A5) may be exposed to the outside. When the second housing portion (220) and the third housing portion (230) are unfolded by the second hinge structure (250), the second rear side of the second housing portion (220) and the third rear side of the third housing portion (230) may face the same direction.
[0070] Referring to FIGS. 3a to 3g, the G-type electronic device (101G) can be folded so that the first front surface of the first housing portion (210) and the second front surface of the second housing portion (220) face each other by rotating the first housing portion (210) with respect to the second housing portion (220) by means of a first hinge structure (240) which is an in-folding structure (see folding state in FIGS. 3a to 3c). The G-type electronic device (101G) can be unfolded by rotating the first housing part (210) relative to the second housing part (220) by means of a first hinge structure (240) which is an in-folding structure, so that the first front surface of the first housing part (210) and the second front surface of the second housing part (220) face in the same direction (see unfolded state of FIG. 3d or 3e, unfolded state of FIG. 3f or 3g). The G-type electronic device (101G) can be folded in such a way that the second front surface of the second housing part (220) and the third front surface of the third housing part (230) come into contact with each other by rotating the third housing part (230) with respect to the second housing part (220) by means of a second hinge structure (250) which is an in-folding structure (see folding state in FIGS. 3a to 3c). The G-type electronic device (101G) can be unfolded by rotating the third housing part (230) relative to the second housing part (220) by means of a second hinge structure (250) which is an in-folding structure, so that the second front of the second housing part (220) and the third front of the third housing part (230) face in the same direction (see the half-folded state of FIG. 3d or 3e, and the unfolded state of FIG. 3f or 3g).
[0071] According to one example, when the first housing portion (210) and the second housing portion (220) of the G-type electronic device (101G) are folded by the first hinge structure (240) (e.g., the folding state of FIGS. 3a to 3c), the first front surface of the first housing portion (210) may face the second front surface of the second housing portion (220). When the first housing portion (210) and the second housing portion (220) are folded by the first hinge structure (240) (e.g., the folding state of FIGS. 3a to 3c), parts (e.g., A1, A2, A4) of the flexible display (203) placed on the front of the first housing portion (210) and the second housing portion (220) may not be exposed to the outside. When the first housing portion (210) and the second housing portion (220) are folded by the first hinge structure (240) (e.g., the folded state of FIGS. 3a to 3c), the first rear surface of the first housing portion (210) and the second rear surface of the second housing portion (220) may face in opposite directions.
[0072] According to one example, in a G-type electronic device (101G), when the first housing portion (210) and the second housing portion (220) are unfolded by the first hinge structure (240) (e.g., the half-folded state of FIG. 3d or FIG. 3e, the unfolded state of FIG. 3f or FIG. 3g), the first front surface of the first housing portion (210) and the second front surface of the second housing portion (220) may face in the same direction. When the first housing portion (210) and the second housing portion (220) are unfolded by the first hinge structure (240) (e.g., the half-folded state of FIG. 3d or FIG. 3e, the unfolded state of FIG. 3f or FIG. 3g), a part (e.g., A1, A2, A4) or all (e.g., A1, A2, A3, A4, A5) of the flexible display (203) placed on the front of the first housing portion (210) and the second housing portion (220) may be exposed to the outside. When the first housing portion (210) and the second housing portion (220) are unfolded by the first hinge structure (240), the first rear surface of the first housing portion (210) and the second rear surface of the second housing portion (220) may face the same direction.
[0073] According to one example, when the second housing portion (220) and the third housing portion (230) of the G-type electronic device (101G) are folded by the second hinge structure (250) (e.g., the folded state of FIG. 3a to 3c, the half-folded state of FIG. 3d or FIG. 3e), the second front surface of the second housing portion (220) may face the third front surface of the third housing portion (230). When the second housing portion (220) and the third housing portion (230) are folded by the second hinge structure (250) (e.g., the folded state of FIG. 3a to 3c, the half-folded state of FIG. 3d or FIG. 3e), parts of the flexible display (203) placed on the front of the second housing portion (220) and the third housing portion (230) (e.g., A2, A3, A5) may not be exposed to the outside. When the second housing portion (220) and the third housing portion (230) are folded by the second hinge structure (250) (e.g., the folded state of FIG. 3a to 3c, the half-folded state of FIG. 3d or FIG. 3e), the second rear surface of the second housing portion (220) and the third rear surface of the third housing portion (230) may face in opposite directions.
[0074] According to one example, when the second housing portion (220) and the third housing portion (230) of the G-type electronic device (101G) are unfolded by the second hinge structure (250) (e.g., the unfolded state of FIG. 3f or FIG. 3g), the second front surface of the second housing portion (220) and the third front surface of the third housing portion (230) may face in the same direction. When the second housing portion (220) and the third housing portion (230) are unfolded by the second hinge structure (250) (e.g., the unfolded state of FIG. 3f or FIG. 3g), all of the flexible displays (203) placed on the front surfaces of the second housing portion (220) and the third housing portion (230) (e.g., A1, A2, A3, A4, A5) may be exposed to the outside. When the second housing portion (220) and the third housing portion (230) are unfolded by the second hinge structure (250), the second rear surface of the second housing portion (220) and the third rear surface of the third housing portion (230) may face in the same direction.
[0075] Referring to FIGS. 4a to 4g, the z-type electronic device (101z) can be folded in such a way that the first rear surface of the first housing part (210) and the second rear surface of the second housing part (220) come into contact with each other by rotating the second housing part (220) relative to the first housing part (210) by means of a first hinge structure (240) which is an out-folding structure (see folding state of FIGS. 4a to 4c, half-folding state of FIG. 4d or 4e). The z-type electronic device (101z) can be unfolded so that the first front surface of the first housing portion (210) and the second front surface of the second housing portion (220) face in the same direction by rotating the second housing portion (220) relative to the first housing portion (210) by means of a first hinge structure (240) which is an out-folding structure (see unfolded state of FIG. 4f or FIG. 4g). The z-type electronic device (101z) can be folded so that the second front surface of the second housing portion (220) and the third front surface of the third housing portion (230) come into contact with each other by rotating the second housing portion (220) relative to the third housing portion (230) by means of a second hinge structure (250) which is an in-folding structure (see folded state of FIG. 4a to FIG. 4c). The z-type electronic device (101z) can be unfolded by rotating the second housing part (220) relative to the third housing part (230) by means of a second hinge structure (250) which is an in-folding structure, so that the second front of the second housing part (220) and the third front of the third housing part (230) face in the same direction (see the half-folded state of FIG. 4d or 4e, and the unfolded state of FIG. 4f or 4g).
[0076] According to one example, when the first housing portion (210) and the second housing portion (220) of the z-type electronic device (101z) are folded by the first hinge structure (240) (e.g., the folding state of FIG. 4a to 4c, the half-folding state of FIG. 4d or FIG. 4e), the first rear surface of the first housing portion (210) may face the second rear surface of the second housing portion (220). When the first housing portion (210) and the second housing portion (220) are folded by the first hinge structure (240) (e.g., the folding state of FIG. 4a to 4c, the half-folding state of FIG. 4d or FIG. 4e), the cover display (204) (e.g., A1) placed on the first front surface of the first housing portion (210) may be exposed to the outside. For example, when the first housing portion (210) and the second housing portion (220) are folded by the first hinge structure (240), the cover display (204) exposed to the outside may be deactivated. When the first housing portion (210) and the second housing portion (220) are folded by the first hinge structure (240) (e.g., the folded state of FIGS. 4a to 4c, the half-folded state of FIGS. 4d or FIGS. 4e), the first front of the first housing portion (210) and the second front of the second housing portion (220) may face in opposite directions.
[0077] According to one example, in a z-type electronic device (101z), when the first housing portion (210) and the second housing portion (220) are unfolded by the first hinge structure (240) (e.g., the unfolded state of FIG. 4f or FIG. 4g), the first front surface of the first housing portion (210) and the second front surface of the second housing portion (220) may face in the same direction. When the first housing portion (210) and the second housing portion (220) are unfolded by the first hinge structure (240) (e.g., the unfolded state of FIG. 4f or FIG. 4g), parts of the flexible display (203) placed on the front of the first housing portion (210) and the second housing portion (220) (e.g., A1, A2, A3, A4, A5) may be exposed to the outside. When the first housing portion (210) and the second housing portion (220) are unfolded by the first hinge structure (240), the first rear surface of the first housing portion (210) and the second rear surface of the second housing portion (220) may face in the same direction.
[0078] According to one example, when the second housing portion (220) and the third housing portion (230) of the z-type electronic device (101z) are folded by the second hinge structure (250) (e.g., the folding state of FIGS. 2a to 2c), the second front surface of the second housing portion (220) may face the third front surface of the third housing portion (230). When the second housing portion (220) and the third housing portion (230) are folded by the second hinge structure (250) (e.g., the folding state of FIGS. 4a to 4c), parts (e.g., A2, A3, A5) of the flexible display (203) placed on the front of the second housing portion (220) and the third housing portion (230) may not be exposed to the outside. When the second housing portion (220) and the third housing portion (230) are folded by the second hinge structure (250) (e.g., the folded state of FIGS. 4a to 4c), the second rear surface of the second housing portion (220) and the third rear surface of the third housing portion (230) may face in opposite directions.
[0079] According to one example, in a z-type electronic device (101z), when the second housing portion (220) and the third housing portion (230) are unfolded by the second hinge structure (250) (e.g., the half-folded state of FIG. 4d or FIG. 4e, the unfolded state of FIG. 4f or FIG. 4g), the second front of the second housing portion (220) and the third front of the third housing portion (230) may face in the same direction. When the second housing portion (220) and the third housing portion (230) are unfolded by the second hinge structure (250) (e.g., the half-folded state of FIG. 4d or FIG. 4e, the unfolded state of FIG. 4f or FIG. 4g), parts of the flexible display (203) placed on the front of the second housing portion (220) and the third housing portion (230) (e.g., A2, A3, A5) may be exposed to the outside. When the second housing portion (220) and the third housing portion (230) are unfolded by the second hinge structure (250), the second rear side of the second housing portion (220) and the third rear side of the third housing portion (230) may face the same direction.
[0080] According to one example, the electronic device (101) may include a cover display (204) in addition to a flexible display (203). The cover display (204) may be exposed to the outside even when the electronic device (101) is completely folded. The cover display (204) is positioned opposite to the flexible display (203), and the portion exposed to the user may vary depending on the state of the electronic device (101). In one example, the cover display (204) may be exposed together with a portion of the flexible display (203) in a specific operating state (e.g., the half-folded state of FIG. 4d or FIG. 4e, the unfolded state of FIG. 4f or FIG. 4g). For example, the cover display (204) can be activated in a folded state (e.g., the folded state of FIG. 4a, FIG. 4b, or FIG. 4c) and / or in an unfolded state (e.g., the unfolded state of FIG. 4f or FIG. 4g), and can be deactivated in a half-folded state (e.g., the half-folded state of FIG. 4d or FIG. 4e).
[0081] According to one example, the electronic device (101) may include at least one sensor area. Each sensor area may be placed on a foldable housing (201). At least one of an inertial measurement unit (IMU), a digital Hall IC, an illuminance sensor, and a camera (e.g., an image sensor) may be placed in the sensor area.
[0082] In one example, the IMU may be a 3-axis or 6-axis accelerometer or a gyroscope. The electronic device (101) may detect the degree of inclination of the foldable housing (201), more specifically the angle between the housing parts, based on the IMU sensor values. The electronic device (101) may include a 6-axis sensor for each housing part and may determine the angle between the housing parts based on the angle between the 6-axis sensors mounted on each housing. The electronic device (101) may determine the folded state, unfolded state, and degree of fold or unfolded (angle) of the electronic device (101) based on the angle between the first housing part (210) and the second housing part (220) and / or the angle between the second housing part (220) and the third housing part (230). The electronic device (101) may detect a change in the state of the foldable housing (201) using the IMU sensor. For example, the electronic device (101) can detect a continuous state in which the third housing part (230) is folded or unfolded relative to the second housing part (220) according to a continuous change in the IMU sensor value.
[0083] An electronic device (101) according to one example can determine whether the space between the first housing portion (210) and the second housing portion (220) or between the second housing portion (220) and the third housing portion (230) of the foldable housing (201) is fully unfolded (e.g., unfolded or open) or fully folded (e.g., folded or closed) based on a digital Hall sensor value. In cases where the electronic device (101) only needs to determine the opening or closing of the housing portion, it can determine the opening or closing of the housing portion based on an interrupt occurrence event caused by reaching a threshold value of the digital Hall sensor. The digital Hall sensor may be used to detect the opening or closing of the foldable housing (201) without accompanying movement of the image sensor. For example, in an e-type electronic device (101e), a digital Hall sensor can be used to detect complete folding (close) / unfolding (open) when the first housing portion (210) is folded or unfolded. Alternatively, in a G-type electronic device (101G), a digital Hall sensor can be used to detect complete folding / unfolding when the third housing portion (230) is folded or unfolded.
[0084] According to one example, the electronic device (101) may display an execution screen according to the use of an application in a part or the entire display area of a cover display (204) or in a part or the entire display area of a flexible display, depending on the operating state of the electronic device (101). The operating state of the electronic device (101) may be determined based on the angle between the first housing part (210) and the second housing part (220) and / or the angle between the second housing part (220) and the third housing part (230). For example, the operating state of the electronic device (101) may include a first folded state, a first unfolded state, or a first intermediate state by the first housing part (210) and the second housing part (220). For example, the operating state of the electronic device (101) may include a second folded state, a second unfolded state, or a second intermediate state by means of the second housing part (220) and the third housing part (230).
[0085] According to one example, an electronic device (101) may select either a flexible display (203) or a display (204) as a display to display an application execution screen based on the operating state of the electronic device (101). Depending on the folded or unfolded state of the electronic device (101), the electronic device (101) may display an application execution screen on the entire flexible display (203), at least a part of the flexible display (203), the entire cover display (204), or at least a part of the cover display (204). For example, the electronic device (101) may display an application execution screen on the cover display (204) in response to the electronic device (101) detecting a first folded state and a second folded state based on IMU sensor and digital Hall sensor values. The electronic device (101) can display an application execution screen on a part of the flexible display (203) in response to the electronic device (101) detecting a first intermediate state and a second unfolded state based on IMU sensor and digital Hall sensor values. The electronic device (101) can display an application execution screen on the flexible display (203) in response to the electronic device (101) detecting a first unfolded state and a second unfolded state based on IMU sensor and digital Hall sensor values.
[0086] In one example, the electronic device (101) can adaptively control an image to be displayed as an execution screen of an application to be displayed on a flexible display (203) and / or a cover display (204) according to a change in the state of the electronic device (101).
[0087] An electronic device (101) according to one example may include a plurality of cameras. Based on the state where the foldable housing (201) is fully folded, it may include a front camera (206) and a rear camera (205). In one example, when the foldable housing (201) is fully unfolded, the front camera (206) and the rear camera (205) may face in the same direction. For example, in an e-type electronic device (101e) and a G-type electronic device (101G), the rear camera (205) may be positioned on the rear of the second housing portion (220) or the third housing portion (230) of the foldable housing (201), and the front camera (206) may be positioned on the front of the cover display (204) positioned on the rear (201b) of the foldable housing (201), that is, on the rear of the first housing portion (210) or the second housing portion (220) of the foldable housing (201). In one example, when the foldable housing (201) is fully unfolded, the front camera (206) and the rear camera (205) may face in opposite directions. For example, in a z-type electronic device (101z), the rear camera (205) may be positioned on the rear of the third housing portion (230) of the foldable housing (201), and the front camera (206) may be positioned on a portion of the flexible display (203) (e.g., the first housing portion (210)) positioned on the front (201a) of the foldable housing (201).
[0088] In one example, the front camera (206) or rear camera (205) may include one or more lenses, an image sensor and / or an image signal processor. The flash may include, for example, a light-emitting diode or a xenon lamp. In one example, two or more lenses (infrared camera, wide-angle and telephoto lenses) and image sensors may be placed on one side of the electronic device (101).
[0089] In one example, the electronic device (101) can display the shooting screens of the rear camera (205) and the front camera (206) on a flexible display (203) or a cover display (204) divided into multiple windows.
[0090] In one example, the multiple cameras included in the electronic device (101) may differ in type and / or performance. The type and / or performance may differ between the rear camera (205) and the front camera (206), or the type and / or performance may differ between the multiple cameras included in the rear camera (205). The electronic device (101) may consider one of the two cameras as the main camera and the other as the sub-camera, and may use the shooting results of the sub-camera to correct or expand the results of the main camera after shooting. The electronic device (101) can prevent problems that may occur due to performance differences between cameras, such as angle of view (e.g., wide-angle or telephoto) and resolution, when outputting multiple camera images or utilizing them as input information for an artificial intelligence model. For example, if the performance of the rear camera (205) is better than that of the front camera (206), and they are shooting in the same direction, the rear camera (205) may be set as the main camera and the front camera (206) as the sub-camera, and a preview image may be displayed using the images acquired by the two cameras. In one example, the electronic device (101) can express various images in a single image by changing the magnification level of each camera or diversifying the target being focused on. For example, when two cameras are facing the same direction, the image may be captured using a camera with relatively lower performance based on user settings, but high-quality information from a camera with relatively higher performance can be reflected for a specific part. In various examples, the electronic device (101) can apply various adjustments so that the user perceives the performance difference between multiple cameras as minimal. For example, the electronic device (101) can apply adjustments to image quality, settings of the main camera, diversification of focus, and adjustment of the distance between previews.
[0091] In one example, the rear camera (205) may include a plurality of cameras, and the baseline between each rear camera (205) may be smaller than the baseline between one of the rear cameras (205) and the front camera (206). The depth information obtainable using two cameras may have a first depth information obtainable using one rear camera (205) and the front camera (206) that is deeper than the second depth information obtainable using each rear camera (205). When the rear camera (205) and the front camera (206) are facing the same direction, the shooting screens of the two cameras can be appropriately combined to increase the accuracy of the depth information of the screen and to take a three-dimensional photograph.
[0092] In one example, the field of view (or magnification) of the image that can be captured by the rear camera (205) and / or the front camera (206) and the screen size of the flexible display (203) and / or the cover display (204) may be different. The electronic device (101) may crop a portion of the preview image to display a wide-angle preview image on a narrow screen.
[0093] According to one example, when the electronic device (101) is fully folded, the front camera (205) can photograph the direction of the user, and the rear camera (205) can photograph the direction opposite to the user. Alternatively, when the electronic device (101) is fully unfolded, both the front camera (206) and the rear camera (205) can photograph the direction opposite to the user. In one example, referring to FIGS. 4f and 4g, even when the z-type electronic device (101z) is fully unfolded, the front camera (206) can photograph the direction of the user, and the rear camera (205) can photograph the direction opposite to the user.
[0094] According to one example, the camera may not be visually exposed. For example, the camera may be configured as an under-display camera (UDC). Pixels in one area of the flexible display (203) corresponding to the location of the UDC may be configured differently from pixels in other areas so that the image sensor and / or camera may not be visually exposed.
[0095] According to one example, a rear camera (205) may be positioned on the rear of the second housing portion (220) or the third housing portion (230) of the foldable housing (201) to generate a first preview image. A front camera (206) may be positioned on the front of the display (204) or the front of the first housing portion (210) to generate a second preview image. The electronic device (101) may determine the user's field of view based on the operating state of the electronic device (101). The operating state of the electronic device (101) may be determined based on the angle between the first housing portion (210) and the second housing portion (220) and / or the angle between the second housing portion (220) and the third housing portion (230). For example, the operating state of the electronic device (101) may include a first folded state, a first unfolded state, or a first intermediate state by means of the first housing part (210) and the second housing part (220). For example, the operating state of the electronic device (101) may include a second folded state, a second unfolded state, or a second intermediate state by means of the second housing part (220) and the third housing part (230).
[0096] According to one example, an electronic device (101) can determine a flexible display (203) or a display (204) that is included in the user's field of view according to the operating state of the electronic device (101). Depending on the folded or unfolded state of the electronic device (101), the electronic device (101) can display a first screen and a second screen, respectively, on the entire flexible display (203), at least a part of the flexible display (203), the entire cover display (204), or at least a part of the cover display (204). For example, the electronic device (101) can display a second preview image by the front camera (206) on the cover display (204) in response to the electronic device (101) detecting a first folded state and a second folded state based on IMU sensor and digital Hall sensor values. Based on IMU sensor and digital Hall sensor values, the electronic device (101) may display a first preview image by the rear camera (205) on a portion of the flexible display (203) and a second preview image by the front camera (206) on the cover display (204) in response to the electronic device (101) detecting a first intermediate state and / or a second unfolded state based on IMU sensor and digital Hall sensor values.
[0097] In one example, the electronic device (101) can adaptively control a preview image displayed on a flexible display (203) and / or a cover display (204) according to a change in the state of the electronic device (101). For example, when the electronic device (101) detects a change in state where the third housing portion (230) is unfolded while the electronic device (101) is fully folded, it can output a screen to the third display area (A3) of the flexible display (203).
[0098] According to one example, a button (207) may be included on one side of the foldable housing (201). The button (207) may be placed on the left side (e.g., the left side of the first housing portion (210)) or the right side (e.g., the right side of the third housing portion (230)) of the foldable housing (201). It may be located on the left side or the right side when the foldable housing (201) is fully folded. Depending on the state of the electronic device (101), the button (207) may be changed to the left side or the right side relative to the user.
[0099] FIG. 5 is a block diagram of an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 1).
[0100] Referring to FIG. 5, in a network environment, an electronic device (101) can communicate with an external display device (501) based on a wireless communication protocol or with an external display device (501) based on a wired communication protocol. The electronic device (101) may include at least one processor (510) (e.g., processor (120) of FIG. 1 (hereinafter referred to as 'processor (510)'), at least one memory (520) (e.g., memory (130) of FIG. 1) (hereinafter referred to as 'memory (520)'), a display (530) (e.g., display module (160) of FIG. 1 (hereinafter referred to as 'display (530)'), a communication circuit (540) (e.g., communication module (190) of FIG. 1 (hereinafter referred to as 'communication circuit (540)'), or an interface (550) (e.g., interface (177) of FIG. 1 (hereinafter referred to as 'interface (550)'). In some examples, at least one of these components (e.g., communication circuit (540) or interface (550)) may be omitted from the electronic device (101), or one or more other components may be added. In the example, some of these components (e.g., communication circuit (540) or interface (550)) may be integrated into a single component (e.g., communication module).
[0101] The processor (510) may be implemented as one or more integrated circuit (or circuitry) chips and may perform various data processing operations. The processor (510) may include at least one electrical circuit and may process instructions (or programs, data, etc.) stored in memory (520) individually or collectively in a distributed manner. The processor (510) may include a processor assembly comprising one or more processing circuits. The processor (510) may include any processing circuit that is operative to control the performance or operation of one or more components of the electronic device (101) (e.g., memory (520), display (530), communication circuit (540), and / or interface (550)). The processor (510) (e.g., application processor (AP) or communication processor (CP)) may be implemented, for example, as a system on chip (SoC). The processor (510) may be implemented with a plurality of cores (or at least one core circuit), a plurality of chips, or a plurality of chipsets. The processor (510) may include one or more processing circuits. The processor (510) may include one or more processing circuits configured to perform the various functions of the present disclosure individually and / or collectively. As an example without limitation, at least a portion of the processor (510) may be included in a first chip of the electronic device (101), and at least another portion of the processor (510) may be included in a second chip of an electronic device different from the first chip of the electronic device (101).
[0102] Memory (520) can store various data used by at least one component (e.g., processor (510)) of the electronic device (101). The data may include, for example, software (e.g., a program) and input or output data for instructions associated therewith. Memory (520) may include volatile memory or non-volatile memory. A program may be stored in memory (520) as software, for example. According to one example, memory (520) may include an operating system, middleware, or application.
[0103] The display (530) can visually provide information to an external (e.g., user) of the electronic device (101). The display (530) may include, for example, a display, a holographic device, or a projector and a control circuit for controlling said device. As an example, the display (530) may provide a screen of use for a specific application running on the electronic device (101). The display (530) may include a touch sensor configured to detect a touch, or a pressure sensor configured to measure the intensity of the force generated by the touch.
[0104] According to one example, the display (530) may include a first display (531) and a second display (533). The first display (531) may be exposed, for example, through a rear cover of a specific housing portion. The first display (531) may be referred to as a cover display (e.g., the cover display (204) of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g). For example, the first display (531) may be exposed through a second rear surface of the second housing portion (220) of FIG. 2a. The first display (531) may have a relatively small display area compared to the second display (533), which will be described in more detail later, and in this respect, it may be referred to as a 'sub-display'.
[0105] The second display (533) may be exposed to the outside when the electronic device (101) is unfolded (e.g., in a half-folded state or in an unfolded state). The second display (533) may be referred to as a flexible display (e.g., the flexible display (203) of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g). As an example, at least a portion of the second display (533) (e.g., a portion corresponding to a hinge) (e.g., display area A4 or A5 in FIG. 2a) may be folded together with the second display (533) when the electronic device (101) is folded. As previously stated, the second display (533) may be a flexible display (203), but it will be named the second display (533) to distinguish it from the first display (531). For example, if the form factor is of the foldable type, the first area and the second area of the second display (533) may face each other when folded. The first area and the second area may be distinguished based on a boundary line included in a part corresponding to the hinge, for example. In addition, the first area and the second area of the second display (533) may form substantially the same plane when unfolded. The size of the second display (533) may be, for example, larger than that of the first display (531). Alternatively, the resolution of the second display (533) may be expressed as being higher than that of the first display (531). According to one example, in order to output a screen to the first display (531), first attribute information may be set by default in the application. According to one example, in order to output a screen to the second display (533), second attribute information may be set in the application. The first attribute information is based on the output characteristics of the first display (531), and the second attribute information is based on the output characteristics of the second display (533), so they may be different from each other.
[0106] Table 1 below defines items that can be set as first or second attribute information for an application.
[0107] Property Item Application #1 Application #2 Screen Size OnOff Screen Orientation OffOff Screen Density OnOff Smallest Screen Size OffOff
[0108] In the above , 'On' may be a setting that requires the output screen to be reconfigured so that changed information regarding the corresponding attribute item can be reflected when a screen transition occurs in a situation where a screen corresponding to the application is displayed. For example, if the screen size of the first attribute information and the screen size of the second attribute information change due to a screen transition from the first display (531) to the second display (533), screen reconfiguration will be necessary to maintain the use of Application #1. However, if the screen size of the first attribute information and the screen size of the second attribute information change due to a screen transition from the first display (531) to the second display (533), screen reconfiguration may not be necessary to maintain the use of Application #2. In the present disclosure, an application configured to require screen reconfiguration in response to a screen transition may be referred to as an 'application with identified change in usage state'. In the present disclosure, an application configured not to require screen reconfiguration in response to a screen transition may be referred to as an 'application with unidentified change in usage state'.
[0109] In the present disclosure, a display area in which an electronic device (101) can output a specific screen on a first display (531) will be assumed to be a first display area (e.g., a first display area (208) of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g). In addition, in the present disclosure, a display area in which an electronic device (101) can output a specific screen on a second display (533) will be assumed to be a second display area (e.g., a second display area (209) of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g). However, this is merely an example, and the number of displays and / or the number of display areas must not be specified as two.
[0110] For example, the processor (510) may use a portion of the entire display area of a display (e.g., the display (530) of FIG. 5) as a first display area (208) and the entire display area as a second display area (209) to perform the operation according to FIG. 6. For example, the processor (510) may use the display area in an unextended state (e.g., a folding state) of an expandable display (e.g., a flexible display) as the first display area (208) and the display area in an extended state (e.g., an unfolded state) as the second display area (209) to perform the operation according to FIG. 6. For example, the processor (510) may perform the operation according to FIG. 6 by using a display area capable of outputting a screen on one internal display (e.g., display (530) of FIG. 5) as the first display area (208) and a display area capable of outputting a screen on the display of another electrically connected device (e.g., display device (501) of FIG. 5) as the second display area (209). For example, the processor (510) may perform the operation according to FIG. 6 by using a display area capable of outputting a screen on each display of two other electrically connected devices (e.g., display device (501) of FIG. 5) as the first display area (208) or the second display area (209).
[0111] The communication circuit (540) may include one or more communication circuits. As an example, the communication circuit (540) may support the establishment of a wireless communication channel between an electronic device (101) and an external electronic device, such as a display device (501), based on a predetermined wireless communication protocol, and the performance of communication through the established communication channel. The communication circuit (540) may include one or more communication processors that operate independently of the processor (510) and support wireless communication. The communication circuit (540) may include a wireless communication module (e.g., a cellular communication module, a short-range wireless communication module, or a GNSS (global navigation satellite system) communication module) and / or a wired communication module (e.g., a LAN (local area network) communication module, or a power line communication module). The corresponding communication module among these communication modules can communicate with the display device (501) via a network (e.g., a short-range communication network such as Bluetooth, WiFi direct or IrDA (infrared data association), or a long-range communication network such as a cellular network, the Internet, or a computer network (e.g., LAN or WAN). These various types of communication modules may be integrated into a single component (e.g., a single chip) or implemented as multiple separate components (e.g., multiple chips).
[0112] The interface (550) can be used to connect the electronic device (101) to an external electronic device, such as a display device (501), based on a predetermined interface protocol. The interface (550) may support one or more specified interface protocols. The interface (550) may include, for example, a high definition multimedia interface (HDMI), a universal serial bus (USB) interface, an SD card interface, or an audio interface.
[0113] FIG. 6 is a control flow diagram for outputting a screen based on the properties of a display in an electronic device (e.g., the electronic device (101) of FIG. 5) according to one embodiment. FIG. 7 is a diagram for exemplarily illustrating an execution screen of a specific application (hereinafter referred to as 'target application') output by the electronic device (101) according to the control flow diagram of FIG. 6.
[0114] The operation of the electronic device (101) according to FIG. 6 is described by assuming that the execution screen of the target application (e.g., the first execution screen (713), the second execution screen (723), 735, 743, 753) of FIG. 7) is displayed in the first display area (711) or the second display area (731 or 751) on each of the two displays (e.g., the first display (531) or the second display (533) of FIG. 5), but the number of displays is not specified as two, and one or multiple displays must all be included in one electronic device.
[0115] For example, in an electronic device (e.g., the electronic device (101) of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g) (hereinafter referred to as 'electronic device (101)') to which an expandable display (e.g., a flexible display (203) or cover display (204) according to a multi-foldable structure of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g) is applied, a display in an unexpanded state (e.g., the folded state of FIGS. 2b, 2c, 3b, 3c, 4b, or FIGS. 4c) (e.g., the cover display (204) of FIGS. 2b, 2c, 3b, 3c, 4b, or FIGS. 4c) is used as a first display area, and an expanded state (e.g., FIGS. 2d, 2e, 3d, FIGS. 4c) is used as a first display area, and a cover display (204) of FIGS. 4c) is used as a first display area, and an expanded state (e.g., FIGS. 2d, 2e, 3d, FIGS. 4c) A display (e.g., a flexible display (203) of FIG. 2D, FIG. 2E, FIG. 3D, FIG. 3E, FIG. 4D, or FIG. 4E) of FIG. 3e, FIG. 4D, or FIG. 4E in a half-folded state) may be used as a second display area. To this end, the electronic device (101) may include a display assembly of a form factor capable of expanding the size of the display, such as a foldable structure, a multi-foldable structure, a sliderable structure, or a flip structure.
[0116] For example, the electronic device (101) may use the display area of one internal display (e.g., display (530) of FIG. 5) as the first display area and the display area of another electrically connected device (e.g., display device (501) of FIG. 5) as the second display area. For example, the electronic device (101) may use the display area of each display provided in two electrically connected devices (e.g., display device (501) of FIG. 5) as the first display area or the second display area. For example, the electronic device (101) may use a portion of the entire display area of one display (e.g., display (530) of FIG. 5) as the first display area and the remaining display area as the second display area.
[0117] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.
[0118] Referring to FIG. 6, the electronic device (101) can, in operation 610, allow a screen (e.g., the first execution screen (713) of FIG. 7) (hereinafter referred to as 'first execution screen (713)') according to the execution or use of a target application to be displayed in a first display area (e.g., the first display area (711) of FIG. 7) (hereinafter referred to as 'first display area (711)'). The first display area (711) may be assigned to a first display (e.g., the first display (531) of FIG. 5). For example, the electronic device (101) may display the first execution screen (713) in the first display area (711) based on first attribute information. The first attribute information may be information regarding the characteristics of the first display (531) to be referenced to output a screen in the first display area (711). For example, the first attribute information may be information regarding the attributes (e.g., screen size, screen orientation, screen density, or minimum screen size) of the first display area (711) for displaying the execution screen (713) of the target application by the electronic device (101). The first attribute information may be determined by considering the characteristics (e.g., screen size, number of pixels, pixel size, or resolution) of the first display (531). Accordingly, the attribute information may differ depending on the display. The target application may be an application that a user can use for a specific purpose, such as, for example, games, schedule management, movie ticket booking, financial transactions, shopping, multimedia content usage, or social networking services (SNS).
[0119] The first execution screen (713) may not include a home screen containing identifiers such as multiple icons or folders on an electronic device such as a smartphone or tablet PC. The electronic device (101) may provide an initial execution screen in response to the execution of a target application. The electronic device (101) may provide an execution screen (713) based on the user's use of the target application after the target application has been executed (e.g., see the first operation state (710) of FIG. 7). For example, the execution screen (713) may be a screen that displays search results corresponding to a search term entered by the user in the execution screen of an application providing a portal service. For example, the execution screen (713) may be a screen that displays shopping target products corresponding to a search term entered by the user in the execution screen of an application providing a shopping service. For example, the execution screen (713) may be a screen where the user is using a game by executing a game application. For example, the electronic device (101) may display a first execution screen (713) in a first display area (711) corresponding to the entire display area of the first display (531). For example, the electronic device (101) may display a first execution screen (713) in a first display area (711) corresponding to a part of the display area of the first display (531). For example, the first display (531) may be exposed to the outside in a folded state in which a display assembly of a foldable structure or a multi-foldable structure is folded. The first display (531) including the first display area (711) may be, for example, the cover display (204) of FIGS. 2a to 4g. In this case, the first display (531) may provide visual information to the user when the electronic device (101) is folded, or receive information from the user by an input method such as touch.
[0120] According to one example, an electronic device (101) may acquire first attribute information of a first display (531) and, based on the acquired first attribute information, generate a first execution screen (713) according to the execution or use of a target application. The electronic device (101) may output the generated first execution screen (713) through a first display area (711) of the first display (531). Here, the first attribute information may include information regarding items to be used to render the execution screen (713) to be displayed by the electronic device (101) on the first display area (711) of the first display (531). The first attribute information may be pre-set for the first display (531). For example, the first attribute information may include information regarding at least one of screen size, screen orientation, screen density, or smallest screen size. For example, screen size may be information regarding the size of the screen to be displayed on the display. For example, screen orientation may be information regarding the display direction (e.g., horizontal or vertical) of the screen to be displayed on the display. For example, screen density may be information regarding the length (or height) of the pixels constituting the screen to be displayed on the display. For example, minimum screen size may be information regarding the minimum size of the screen that can be displayed on the display. In addition, attribute information may include pixel density, which indicates the number of pixels that fit in one inch of the screen to be displayed on the display. In the electronic device (101), the first attribute information may be pre-set based on characteristics such as the resolution or size supported by the display to output the screen.For example, the first attribute information may differ depending on the display (e.g., the first display (531) or the second display (533) of FIG. 5) on which the electronic device (101) can output an execution screen according to the execution and / or use of the application. Accordingly, the attribute information may change due to the switching of the display.
[0121] The electronic device (101) can identify whether a screen switching request occurs in a first operation state (710) in which, in operation 620, a first execution screen (713) is displayed in a first display area (711) of a first display (531). For example, a screen switching request may occur by switching the display to be used for a specific application. For example, a screen switching request may occur by expanding the display area allocated for a specific application. For example, a screen switching request may occur by expanding the display area of the display for a specific application. For example, a screen switching request may occur by the operation state of the electronic device (101) switching from a folding state to a half-folding state. For example, a screen switching request may occur by the operation state of the electronic device (101) switching from a folding state to an unfolding state. For example, an electronic device (101) having a foldable or multi-foldable type form factor can recognize that a screen transition request has occurred when the angle of at least one hinge connecting two housings (e.g., the first hinge structure (240) or the second hinge structure (250) of FIGS. 2a to 4g) changes from 0 degrees to a critical angle (e.g., 180 degrees) (when screen reconstruction of FIG. 7 is required (see 701 or 705)).
[0122] The electronic device (101) may determine whether it is necessary to perform a procedure to ensure continuity of use of the target application when a screen transition request occurs in operation 620. For example, if the current state of use of the target application cannot be maintained due to a screen transition, the electronic device (101) may determine that it is necessary to perform a procedure to ensure continuity of use of the target application. For example, if the current state of use of the target application may be lost due to a screen transition, the electronic device (101) may determine that it is necessary to perform a procedure to ensure continuity of use of the target application. For example, if the execution screen of the target application must be reconstructed based on the attributes of the display changed due to a screen transition, the electronic device (101) may determine that it is necessary to perform a procedure to ensure continuity of use of the target application. For example, if the target application must be re-executed due to a screen transition, the electronic device (101) may determine that it is necessary to perform a procedure to ensure continuity of use of the target application. For example, when the target application is configured to directly handle the attributes of the changed display, the electronic device (101) may determine that it is necessary to perform a procedure to ensure continuity of use of the target application.
[0123] According to one example, when an electronic device (101) detects a screen switching request, it may determine one of the first attribute information of the first display (531) or the second attribute information of the second display (533) as attribute information to be applied to the second display (533) where the screen switching is to take place. For example, if there is no application running at the time the screen switching request is detected, the electronic device (101) may determine the second attribute information as attribute information to be applied after the screen switching. For example, if a home screen is displayed on the first display (531) at the time the screen switching request is detected, the electronic device (101) may determine the second attribute information as attribute information to be applied after the screen switching. For example, if there is an application running at the time the screen switching request is detected, the electronic device (101) may determine whether it is necessary to perform a procedure to ensure continuity of use of the target application.
[0124] For example, the electronic device (101) can identify whether the target application is an application that cannot maintain its current state of use or may lose its current state due to screen switching. For example, the electronic device (101) can check whether the application is configured to reconfigure the screen to match the changed attributes when the attributes of the display change due to screen switching. For example, during initial development, items regarding the attribute information of the display that the application will directly process may be registered in the manifest. Items of attribute information that may be registered in the application's manifest for direct processing may include at least one of screen size, screen orientation, screen density, or minimum screen size. If the items registered in the target application's manifest change due to screen switching, the electronic device (101) can identify that the target application is an application that cannot maintain its current state of use or may lose its current state due to screen switching. If the target application is configured to reconfigure the screen when the attributes of the display change, the electronic device (101) can re-execute the target application to reconfigure the screen. In this case, the electronic device (101) cannot provide continuous use of data resulting from the use of the target application prior to the screen transition. To prevent this, if the electronic device (101) determines that the current state of use of the target application cannot be maintained due to the screen transition, it may decide to use the first attribute information that was used prior to the screen transition even after the screen transition. If the electronic device (101) determines that the current state of use of the target application can be maintained due to the screen transition, it may decide to use the second attribute information, which is the attribute information of the transitioned display, after the screen transition.
[0125] According to one example, if it is determined that a procedure to ensure continuity of use of the target application is necessary, the electronic device (101) may determine the first attribute information as attribute information to be applied after the screen transition. The first attribute information corresponds to the attribute information of the first display (531) that was applied to display the first execution screen (713) in the first display area (711) prior to the screen transition, rather than the attribute information of the second display (533) which is the display changed by the screen transition. For example, if it is determined that screen reconfiguration for the use of the target application is necessary in response to the screen transition, the electronic device (101) may determine the first attribute information as attribute information to be used after the screen transition. In this case, the electronic device (101) may allocate a compatible display area (721) based on the first attribute information to ensure continuity of use of the target application. For example, the electronic device (101) may allocate a compatible display area (721) in the second display area (or second display (533)) in response to screen switching. The second display area may be, for example, the entire display area of the flexible display (203) of FIGS. 2a to 4g. The compatible display area (721) may be, for example, a partial display area included in the entire display area of the flexible display (203).
[0126] When the electronic device (101) determines the first attribute information as the applied attribute information, in operation 630, a second execution screen (723) corresponding to the use of the target application based on the first attribute information can be displayed in the compatible display area (721). For example, when screen reconfiguration is required to maintain the use of the target application, the electronic device (101) can assign a compatible display area (721) having the same attributes as the first display area (711) in the second display area (731) (or the second display (533)). The electronic device (101) can display the second execution screen (723) corresponding to the use of the target application in the compatible display area (721). The second execution screen (723) may be a second output screen synchronized with the first execution screen (713), which is the first output screen that was displayed in the first display area (711) (see the second operation state (720) of FIG. 7).
[0127] For example, if a change in the state of the target application is not predicted even after the screen transition, the electronic device (101) may determine the second attribute information of the second display (533), which is the display changed by the screen transition, as the attribute information to be applied after the screen transition. The electronic device (101) may determine, for example, that a change in the state of the target application is not predicted even after the screen transition if the target application can maintain its current usage state due to the screen transition or can maintain its current state.
[0128] According to one example, if the electronic device (101) determines that the second attribute information is the attribute information applied after the screen transition, in operation 640, a third output screen (e.g., the fourth execution screen (743) or the fifth execution screen (753) of FIG. 7) based on the second attribute information and the use of the target application can be displayed in the corresponding display area (e.g., the fourth display area (741) or the fifth display area (751) of FIG. 7).
[0129] For example, the electronic device (101) may provide second attribute information to the application layer. The application layer may allocate a default display area (e.g., a fourth display area (741)) in the flexible display area (203) based on the second attribute information, and display a screen (743) in which the target application is executed in the allocated default display area (741) (e.g., see the fourth operation state (740) of FIG. 7). In the application layer, when the operation state transitions from a half-folding state (fourth operation state (740)) to an unfolding state (fifth operation state (750)), the screen (753) in which the target application is executed in the full display area (e.g., a fifth display area (751)) corresponding to the flexible display area (203) based on the second attribute information (e.g., see the fifth operation state (750) of FIG. 7).
[0130] According to one example, an electronic device (101) having a multi-foldable type form factor can recognize the occurrence of a screen transition request resulting from a transition from a second operating state (720) (e.g., half-folding state) to a third operating state (730) (e.g., unfolding state) (see 705 in FIG. 7). In this case, the second display area (731), which is the entire display area of the electronic device (101) (e.g., the entire display area of a flexible display (203)), may include a compatible display area (721) that displays the second execution screen (723) and a third display area (733), which is an additionally expanded display area. The electronic device (101) may assign the third display area (733), which is the remaining display area excluding the compatible display area (721) from the second display area (731), as the default display area to output the screen based on second attribute information regarding the second display area (731). For example, the electronic device (101) can use the second attribute information to display the execution screen of another application running in addition to the target application in the third display area (733), which is the default display area. For example, the electronic device (101) can use the second attribute information to display the home screen (735) in the third display area (733), which is the default display area.
[0131] FIG. 8a or FIG. 8b is a drawing for illustrating the allocation of a display area according to an operating state in an electronic device (e.g., the electronic device (101) of FIG. 5) according to one embodiment.
[0132] The operating state illustrated in FIG. 8a or FIG. 8b is assumed to be an electronic device (101) having a multi-foldable type form factor, but a similar operating state may be applied to an electronic device having an expandable display form factor, such as an electronic device having a foldable type form factor. For example, the operating state of the multi-foldable type electronic device (101) can be distinguished as a folding state, a half-folding state, or an unfolding state. For example, the operating state of the foldable type electronic device (101) can be distinguished as a folding state or an unfolding state. An example in which the electronic device (101) illustrated in FIG. 8a or FIG. 8b allocates a display area according to the operating state will be described under the premise of using an application that may lose its current state due to screen switching.
[0133] Referring to FIG. 8a or FIG. 8b, the electronic device (101) can output a screen (Screen #1) (810) to a display exposed to the outside (e.g., the cover display (204) of FIG. 2a to 4g) in a fully folded state (see a). For example, when an application is executed in the folded state, the electronic device (101) can display an initial execution screen of the application on the cover display (204) based on first attribute information. The electronic device (101) can display a first execution screen (810) on the cover display (204) based on the use of the application executed based on the first attribute information. The first attribute information may be information regarding the characteristics of the cover display (204) to be referenced in order to output a screen to the cover display (204). For example, the first attribute information may be information regarding the attributes (e.g., screen size, screen orientation, screen density, or minimum screen size) of the cover display (204) for the electronic device (101) to display the execution screen (810) of an application. The first attribute information may be determined by considering the characteristics (e.g., screen size, number of pixels, pixel size, or resolution) of the cover display (204).
[0134] When the operating state of the electronic device (101) is switched from a folding state to a half-folding state (801), it may assign a portion of the display area (e.g., the first display area (A1) of FIGS. 2a to 4g) on the flexible display (e.g., the flexible display (203) of FIGS. 2a to 4g) as a compatible display area (820) (see b). The electronic device (101) may perform synchronization to match the attributes of the compatible display area (820) with the attributes used to display the first execution screen (810) on the cover display (204) prior to the screen transition. For example, the electronic device (101) may assign the compatible display area (820) such that the screen size, screen orientation, screen density, or minimum screen size of the first execution screen (810) displayed on the cover display (204) remains the same. For example, the electronic device (101) may assign a compatible display area (820) to a first display area (A1) that is exposed to the outside in a half-folded state among the display areas of the flexible display (203). The electronic device (101) may assign a second display area (A2), a third display area (A3), and a second folding area (A5) that are not exposed to the outside in a half-folded state among the display areas of the flexible display (203) as default display areas (830). A first folding area (A4) that is exposed to the outside in a half-folded state among the display areas of the flexible display (203) but is not substantially assigned to a compatible display area (820) may be assigned to a default display area (830).
[0135] According to one example, the electronic device (101) can detect the occurrence of a screen switching request by the operation state transitioning from a folding state to a half-folding state (801). The electronic device (101) can determine whether the screen switching request occurred while the execution screen (810) of a specific application was being displayed on the cover display (204). When the electronic device (101) detects the screen switching request while the execution screen of a specific application is being displayed on the cover display (204), it can determine the attributes of the specific application in advance and allocate a compatible display area (820). For example, the electronic device (101) can identify whether the application is one whose current usage state can be reset due to the screen switching based on the attributes of the specific application. The reset of the current usage state in the electronic device (101) may occur by reconfiguring the execution screen or by re-executing the specific application. For example, the electronic device (101) can determine whether continuity of use for a specific application is guaranteed by whether the specific application can directly process attribute information of the display changed by screen switching. For example, if the attribute of a specific application indicates that it cannot directly process attribute information of the display changed at the application level, the electronic device (101) can determine that continuity of use for the specific application cannot be guaranteed. In this case, the electronic device (101) can allocate a compatible display area (820). For example, the electronic device (101) can allocate a compatible display area based on attribute information that was considered to display the execution screen (810) on the cover display (204) used prior to screen switching. For example, if the attribute of a specific application indicates that it can directly process attribute information of the display changed at the application level, the electronic device (101) can determine that continuity of use for the specific application can be guaranteed.In this case, the electronic device (101) can run a specific application directly on the first display area (A1) without allocating a compatible display area (820).
[0136] The electronic device (101) can generate a second execution screen that ensures continuity in the use of a specific application based on the first attribute information. The electronic device (101) outputs (803) the generated second execution screen to a compatible display area (820), thereby causing the second execution screen (Screen #2) (840) to be displayed in the compatible display area (820) (see c). A display portion corresponding to a default area (830) that is not exposed externally in a half-folding state (e.g., the second display area (A2), the third display area (A3), and the second folding area (A5) of FIGS. 2a to 4g) may exist in a deactivated state.
[0137] According to one example, the electronic device (101) can detect the occurrence of a screen switching request by switching the operating state from a half-folding state to an unfolding state (805). In response to the screen switching request, the electronic device (101) can activate a newly expanded default display area (830) to display a home screen or a third execution screen (Screen #3) (850) of another application based on the second attribute information of the flexible display (203) (see d). At this time, the electronic device (101) can output a first execution screen (Screen #2) (840) based on the use of an existing application through a compatible display area (820) based on the first attribute information.
[0138] FIG. 9 is a diagram illustrating a data structure for screen output in an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 5).
[0139] Referring to FIG. 9, a data structure for managing displays may include a root container (910) or one or more displays (920). The root container (910) may distribute resources operated by the electronic device (101) by display and / or by process. For example, a data structure for managing displays may include a display content (921), a default display area (DefaultTaskDisplayArea) (923), or one or more tasks (Task #1 (925), Task #2 (927)) by display (920) in a first operating state (S1). For example, a data structure for managing a display may include a display content (921), a default display area (DefaultTaskDisplayArea) (923), a compatible display area (CompatTaskDisplayArea) (929), or one or more tasks (Task#1 (925), Task#2 (927)) for each display (920) in a second operation state (S2) or a third operation state (S3).
[0140] Display content (921) can manage resources for content to be displayed on the corresponding display (920). Each display (920) may have a default display area (DefaultTaskDisplayArea) (923) by default. One or more tasks (Task #1 (925), Task #2 (927)) may be displayed within the default display area (DefaultTaskDisplayArea) (923). Each of the one or more tasks (Task #1 (925), Task #2 (927)) may define one application.
[0141] According to one example, when the first operation state (S1) is in a folding state, the display content (921) may assign a default display area (DefaultTaskDisplayArea) (923) to the first display (531) based on the first attribute information of the first display (e.g., the first display (531) of FIG. 5). In the default display area (DefaultTaskDisplayArea) (923) assigned to the first display (531), a screen corresponding to the execution of one or more tasks (Task #1 (925), Task #2 (927)) may be displayed.
[0142] For example, the default display area (DefaultTaskDisplayArea) (923) is a data structure that is directly affected by changes in the display state. For example, when a screen transition occurs in the electronic device (101), the default display area (DefaultTaskDisplayArea) (923) may be reconfigured to allow for the execution of one or more tasks (Task #1 (925), Task #2 (927)) according to the changed attribute information. For example, when a screen transition occurs from the first display (531) to the second display (e.g., the second display (533) of FIG. 5), the attribute information may be changed from the first attribute information of the first display (531) to the second attribute information of the second display (533). At this time, the attributes of one or more tasks (Task #1 (925), Task #2 (927)) included in the default display area (DefaultTaskDisplayArea) (923) may also be changed by being affected by the attribute information changed for the default display area (DefaultTaskDisplayArea) (923). During this process, a situation may occur where the application corresponding to one or more tasks (Task #1 (925), Task #2 (927)) is re-executed or its usability cannot be maintained.
[0143] For example, the data structure for the screen splitting function referred to as multi-window is based on a fundamental structure where the DefaultTaskDisplayArea included in the display exposed to the user is divided and occupied by applications corresponding to one or more tasks. In this case, a task can directly restrict its application from operating based on multi-window at the application level. This is because, when the size of the screen on which an application runs in multi-window changes, the application may be relaunched or fail to maintain its current state, making it impossible to guarantee continuous usability of the application.
[0144] In this disclosure, a method is provided to enable screen switching and / or screen splitting on a multi-display device while reflecting the characteristics of the application described above, and to provide, from the perspective of the application, the same effect as running in full screen on a general bar-type electronic device rather than a multi-window. As an example, a CompatTaskDisplayArea (929) is proposed as a method to maintain continuity of application usage even during screen switching and / or screen splitting.
[0145] According to one example, when a change in the state of an application is identified by a screen switch (901), the electronic device (101) may provide a data structure of a CompatTaskDisplayArea (929) for placing the application so that continuity of use of the application can be maintained (see S2). For example, the electronic device (101) may search for a task located at the top relative to the display and, depending on whether the task exists, decide whether to switch immediately to the second display (533) or to check the attributes of the task before switching to the second display (533). If the attributes of the task indicate that the usage state may change due to a screen switch, the electronic device (101) may assign a CompatTaskDisplayArea (929) to the second display (533) based on the first attribute information in the first operating state (S1). For example, when a screen transition occurs from the first display (531) where an application corresponding to a specific task (Task #1 (925)) is running to the second display (533), the electronic device (101) can identify whether a change in the state of the application has occurred due to the screen transition. If it is identified that a change in the state of the application has occurred due to the screen transition, the electronic device (101) can create a compatible display area (CompatTaskDisplayArea) (929) having the same attribute information as the first attribute information of the default display area (DefaultTaskDisplayArea) (923) prior to the screen transition. Since the attribute information of the compatible display area (CompatTaskDisplayArea) (929) and the default display area (DefaultTaskDisplayArea) (923) prior to screen transition is identical, no state change may occur at the application level even if the task (Task#1) (925) corresponding to the application is placed in the compatible display area (CompatTaskDisplayArea) (929).That is, the usability of the application displayed on the first display (531) can be maintained on the second display (533) as well. The CompatTaskDisplayArea (929) may be a data structure that can have a layer equivalent to the DefaultTaskDisplayArea (923). The CompatTaskDisplayArea (929) is a data structure that can have tasks (925, 927) identical to the DefaultTaskDisplayArea (923).
[0146] According to one example, when a screen transition occurs from the first display (531) to the second display (533), the electronic device (101) can move (903) a task (Task #1) (925) corresponding to an application running in the default display area (DefaultTaskDisplayArea) (923) of the first display (531) to the compatible display area (CompatTaskDisplayArea) (929) (see S3). Since the compatible display area (CompatTaskDisplayArea) (929) has the same properties as the default display area (DefaultTaskDisplayArea) (923) prior to the screen transition, the application of the task (Task #1) (925) moved to the compatible display area (CompatTaskDisplayArea) (929) can maintain its existing usage state without changing its usage state. That is, the user can continue to use the application even after the screen transition.
[0147] For example, the electronic device (101) can synchronize the default display area (DefaultTaskDisplayArea) (923) before screen switching and the compatible display area (CompatTaskDisplayArea) (929) after screen switching so that attribute information including screen size, screen orientation, screen density, or smallest screen size is matched.
[0148] According to one example, after a screen transition, the default display area (DefaultTaskDisplayArea) (923) and the compatible display area (CompatTaskDisplayArea) (929) may be separated within the second display (533). Thus, even if the application currently in use is running in the compatible display area (CompatTaskDisplayArea) (929), a task (Task #2) (927) corresponding to a different application may be run in the default display area (DefaultTaskDisplayArea) (923). In this case, even for applications that do not support multi-window functionality, an effect similar to multi-window can be provided, as if two ordinary displays were virtually connected.
[0149] According to one example, a task (Task #1) (925) that is placed in and running in the CompatTaskDisplayArea (929) on the second display (533) can be continuously used in the DefaultTaskDisplayArea (923) of the first display (531) even if the screen is switched from the second display (533) to the first display (531), because the properties of the CompatTaskDisplayArea (929) are the same as the properties of the first display (531).
[0150] FIG. 10 is a control flow diagram for outputting a screen in an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 9). FIG. 11 is a diagram for explaining the allocation of a display area according to an operating state in an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 5).
[0151] The operation of the electronic device (101) according to FIG. 10 is described by assuming that the output screen of the target application is displayed in the first display area or the second display area on each of the two displays (e.g., the first display (531) or the second display (533) of FIG. 5), but the number of displays is not specified as two, and one or multiple displays must all be included in one electronic device.
[0152] For example, in an electronic device (e.g., the electronic device (101) of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g) (hereinafter referred to as 'electronic device (101)') to which an expandable display (e.g., a flexible display (203) or cover display (204) according to a multi-foldable structure of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g) is applied, a display in an unexpanded state (e.g., the folded state of FIGS. 2b, 2c, 3b, 3c, 4b, or FIGS. 4c) (e.g., the cover display (204) of FIGS. 2b, 2c, 3b, 3c, 4b, or FIGS. 4c) is used as a first display area, and an expanded state (e.g., FIGS. 2d, 2e, 3d, FIGS. 4c) is used as a first display area, and a cover display (204) of FIGS. 4c) is used as a first display area, and an expanded state (e.g., FIGS. 2d, 2e, 3d, FIGS. 4c) A display (e.g., a flexible display (203) of FIG. 2D, FIG. 2E, FIG. 3D, FIG. 3E, FIG. 4D, or FIG. 4E) of FIG. 3e, FIG. 4D, or FIG. 4E in a half-folded state) may be used as a second display area. To this end, the electronic device (101) may include a display assembly of a form factor capable of expanding the size of the display, such as a foldable structure, a multi-foldable structure, a sliderable structure, or a flip structure.
[0153] For example, the electronic device (101) may use the display area of one internal display (e.g., display (530) of FIG. 5) as the first display area and the display area of another electrically connected device (e.g., display device (501) of FIG. 5) as the second display area. For example, the electronic device (101) may use the display area of each display provided in two electrically connected devices (e.g., display device (501) of FIG. 5) as the first display area or the second display area. For example, the electronic device (101) may use a portion of the entire display area of one display (e.g., display (530) of FIG. 5) as the first display area and the remaining display area as the second display area.
[0154] Referring to FIG. 10 or FIG. 11, the electronic device (101) can display a second output screen (Screen #2) (1140) synchronized with a first output screen in operation 1010 on a predetermined display area (e.g., a compatible display area (1120) of FIG. 11) (unfolded state (a) or half-folded state (b) of FIG. 11) (hereinafter referred to as 'first state (a, b)'). The second output screen (Screen #2) (1140) synchronized with the first output screen can provide the user with the feeling that they are continuing to use the application they were using before the screen transition without interruption, even after the screen transition. For example, even if the screen transition occurs while the user is searching for items to purchase on the first output screen, the second output screen, which is identical to the first output screen that was displaying the search results, can be displayed on the switched display.
[0155] As an example, an electronic device (101) may display a second output screen (Screen #2) (1140) synchronized with the first output screen in a compatible display area (1120) in response to a request for screen switching from a first display (e.g., the cover display (204) of FIG. 2a, FIG. 3a, or FIG. 4a) to a second display (e.g., the flexible display (203) of FIG. 2da, FIG. 3a, or FIG. 4a) (hereinafter referred to as the 'first screen switching request'). The first output screen may be a screen that was displayed on the first display (204) by a predetermined application running or by use prior to the occurrence of the first screen switching request. The first output screen may be displayed on the first display (204) according to first attribute information. The first attribute information may be information regarding the attributes of the corresponding application for outputting the first output screen to the first display (204). The first attribute information can be pre-configured so that the execution screen resulting from the execution or use of the corresponding application is displayed on the first display (204) in a form according to the settings. The compatible display area (1120) can be assigned to the second display (203) to display the second output screen (Screen #2) (1140) based on the first attribute information. In this case, since the compatible display area (1120) has the same attributes as the display area where the first output screen was displayed, the second output screen (Screen #2) (1140) can provide continuity with the first output screen. This continuity can provide the user with the feeling of continuing to use the application without interruption, even when switching screens.
[0156] For example, a first screen transition request may occur when the operating state of the electronic device (101) transitions from a folding state to an unfolded state (a). In the unfolded state (a), both the compatible display area (1120) and the default display area (1130) included in the second display (203) may be in an active state. An active state may be a state in which it is possible to display a screen on the corresponding display area (e.g., the compatible display area (1120) and the default display area (1130)). For example, the default display area (1130) may display a home screen (Screen#3) (1150) provided by the electronic device (101). For example, the default display area (1130) may display an execution screen (Screen#3) (1150) of an application currently running by the electronic device (101). An application that displays an execution screen (Screen#3) (1150) in a default display area (1130) may be different from an application that displays a second output screen (Screen#2) (1140) in a compatible display area (1120).
[0157] For example, a first screen transition request may occur when the operating state of the electronic device (101) transitions from a folding state to a half-folding state (b). In the half-folding state (b), a compatible display area (1120) included in the second display (203) may be activated. In the half-folding state (b), a default display area (1130) included in the second display (203) may be in a deactivated state. An activated state may be a state in which it is possible to display a screen on the corresponding display area (e.g., compatible display area (1120)). A deactivated state may be a state in which it is impossible to display a screen on the corresponding display area (e.g., default display area (1130)).
[0158] The electronic device (101) can display the first output screen (Screen#1) (1110), which is synchronized with the second output screen (Screen#2) (1140), in a predetermined display area (e.g., the display area of the first display (204)) in response to a screen switching request (hereinafter referred to as the 'second screen switching request') in the first state (folding state (c) of FIG. 11) (hereinafter referred to as the 'second state (c)'). The second screen switching request may occur, for example, when the operating state of the electronic device (101) is switched from an unfolded state (a) to a folding state (c) (1101). The second screen switching request may occur, for example, when the operating state of the electronic device (101) is switched from a half-folded state (b) to a folding state (c) (1103). A first output screen (Screen#1) (1110) synchronized with a second output screen (Screen#2) (1140) can provide the user with the feeling that they are continuing to use the application they were using before the screen transition without interruption, even after the screen transition. For example, even if a screen transition occurs while the user is searching for items to purchase on the second output screen (Screen#2) (1140), the first output screen (Screen#1) (1110), which is identical to the second output screen (Screen#2) (1140) that was displaying the search results, can be displayed on the switched first display (204).
[0159] For example, the electronic device (101) may display a first output screen (Screen #1) (1110) synchronized with a second output screen (Screen #2) (1140) in the display area of the first display (204) in response to a second screen switching request. The second output screen may be a screen that was displayed on the second display (203) by a predetermined application running or by use prior to the occurrence of the second screen switching request. The second output screen may be displayed in a compatible display area (1120) assigned to the second display (203) according to first attribute information. The first attribute information may be information regarding the attributes of the corresponding application for outputting the second output screen to the compatible display area (1120). The first attribute information was applied to display the first output screen on the first display (204) prior to the screen switching made by the first screen switching request. Accordingly, since the display area of the first display (204) for displaying the first output screen (Screen#1) (1110) has the same properties as the compatible display area (1120) where the second output screen (Screen#2) (1140) was displayed, the first output screen (Screen#1) (1110) can provide continuity with the second output screen (Screen#2) (1140). This continuity can provide the user with the feeling of continuing to use the application without interruption, even when switching screens.
[0160] Although not explicitly illustrated in FIG. 11, the electronic device (101) may perform a screen transition from an unfolded state (a) to a half-folded state (b). In this case, the electronic device (101) may stop outputting the home screen or execution screen (Screen#3) (1150) that was displayed in the default display area (1130). Even when transitioning from the unfolded state (a) to the half-folded state (b), the electronic device (101) may continue to output the second output screen (Screen#2) (1140) that was displayed in the compatible display area (1120).
[0161] FIG. 12 is a diagram illustrating a data structure for screen output in an electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 5).
[0162] Referring to FIG. 12, a data structure for managing displays may include a root container (1210) or one or more displays (1220). The root container (1210) may distribute resources operated by the electronic device (101) by display and / or by process. For example, a data structure for managing displays may include display content (1221), a default display area (DefaultTaskDisplayArea) (1223), a compatible display area (CompatTaskDisplayArea) (1229), or one or more tasks (Task#1 (1225), Task#2 (1227)) by display (1220) in a third operation state (S3). For example, a data structure for managing a display may include display content (1221), a default display area (1223), or one or more tasks (Task#1 (1225), Task#2 (1227)) for each display (1220) in a first operation state (S1).
[0163] According to one example, when a screen transition occurs from the second display (533) to the first display (531), the electronic device (101) can move (1201) a task (Task #1) (1225) corresponding to an application running in the compatible display area (1229) of the second display (533) to the default display area (1223) (see S1). Since the compatible display area (1229) has the same properties as the default display area (1223) prior to the screen transition, the application of the task (Task #1) (1225) that has been moved from the compatible display area (1229) back to the default display area (1223) can maintain its existing usage state without any change in usage state. That is, the user can continue to use the application even after the screen transition.
[0164] FIG. 13 is a drawing for illustrating an example of displaying an application execution screen in response to a screen transition in a multi-foldable electronic device (e.g., the electronic device (101) of FIG. 1) according to one embodiment.
[0165] Referring to FIG. 13, the electronic device (101) can output a first output screen (e.g., the first execution screen (Screen #1 (810)) of FIG. 8a) to a first display (e.g., the cover display (204) of FIG. 8a) in a folded state (e.g., the folded state (a) of FIG. 8a) (see 1310). The first output screen may be, for example, an execution screen displayed on the first display by the execution of a target application in the folded state of the electronic device (101). The first output screen may be, for example, an execution screen displayed on the first display by the use of a target application in the folded state of the electronic device (101).
[0166] As an example, in response to the occurrence of a first screen transition event (1301), the electronic device (101) may output a second output screen (e.g., the second execution screen (Screen #2 (840)) of FIG. 8b) to a compatible display area (e.g., the compatible display area (820) of FIG. 8a or FIG. 8b)) assigned to a second display (e.g., the half-folding state (b, c) of FIG. 8a or FIG. 8b) in a half-folding state (see 1320). The first screen transition event may occur, for example, by the operating state of the electronic device (101) transitioning from a folding state to a half-folding state. Since the requirements for the electronic device (101) to assign a compatible display area and / or the action of assigning a compatible display area have been sufficiently described prior to this, a detailed description thereof will be omitted. The second output screen is the first output depending on the continuous use of the target application Continuity with the screen can be guaranteed. Here, continuity can provide the user with the feeling of continuing to use the target application without interruption, even when switching to the first screen.
[0167] For example, in response to the occurrence (1303) of a second screen transition event, the electronic device (101) may output a third output screen (e.g., the second execution screen (Screen #2 (840) of FIG. 8d)) to a compatible display area (e.g., the compatible display area (820) of FIG. 8d) assigned to the second display in an unfolded state (e.g., the unfolded state (d) of FIG. 8b), and may output a fourth output screen (e.g., the third execution screen (Screen #3 (850) of FIG. 8d)) to the remaining display area (e.g., the default display area (830) of FIG. 8d). The fourth output screen may be a home screen or a screen where another application is running. The second screen transition event may occur, for example, by the operating state of the electronic device (101) transitioning from a half-folded state to an unfolded state. The electronic device (101) may output a fourth output screen to the default display area in the unfolded state. As the output operation has been explained previously, a detailed explanation thereof will be omitted. The third output screen can ensure continuity with the second output screen based on the continuous use of the target application. Here, continuity can provide the user with the sensation of continuing to use the target application without interruption, even when switching to the second screen.
[0168] For example, in response to the occurrence of a third screen transition event (1305), the electronic device (101) may output a fifth output screen (e.g., a second execution screen (Screen #2 (1140)) displayed in the half-folding state (b) of FIG. 11) to a compatible display area assigned to the second display in a half-folding state (see 1320). In response to the occurrence of a third screen transition event (1305), the electronic device (101) may stop outputting the fourth output screen that was displayed in the default display area. The third screen transition event may occur, for example, by the operating state of the electronic device (101) transitioning from an unfolded state to a half-folding state. The fifth output screen may ensure continuity with the third output screen according to the continuous use of the target application. Here, continuity may provide the user with the feeling of continuing to use the target application without interruption even during the third screen transition.
[0169] For example, in response to the occurrence of a fourth screen transition event (1307), the electronic device (101) may output a sixth output screen (e.g., a first execution screen (Screen #1 (1110)) displayed in the folding state (c) of FIG. 11) to the first display in a folding state (see 1310). The fourth screen transition event may occur, for example, by the operating state of the electronic device (101) transitioning from a half-folding state to a folding state. The sixth output screen may ensure continuity with the fifth output screen according to the continuous use of the target application. Here, continuity may provide the user with the feeling of continuing to use the target application without interruption even during the fourth screen transition.
[0170] FIG. 14 is a control flow diagram for outputting an application execution screen in a foldable type electronic device (e.g., FIG. 2a to 2g, FIG. 3a to 3g, or FIG. 4a to 4g electronic device (101)) according to one embodiment.
[0171] The operation of the electronic device (101) according to FIG. 14 is such that, in an expanded state (e.g., the flexible display (203) or cover display (204) of FIG. 2a to 2g, FIG. 3a to 3g, or FIG. 4a to 4g), a first display area (e.g., the cover display area (B) of FIG. 2b, FIG. 2c, FIG. 3b, FIG. 3c, FIG. 4b, or FIG. 4c) is activated when the expandable display (e.g., the folded state of FIG. 2b, FIG. 2c, FIG. 3b, FIG. 3c, FIG. 4b, or FIG. 4c) is not expanded (e.g., the folded state of FIG. 4c), and in an expanded state (e.g., the half-folded state of FIG. 2d, FIG. 2e, FIG. 3d, FIG. 4d, or FIG. 4e), a second display area (e.g., FIG. 2d, FIG. 2e, FIG. 3d, FIG. 3e, FIG. 4d, or FIG. 4d) is activated. The explanation will assume that the flexible display area (A) of 4e is activated, but this is merely an example.
[0172] In the following embodiments, each operation may be performed sequentially, but is not necessarily performed sequentially. For example, the order of each operation may be changed, and at least two operations may be performed in parallel.
[0173] Referring to FIG. 14, the electronic device (101) can determine, in operation 1411, whether the execution of a specific application is requested in a folding state. For example, the specific application may be executed by the user selecting an identifier (e.g., an icon or emoticon) displayed on the home screen of the electronic device (101). For example, the specific application may be executed by the electronic device (101) in response to a voice command from the user. If the execution of the specific application is not requested, the electronic device (101) may transition to a standby state or continue to monitor whether the specific application is executed.
[0174] When the execution of a specific application is requested, the electronic device (101) may, in operation 1413, acquire first attribute information and, based thereon, output a first screen to a first display area of a first display (e.g., the cover display (204) of FIGS. 2a to 2g, FIGS. 3a to 3g, or FIGS. 4a to 4g). The first attribute information may be used to display the execution screen of the specific application on the first display. For example, the first attribute information may include information regarding at least one of screen size, screen orientation, screen density, or minimum screen size. The first display may operate to output visual information by the electronic device (101) in a folded state. The first display may be provided in the electronic device (101), for example, and used in a folded state. The first display may be connected to the electronic device (101), for example, via a wired or wireless link based on a predetermined communication protocol. The first display area may be a display area allocated for the execution of a specific application on the first display. The first screen may be an initial execution screen displayed in the first display area in response to the execution of a specific application, or an execution screen displayed in the first display area according to subsequent user usage.
[0175] The electronic device (101) can determine whether a display switching event occurs in operation 1415. A display switching event may occur due to a screen switching request. A display switching event may occur due to a request to change the display to output the execution screen of a specific application from the first display to the second display. For example, a display switching event may occur when the electronic device (101) transitions from a folded state to a half-folded state, or from a folded state to an unfolded state. The electronic device (101) may, for example, generate a display switching event by sensing that a folded folder is unfolded beyond a predetermined angle.
[0176] The electronic device (101) can return to operation 1413 and display a first screen according to the execution of a specific application in the first display area if no display switching event occurs.
[0177] When a display switching event occurs, the electronic device (101) can determine in operation 1417 whether the first screen is being displayed in the first display area of the first display. For example, the electronic device (101) can check whether a specific application is being executed in the first display area.
[0178] The electronic device (101) can perform a display switching operation 1429 when the first screen is not being output to the first display. For example, the electronic device (101) can perform a display switching operation by deactivating the first display and activating the second display. For example, the electronic device (101) can generate a screen to be displayed on the switched display based on pre-set second attribute information, in which the attributes of the second display are reflected during the display switching operation. The electronic device (101) can output the screen generated based on the second attribute information to the switched display. The items of the second attribute information may be the same as the items of the first attribute information defined above.
[0179] If the electronic device (101) is in a state where the first screen is being output to the first display, in operation 1419, it can check the display attributes set corresponding to a specific application. The display attributes may be setting information regarding the specific application. The electronic device (101) can determine whether the application requires screen reconfiguration when the display is switched based on the setting information regarding the specific application. For example, the electronic device (101) can determine whether the application is an application whose usage state may not be maintained when the display is switched while the application is in use. To this end, the setting information may instruct the execution screen to be reconfigured based on the attribute information of the display to be switched when a screen switch occurs while the specific application is running. This may be to provide an execution screen optimized for the attribute information of the display.
[0180] The electronic device (101) can determine whether the creation of a compatible display area is necessary based on the configuration information of a specific application in operation 1421. For example, the electronic device (101) may determine that the creation of a compatible display area is necessary to maintain the usage state if the configuration information of a specific application instructs screen reconfiguration according to the screen transition when the screen transition occurs. For example, the electronic device (101) may determine that the creation of a compatible display area is not necessary if the configuration information of a specific application does not instruct screen reconfiguration according to the screen transition when the screen transition occurs.
[0181] If the electronic device (101) determines that the creation of a compatible display area is not necessary, it may perform a display switching in operation 1429. For example, the electronic device (101) may perform a display switching by deactivating the first display and activating the second display. For example, the electronic device (101) may generate a screen to be displayed on the switched display based on pre-set second attribute information, in which the attributes of the second display are reflected during the display switching. The electronic device (101) may output the screen generated based on the second attribute information to the switched display. The items of the second attribute information may be identical to the items of the first attribute information defined earlier.
[0182] When the electronic device (101) determines that the creation of a compatible display area is necessary, in operation 1423, it may allocate a compatible display area to be placed on the second display based on the attribute information of the first display. Since the compatible display area has the same attributes as the display area where the first screen was output, the second screen to be displayed in the compatible display area can provide continuity with the first screen. This continuity can provide the user with the feeling of continuing to use the application without interruption even when switching screens.
[0183] The electronic device (101) can generate a second screen synchronized with the first screen in operation 1425. For example, the electronic device (101) may consider first attribute information to generate the second screen. The first screen may be a screen provided to allow continued use of a specific application that was in use prior to the occurrence of a display switching event.
[0184] The electronic device (101) can output a second screen to a compatible display area assigned to the second display in operation 1427.
[0185] FIG. 15 is a diagram illustrating an operation in which a multi-foldable electronic device (e.g., the electronic device (101) of FIG. 5) according to one embodiment selectively outputs a screen in an unfolded state (e.g., the unfolded state (d) of FIG. 8b).
[0186] Referring to FIG. 15, when a first screen transition request (1501) occurs in a folding state (1510) (e.g., folding state (a) of FIG. 8a), the electronic device (101) can transition to a half-folding state (1520) (e.g., half-folding state (b) of FIG. 8a or half-folding state (b) of FIG. 8b). The electronic device (101) can, for example, output a first output screen of a specific application (e.g., first execution screen (810) of FIG. 8a) in the folding state (1510) through a first display (e.g., cover display (204) of FIG. 8a). For example, the electronic device (101) can recognize that a first screen transition request (1501) has occurred based on the angle at which the first housing that was folded is unfolded.
[0187] When the electronic device (101) transitions to a half-folding state (1520), it can check whether the screen is configured to be reconfigured when switching screens for a specific application. If the electronic device (101) is configured to be reconfigured when switching screens for a specific application, it can assign a compatible display area (e.g., the compatible display area (820) of FIG. 8a) to be placed on the first display (e.g., the flexible display (203) of FIG. 8a) based on the first attribute information applied to the first execution screen (810) by considering the attributes of the first display. Since the requirements for assigning the compatible display area and / or the operation of assigning the compatible display area have been sufficiently explained prior to this, a detailed explanation thereof will be omitted.
[0188] The electronic device (101) can output a second output screen (e.g., the second execution screen of FIG. 8b (Screen #2 (840)) to a compatible display area in a half-folded state (1520). The second output screen can ensure continuity with the first output screen according to the continuous use of the target application. Here, continuity can provide the user with the feeling of continuing to use the target application without interruption even when switching to the first screen.
[0189] The electronic device (101) can determine how to output a screen to the second display in an unfolded state (1530 or 1540) (e.g., unfolded state (d) of FIG. 8b) in response to whether the user presses the compatible display area (1503) while the second output screen is being output to the compatible display area.
[0190] For example, when the compatible display area transitions from a pressed state to an unfolded state (1530) (1505), the electronic device (101) can display a third execution screen (1531) in the compatible display area to maintain continuity with the second execution screen (1521). In addition, the electronic device (101) can display a home screen or an execution screen of another application in a default display area (1533) that has been extended for use.
[0191] For example, when the compatible display area is not pressed and transitions to the unfolded state (1540) (1507), the electronic device (101) may re-execute the application that was outputting the second execution screen (1521) in order to reconstruct the execution screen (1541) that reflects the second attribute information prepared for the application based on the attributes of the second display. The electronic device (101) may display the execution screen (1541) reconstructed by the re-execution of the application over the entire area of the second display.
[0192] In the operation described above, it was proposed that the continuity of the execution screen of the application in use be ensured when the screen transitions from the half-folded state to the unfolded state while the compatible display area is pressed, but this may be just one example. That is, the electronic device (101) may be implemented to ensure the continuity of the execution screen of the application in use when the screen transitions from the half-folded state to the unfolded state while the compatible display area is not pressed.
[0193] FIG. 16a or FIG. 16b is a diagram illustrating an operation in which a multi-foldable electronic device according to one embodiment (e.g., the electronic device (101) of FIG. 5) outputs a screen corresponding to a sequential state transition to an unfolded state (e.g., the unfolded state (d) of FIG. 8b), a half-folded state (e.g., the half-folded state (b or c) of FIG. 8a or FIG. 8b), or a folded state (e.g., the folded state (a) of FIG. 8a).
[0194] Referring to FIG. 16a or FIG. 16b, the electronic device (101) can output an execution screen (1611) of a target application to a display area (e.g., a second display area (209) of FIG. 2a to 2g, FIG. 3a to 3g, or FIG. 4a to 4g) of a flexible display (e.g., FIG. 2a to 2g, FIG. 3a to 3g, or FIG. 4a to 4g) in an unfolded state (1610) (e.g., unfolded state (d) of FIG. 8b).
[0195] The electronic device (101) may recognize the occurrence of a screen transition event (1601) requesting a transition of the operating state from the unfolded state (1610) to the half-folded state (1620) (e.g., the half-folded state (b or c) of FIG. 8a or FIG. 8b). When the electronic device (101) recognizes the occurrence of the screen transition event (1601), it may output an execution screen (1621) that maintains continuity with the execution screen (1611) that was output in the unfolded state (1610) to a specific display area. For example, the specific display area activated in the half-folded state may be a part of the display area of the flexible display. In order for the execution screen (1621) to be displayed in the specific display area to maintain continuity with the execution screen (1611) that was output in the unfolded state (1610), the electronic device (101) may use the same attribute information (e.g., aspect ratio) of the flexible display. For example, the electronic device (101) may output at least one identifier for user interaction (e.g., a replay button (1623) and / or a screen rotation button (1625)) to a specific display area.
[0196] For example, when the re-run button (1623) is operated by a user, the electronic device (101) may perform an action to re-run the corresponding application for screen reconstruction (1603). For example, the electronic device (101) may re-run the corresponding application in a specific display area that is activated in a half-folding state. In this case, the electronic device (101) may output a screen (1631) of the re-run application in the specific display area (state 1630).
[0197] The electronic device (101) can detect the occurrence of a screen switching event (1607) in state 1630. Here, the screen switching event (1607) may occur by requesting a transition of the operating state from a half-folding state (1630) to a folding state (1640) (e.g., the folding state (a) of FIG. 8a). When the electronic device (101) detects the occurrence of the screen switching event (1607), it can output an execution screen (1641) of the corresponding application to a display area (e.g., the first display area (208) of FIG. 2a to 2g, FIG. 3a to 3g, or FIG. 4a to 4g) of a cover display (e.g., the cover display (204) of FIG. 2a to 2g, FIG. 3a to 3g, or FIG. 4a to 4g). The electronic device (101) can output an execution screen (1641) of the corresponding application to the display area of the cover display by using attribute information (e.g., aspect ratio) of the flexible display to maintain continuity with the execution screen (1631) that was output in the half-folding state (1630), for example. The electronic device (101) can output a re-execution screen (1641) by re-executing the corresponding application to the display area of the cover display by using attribute information of the cover display, for example.
[0198] For example, when the screen rotation button (1625) is operated by the user, the electronic device (101) can perform an action to rotate the screen being displayed 90 degrees in a specific direction (e.g., counterclockwise or clockwise) (1605). For example, the electronic device (101) can display a screen (1651) that has been changed from a vertical mode to a horizontal mode in a specific display area that is activated in a half-folding state (state 1650).
[0199] The electronic device (101) can detect the occurrence of a screen transition event (1609) in state 1650. Here, the screen transition event (1609) may occur by requesting a transition of the operating state from the half-folding state (1650) to the folding state (1660) (e.g., the folding state (a) of FIG. 8a). When the electronic device (101) detects the occurrence of the screen transition event (1609), it can output an execution screen (1661) of the corresponding application to the display area of the cover display. The electronic device (101) can output an execution screen (1661) of the corresponding application to the display area of the cover display using attribute information of the flexible display (e.g., aspect ratio) to maintain continuity with the execution screen (1651) that was output in the half-folding state (1650), for example. The electronic device (101) can, for example, use attribute information of the cover display to re-run the corresponding application in the display area of the cover display and output a re-run screen (1661).
[0200] As an example, the electronic device (101) may include a memory (520) comprising one or more storage media for storing instructions. The electronic device (101) may include at least one processor (510) configured to include a processing circuit and to perform control for outputting a screen to at least one display among a plurality of displays. When the instructions are executed individually or collectively by the at least one processor (510), the electronic device (101) may be caused to perform at least one operation. The at least one operation may include an operation (610) that causes a first execution screen (713) of a specific application to be displayed in a first display area (711). The at least one operation may include an operation (620) that determines whether screen reconfiguration is required to maintain the use of the specific application in response to a first screen switching request from the first display area (711) to a second display area (731). The above at least one operation may include an operation (630) of allocating a compatible display area (721) having the same attributes as the first display area (711) in the second display area (731) when screen reconfiguration is required. The above at least one operation may include an operation (630) of displaying a second execution screen (723) according to the use of the specific application in the compatible display area (721). Here, the second execution screen (723) may maintain continuity with the first execution screen (713).
[0201] For example, when the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform an operation (640) of assigning a default display area ((741) having the attributes of the second display area (731) in the second display area (731) when the screen reconfiguration is not required (703).
[0202] As an example, when the above instructions are executed individually or collectively by at least one processor (120), an operation (640) may be performed to display a third execution screen (743) according to the use of the specific application in the default display area (741).
[0203] For example, when the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform the operation of assigning the compatible display area (721) to display the second execution screen (723) in the second display area (731) using the first attribute information applied to display the first execution screen (713) in the first display area (711).
[0204] For example, when the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform an operation of assigning the remaining display area, excluding the compatible display area (721) in the second display area (731), as a default display area (731) to output a screen (733) based on second attribute information regarding the second display area (731).
[0205] As an example, the above second attribute information may differ from the above first attribute information.
[0206] As an example, the first attribute information or the second attribute information may include information regarding at least one of screen size, screen orientation, screen density, or smallest screen size.
[0207] As an example, the electronic device (101) may include a first display (531) including the first display area (711) and a second display (533) including the second display area (731).
[0208] As an example, when the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform an operation of obtaining a display switching request from the first display (531) to the second display (533).
[0209] As an example, when the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform an operation to disable the first display (531) in response to the display switching request.
[0210] As an example, when the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform an operation to activate the second display (533) in response to the display switching request.
[0211] As an example, the electronic device (101) may include a cover display (204) and a flexible display (203).
[0212] For example, when the instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform the operation of displaying the first execution screen (713) in the first display area (208 or 711) assigned to the cover display (204) in the folded state of the flexible display (203) (Figs. 2a to 2c, Figs. 3a to 3c, or Figs. 4a to 4c).
[0213] For example, when the instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform the operation of displaying the second execution screen (723) in the compatible display area (721) assigned to the flexible display (203) in the half-folded state (Fig. 2d, Fig. 2e, Fig. 3d, Fig. 3e, Fig. 4d, or Fig. 4e) or unfolded state (Fig. 2f, Fig. 2g, Fig. 3f, Fig. 3g, Fig. 4f, or Fig. 4g) of the flexible display (203).
[0214] As an example, when the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform an operation to identify whether the specific application is in an execution state in response to the first screen switching request.
[0215] For example, when the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform an operation (1020) of identifying a request for a second screen transition from the second display area (731) to the first display area (711) in a state where the second execution screen (723) is displayed.
[0216] For example, when the above instructions are executed individually or collectively by at least one processor (120), the electronic device (101) may be caused to perform an operation (1020) that causes a fourth execution screen (713) according to the use of the specific application to be displayed in the first display area (711) based on the attributes of the first display area (711) in response to the identified second screen switching request.
[0217] For example, the operation method of an electronic device (101) may include an operation (610) of displaying a first execution screen (713) of a specific application in a first display area (711). The operation method may include an operation (620) of determining whether screen reconfiguration is required to maintain the use of the specific application in response to a request for a first screen transition from the first display area (711) to a second display area (731). The operation method may include an operation (630) of allocating a compatible display area (721) having the same attributes as the first display area (711) in the second display area (731) when screen reconfiguration is required (701). The operation method may include an operation (630) of displaying a second execution screen (723) according to the use of the specific application in the compatible display area (721). Here, the second execution screen (723) can maintain continuity with the first execution screen (713).
[0218] As an example, the above operation method may include an operation (640) of assigning a default display area (741) having the attributes of the second display area (731) in the second display area (731) when screen reconstruction is not required (703).
[0219] As an example, the above operation method may include an operation (640) that causes a third execution screen (743) according to the use of the specific application to be displayed in the default display area (741).
[0220] As an example, the operation (630) of allocating the compatible display area may include the operation of allocating the compatible display area (721) to display the second execution screen (723) in the second display area (731) using the first attribute information applied to display the first execution screen (713) in the first display area (711).
[0221] As an example, the above operation method may include an operation of assigning the remaining display area, excluding the compatible display area (721) in the second display area (731), as a default display area (731) to output a screen (733) based on second attribute information regarding the second display area (731).
[0222] As an example, the above second attribute information may differ from the above first attribute information.
[0223] As an example, the first attribute information or the second attribute information may include information regarding at least one of screen size, screen orientation, screen density, or smallest screen size.
[0224] As an example, the above operation method may include an operation to disable the first display (531) including the first display area (711) in response to the first screen switching request.
[0225] As an example, the above operation method may include an operation of activating a second display (533) including a second display area (731) in response to the first screen switching request.
[0226] As an example, the first screen switching request may be a display switching request from the first display (531) to the second display (533).
[0227] As an example, the operation (610) of displaying the first execution screen may include displaying the first execution screen (713) in the first display area (208 or 711) assigned to the cover display (204) in the folded state of the flexible display (203) (Figs. 2a to 2c, Figs. 3a to 3c, or Figs. 4a to 4c).
[0228] As an example, the operation (630) of displaying the second execution screen may include displaying the second execution screen (723) in the compatible display area (721) assigned to the flexible display (203) in the half-folded state (Fig. 2d, Fig. 2e, Fig. 3d, Fig. 3e, Fig. 4d, or Fig. 4e) or unfolded state (Fig. 2f, Fig. 2g, Fig. 3f, Fig. 3g, Fig. 4f, or Fig. 4g) of the flexible display (203).
[0229] As an example, the above operation method may include an operation to identify whether the specific application is in an execution state in response to the first screen switching request.
[0230] As an example, the above operation method may include an operation (1020) of identifying a request to switch from the second screen to the first display area (711) from the second display area (731) while the second execution screen (723) is being displayed.
[0231] As an example, the above operation method may include an operation (1020) that causes a fourth execution screen (713) according to the use of the specific application to be displayed in the first display area (711) based on the attributes of the first display area (711) in response to the identified second screen switching request.
[0232] As an example, a recording medium may store instructions that can be read by a computer. When executed by at least part of at least one processor (510) included in the electronic device (101), the instructions may cause the electronic device (101) to perform at least one operation. The at least one operation may include an operation (610) that causes a first execution screen (713) of a specific application to be displayed in a first display area (711). The at least one operation may include an operation (620) that determines whether screen reconfiguration is required to maintain the use of the specific application in response to a first screen switching request from the first display area (711) to a second display area (731). The at least one operation may include an operation (630) that, when screen reconfiguration is required (701), allocates a compatible display area (721) having the same attributes as the first display area (711) in the second display area (731). The above at least one operation may include an operation (630) that causes a second execution screen (723) according to the use of the specific application to be displayed in the compatible display area (721). Here, the second execution screen (723) may maintain continuity with the first execution screen (713).
[0233] The embodiments of this document and the terms used therein are not intended to limit the technical features described in this document to specific embodiments, and should be understood to include various modifications, equivalents, or substitutions of said embodiments. In connection with the description of the drawings, similar reference numerals may be used for similar or related components. The singular form of a noun corresponding to an item may include one or more of said items unless the relevant context clearly indicates otherwise. In this document, phrases such as "A or B," "at least one of A and B," "at least one of A or B," "A, B or C," "at least one of A, B and C," and "at least one of A, B, or C" may each include any one of the items listed together in the corresponding phrase, or all possible combinations thereof. Terms such as "first," "second," or "first" or "second" may be used simply to distinguish said components from other said components and do not limit said components in any other aspect (e.g., importance or order). Where any (e.g., 1st) component is referred to as “coupled” or “connected” to another (e.g., 2nd) component, with or without the terms “functionally” or “communicationly,” it means that said any component may be connected to said other component directly (e.g., via a wire), wirelessly, or through a third component.
[0234] As used in one embodiment of this document, the term “module” may include a unit implemented in hardware, software, or firmware, and may be used interchangeably with terms such as logic, logic block, component, or circuit, for example. A module may be a component formed integrally, or a minimum unit of said component or a part thereof that performs one or more functions. For example, according to one embodiment, a module may be implemented in the form of an application-specific integrated circuit (ASIC).
[0235] One embodiment of the present document may be implemented as software comprising one or more instructions stored in a storage medium (e.g., memory (520)) readable by a machine (e.g., electronic device (101)). For example, a processor (e.g., processor (510)) of the machine (e.g., electronic device (101)) may call at least one of the one or more instructions stored from the storage medium and execute it. This enables the machine to be operated to perform at least one function according to the at least one called instruction. The one or more instructions may include code generated by a compiler or code that can be executed by an interpreter. The storage medium readable by the machine may be provided in the form of a non-transitory storage medium. Here, 'non-temporary' simply means that the storage medium is a tangible device and does not contain a signal (e.g., electromagnetic waves), and the term does not distinguish between cases where data is stored semi-permanently and cases where it is stored temporarily.
[0236] According to one embodiment, the method according to one embodiment disclosed herein may be provided by being included in a computer program product. The computer program product may be traded between a seller and a buyer as a product. The computer program product may be distributed in the form of a device-readable storage medium (e.g., compact disc read-only memory (CD-ROM)), or distributed online (e.g., download or upload) through an application store (e.g., Play Store™) or directly between two user devices (e.g., smartphones). In the case of online distribution, at least a portion of the computer program product may be temporarily stored or temporarily created on a device-readable storage medium, such as the memory of a manufacturer's server, an application store's server, or a relay server.
[0237] According to one embodiment, each component (e.g., module or program) of the components described above may include a singular or multiple entities, and some of the multiple entities may be separated and placed in other components. According to one embodiment, one or more of the components or operations among the aforementioned components may be omitted, or one or more other components or operations may be added. Generally or additionally, multiple components (e.g., module or program) may be integrated into a single component. In this case, the integrated component may perform one or more functions of each of the multiple components in the same or similar manner as those performed by the corresponding component among the multiple components prior to integration. According to one embodiment, operations performed by the module, program, or other components may be executed sequentially, in parallel, iteratively, or heuristically, or one or more of the operations may be executed in a different order, omitted, or one or more other operations may be added.
Claims
1. In an electronic device (101), Memory (520) comprising one or more storage media for storing instructions; and It includes at least one processor (510) configured to include a processing circuit and to perform control for outputting a screen to at least one display among a plurality of displays, and When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (101) is caused to perform at least one operation, and The above at least one operation is, An action (610) of displaying a first execution screen (713) of a specific application in a first display area (711); An operation (620) to determine whether screen reconfiguration is required to maintain the use of the specific application in response to a request for a first screen transition from the first display area (711) to the second display area (731); When screen reconstruction is required, an operation (630) of allocating a compatible display area (721) having the same attributes as the first display area (711) in the second display area (731); and An operation (630) of displaying a second execution screen (723) according to the use of the above specific application—wherein the second execution screen (723) maintains continuity with the first execution screen (713)—in the compatible display area (721). An electronic device (101) including 2. In Paragraph 1, When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (101) is made to: When the above screen reconstruction is not required (703), an operation (640) of assigning a default display area (741) having the attributes of the second display area (731) in the second display area (731); and The operation (640) of displaying the third execution screen (743) according to the use of the above specific application in the default display area (741) An electronic device (101) that causes to perform.
3. In Paragraph 1 or 2, When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (101) is made to: The operation of assigning the compatible display area (721) to display the second execution screen (723) in the second display area (731) using the first attribute information applied to display the first execution screen (713) in the first display area (711); and An operation of assigning the remaining display area, excluding the compatible display area (721) from the second display area (731), as a default display area (731) to output a screen (733) based on second attribute information regarding the second display area (731). Cause it to perform, The above second attribute information is different from the above first attribute information, and The electronic device (101), wherein the first attribute information or the second attribute information comprises information regarding at least one of screen size, screen orientation, screen density, or smallest screen size.
4. In any one of paragraphs 1 through 3, A first display (531) including the first display area (711) above; and A second display (533) including the second display area (731) Includes, When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (101) is made to: An operation to obtain a request to switch the display from the first display (531) to the second display (533); An operation to disable the first display (531) in response to the above display switching request; and The operation of activating the second display (533) in response to the above display switching request An electronic device (101) that causes to perform.
5. In any one of paragraphs 1 through 3, Cover display (204); and Includes a flexible display (203), When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (101) is made to: An operation of displaying the first execution screen (713) in the first display area (208 or 711) assigned to the cover display (204) in the folded state of the flexible display (203) (Figs. 2a to 2c, Figs. 3a to 3c, or Figs. 4a to 4c); and An operation of displaying the second execution screen (723) in the compatible display area (721) assigned to the flexible display (203) in the half-folded state (Fig. 2d, Fig. 2e, Fig. 3d, Fig. 3e, Fig. 4d, or Fig. 4e) or unfolded state (Fig. 2f, Fig. 2g, Fig. 3f, Fig. 3g, Fig. 4f, or Fig. 4g) of the flexible display (203). An electronic device (101) that causes to perform.
6. In any one of paragraphs 1 through 5, When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (101) is made to: An operation to identify whether the specific application is in an execution state in response to the first screen switching request. An electronic device (101) that causes to perform.
7. In any one of paragraphs 1 through 6, When the above instructions are executed individually or collectively by at least one processor (510), the electronic device (101) is made to: An operation (1020) for identifying a request to switch to a second screen from the second display area (731) to the first display area (711) in the state where the second execution screen (723) is being displayed; and An operation (1020) to display a fourth execution screen (713) according to the use of the specific application in the first display area (711) based on the attributes of the first display area (711) in response to the identified second screen switching request. An electronic device (101) that causes to perform.
8. In the method of operating the electronic device (101), An action (610) of displaying a first execution screen (713) of a specific application in a first display area (711); An operation (620) to determine whether screen reconfiguration is required to maintain the use of the specific application in response to a request for a first screen transition from the first display area (711) to the second display area (731); When screen reconstruction is required (701), an operation (630) of allocating a compatible display area (721) having the same attributes as the first display area (711) in the second display area (731); and An operation (630) of displaying a second execution screen (723) according to the use of the above specific application—wherein the second execution screen (723) maintains continuity with the first execution screen (713)—in the compatible display area (721). A method of operation including 9. In Paragraph 8, When the above screen reconstruction is not required (703), an operation (640) of assigning a default display area (741) having the attributes of the second display area (731) in the second display area (731); and The operation (640) of displaying the third execution screen (743) according to the use of the above specific application in the default display area (741) A method of operation including 10. In Paragraph 8 or 9, The operation (630) of allocating the above compatible display area is, The operation of assigning the compatible display area (721) to display the second execution screen (723) in the second display area (731) using the first attribute information applied to display the first execution screen (713) in the first display area (711); and An operation of assigning the remaining display area, excluding the compatible display area (721) from the second display area (731), as a default display area (731) to output a screen (733) based on second attribute information regarding the second display area (731). Includes, The above second attribute information is different from the above first attribute information, and A method of operation in which the first attribute information or the second attribute information comprises information regarding at least one of screen size, screen orientation, screen density, or smallest screen size.
11. In any one of paragraphs 8 through 10, An operation to disable the first display (531) including the first display area (711) in response to the first screen switching request; and An operation to activate a second display (533) including a second display area (731) in response to the first screen switching request. Includes, The above first screen switching request is a display switching request from the first display (531) to the second display (533), a method of operation.
12. In any one of paragraphs 8 through 10, The operation (610) of displaying the first execution screen above is, An operation of displaying the first execution screen (713) in the first display area (208 or 711) assigned to the cover display (204) in the folded state of the flexible display (203) (Figs. 2a to 2c, Figs. 3a to 3c, or Figs. 4a to 4c). Includes, The operation (630) of displaying the second execution screen above is, An operation of displaying the second execution screen (723) in the compatible display area (721) assigned to the flexible display (203) in the half-folded state (Fig. 2d, Fig. 2e, Fig. 3d, Fig. 3e, Fig. 4d, or Fig. 4e) or unfolded state (Fig. 2f, Fig. 2g, Fig. 3f, Fig. 3g, Fig. 4f, or Fig. 4g) of the flexible display (203). A method of operation including 13. In any one of paragraphs 8 through 12, An operation to identify whether the specific application is in an execution state in response to the first screen switching request. A method of operation including 14. In any one of paragraphs 8 through 13, An operation (1020) for identifying a request to switch to a second screen from the second display area (731) to the first display area (711) while the second execution screen (723) is being displayed; and An operation (1020) of displaying a fourth execution screen (713) according to the use of the specific application in the first display area (711) based on the attributes of the first display area (711) in response to the identified second screen switching request. A method of operation including 15. In a recording medium storing computer-readable instructions, When the above instructions are executed by at least part of at least one processor (510) included in the electronic device (101), the electronic device (101) causes at least one operation to be performed, and The above at least one operation is: An action (610) of displaying a first execution screen (713) of a specific application in a first display area (711); An operation (620) to determine whether screen reconfiguration is required to maintain the use of the specific application in response to a request for a first screen transition from the first display area (711) to the second display area (731); When screen reconstruction is required (701), an operation (630) of allocating a compatible display area (721) having the same attributes as the first display area (711) in the second display area (731); and An operation (630) of displaying a second execution screen (723) according to the use of the above specific application—wherein the second execution screen (723) maintains continuity with the first execution screen (713)—in the compatible display area (721). A recording medium including